Python has a ton of solutions to parallelize loops on several CPUs, and the choice became even richer with python 3.13 this year. I had written a post 4 years ago on multiprocessing, but it comes short of presenting the available possibilities. Here is an attempt to bring all of them finally in a single place.

Transformers have completely taken by storm the field of sequence modelling with deep networks, becoming the standard for text processing, video, even images. RNNs that were once a very active engineering field have slowly faded into the void. All of them? No, some RNNs are bravely fighting back to claim state-of-the-art results in sequence tasks. The most suprising part? They are linear...

This post is an attempt at summarizing results obtained over five years of research in the laboratory of Srdjan Ostojic, at ENS Paris, on the uses of low-rank RNNs, in a ten-minutes read. Let's see if that's enough to catch your interest!

Between self-supervised approaches for transfer learning, contrastive losses and representational similarity analysis, these last few years were as rich in ideas as buzzing with confusing words. Here is a little dictionary to celebrate the end of 2021. If you have time for only one entry, check out the self-supervised learning one above all!

Did you know PCA and Pearson's correlation had a child together ? Let's meet this fascinating and multifaceted tool called CCA.

Linear regression, despite being the most basic model of the field of statistics, hides a lot of subtleties and elegant results.

As humans have been grappling with a pretty rough ride this year, how have machines been doing? Let’s find out in this small review! Welcome, Gigantic Prolific Transformer III Let’s start with one of the most remarkable and buzz-generating AI releases of the year, I have named the infamous GPT-3, latest language model of a series developed by OpenAI.

Having machines with many CPU cores is a great way to make all your computations run much faster, right?

As I come from the computer science community, I find that git is a very useful tool for handling projects, although it can be intimidating at first. This is my attempt at get you going on git in a few minutes. Of course, if you want to really master it, nothing beats the official tutorial, but it is maybe too much for a basic usage.