Messages de Rogue Scholar

language
LLMsAITech PredictionsAnglais
Publié in Chris von Csefalvay
Auteur Chris von Csefalvay

There’s an old parable about a drunk searching for his keys under a streetlamp. A passerby stops to help, and after some fruitless searching asks, “Are you sure you lost them here?” The drunk replies, “No, I lost them in the alley. But the light’s better here.” I think about this story a lot when I read AI predictions.

ScienceAnglais
Publié in Reciprocal Space
Auteur Stephen Curry

Green and gold of autumn My annual selection of favourites from the photographs I took in the past year is now available on Flickr. Do people still use Flickr? I have broken my usual rule of not including family photos because of the very exceptional and very happy occurrences of both of our daughters’ weddings this year. It would have felt wrong somehow to omit pictures that captured the sheer joy of these events.

AILLMsLLMOpsPost-trainingReinforcement LearningAnglais
Publié in Chris von Csefalvay
Auteur Chris von Csefalvay

TipHey, I’m writing a book about this! I’m actually writing a book about this stuff. It turns out there isn’t a lot of literature on how to do post-training at the level too big for single-GPU laptop-sized hobby projects and requiring enterprise reliability on one hand, but not quite at the scale of multi-team distributed post-training you’d get in foundation labs.