The Annotated Kolmogorov-Arnold Network (Kan)

What Does Any of This Have to Do with Physics?

What I'm thinking about these days

How to cheat at settlers by loading the dice (2017)

Neural Vector Embeddings

Harnessing the Universal Geometry of Embeddings

Text Embeddings are All Alike

Why We Think

A Meticulous Guide to Advances in Deep Learning Efficiency over the Years (2024)

Deep Laziness

Embeddings are underrated (2024)

What Physics Can Teach Us About AI (OpenAI's Dan Roberts)

Deep Learning for Natural Language Processing (Without Magic) (2013)

Robotics Predictions for 2025

Giant Inscrutable Matrices: Not Worse Than Anything Else

AI crawler wars threaten to make the web more closed for everyone

Why GRPO Is Important and How It Works

The Speed of VITs and CNNs

Good Research Takes Are Not Sufficient for Good Strategic Takes

Thank you for holding my duck (2021)

The Maintenance Race

Product Quantization: Compressing high-dimensional vectors by 97%

Notes on "An Observation on Generalization"

Surprises in Logic (2016)

Agency Is Eating the World

Is a PhD on Language Models Worth It in 2025?

Embzip

Healthy Obsession

To Make Language Models Work Better, Researchers Sidestep Language

Modifying Custom Matmul CUDA Kernels

Reading the Llama Code

What It Feels Like to Get Stronger

How I Don't Use LLMs

A vision researcher's guide to some RL stuff: PPO and GRPO

There Are No New Ideas in AI... Only New Datasets

Introduction to Theoretical Computer Science (2023)

An intuitive introduction to text embeddings

There Are No New Ideas in AI... Only New Datasets

There Are No New Ideas in AI – Only New Datasets

Understanding Flash Attention: Writing the Algorithm from Scratch in Triton

The Scaling Hypothesis (2020)

Optimizing Matrix Multiplication

Phylogeny of all the plants I can remember eating

The Experience of Using a Guest Pass at an Elite Gym

Book Review: The PhD Grind

The Egg (2009)

Language Modeling with 3D Parallelism

The Mean-Ing of Loss Functions

The Serendipity Machine (Notes on Using Twitter)

Attention Is Logarithmic

What Fruits and Vegetables Looked Like Before We Domesticated Them (2016)

The PhD Metagame: Don't try to reform science – not yet

Seeing Circles, Sines, and Signals: A Compact Primer on Digital Signal Processin

Kill Math

Inference Characteristics of Llama

Math –> GPU: My Transition from Academic Math to GPU Programming

Poking Around Claude Code

Deriving Muon

The Ones Who Stay and Fight

How to hire ML engineers/researchers

A Case of Plagarism in Machine Learning Research

Read "Harry Potter and the Methods of Rationality"

Laws of Tech: Commoditize Your Complement

AI Blindspots

Copilot for Everything: Training your AI replacement one keystroke at a time

Thoughts on Cursor

Quantity Always Trumps Quality (2008)

Colophon

Training a 70B Model from Scratch

A Meticulous Guide to Advances in Deep Learning Efficiency

I think Yann Lecun was right about LLMs (but perhaps only by accident)

Please Commit More Blatant Academic Fraud (2021)

Demystifying Noise Contrastive Estimation

It's time to become an ML engineer (2022)