June 2026
Running Gemma-4 26B at 124 tokens/sec on a CPU, no GPU
A 26-billion-parameter mixture-of-experts model on a plain desktop with no graphics card — the recipe, the byte budget, and the map of where the walls actually are.
Read →Writeups on the systems I work on — mostly AI, performance, and the engineering decisions behind them. Measured, dead-ends left in.
A 26-billion-parameter mixture-of-experts model on a plain desktop with no graphics card — the recipe, the byte budget, and the map of where the walls actually are.
Read →