Thoughts
Short essays and notes — things I noticed, worked out, or changed my mind about.
2026
- Neural networks need sleep
We borrowed neurons from the brain and left out sleep. In a toy test, a network that prunes and dreams every night keeps its old task at 96%. One that studies all night falls to 68%.
- Quantization is just a histogram
A 4-bit model is a 16-bar histogram of its own weights. Bit-width, calibration, and NF4 all fall out of that one picture.