Short essays and notes on machine learning, mathematics, and whatever else I am thinking about.https://wolfniu.github.io/enhttps://wolfniu.github.io/thoughts/neural-networks-need-sleep/https://wolfniu.github.io/thoughts/neural-networks-need-sleep/We borrowed neurons from the brain and left out sleep. In a toy test, a network that prunes and dreams every night keeps its old task at 96%. One that studies all night falls to 68%.Thu, 12 Nov 2026 00:00:00 GMTmachine learningcontinual learningTong Niuhttps://wolfniu.github.io/thoughts/quantization-is-a-histogram/https://wolfniu.github.io/thoughts/quantization-is-a-histogram/A 4-bit model is a 16-bar histogram of its own weights. Bit-width, calibration, and NF4 all fall out of that one picture.Thu, 12 Nov 2026 00:00:00 GMTmachine learningquantizationTong Niu