Why the usual healing methods fall short here Our approach Results QAH against QAT, head to head What this changes in practice Making a large language model smaller almost always comes with a cost. The now-standard recipe for efficient deployment is to compress the architecture first, cutting the parameter count by removing layers, heads, or neurons, and then quantize the remaining weights down to 4 bits to shrink memory and compute further. Both steps save a lot, but together they systematically degrade the capabilities people actually care about: reasoning, mathematical problem-solving, and code generation. Because of this, serious deployment pipelines add a recovery step, usually called healing, before the model goes into production. Recent open-weight releases such as gpt-oss, NVIDIA's Nemotron family, and our own Hypernova 60B all rely on some version of this compress-then-heal approach.
Quantization-Aware Healing: a compressed, 4-bit model that outperforms its full-precision original
A Blog post by Multiverse Computing on Hugging Face

Key points
- We introduce Quantization-Aware Healing (QAH), and applied to a GPT-OSS 120B model compressed to 60B parameters and quantized to MXFP4, it produces a model that beats its own full-precision (bfloat16) version on 7 of 9 benchmarks.
- The only candidate teacher is the recovered bfloat16 checkpoint, which is itself a distilled approximation of the original model.
- The natural comparison is against that same 60B model's bfloat16 checkpoint, the best full-precision version of this architecture that exists.
Sentences selected automatically from the original article by Hugging Face Blog.
Story details
- Published
- Format
- Article
- Original
- huggingface.co ↗
Related reporting
2 stories on this topic from 2 sources, oldest first.
- Hugging Face Blog Quantization-Aware Healing: a compressed, 4-bit model that outperforms its full-precision original (this story)




