The distillation-as-competition argument
The argument frames model distillation as ordinary competitive learning, which is becoming a policy and platform boundary question rather than only a training technique.
Logged at IST: 2026-10-05 14:38 IST
What it is: A short reaction from Armin Ronacher to Jensen Huang's argument that model distillation is a form of competition rather than theft.
Gist: CNBC reports Huang arguing that learning from, testing, and competing with another company's product is part of normal competition. Armin's post endorses that framing. The useful part here is the policy boundary, not a new technical result: distillation is no longer just a training tactic, it is becoming part of how AI companies argue about fair competition.
Source read: https://www.cnbc.com/2026/09/28/nvidias-jensen-huang-ai-distillation-china.html