TECH

Show HN: Distilling DeepSeek into GPT-OSS doesn't transfer censorship. Try it

Hacker News · Thu, 30 Jul 2026 18:13:06 GMT

We recently used DeepSeek V4 Flash as a teacher for finance tasks with GPT-OSS-120B. Distillation works well on this problem. At a constrained 8k token budget, our self-distilled 120B scores 83.61% on FinanceReasoning, above Kimi K3 (81.93%) and Inkling (65.13%). We released the

Read original source Discuss with SiiMON