ali
@waterloo_intern
ml research, kernels, and the occasional peer-reviewed shitpost
inference @baseten || eng @uwaterloo
๊ฐ์
October 2024
99 ํ๋ก์ ์ค 35.1K ํฌ
we distilled 2.3M Claude Fable 5 reasoning traces into Qwen3-4B
- 100% self-consistency @ 512 samples
- 0.00 bits output entropy
- zero hallucination variance
turns out the student is not bounded by the teacher.
it also converged on one universal truth.
we open-sourced the model weights๐
๋ ๋ณด๊ธฐ
