Register and share your invite link to earn from video plays and referrals.

filipe
@filicroval
data eng | 1xAsus Ascent GX10 | benchmarking local models so you don't have to
Joined May 2023
214 Following    153.4K Followers
Can you make a reasoning model stop looping without just cutting it off? I used an MLX-LM logits processor to penalize rumination continuations inside : “Wait…”, “Actually…”, “double-check…”, “reconsider…” No finetune, no weight changes. Runtime steering. DeepSeek-R1-Distill-Qwen-14B-4bit · GSM8K n=100: baseline: 90% acc · 524 avg tokens · 250 marker hits penalty: 91% acc · 439 avg tokens · 7 marker hits hard cap near same budget: 48% acc · 410 avg tokens · 35 missing It changes how the model gets shorter: fewer self-doubt loops, not chopped reasoning. training-free, repo:
Show more