Sebastian Raschka
@rasbt
ML/AI research engineer. Ex stats professor.
Author of "Build a Large Language Model From Scratch" ( & reasoning (
1.2K Following 486.1K Followers
How can an LLM switch between low-, medium-, and high-effort reasoning? And how does an LLM learn to reason more or less?
I put together a “little” article explaining how these effort levels are implemented at inference time and during training.
Show more
For agentic coding, one can say:
- Unless you need Terra Ultra perf, it's always better to use a Luna model with higher effort setting (same or better performance but cheaper).
- Forget everything below Sol High, use Luna with higher effort settings here
- Forget Sol Extra High, use Terra Ultra here
- The extra cost of Sol Ultra is probably not worth it over Max
Show more
After 18 months of writing, coding, and experimenting, Build a Reasoning Model (From Scratch) is
finally out!
My first copies just arrived! 📚
440 full-color pages. Inference scaling, reinforcement learning, and distillation from scratch.
Show more
