this lil toy amazed me as a kid.
with the tech we have at our fingertips
I can legitimately make this as I nostalgically remember.
new dream acquired. what a time to be alive
Introducing Contrastive Language Model (CLM): an ultra-fast System One Model trained with a contrastive learning objective that connects states and actions.
CLM-8B is pre-trained on internet-scale data and delivers up to 9× faster inference than Jev ⚡ while achieving comparable performance across computer-use, gaming, and tool-calling tasks.
With lightweight fine-tuning, CLM-8B sets a new SOTA on challenging agentic coding benchmarks, such as DeepSWE (81.6%) and Terminal-Bench 2.1 (87.6%). In contrast, Jev fails to serve as an effective verifier for these long-horizon tasks.
We also build an efficient training and serving infra for CLMs by disaggregating states and actions, allowing their embeddings to be cached and reused independently. This substantially reduces inference latency in settings where the state evolves continuously while the action set remains fixed.
Finally, we establish scaling laws for CLMs and show that the test contrastive loss decreases predictably as a power law in training compute, model size, and dataset size.
📄 Blog:
💻 Code:
🗣️ Discord:
🤗 Data & Models:
More details on CLM’s architecture, data recipe, and scaling laws in the thread below 🧵
watching mfs irl slowing become a series of AI generated responses when I ask basic questions.
where’s the taste, where’s “their voice”
“I ASKED YOU, NOT CLAUDE!”
I hate this. I hate that people, even when slopping, don't even think about how it works. This has to end poorly and I don't see how an increase in "intelligence" is going to save you from the results of blind feature lust