System 1 models have generated significant excitement recently, particularly following the introduction of #
Jev#.
We introduce Contrastive Language Model (CLM): an ultra-fast System 1 model that connects states and actions through contrastive learning.
CLM-8B delivers up to 9× faster inference than Jev ⚡ while achieving comparable performance across computer use, gaming, and tool calling. With lightweight fine-tuning, it achieves 81.6% on DeepSWE and 87.6% on Terminal-Bench 2.1.
We also introduce efficient training and serving infrastructure for CLMs and establish scaling laws across compute, model size, and dataset size.
📄 Blog:
💻 Code:
🗣️ Discord:
🤗 Data & Models:
Work led by
@jackyk02, in collaboration with
@hangoo_kang @TarunSures41845 @JonSaadFalcon
@Azaliamirh @HazyResearch
More details in
@jackyk02's post:
@StanfordASL @StanfordAILab @StanfordEng
Introducing Contrastive Language Model (CLM): an ultra-fast System One Model trained with a contrastive learning objective that connects states and actions.
CLM-8B is pre-trained on internet-scale data and delivers up to 9× faster inference than Jev ⚡ while achieving comparable performance across computer-use, gaming, and tool-calling tasks.
With lightweight fine-tuning, CLM-8B sets a new SOTA on challenging agentic coding benchmarks, such as DeepSWE (81.6%) and Terminal-Bench 2.1 (87.6%). In contrast, Jev fails to serve as an effective verifier for these long-horizon tasks.
We also build an efficient training and serving infra for CLMs by disaggregating states and actions, allowing their embeddings to be cached and reused independently. This substantially reduces inference latency in settings where the state evolves continuously while the action set remains fixed.
Finally, we establish scaling laws for CLMs and show that the test contrastive loss decreases predictably as a power law in training compute, model size, and dataset size.
📄 Blog:
💻 Code:
🗣️ Discord:
🤗 Data & Models:
More details on CLM’s architecture, data recipe, and scaling laws in the thread below 🧵
もっと見る