MTS(@MTSlive):Hugging Face researcher @evijit reveals how Carbon-X, a 14B open-source AI model, rivaled GPT-6.1 Sol on genomics benchmarks for a fraction of the cost: "On many science benchmarks, closed models are ahead and open models are falling behind." "When you try to make a model better for science, you can’t really do that with existing architecture, with existing data." "For Carbon-X, we had to take the Qwen3-14B model and mid-train it with 300 billion tokens of English and DNA. RL fine-tuning will not help you. That made it comparable on genomic benchmarks with GPT 6.1 Sol, for a tiny, tiny fraction of the price." "Academics don’t have the kind of resources that these closed labs do." @huggingface

2026.10.29 20:44

Hugging Face researcher @evijit reveals how Carbon-X, a 14B open-source AI model, rivaled GPT-6.1 Sol on genomics benchmarks for a fraction of the cost: "On many science benchmarks, closed models are ahead and open models are falling behind." "When you try to make a model better for science, you can’t really do that with existing architecture, with existing data." "For Carbon-X, we had to take the Qwen3-14B model and mid-train it with 300 billion tokens of English and DNA. RL fine-tuning will not help you. That made it comparable on genomic benchmarks with GPT 6.1 Sol, for a tiny, tiny fraction of the price." "Academics don’t have the kind of resources that these closed labs do." @huggingface

显示更多