注册并分享邀请链接,可获得视频播放与邀请奖励。

Lewis Tunstall
@_lewtun
🤠 post-training @huggingface
加入 August 2018
566 正在关注    21.1K 粉丝
Today we're releasing Carbon-X, a 14B model that brings DNA and natural language together for the first time 🧬 1. Beats every open language model we tested across DNA benchmarks. Within a point of GPT-6.1 Sol at >1,000× lower inference cost. 2. Mid-trained on 300B tokens of interleaved DNA and text, followed by SFT (without distillation!) and RL. 3. A new hybrid tokenizer encodes DNA using ~3× fewer tokens than BPE. 4. Gives other models a DNA specialist subagent: Kimi K3 gains 11.1 points when it consults Carbon-X. 5. Runs locally on a laptop with llama.cpp. Apache 2.0. Your DNA stays on your hardware. Model: Blog:
显示更多
0
36
278
44
转发到社区