๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

Lewis Tunstall
@_lewtun
๐Ÿค  post-training @huggingface
๊ฐ€์ž… August 2018
566 ํŒ”๋กœ์ž‰ ์ค‘    21.1K ํŒฌ
Today we're releasing Carbon-X, a 14B model that brings DNA and natural language together for the first time ๐Ÿงฌ 1. Beats every open language model we tested across DNA benchmarks. Within a point of GPT-6.1 Sol at >1,000ร— lower inference cost. 2. Mid-trained on 300B tokens of interleaved DNA and text, followed by SFT (without distillation!) and RL. 3. A new hybrid tokenizer encodes DNA using ~3ร— fewer tokens than BPE. 4. Gives other models a DNA specialist subagent: Kimi K3 gains 11.1 points when it consults Carbon-X. 5. Runs locally on a laptop with llama.cpp. Apache 2.0. Your DNA stays on your hardware. Model: Blog:
๋” ๋ณด๊ธฐ