註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Liam Fedus
@LiamFedus
Building industrial-scale science at @periodiclabs Past: VP of Post-Training @OpenAI; Google Brain
加入 October 2012
1.2K 正在關注    36.4K 粉絲
A competitive, rapidly improving open-source model ecosystem lets companies translate their proprietary data and know-how into their own intelligence. Cursor, Cognition, and now Harvey are building their own SOTA models. Congrats @harvey and @FireworksAI_HQ on Tenet! This was a rank-64 LoRA post-trained model on Kimi K3, trained on ~2k legal tasks on a B300 cluster.
顯示更多
Introducing Tenet, our first model post-trained for legal. Tenet is a Kimi K3 base that we post-trained with @FireworksAI_HQ on a corpus of publicly available legal data, synthetic data, and human expert data simulating long-horizon legal work. Training increases Tenet's all-pass rate by 82% on LAB and 22% on LAB Contracts relative to the Kimi K3 base model. It achieves state-of-the-art performance on LAB Contracts and places second on LAB. These gains generalize to other leading agentic benchmarks including @mercor's Apex Agents - Corporate Law, @crosbylegal's Redline Bench, and @scale_AI's Professional Reasoning Bench. Tenet is also optimized for token efficiency, operating at less than a fourth the cost of leading foundation models. We additionally post-trained three specialist models for Tenet to use as subagents: 1) M&A Diligence: post-trained with @baseten on our LAB Diligence environment in an RLM harness, this model is optimized for high-scale, long-horizon tasks. 2) Review Tables: trained with @appliedcompute on our Review Table environment, this model is state-of-the-art and cost-effective at high-volume document review and structured data extraction. 3) Firm Knowledge: trained with @EngramLab on our synthetic law firm environment, this model is optimized to learn and search over a firm's knowledge via memory and structured notes. More details on model training, environment design, benchmarking, results, and more in the article by @gabepereyra below. What's next for Harvey’s research? - Scaling LAB to more jurisdictions, practice areas and workflows - Scaling compute to bring new generalist models and capabilities to Harvey More to come soon.
顯示更多
0
12
245
11
轉發到社區