登録して招待リンクを共有すると、動画再生報酬と紹介報酬を獲得できます。

Turing Post
@TheTuringPost
On X we surface the AI research that matters and explain the ideas behind it. In the newsletter, we connect the dots between AI’s past, present, and future ⬇️
参加 June 2020
8.3K フォロー中    88K ファン
A 4B model’s BFCL score jumped from 39.51% to 54.18% after one change before supervised fine-tuning and RL: it learned about tools during mid-training. MidTool paper from @Snowflake tests whether tool use should be shaped earlier in a model’s development. Its 20.3-billion-token corpus combines technical webpages, PDFs and code with two forms of synthetic data. - Context-grounded examples turn real documentation, APIs and MCP skills into questions and workflows. - Native agent trajectories teach the model to execute several steps and recover when information is missing. Researchers tested Qwen3-4B-Base and 8B-Base while keeping the downstream recipe fixed: the same SFT data and optional RL. Results: - For the 4B model, MidTool raised BFCL from 39.73% to 50.25% after SFT. After RL: 39.51% → 54.18% - On τ²-Bench, Pass@1 went from 13.04% to 19.96% Another important insight is that executable trajectories helped function calling most, while documentation-grounded data transferred better to unfamiliar environments. Only the complete mixture improved all eight reported metrics. But there’s a boundary: every model scored 0% on MCP-Universe’s web-search subset. Learning tools and workflows wasn’t enough for long-horizon research. So the main lesson from this study: dedicated tool-use mid-training provides a stronger starting point to SFT/RL
もっと見る