๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

cv usk
@cv_usk
AI / Software Research Notes AI Agent, LLMOps, MLOps, Software Architecture ๆŠ•็จฟใฏๅ€‹ไบบใฎๆ„่ฆ‹ใงใ™ใ€‚
๊ฐ€์ž… May 2026
285 ํŒ”๋กœ์ž‰ ์ค‘    455 ํŒฌ
TL;DR A method that rewrites successes found under several harnesses into training data a single general harness can reproduce. Training on the raw traces hurts; rewriting them lifts pass@3 from 57.0% to 74.2%. Title: Scaling Trajectories for Complex Tasks through Recursive Self-Rewrite URL: Points ๐Ÿงฉ Different harnesses solve different tasks; the union of three solves 34.3% more than the best single one ๐Ÿ“ A planner turns each success into a runbook, and an executor re-solves the task from scratch under the general harness ๐Ÿ” A critic screens every runbook for leaked answers and sends rejects back with a reason ๐Ÿงน The model then flags values that can't be derived from the task or environment and discards those traces ๐Ÿ“ˆ Training data grows from 2,001 to 11,094 trajectories, and Terminal-Bench Hard rises from 39.0% to 63.0% โš ๏ธ Direct SFT actually degrades TB2, with dead-end loops where the model repeats the same action pattern forever ๐ŸŽ› Even with no training, swapping the harness doubles TBH from 33.0% to 66.0% If you're thinking about feeding your own agent logs back into training, this makes a solid case for a rewrite-and-audit step first. #AIAgents# #SelfImprovement#
๋” ๋ณด๊ธฐ