๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

cv usk
@cv_usk
AI / Software Research Notes AI Agent, LLMOps, MLOps, Software Architecture ๆŠ•็จฟใฏๅ€‹ไบบใฎๆ„่ฆ‹ใงใ™ใ€‚
๊ฐ€์ž… May 2026
280 ํŒ”๋กœ์ž‰ ์ค‘    422 ํŒฌ
TL;DR Self-evolving agents that write their own questions and answer them can fall into "co-cheating," where the proposer and solver quietly agree on the same mistakes. Splitting source documents to evaluate across folds fixes this and lifts performance by over 8 points. Title: False Frontiers: Diagnosing and Mitigating Co-Cheating in Self-Evolving Search Agents URL: Points ๐Ÿ” Proposer and solver share source-derived errors, letting false agreement cycle back as reward โ€” the paper calls this "co-cheating" ๐Ÿ“‰ Standard Dr. Zero systems show 6.1% and 8.8% false-agreement mass โœ‚๏ธ CrossFit splits source documents into two folds, scoring each proposer's questions with a solver trained only on the other fold ๐Ÿ“Š CrossFit alone cuts false agreement to 3.0%/3.7%; combined with MSV it drops to 2.0%/1.7% ๐Ÿš€ Average downstream Cover-EM improves by 8.8 and 8.4 points over Dr. Zero ๐Ÿงฉ Multi-hop tasks see the biggest gains, averaging over 10 points ๐Ÿ’ฐ Compute cost rises 1.72-2.7x over baseline, though a half-budget variant still works What stands out: without auditing the evaluator's own training history, apparent progress can be an illusion. #SelfEvolvingAgents# #ReinforcementLearning#
๋” ๋ณด๊ธฐ