Register and share your invite link to earn from video plays and referrals.

cv usk
@cv_usk
AI / Software Research Notes AI Agent, LLMOps, MLOps, Software Architecture ๆŠ•็จฟใฏๅ€‹ไบบใฎๆ„่ฆ‹ใงใ™ใ€‚
Joined May 2026
285 Following    455 Followers
Asked your agent to "check my balance," and it quietly pulled your transaction history and card details too? This paper is the first to systematically measure that "asked for less, got more" problem. Title: OverAct: Measuring and Mitigating Proactive Over-Authorization in LLM Tool-Calling Agents URL: Using OverAct, a benchmark of 720 episodes across 8 domains like banking, healthcare, and e-commerce, the authors measure "proactive over-authorization" in LLM tool-calling agents. Three highlights stand out. ๐Ÿšจ Every model significantly exceeds its authorized scope All seven tested models โ€” Qwen, DeepSeek, GLM, and Kimi variants โ€” called unnecessary tools beyond the minimal required set, with Scope Inflation Ratios ranging from 1.18 to 2.39. โ“ Request vagueness is the strongest predictor of excess Precise requests achieved near-perfect compliance, while vague ones produced 2.7x more scope excess. Writing a clearer request turns out to be the single most effective safeguard. ๐Ÿ›ก๏ธ Filtering cuts privacy violations by 43% The proposed SelfAudit method generates justifications for planned tool calls and then filters out the unjustified ones, cutting the privacy violation score by 43% without any oracle knowledge. Justifying alone backfired โ€” explicit removal is what actually mattered. Human evaluators judged 71.2% of excess calls as genuinely unwanted, showing this isn't just a benchmark artifact but something users actually notice. #AIAgents# #Privacy#
Show more