๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

cv usk
@cv_usk
AI / Software Research Notes AI Agent, LLMOps, MLOps, Software Architecture ๆŠ•็จฟใฏๅ€‹ไบบใฎๆ„่ฆ‹ใงใ™ใ€‚
๊ฐ€์ž… May 2026
258 ํŒ”๋กœ์ž‰ ์ค‘    220 ํŒฌ
# Decision Points in AI Agent Development ๐ŸŽฏ The Hook "Let's require approval for everything to be safe" is actually not safe at all. When 100 approval requests hit per day, approvers stop reading and just click OK. This is approval fatigue: the formal illusion of oversight with zero actual checking. It is more dangerous than having no approvals at all. HITL approval frequency is the dial that determines whether you get both safety and the benefits of automation. ๐Ÿ“‹ Overview HITL (Human-in-the-Loop) approval frequency controls how often an agent pauses to request human approval during processing. The spectrum ranges from approving every operation to approving only high-risk ones to relying on post-hoc sample audits. Approving everything throttles agent throughput down to human response speed, erasing the value of automation. Removing approvals entirely eliminates the last line of defense against hallucination-driven errors and unintended tool side effects. ๐Ÿ” Decision Points ๐Ÿ“Œ Failure cost: The primary driver. Higher-damage operations demand more approval; lower-damage ones can skip it. ๐Ÿ“Œ Reversibility: Whether an action can be undone changes the calculus entirely. Read operations and draft generation need no approval. Irreversible operations (production DB deletes, email sends, payments) require pre-approval. ๐Ÿ“Œ Approver cognitive load: Always keep in mind the paradox: higher approval frequency leads to lower approval quality. ๐Ÿ’ก Key Details ๐Ÿ—๏ธ Use a risk-gate approach. Classify operations into three tiers: - Auto-execute: Read operations, reversible small writes. No approval needed. - Pre-approval: Irreversible operations, financial transfers, external notifications. Human confirms before execution. - Forbidden: Bulk production data deletion, etc. The agent is never granted execution rights. ๐Ÿ—๏ธ Batch approvals are highly effective. Reviewing 10 items in a list and approving them together is less taxing on the approver than 10 individual requests, and the ability to compare items actually improves review quality. ๐Ÿ—๏ธ Sample auditing adds efficiency. Randomly sample 5-10% of auto-executed operations for quality auditing. If anomalies surface, downgrade that category's autonomy level. ๐Ÿ—๏ธ Monitor approval fatigue quantitatively. If the average time from approval request to response drops below 2 seconds, approvers are likely not reading the content. โš–๏ธ Trade-offs ๐Ÿ”ป Too few approvals: Irreversible operations execute on LLM judgment alone. When hallucination-driven errors occur, it is too late. Lack of audit trails can also create compliance violations. ๐Ÿ”บ Too many approvals: Approval fatigue reduces effective checking to zero. Throughput becomes bottlenecked by human response speed: a 5-minute approval cycle turns a 30-second process into 30 minutes. Users grow frustrated with constant interruptions and abandon the agent entirely. The best practice is progressive trust building. Start with pre-approval, shift to sample auditing as track record accumulates, and promote to auto-execution once sufficient confidence is established. ๐Ÿ› ๏ธ Use Cases ๐Ÿ“ง Email sending agent: Draft generation needs no approval. Internal emails get sample auditing (10% post-check). Customer-facing emails require full pre-approval. Bulk sends (100+ emails) require multi-person approval. Templated order confirmations can be promoted to auto-execution. ๐Ÿ—„๏ธ Database management agent: SELECT needs no approval. INSERT/UPDATE starts with pre-approval and transitions to batch approval with track record. DELETE always requires pre-approval. DDL operations require multi-person approval. Separating approval policies between production and development environments is essential. ๐ŸŒ™ 24-hour batch agent: During off-hours when approvers are unavailable, queue approval-required operations for next business day. Default approval timeouts to the safe side (auto-reject). Auto-approve on timeout hollows out the entire approval process. #AIAgents# #SoftwareArchitecture#
๋” ๋ณด๊ธฐ