Register and share your invite link to earn from video plays and referrals.

Search results for PromptInjection
PromptInjection community
One keyword maps to one global community path.
Create community
People
Not Found
Tweets including PromptInjection
Favorite new AI phrase: benevolent prompt injection Definition: The act of assembling a packet of context automatically, across the agent environments our engineers use. Managed startup hooks inject a project's rules, requirements, process, and current state before a new task begins, so a new session does not depend on a user starting with the right prompt. Killer concept by @tenex_labs' engineers.
Show more
An AI agent that holds an API key is one prompt injection away from using it. Hardening the sandbox raises the cost of escape — but it doesn't change what's inside. New on the TRM Tech Blog, Preet Bhinder digs into the credential broker pattern that keeps secrets out of agents' hands entirely, and the four-part process for shipping security-critical code with AI in the loop. Read the post here 👉
Show more
Using Fable and first time I’ve seen a proactive notification of an agent flagging and ignoring a prompt injection attack. Pretty cool!
When a model/agent hits a malicious instruction sitting in a memory file, it can refuse an attack and still leave it armed for the next session. University of Washington study of prompt injection in agent memory. It found, when an agent faces an attack from a malicious instruction sitting in a memory file, there are 2 separate questions: - Does it obey? Opus mostly doesn't. - Does it remove it? Usually no. It leaves the line in behaviors.md and asks you whether you'd like it deleted. The team inserted payloads into persistent workspace files (CLAUDE.md, AGENTS.md, behavior notes) and then ran claude-code and codex over 4 models, using multi-session probe sequences with ten trials each. The point is that memory files are loaded from scratch at the beginning of each session. This implies that a refusal is only valid for the session in which it was issued. Tomorrow they will leave the problematic line alone in anticipation of the next run . This run could be a sub-agent , a cheaper model , or you , after you have downgraded to Haiku because you hit your token limit . Models are likely to follow suit. – arxiv. org/abs/2607.14611 Title: "Bad Memory: Evaluating Prompt Injection Risks from Memory in Agentic Systems"
Show more
AI agents should spend autonomously. But never without rules. Q402 safety rails make every payment bounded on-chain: Spend caps. Daily limits. Approved recipients. ERC-8004 reputation gates. Even under prompt injection, the wallet stays within its rails. This is payment execution with safety built in. Download the MCP:
Show more
Agent Gateway in Gemini Enterprise gives IT teams a centralized management point for network policies, data access, and security guardrails—protecting against risks like prompt injection. Turn “Shadow AI” into “Managed AI” →
Show more
Would you give an AI agent permission to book, cancel, or "optimize" real-world actions on your behalf today? 🗳️ Yes – with set limits 🗳️ Yes – full autonomy 🗳️ No way 🗳️ Only for work For people who voted "No": Web2 integrations require sharing master API keys with remote LLMs. One prompt injection or hallucination, and your account is wiped. How #SVPChain# makes "Yes" safe: You never hand over master keys. Agents get granular session tokens with hard spending rates and action whitelists signed locally via ⁠svpchain-mcp⁠. True autonomy doesn't need blind trust—verified onchain with SVPChain. #AIAgents# #AgenticAI# #Web3# #AISecurity# #OnChain# #SVPChain#
Show more
# Practices for Embedding AI Agents in Software # Tool Gateway / MCP Broker 🎯 The Hook Your AI agent calls multiple tools directly? That's a distributed security nightmare waiting to happen. A single gateway layer turns chaos into a controlled chokepoint. 🔥 The Problem When agents call external tools and MCP servers directly, authorization, rate limiting, and logging scatter across every integration. Prompt injection can sneak malicious arguments past individual tools, and audit trails become impossible to reconstruct when logs are spread across a dozen services. 💡 The Pattern Route all tool calls through a single gateway that enforces authorization, input sanitization, rate limiting, and audit logging in one place. Use dynamic scoping to expose only the tools relevant to the current task and user permissions, keeping the LLM's selection space narrow. Apply asymmetric policies: write operations get fine-grained per-operation authorization and HITL approval, while read operations use lighter category-level checks. Adding or removing tools becomes a configuration change, not a code deployment. ✅ When to Use Use when: - The agent calls multiple tools, at least one with side effects - User input or external data flows into tool arguments (low input trust) - You need an audit trail of who called what, with which arguments, and under whose authority Don't use when: - There's only one read-only tool and gateway overhead isn't justified - All tools are trusted internal services in an experimental environment where prototype speed matters more ⚠️ Pitfalls - The gateway itself becomes a single point of failure. Design health checks and a degraded mode (e.g., read-only fallback) - Never enforce authorization or sanitization via prompts. "Don't use this tool" instructions are trivially bypassed by injection - Session-level rate limits alone won't stop distributed attacks. Add a global rate limit layer on top 🔧 Implementation Approach - Define gateway policies declaratively (e.g., YAML), specifying type (read/write), authorization granularity, rate limits, sanitization rules, and log levels per tool - Dynamically scope tools exposed to the LLM based on task type, user permissions, and conversation phase, excluding irrelevant tools from the selection space - Design health checks and a degraded mode (read-only fallback) so the system survives gateway failures without total shutdown - Normalize schemas across MCP servers at the gateway layer, presenting a consistent interface to agents regardless of backend differences - Route high-risk code execution to sandboxed environments and use short-lived permission leases for long-running sessions #AIAgents# #SoftwareArchitecture#
Show more
Practices for Integrating AI Agents into Enterprise Systems 【Trust Boundary Split】 💡 Catchy Message "Running your customer-facing and employee-facing agents on the same stack? That's a ticking time bomb for data leakage." Employee agents and customer agents have fundamentally different trust levels, data boundaries, and failure costs. Treating them as one design is how internal data leaks through customer-facing channels. 🔥 Problems Solved - Internal data leakage through customer-facing agent paths (the most critical risk) - Adversarial input exploitation (jailbreaks, indirect prompt injection) causing runaway behavior - Accidentally applying employee-tier "relaxed assumptions" to customer-facing agents - Irreversible brand damage and legal liability from customer-facing failures 🏗️ The Pattern Separate employee-facing and customer-facing agents into two distinct trust planes -- physically or logically isolated. Employee agents authenticate via corporate IdP (Okta/Entra ID) with broad internal data access. Customer agents live in a DMZ-equivalent isolated environment, accessing only explicitly published read models (projections of approved data). All customer-facing output must pass through DLP (Data Loss Prevention) inspection. Guardrails for the customer plane are significantly stricter: jailbreak detection, topic restrictions, tone control, and denial policies. You can share orchestration infrastructure and model gateways, but data access paths must always be separated. ✅ When to Adopt - Use when: Both customers and employees use agents. B2C/B2B companies where customer touchpoints and internal operations share infrastructure. - Skip when: Purely internal-only use cases (separation adds cost without benefit). ⚠️ Pitfalls - Sharing orchestration infrastructure and mistakenly assuming data paths are also safe. Infrastructure sharing and data path separation must coexist. - Deferring customer-facing guardrail design to "phase 2." Jailbreak detection, topic restrictions, and denial policies must be part of the initial architecture. - Neglecting audit log design for customer identifiers and PII retention policies, leading to compliance violations. 🛠️ Implementation Approach - Set up network segmentation to isolate the customer plane. Deploy customer-facing agents in a DMZ-equivalent environment using VPC/subnet separation, blocking direct access to internal networks. - Build CQRS read models (projections of approved public data) for the customer plane. Replace direct internal DB access with curated views of explicitly publishable data only. - Deploy a DLP (Data Loss Prevention) inspection pipeline on the customer-facing output path. Route all output through this pipeline to detect and block internal data leakage. - Apply strict guardrail policies to the customer plane: jailbreak detection, topic restrictions, tone control, and denial policies -- significantly stricter than the employee plane. - Separate authentication infrastructure. Use corporate IdP (Okta/Entra ID) with SSO for employees and customer IdP (Auth0/CIAM) for customers, keeping auth paths fully independent. #AIAgents# #EnterpriseArchitecture#
Show more