“AI Meltdown” is the scenario where the agent goes off the rails and forgets/ignores all previous instructions and soft guardrails. No prompt injection or malicious actor is needed for this to happen.
At @perplexity_ai we built a suite of tools to prevent AI Meltdown from happening, and we opened sourced it just yesterday! Please use Numbat to secure yourselves from similar self-inflicted attacks
もっと見る
