GenAI vulnerable to prompt injection attacks
New research shows that one in 10 prompt injection atempts against GenAI systems manage to bypass basic guardrails. Their non-deterministic nature also means failed attempts can suddenly succeed, even with identical content.
AI security company Pangea ran a Prompt Injection Challenge in March this year. The month-long initiative attracted more than 800 participants from 85 countries who attempted to bypass AI security guardrails across three virtual rooms with increasing levels of difficulty.
LLMs vulnerable to prompt injection attacks
As we've already seen today AI systems are becoming increasingly popular targets for attack.
New research from Snyk and Lakera looks at the risks to AI agents and LLMs from prompt injection attacks.