AI Security & Adversarial Attacks › Prompt Injection Attacks on LLMs

What is Prompt Injection Attacks on LLMs

Beginner

Answer

Prompt injection attacks on LLMs occur when a user or piece of content tries to trick a language model into ignoring its original instructions and following different, unintended commands instead.
Real-world example A malicious webpage might include hidden text trying to instruct an AI assistant to ignore its safety guidelines when summarizing that page.

Common follow-ups: What is AI Security & Adversarial Attacks, How is Prompt Injection Attacks on LLMs evaluated in practice, What tools are commonly used for Prompt Injection Attacks on LLMs