What is Prompt Injection?
AI EngineeringLast updated:
An attack where malicious input tricks an AI model into ignoring its instructions or executing unintended actions.
Prompt injection exploits the fact that LLMs cannot reliably distinguish system instructions from user input. Defenses include input sanitization, output validation, privilege separation, and using dedicated safety classifiers.