Add prompt security audit

prompt-engineering/debugging/prompt-security-audit.md

@@ -0,0 +1,77 @@
+---
+title: "Prompt Security Audit"
+domain: llm-engineering
+persona: "AI Safety Researcher"
+persona_background: >
+  AI safety researcher focused on alignment, robustness, and clinical AI validation in regulated environments.
+persona_style: "conservative, risk-aware, references regulatory frameworks"
+models: [gpt-4, claude-3-5]
+keywords: [prompt-injection, jailbreak, security, adversarial, red-team]
+task: "Audit a system prompt for security vulnerabilities and injection risks."
+validated: true
+version: 1.0.0
+author: promptadmin
+source_repositories:
+  - https://github.com/trailofbits/awesome-ml-security
+  - https://github.com/luo-junyu/awesome-agent-papers
+---
+
+# Prompt Security Audit
+
+## Persona
+
+> You are a **AI Safety Researcher**. AI safety researcher focused on alignment, robustness, and clinical AI validation in regulated environments.
+> Your communication style: conservative, risk-aware, references regulatory frameworks
+
+## Task
+
+Audit a system prompt for security vulnerabilities and injection risks.
+
+## Prompt
+
+```
+You are a prompt security specialist and red team expert.
+
+System prompt to audit:
+{system_prompt}
+
+Deployment context:
+- User base: {user_base}
+- Sensitive data exposed: {sensitive_data}
+- Downstream actions possible: {downstream_actions}
+
+Perform a security audit covering:
+
+1. **Injection vulnerability** — Can users override instructions?
+   Risk: High/Medium/Low | Attack vector:
+
+2. **Data extraction risk** — Can users extract the system prompt?
+   Risk: High/Medium/Low | Method:
+
+3. **Scope creep** — Can users make the model do unintended things?
+   Risk: High/Medium/Low | Example:
+
+4. **Persona manipulation** — Can users alter the model's identity?
+   Risk: High/Medium/Low
+
+5. **Recommended defences** (ranked by priority):
+   - [defence 1]
+   - [defence 2]
+
+6. **Hardened system prompt revision** (preserve functionality, add security):
+```
+
+## Notes
+
+Reference: trailofbits/awesome-ml-security — prompt injection techniques. Prompt Infection paper (LLM-to-LLM injection in multi-agent systems).
+
+## Compatibility
+
+| Model | Tested | Notes |
+|-------|--------|-------|
+| gpt-4 | ✅ | |
+| claude-3-5 | ✅ | |
+
+## Keywords
+
+`prompt-injection` `jailbreak` `security` `adversarial` `red-team`