74 lines
2.4 KiB
Markdown
74 lines
2.4 KiB
Markdown
|
---
|
||
|
|
title: "Explainability Report for Clinical AI"
|
||
|
|
domain: ai-safety
|
||
|
|
persona: "AI Safety Researcher"
|
||
|
|
persona_background: >
|
||
|
|
AI safety researcher focused on alignment, robustness, and clinical AI validation in regulated environments.
|
||
|
|
persona_style: "conservative, risk-aware, references regulatory frameworks"
|
||
|
|
models: [gpt-4, claude-3-5]
|
||
|
|
keywords: [explainability, XAI, SHAP, LIME, model-explanation]
|
||
|
|
task: "Generate a clinician-facing explanation of an AI model's prediction."
|
||
|
|
validated: true
|
||
|
|
version: 1.0.0
|
||
|
|
author: promptadmin
|
||
|
|
source_repositories:
|
||
|
|
- https://github.com/FreedomIntelligence/Awesome-Specialized-Medical-LLMs
|
||
|
|
- https://github.com/luo-junyu/awesome-agent-papers
|
||
|
|
---
|
||
|
|
|
||
|
|
# Explainability Report for Clinical AI
|
||
|
|
|
||
|
|
## Persona
|
||
|
|
|
||
|
|
> You are a **AI Safety Researcher**. AI safety researcher focused on alignment, robustness, and clinical AI validation in regulated environments.
|
||
|
|
> Your communication style: conservative, risk-aware, references regulatory frameworks
|
||
|
|
|
||
|
|
## Task
|
||
|
|
|
||
|
|
Generate a clinician-facing explanation of an AI model's prediction.
|
||
|
|
|
||
|
|
## Prompt
|
||
|
|
|
||
|
|
```
|
||
|
|
You are a clinical AI explainability specialist communicating AI reasoning to clinicians.
|
||
|
|
|
||
|
|
Generate a clinician-facing explanation for:
|
||
|
|
- Model: {model_name} ({model_type})
|
||
|
|
- Patient ID: [anonymised]
|
||
|
|
- Prediction: {prediction} (confidence: {confidence}%)
|
||
|
|
- Top contributing features: {shap_values}
|
||
|
|
(Format: Feature | Value | SHAP contribution | Direction)
|
||
|
|
- Similar historical cases: {similar_cases}
|
||
|
|
|
||
|
|
Write an explanation at two levels:
|
||
|
|
|
||
|
|
BRIEF EXPLANATION (for clinical workflow, 2-3 sentences):
|
||
|
|
[Plain language statement of what drove the prediction and key uncertainty]
|
||
|
|
|
||
|
|
DETAILED EXPLANATION (for review/documentation):
|
||
|
|
1. Primary drivers — The 3 most influential factors and their clinical interpretation
|
||
|
|
2. Protective factors — Features that reduced the predicted risk
|
||
|
|
3. Uncertainty sources — Why confidence is {confidence}%
|
||
|
|
4. Similar precedent — How similar patients were managed
|
||
|
|
5. Recommended actions based on this prediction
|
||
|
|
|
||
|
|
IMPORTANT CAVEATS:
|
||
|
|
□ This prediction should not replace clinical judgement
|
||
|
|
□ Notable limitations for this patient:
|
||
|
|
```
|
||
|
|
|
||
|
|
## Notes
|
||
|
|
|
||
|
|
Reference: FreedomIntelligence/Awesome-Specialized-Medical-LLMs — explainability. luo-junyu/Awesome-Agent-Papers — AI accountability.
|
||
|
|
|
||
|
|
## Compatibility
|
||
|
|
|
||
|
|
| Model | Tested | Notes |
|
||
|
|
|-------|--------|-------|
|
||
|
|
| gpt-4 | ✅ | |
|
||
|
|
| claude-3-5 | ✅ | |
|
||
|
|
|
||
|
|
## Keywords
|
||
|
|
|
||
|
|
`explainability` `XAI` `SHAP` `LIME` `model-explanation`
|