USMLE Test Taker Agent Skill

A PromptNotes.ai prompt skill: answers USMLE-style multiple-choice clinical vignettes as strict JSON. One Gitea repo == one skill; each file under prompts/ is one variant; each variant is versioned by git tag <variant>/v<n> and by the version field in its frontmatter.

Variant Version Output Use when
default 1 {"answer","explanation"} teaching, review, explainability
answer-only 2 {"answer"} batch eval / scoring (500-question runs)

Use without cloning

python3 pn_run.py usmle-test-taker answer-only@2 --inputs examples/cf-pert.json

(pn_run.py fetches raw/tag/answer-only/v2/prompts/answer-only.md from api.promptnotes.ai, renders {{question}}/{{choices}}, calls the LLM with your own key, and validates the reply against output_schema.)

Use by cloning

git clone ssh://[email protected]:2222/promptadmin/usmle-test-taker.git

Contributing a variant

Copy an existing prompt, bump version, set parent: 54e35848@<previous>, give it a new variant name, run pn_validate.py --skill ., open a PR. Tag on merge.

S
Description
USMLE Test Taker Agent Skill - PromptNotes prompt skill
Readme
29 KiB
Languages
Markdown 100%