32 lines
1.1 KiB
Markdown
32 lines
1.1 KiB
Markdown
|
# USMLE Test Taker Agent Skill
|
||
|
|
|
||
|
|
A PromptNotes.ai prompt skill: answers USMLE-style multiple-choice clinical vignettes as
|
||
|
|
strict JSON. One Gitea repo == one skill; each file under `prompts/` is one variant; each
|
||
|
|
variant is versioned by git tag `<variant>/v<n>` and by the `version` field in its
|
||
|
|
frontmatter.
|
||
|
|
|
||
|
|
| Variant | Version | Output | Use when |
|
||
|
|
|---|---|---|---|
|
||
|
|
| `default` | 1 | `{"answer","explanation"}` | teaching, review, explainability |
|
||
|
|
| `answer-only` | 2 | `{"answer"}` | batch eval / scoring (500-question runs) |
|
||
|
|
|
||
|
|
## Use without cloning
|
||
|
|
|
||
|
|
```bash
|
||
|
|
python3 pn_run.py usmle-test-taker answer-only@2 --inputs examples/cf-pert.json
|
||
|
|
```
|
||
|
|
(`pn_run.py` fetches `raw/tag/answer-only/v2/prompts/answer-only.md` from
|
||
|
|
`api.promptnotes.ai`, renders `{{question}}`/`{{choices}}`, calls the LLM with your own
|
||
|
|
key, and validates the reply against `output_schema`.)
|
||
|
|
|
||
|
|
## Use by cloning
|
||
|
|
|
||
|
|
```bash
|
||
|
|
git clone ssh://[email protected]:2222/promptadmin/usmle-test-taker.git
|
||
|
|
```
|
||
|
|
|
||
|
|
## Contributing a variant
|
||
|
|
|
||
|
|
Copy an existing prompt, bump `version`, set `parent: 54e35848@<previous>`, give it a new
|
||
|
|
`variant` name, run `pn_validate.py --skill .`, open a PR. Tag on merge.
|