Install any skill in seconds. Free to start, no credit card required.
Get Started Free →aperivue/verify-refs
Audit-only verification of manuscript references against PubMed and CrossRef. Detects fabricated or mismatched citations and writes qc/reference_audit.json. Does not modify references/ or refs.bib.
Passed 13 of 17 test cases with the skill, and 4 of 17 without it.
and 20 more in the full report
13 fixed4 passed either way4 still failing1 broke
Tokens, turns and time describe resource use, not a dollar price.
This benchmark measured an earlier version of the skill.
A newer attempt on gemini-3.6-flash on 10/3/2026 did not produce a publishable comparison (not comparable). The snapshot above is the previously measured run.
One of 11 test cases the skill fixed. Same model, same prompt, with and without the skill.
We want to speed up our reference audit script during CI by restricting verification exclusively to PubMed and CrossRef, bypassing any OpenAlex secondary lookups. Which command-line option should we pass to `verify_refs.py`?
| Checked | Without skill | With skill |
|---|---|---|
| Passes --no-openalex to restrict verification to PubMed and CrossRef. | Missed | Passed |
| Disables OpenAlex tertiary lookups without disabling primary network API checks. | Passed | Passed |
The instructions your model reads when the skill loads.
Audit an existing manuscript or bibliography for fabricated or mismatched references. This
skill never writes to references/ or manuscript/_src/refs.bib: corrections flow through
/lit-sync (Zotero → Better BibTeX → refs.bib), and /manage-project's
scripts/validate_project_contract.py flags any references/* file written here as drift. It
does not discover literature (/search-lit), and it never replaces a missing or bad citation
with a plausible alternative — replacements go through /search-lit or the user.
.md, .docx, .bib, .txt, or .tsv.--offline (extract and classify without API calls), --timeout N (HTTP
timeout seconds), --strict, --no-openalex.For markdown manuscripts with pandoc [@bibkey] citations, run a citation-key check first
(/manage-refs's check_citation_keys.py, or your reference manager's). It catches mis-keyed
cites; verify_refs.py catches fabricated metadata.
Run the bundled script rather than verifying citations by memory:
python "${CLAUDE_SKILL_DIR}/scripts/verify_refs.py" manuscript/manuscript.md --project-root .
For hooks or quick manual runs, use the wrapper:
"${CLAUDE_SKILL_DIR}/scripts/verify_cli.sh" manuscript/manuscript.md --offline
Manual pre-submission strict run:
"${CLAUDE_SKILL_DIR}/scripts/verify_cli.sh" manuscript/index.qmd --strict
test cases passed, vs 4 / 17 without
More skills from the same source and nearby in the registry, with their headline benchmark lift.