Install any skill in seconds. Free to start, no credit card required.
Get Started Free →Audit manuscript and replication package against FAIR open-science principles.
.claude/skills/brycewang-stanford-fair-check/SKILL.md| Test case | Without → With | Effect | Δ tokens | Δ turns |
|---|---|---|---|---|
| case-01 | ✗→✓ | ▲ Improved | -15% | 0% |
| case-02 | ✗→✓ | ▲ Improved | 2% | 0% |
| case-03 | ✗→✓ | ▲ Improved | -5% | 0% |
| case-04 | ✓→✓ | = Same ✓ | 131% | 0% |
| case-05 | ✓→✓ | = Same ✓ | 75% | 0% |
Use the FAIR principles as manuscript-facing checks for research objects: Findable, Accessible, Interoperable, Reusable. FAIR does not mean everything must be openly downloadable. Sensitive or restricted data can be FAIR when metadata, access conditions, identifiers, and reuse terms are explicit. The practical standard is "as open as possible, as restricted as necessary."
Core references: Wilkinson et al. (2016) for the FAIR principles, GO FAIR for the F/A/I/R subprinciples, OSF documentation for repository metadata and data archiving, FORCE11 for data citation principles, and TOP/DA-RT for manuscript transparency expectations.
Before judging compliance, list every research object the manuscript depends on:
If an object is not shareable, it still needs metadata and a clear access or non-availability explanation.
For each research object, verify:
Prompt author if missing: repository URL, DOI/identifier, title, contributors, version/date, and how each object maps to manuscript claims.
Verify:
Prompt author if missing: access restrictions, embargo date, contact process, data-use agreement, privacy constraints, and post-acceptance public URL.
Verify that others can read and combine the materials:
renv.lock, requirements.txt, environment.yml, Dockerfile, session info, package versions, or OS notes.Prompt author if missing: codebook, README, variable dictionary, software environment, data provenance, or mapping from files to outputs.
Verify:
Prompt author if missing: license choices, consent/sharing compatibility, restrictions on reuse, provenance notes, and replication instructions.
Check these sections, or draft them if absent:
Statements must be specific enough for a reader to find and reuse objects. "Available upon request" is weak unless privacy, legal, or contractual constraints justify it and the access process is concrete.
citation-check when repository objects need formal citation or DOI checks.figure-table-audit to verify figures/tables trace to repository files or scripts.methods-reporting for DA-RT, TOP, JARS, CONSORT, and methods-section integration.text-classification, topic-modeling, or vlm-ocr-pipeline when FAIRness depends on prompts, models, corpora, or derived computational objects.paper-review-lite or presubmit for full pre-submission review after FAIR fixes.Produce a FAIR Manuscript Audit:
# FAIR Manuscript Audit
Scope:
Manuscript files:
Repository/package links checked:
Summary: <N blocking, N recommended, N minor, N author prompts>
## Research Object Inventory
| Object | Location in manuscript | Repository/identifier | Share status | Notes |
## FAIR Checklist
| Object | Findable | Accessible | Interoperable | Reusable | Main gap |
## Blocking Issues
| Location | FAIR dimension | Issue | Fix |
## Recommended Fixes
| Location | FAIR dimension | Issue | Fix |
## Author Prompts
1. <question the author must answer before the statement can be finalized>
## Draft Availability Statements
### Data
### Code
### Materials
### Preregistration
## Repository Package Checklist
| Item | PASS/FAIL/PARTIAL/NA | Notes |Severity:
| Case | Status | Duration (ms) | Turns | Tokens | Tool calls | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Without | With | Δ | Without | With | Δ | Without | With | Δ | Without | With | Δ | ||
case-01 | fail→pass | 34,643 | 19,247 | -44% | 1 | 1 | 0% | 6,253 | 5,321 | -15% | 0 | 0 | — |
case-02 | fail→pass | 32,040 | 22,382 | -30% | 1 | 1 | 0% | 5,793 | 5,921 | +2% | 0 | 0 | — |
case-03 | fail→pass | 32,037 | 21,146 | -34% | 1 | 1 | 0% | 5,667 | 5,360 | -5% | 0 | 0 | — |
case-04 | pass→pass | 9,568 | 13,068 | +37% | 1 | 1 | 0% | 1,777 | 4,103 | +131% | 0 | 0 | — |
case-05 | pass→pass | 17,092 | 23,112 | +35% | 1 | 1 | 0% | 3,602 | 6,318 | +75% | 0 | 0 | — |
case-06 | pass→pass | 13,758 | 13,118 | -5% | 1 | 1 | 0% | 2,820 | 4,275 | +52% | 0 | 0 | — |
case-07 | pass→pass | 12,428 | 14,679 | +18% | 1 | 1 | 0% | 2,250 | 4,441 | +97% | 0 | 0 | — |
case-08 | pass→pass | 8,774 | 9,140 | +4% | 1 | 1 | 0% | 1,682 | 3,510 | +109% | 0 | 0 | — |
case-09 | pass→pass | 12,521 | 9,996 | -20% | 1 | 1 | 0% | 2,019 | 3,390 | +68% | 0 | 0 | — |
case-10 | pass→pass | 10,773 | 11,448 | +6% | 1 | 1 | 0% | 1,911 | 3,623 | +90% | 0 | 0 | — |
case-11 | pass→pass | 14,228 | 13,749 | -3% | 1 | 1 | 0% | 2,433 | 4,062 | +67% | 0 | 0 | — |
case-12 | pass→pass | 13,317 | 9,713 | -27% | 1 | 1 | 0% | 2,243 | 3,318 | +48% | 0 | 0 | — |
case-13 | pass→pass | 10,763 | 7,466 | -31% | 1 | 1 | 0% | 1,797 | 2,935 | +63% | 0 | 0 | — |
case-14 | fail→fail | 13,230 | 9,823 | -26% | 1 | 1 | 0% | 2,097 | 3,330 | +59% | 0 | 0 | — |
case-15 | pass→pass | 11,371 | 6,987 | -39% | 1 | 1 | 0% | 1,923 | 2,900 | +51% | 0 | 0 | — |
case-16 | pass→pass | 10,070 | 9,883 | -2% | 1 | 1 | 0% | 1,755 | 3,576 | +104% | 0 | 0 | — |
case-17 | pass→pass | 11,456 | 9,712 | -15% | 1 | 1 | 0% | 1,953 | 3,418 | +75% | 0 | 0 | — |
case-18 | pass→pass | 11,991 | 10,339 | -14% | 1 | 1 | 0% | 1,955 | 3,451 | +77% | 0 | 0 | — |
case-19 | pass→pass | 13,251 | 14,344 | +8% | 1 | 1 | 0% | 2,196 | 3,978 | +81% | 0 | 0 | — |
case-20 | pass→pass | 11,032 | 11,060 | +0% | 1 | 1 | 0% | 1,862 | 3,730 | +100% | 0 | 0 | — |
case-21 | pass→pass | 9,990 | 14,486 | +45% | 1 | 1 | 0% | 1,658 | 4,133 | +149% | 0 | 0 | — |
case-22 | pass→pass | 10,394 | 15,258 | +47% | 1 | 1 | 0% | 1,657 | 4,260 | +157% | 0 | 0 | — |
DecimalAI ran this skill against gemini-3.6-flash twice over the same eval suite — once with the skill loaded and once without — and compared the two runs case by case. 22 cases were attempted. The headline lift of +14 percentage points is the difference between those two pass rates over the 22 comparable cases.
Without the skill loaded, the model failed this case. With it loaded, the same prompt on the same model passed. This is one improved case from the latest verified run; every case, including any that regressed, is in the table above.
Other measured skills in the registry, with their headline benchmark lift.