Install any skill in seconds. Free to start, no credit card required.
Get Started Free →FDA regulatory consultant for medical device companies, covering 510(k)/PMA/De Novo pathways, QSR (21 CFR 820), HIPAA, and device cybersecurity. Use for FDA submissions, predicate and substantial-equivalence analysis, and premarket strategy.
.claude/skills/borghei-fda-consultant-specialist/SKILL.md| Test case | Without → With | Effect | Δ tokens | Δ turns |
|---|---|---|---|---|
| case-04 | ✗→✓ | ▲ Improved | 236% | 0% |
| case-05 | ✗→✓ | ▲ Improved | 1531% | 0% |
| case-06 | ✗→✓ | ▲ Improved | 1470% | 0% |
| case-07 | ✗→✓ | ▲ Improved | 941% | 0% |
| case-13 | ✗→✓ | ▲ Improved | 888% | 0% |
FDA regulatory consulting for medical device manufacturers covering submission pathways, Quality System Regulation (QSR), HIPAA compliance, and device cybersecurity requirements.
Before selecting a pathway or assessing compliance, confirm these inputs. If any is unknown or vague, ASK — do not assume:
Stop rule: ask only the 2-3 that most change the output. If the user says "just draft it," proceed and list your assumptions at the top of the analysis.
Determine the appropriate FDA regulatory pathway based on device classification and predicate availability.
Predicate device exists?
├── YES → Substantially equivalent?
│ ├── YES → 510(k) Pathway
│ │ ├── No design changes → Abbreviated 510(k)
│ │ ├── Manufacturing only → Special 510(k)
│ │ └── Design/performance → Traditional 510(k)
│ └── NO → PMA or De Novo
└── NO → Novel device?
├── Low-to-moderate risk → De Novo
└── High risk (Class III) → PMA| Pathway | When to Use | Timeline | Cost | |---------|-------------|----------|------| | 510(k) Traditional | Predicate exists, design changes | 90 days | $21,760 | | 510(k) Special | Manufacturing changes only | 30 days | $21,760 | | 510(k) Abbreviated | Guidance/standard conformance | 30 days | $21,760 | | De Novo | Novel, low-moderate risk | 150 days | $134,676 | | PMA | Class III, no predicate | 180+ days | $425,000+ |
Reference: See fda_submission_guide.md for pathway decision matrices and submission requirements.
Phase 1: Planning
├── Step 1: Identify predicate device(s)
├── Step 2: Compare intended use and technology
├── Step 3: Determine testing requirements
└── Checkpoint: SE argument feasible?
Phase 2: Preparation
├── Step 4: Complete performance testing
├── Step 5: Prepare device description
├── Step 6: Document SE comparison
├── Step 7: Finalize labeling
└── Checkpoint: All required sections complete?
Phase 3: Submission
├── Step 8: Assemble submission package
├── Step 9: Submit via eSTAR
├── Step 10: Track acknowledgment
└── Checkpoint: Submission accepted?
Phase 4: Review
├── Step 11: Monitor review status
├── Step 12: Respond to AI requests
├── Step 13: Receive decision
└── Verification: SE letter received?| Section | Content | |---------|---------| | Cover Letter | Submission type, device ID, contact info | | Form 3514 | CDRH premarket review cover sheet | | Device Description | Physical description, principles of operation | | Indications for Use | Form 3881, patient population, use environment | | SE Comparison | Side-by-side comparison with predicate | | Performance Testing | Bench, biocompatibility, electrical safety | | Software Documentation | Level of concern, hazard analysis (IEC 62304) | | Labeling | IFU, package labels, warnings | | 510(k) Summary | Public summary of submission |
| Issue | Prevention | |-------|------------| | Missing user fee | Verify payment before submission | | Incomplete Form 3514 | Review all fields, ensure signature | | No predicate identified | Confirm K-number in FDA database | | Inadequate SE comparison | Address all technological characteristics |
Quality System Regulation (21 CFR Part 820) requirements for medical device manufacturers.
| Section | Title | Focus | |---------|-------|-------| | 820.20 | Management Responsibility | Quality policy, org structure, management review | | 820.30 | Design Controls | Input, output, review, verification, validation | | 820.40 | Document Controls | Approval, distribution, change control | | 820.50 | Purchasing Controls | Supplier qualification, purchasing data | | 820.70 | Production Controls | Process validation, environmental controls | | 820.100 | CAPA | Root cause analysis, corrective actions | | 820.181 | Device Master Record | Specifications, procedures, acceptance criteria |
Step 1: Design Input
└── Capture user needs, intended use, regulatory requirements
Verification: Inputs reviewed and approved?
Step 2: Design Output
└── Create specifications, drawings, software architecture
Verification: Outputs traceable to inputs?
Step 3: Design Review
└── Conduct reviews at each phase milestone
Verification: Review records with signatures?
Step 4: Design Verification
└── Perform testing against specifications
Verification: All tests pass acceptance criteria?
Step 5: Design Validation
└── Confirm device meets user needs in actual use conditions
Verification: Validation report approved?
Step 6: Design Transfer
└── Release to production with DMR complete
Verification: Transfer checklist complete?Reference: See qsr_compliance_requirements.md for detailed QSR implementation guidance.
HIPAA requirements for devices that create, store, transmit, or access Protected Health Information (PHI).
| Device Type | HIPAA Applies | |-------------|---------------| | Standalone diagnostic (no data transmission) | No | | Connected device transmitting patient data | Yes | | Device with EHR integration | Yes | | SaMD storing patient information | Yes | | Wellness app (no diagnosis) | Only if stores PHI |
Administrative (§164.308)
├── Security officer designation
├── Risk analysis and management
├── Workforce training
├── Incident response procedures
└── Business associate agreements
Physical (§164.310)
├── Facility access controls
├── Workstation security
└── Device disposal procedures
Technical (§164.312)
├── Access control (unique IDs, auto-logoff)
├── Audit controls (logging)
├── Integrity controls (checksums, hashes)
├── Authentication (MFA recommended)
└── Transmission security (TLS 1.2+)Reference: See hipaa_compliance_framework.md for implementation checklists and BAA templates.
FDA cybersecurity requirements for connected medical devices.
| Element | Description | |---------|-------------| | Threat Model | STRIDE analysis, attack trees, trust boundaries | | Security Controls | Authentication, encryption, access control | | SBOM | Software Bill of Materials (CycloneDX or SPDX) | | Security Testing | Penetration testing, vulnerability scanning | | Vulnerability Plan | Disclosure process, patch management |
Tier 1 (Higher Risk):
Tier 2 (Standard Risk):
Researcher Report
↓
Acknowledgment (48 hours)
↓
Initial Assessment (5 days)
↓
Fix Development
↓
Coordinated Public DisclosureReference: See device_cybersecurity_guidance.md for SBOM format examples and threat modeling templates.
| Script | Purpose | |--------|---------| | fda_submission_tracker.py | Track 510(k)/PMA/De Novo submission milestones and timelines | | qsr_compliance_checker.py | Assess 21 CFR 820 compliance against project documentation | | hipaa_risk_assessment.py | Evaluate HIPAA safeguards in medical device software |
| File | Content | |------|---------| | fda_submission_guide.md | 510(k), De Novo, PMA submission requirements and checklists | | qsr_compliance_requirements.md | 21 CFR 820 implementation guide with templates | | hipaa_compliance_framework.md | HIPAA Security Rule safeguards and BAA requirements | | device_cybersecurity_guidance.md | FDA cybersecurity requirements, SBOM, threat modeling | | fda_capa_requirements.md | CAPA process, root cause analysis, effectiveness verification |
bash# Track FDA submission status python scripts/fda_submission_tracker.py /path/to/project --type 510k # Assess QSR compliance python scripts/qsr_compliance_checker.py /path/to/project --section 820.30 # Run HIPAA risk assessment python scripts/hipaa_risk_assessment.py /path/to/project --category technical
The FDA finalized the Quality Management System Regulation (QMSR) in January 2024, replacing the legacy Quality System Regulation (QSR) with ISO 13485:2016 alignment. The rule became effective February 2, 2026.
| Aspect | Legacy QSR (21 CFR 820) | QMSR (Effective Feb 2026) | |--------|------------------------|---------------------------| | Framework | FDA-specific prescriptive requirements | Incorporates ISO 13485:2016 by reference | | Design controls | 820.30 (FDA-specific) | ISO 13485 Clause 7.3 | | CAPA | 820.100 | ISO 13485 Clause 8.5 | | Document control | 820.40 | ISO 13485 Clause 4.2 | | Management responsibility | 820.20 | ISO 13485 Clause 5 | | Purchasing controls | 820.50 | ISO 13485 Clause 7.4 |
Key differences under QMSR:
| Category | Description | FDA Pathway | |----------|-------------|-------------| | Locked algorithm | Algorithm does not change after deployment | Standard 510(k)/De Novo/PMA | | Adaptive algorithm (PCCP) | Algorithm learns and changes with use | Predetermined Change Control Plan | | Continuously learning | Real-time adaptation from new data | Case-by-case; PCCP required |
AI/ML SaMD Submission Package
├── Algorithm description and architecture
├── Training data characterization
│ ├── Data sources and collection methods
│ ├── Demographics and representativeness
│ ├── Data quality and labeling methodology
│ └── Training/validation/test split rationale
├── Performance evaluation
│ ├── Pre-specified performance goals
│ ├── Standalone performance metrics (sensitivity, specificity, AUC)
│ ├── Subgroup analysis (age, sex, race, site)
│ └── Real-world performance data (if available)
├── Reference standard justification
├── Predetermined Change Control Plan (if adaptive)
├── Human factors / user interface
├── Cybersecurity documentation
└── Software documentation per IEC 62304| Section | Content | Evidence | |---------|---------|----------| | Description of modifications | Types of changes the algorithm will make | Change specification document | | Modification protocol | How changes will be developed and tested | Validation protocol | | Impact assessment | How each change type affects safety and effectiveness | Risk analysis per change type | | Performance monitoring | Ongoing real-world performance tracking | Monitoring plan with metrics | | Update verification | How each update will be verified before deployment | Verification and validation plan | | Transparency | How users will be notified of changes | Communication plan |
| Category | Example | Verification Level | |----------|---------|-------------------| | Performance improvement | Retrained model with additional data | Automated testing + clinical validation | | Input adaptation | New imaging modality support | Full V&V cycle | | Output modification | New risk categories or confidence levels | Clinical study | | Architecture change | Model architecture update | New submission (510(k)/PMA supplement) |
The PATCH Act (effective March 2023, codified in FD&C Act §524B) requires:
| Requirement | Details | Evidence | |-------------|---------|----------| | Cybersecurity plan | Submit plan to monitor, identify, and address vulnerabilities | Premarket submission section | | SBOM | Software Bill of Materials including commercial, open-source, off-the-shelf components | CycloneDX or SPDX format | | Patch/update capability | Design device to be patchable throughout lifecycle | Architecture documentation | | Coordinated vulnerability disclosure | Establish and maintain CVD process | Published security policy | | Postmarket updates | Provide patches and updates in a reasonably justified cycle | Patch management plan |
Cybersecurity Premarket Package
├── Security risk assessment
│ ├── Threat model (STRIDE or equivalent)
│ ├── Security risk analysis per AAMI TIR57
│ └── Attack surface analysis
├── Security architecture
│ ├── Security controls implementation
│ ├── Cryptographic architecture
│ └── Network architecture and trust boundaries
├── SBOM (Software Bill of Materials)
│ ├── All software components (commercial, open-source, custom)
│ ├── Version information
│ └── Known vulnerability status
├── Security testing
│ ├── Static analysis (SAST)
│ ├── Dynamic analysis (DAST)
│ ├── Penetration testing report
│ ├── Fuzz testing results
│ └── Vulnerability scanning results
├── Lifecycle security plan
│ ├── Patch management process
│ ├── End-of-life/end-of-support plan
│ └── Customer communication plan
└── Coordinated vulnerability disclosure policyAI-enabled medical devices must comply with both FDA requirements and EU AI Act when marketed in both jurisdictions:
| Aspect | FDA Approach | EU AI Act Approach | Harmonization Strategy | |--------|-------------|-------------------|----------------------| | Risk classification | SaMD risk framework (IMDRF) | Annex III high-risk (medical devices) | Map to both frameworks; use higher standard | | Transparency | Labeling requirements | Art. 13 transparency obligations | Unified transparency documentation | | Data governance | GMLP principles | Art. 10 data and data governance | Comprehensive data quality program | | Human oversight | Human factors per IEC 62366 | Art. 14 human oversight | Integrated human factors + oversight design | | Post-market | Real-world performance monitoring | Art. 72 post-market monitoring | Single monitoring system serving both | | Technical documentation | FDA premarket submission | Annex IV technical documentation | Unified technical file |
> See also: ../mdr-745-specialist/SKILL.md for EU MDR classification of AI/ML medical devices and ../risk-management-specialist/SKILL.md for ISO 14971 risk management for AI devices.
As of October 1, 2023, FDA requires all 510(k) submissions to use the eSTAR template format. Paper submissions are no longer accepted.
| eSTAR Requirement | Details | |-------------------|---------| | Template | FDA eSTAR template (fillable PDF) | | Format | Structured data fields + attachments | | Attachments | PDF/A format, bookmarked, OCR-searchable | | File naming | FDA naming convention required | | Submission portal | CDRH Customer Collaboration Portal or FDA ESG | | Maximum file size | 100MB per individual file; no total limit |
| eSTAR Section | Content | Common Deficiencies | |---------------|---------|---------------------| | Administrative | Cover letter, user fee, truthful/accurate statement | Missing signatures, incorrect fee | | Device Description | Complete device description with images/diagrams | Insufficient detail, missing accessories | | Substantial Equivalence | Predicate comparison table | Incomplete comparison criteria | | Performance Testing | All test reports with summaries | Missing acceptance criteria, incomplete protocols | | Software | Level of concern, hazard analysis, architecture | Outdated IEC 62304 compliance | | Biocompatibility | ISO 10993 evaluation or testing | Missing risk assessment, incomplete contact analysis | | Sterility | Sterilization validation summary | Missing reprocessing instructions (reusable devices) | | Labeling | Device labels, IFU, patient materials | Non-compliant with 21 CFR 801 | | EMC/Electrical Safety | IEC 60601-1 compliance | Missing particular standards | | Clinical | Clinical data summary (if applicable) | Insufficient clinical evidence for new indications |
| Process Area | FDA (QMSR/QSR) | EU MDR 2017/745 | ISO 13485:2016 | |-------------|-----------------|-----------------|----------------| | Quality management system | 21 CFR 820 / QMSR | Annex IX, Annex XI | Clause 4 | | Management responsibility | 820.20 / ISO 13485 Cl. 5 | Annex IX §2.2 | Clause 5 | | Design controls | 820.30 / ISO 13485 Cl. 7.3 | Annex II §6.1, GSPR | Clause 7.3 | | Document control | 820.40 / ISO 13485 Cl. 4.2 | Annex IX §2.3 | Clause 4.2 | | Purchasing | 820.50 / ISO 13485 Cl. 7.4 | Annex IX §2.4 | Clause 7.4 | | Production | 820.70 / ISO 13485 Cl. 7.5 | Annex IX §2.5 | Clause 7.5 | | CAPA | 820.100 / ISO 13485 Cl. 8.5 | Art. 83 (PMS), Art. 89 (FSCA) | Clause 8.5 | | Risk management | 820.30(g) / ISO 14971 | Annex I (GSPR), ISO 14971 | Clause 7.1 | | Clinical evidence | 820.30(f) / clinical data | Annex XIV (clinical evaluation) | N/A (separate) | | Post-market | 820.198 / MDR/MedWatch | Art. 83-86 (PMS), Art. 87-92 (vigilance) | Clause 8.2.1-8.2.3 | | Labeling | 21 CFR 801 | Art. 10-13, Annex I Ch. III | N/A (separate) | | UDI | 21 CFR 830 (FDA UDI) | Art. 27-29 (UDI-DI/PI) | N/A (separate) | | Cybersecurity | §524B FD&C (PATCH Act) | MDCG 2019-16 | N/A (separate) | | AI/ML devices | AI/ML SaMD framework + PCCP | EU AI Act + MDR | ISO 13485 + ISO 42001 |
> Cross-references: See ../quality-manager-qms-iso13485/SKILL.md for ISO 13485 implementation aligned with QMSR, and ../mdr-745-specialist/SKILL.md for EU MDR technical documentation requirements.
The FDA is aligning 21 CFR Part 820 with ISO 13485:2016 through the Quality Management System Regulation (QMSR), effective February 2, 2026:
eu-ai-act-specialist for EU AI Act requirements for AI medical devicesinfrastructure-compliance-auditor for technical cybersecurity checks| Area | FDA (QSR/QMSR) | EU MDR 2017/745 | ISO 13485:2016 | |------|----------------|-----------------|----------------| | Design Controls | 820.30 / QMSR | Annex II | Clause 7.3 | | Risk Management | 820.30(g) | Annex I GSPR | ISO 14971 | | Clinical Evidence | 820.30(f) | Annex XIV | Clause 7.3.7 | | CAPA | 820.90/100 | Art. 83, 89 | Clause 8.5 | | Post-Market | 822, MDR | Chapter VII | Clause 8.2.1 | | Cybersecurity | FDA Guidance | MDCG 2019-16 | IEC 62443 | | AI/ML | PCCP Framework | EU AI Act | ISO 42001 |
| Problem | Possible Cause | Resolution | |---------|---------------|------------| | 510(k) submission returned as RTA (Refuse to Accept) | Missing user fee, incomplete Form 3514, no predicate identified, or inadequate SE comparison | Review the RTA checklist per FDA guidance; verify payment, complete all eSTAR fields, confirm K-number in FDA database, and address all technological characteristics in SE comparison | | QSR compliance checker shows gaps in design controls (820.30) | Design History File incomplete or not aligned with ISO 13485 Clause 7.3 under QMSR | Map existing DHF to ISO 13485 Clause 7.3 structure; ensure design inputs, outputs, reviews, verification, and validation are documented with traceability | | HIPAA risk assessment returns low score for technical safeguards | Missing encryption at rest/transit, no MFA implementation, or audit logging not enabled | Implement AES-256 encryption at rest, TLS 1.2+ in transit, MFA for all users with ePHI access, and comprehensive audit logging; run hipaa_risk_assessment.py with --category technical to validate | | FDA AI request (Additional Information) received during 510(k) review | Performance testing insufficient, SE argument incomplete, or software documentation gaps | Respond within 180 days; address each question specifically; supplement with additional test data, clinical evidence, or software documentation per IEC 62304 | | QMSR transition gap analysis reveals significant differences | Organization structured QMS around legacy 21 CFR 820 rather than ISO 13485 | Conduct systematic gap analysis mapping 820 subsections to ISO 13485 clauses; prioritize complaint handling (retained FDA requirement), risk-based evidence across all processes, and updated Quality Manual | | Cybersecurity documentation rejected in premarket submission | SBOM incomplete, threat model missing, or coordinated vulnerability disclosure policy not published | Generate comprehensive SBOM in CycloneDX or SPDX format; complete STRIDE threat model per AAMI TIR57; publish CVD policy; document patch management lifecycle plan | | AI/ML SaMD submission lacks Predetermined Change Control Plan | Adaptive algorithm deployed without PCCP framework | Develop PCCP covering modification types, validation protocol, impact assessment, performance monitoring, and user notification plan; include all four change categories with appropriate verification levels |
qsr_compliance_checker.py, with all critical subsections (design controls, CAPA, document control) showing evidence of implementationfda_submission_tracker.py milestonesIn Scope:
Out of Scope:
Important Notes:
| Skill | Integration | When to Use | |-------|-------------|-------------| | quality-manager-qms-iso13485 | ISO 13485 QMS implementation aligned with QMSR; process management and supplier qualification | When implementing QMS satisfying both ISO 13485 certification and FDA QMSR requirements | | mdr-745-specialist | Cross-framework mapping for dual US/EU market submissions; technical documentation alignment | When medical device requires both FDA clearance/approval and EU MDR CE marking | | capa-officer | CAPA process management per ISO 13485 Clause 8.5 (replacing legacy 820.100 under QMSR) | When managing corrective and preventive actions within the FDA quality system | | risk-management-specialist | ISO 14971 risk management integrated with design controls and cybersecurity risk assessment | When conducting risk analysis for premarket submissions per 820.30(g) and AAMI TIR57 | | eu-ai-act-specialist | Cross-jurisdictional AI/ML compliance for devices marketed in both US and EU | When AI-enabled medical device requires both FDA PCCP framework and EU AI Act conformity assessment | | infrastructure-compliance-auditor | Technical cybersecurity validation for connected device security controls | When documenting cybersecurity architecture and SBOM for premarket submissions |
Tracks FDA submission milestones and calculates regulatory timelines for 510(k), De Novo, and PMA pathways.
| Flag | Required | Description | |------|----------|-------------| | <project_dir> | Yes | Path to project directory containing submission documents | | --type <pathway> | No | Submission type: 510k (default), de_novo, pma, pma_supplement | | --json | No | Output results in JSON format |
Output: Milestone tracking with completion status, timeline calculations against FDA review goals, phase progress (planning, preparation, submission, review, decision), and overdue milestone alerts.
Assesses compliance with 21 CFR Part 820 / QMSR by analyzing project documentation for evidence of implementation.
| Flag | Required | Description | |------|----------|-------------| | <project_dir> | Yes | Path to project directory containing QMS documentation | | --section <section> | No | Check specific QSR section (e.g., 820.30 for design controls, 820.100 for CAPA) | | --json | No | Output results in JSON format |
Output: Per-section compliance status, evidence found (document patterns and keyword matches), compliance percentage, gap identification with required evidence descriptions.
Evaluates HIPAA Security Rule safeguards for medical device software and connected devices.
| Flag | Required | Description | |------|----------|-------------| | <project_dir> | Yes | Path to project directory for assessment | | --category <cat> | No | Assess specific category: administrative, physical, technical, or all (default) | | --json | No | Output results in JSON format |
Output: Per-safeguard compliance status across administrative (Section 164.308), physical (Section 164.310), and technical (Section 164.312) categories, with weighted scoring, evidence detection, and remediation recommendations.
| Case | Status | Duration (ms) | Turns | Tokens | Tool calls | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Without | With | Δ | Without | With | Δ | Without | With | Δ | Without | With | Δ | ||
case-23 | fail→fail | 17,064 | 30,900 | +81% | 1 | 1 | 0% | 2,949 | 13,742 | +366% | 0 | 0 | — |
case-01 | fail→fail | 37,509 | 25,939 | -31% | 1 | 1 | 0% | 6,237 | 12,716 | +104% | 0 | 0 | — |
case-02 | fail→fail | 34,612 | 30,524 | -12% | 1 | 1 | 0% | 6,226 | 13,514 | +117% | 0 | 0 | — |
case-03 | fail→fail | 36,593 | 34,135 | -7% | 1 | 1 | 0% | 6,179 | 13,725 | +122% | 0 | 0 | — |
case-04 | fail→pass | 19,516 | 12,901 | -34% | 1 | 1 | 0% | 3,049 | 10,253 | +236% | 0 | 0 | — |
case-05 | fail→pass | 3,499 | 2,373 | -32% | 1 | 1 | 0% | 523 | 8,532 | +1531% | 0 | 0 | — |
case-06 | fail→pass | 3,934 | 2,363 | -40% | 1 | 1 | 0% | 542 | 8,508 | +1470% | 0 | 0 | — |
case-07 | fail→pass | 5,106 | 1,944 | -62% | 1 | 1 | 0% | 807 | 8,400 | +941% | 0 | 0 | — |
case-08 | pass→pass | 4,710 | 4,343 | -8% | 1 | 1 | 0% | 850 | 8,807 | +936% | 0 | 0 | — |
case-09 | pass→pass | 11,457 | 12,087 | +5% | 1 | 1 | 0% | 1,912 | 10,168 | +432% | 0 | 0 | — |
case-10 | pass→pass | 3,959 | 6,616 | +67% | 1 | 1 | 0% | 684 | 9,279 | +1257% | 0 | 0 | — |
case-11 | pass→pass | 7,626 | 9,512 | +25% | 1 | 1 | 0% | 1,272 | 9,621 | +656% | 0 | 0 | — |
case-12 | pass→pass | 7,512 | 9,524 | +27% | 1 | 1 | 0% | 1,046 | 9,572 | +815% | 0 | 0 | — |
case-13 | fail→pass | 5,156 | 7,535 | +46% | 1 | 1 | 0% | 947 | 9,354 | +888% | 0 | 0 | — |
case-14 | pass→pass | 5,117 | 8,607 | +68% | 1 | 1 | 0% | 1,155 | 9,777 | +746% | 0 | 0 | — |
case-15 | pass→pass | 2,892 | 3,609 | +25% | 1 | 1 | 0% | 335 | 8,764 | +2516% | 0 | 0 | — |
case-16 | pass→pass | 12,931 | 11,779 | -9% | 1 | 1 | 0% | 2,159 | 10,244 | +374% | 0 | 0 | — |
case-17 | fail→pass | 7,310 | 7,432 | +2% | 1 | 1 | 0% | 1,227 | 9,345 | +662% | 0 | 0 | — |
case-18 | fail→pass | 4,625 | 9,248 | +100% | 1 | 1 | 0% | 730 | 9,481 | +1199% | 0 | 0 | — |
case-19 | pass→pass | 20,183 | 24,242 | +20% | 1 | 1 | 0% | 3,119 | 11,927 | +282% | 0 | 0 | — |
case-20 | pass→pass | 11,915 | 14,854 | +25% | 1 | 1 | 0% | 1,883 | 10,328 | +448% | 0 | 0 | — |
case-21 | fail→fail | 3,637 | 2,119 | -42% | 1 | 1 | 0% | 431 | 8,388 | +1846% | 0 | 0 | — |
case-22 | fail→fail | 24,421 | 27,973 | +15% | 1 | 1 | 0% | 4,323 | 12,943 | +199% | 0 | 0 | — |
case-24 | pass→pass | 10,397 | 17,300 | +66% | 1 | 1 | 0% | 1,581 | 10,984 | +595% | 0 | 0 | — |
DecimalAI ran this skill against gemini-3.6-flash twice over the same eval suite — once with the skill loaded and once without — and compared the two runs case by case. 24 cases were attempted. The headline lift of +29 percentage points is the difference between those two pass rates over the 24 comparable cases.
Without the skill loaded, the model failed this case. With it loaded, the same prompt on the same model passed. This is one improved case from the latest verified run; every case, including any that regressed, is in the table above.
Other measured skills in the registry, with their headline benchmark lift.