Evaluate research rigor. Assess methodology, experimental design, statistical validity, biases, confounding, evidence quality (GRADE, Cochrane ROB), for critical analysis of scientific claims.
SkillScore95Maintained
Automatic
◆Research pack
Last verified 8/21/2026
What it changes
Passed 21 of 22 test cases with the skill, and 20 of 22 without it.
Without skill91%
With skill95%
Checks it passed that the model alone missed
Recommends reporting confidence intervals to evaluate plausible effect sizes.
1 fixed20 passed either way1 still failing0 broke
Pass-rate lift
+5 pp
Tokens
+205%
Agent turns
0%
Response time
-8%
Model gemini-3.6-flashMeasured 8/21/2026v121 of 22 cases passed with skill
Tokens, turns and time describe resource use, not a dollar price.
See it in action
A test case the skill fixed. Same model, same prompt, with and without the skill.
Prompt
A clinical study comparing Cognitive Behavioral Therapy to active control for post-concussion symptoms (N=30 per arm) found a symptom reduction score of 4.2 in CBT vs 3.1 in control (p = 0.08). The authors concluded: 'CBT has no therapeutic effect on post-concussion symptoms.' Evaluate the validity of the authors' conclusion.
What was checked, without and with the skill
Checked
Without skill
With skill
Identifies the conclusion as a statistical error that mistakes failure to reject the null hypothesis for proof of no effect.
Passed
Passed
Recommends reporting confidence intervals to evaluate plausible effect sizes.
Missed
Passed
case-04 · gemini-3.6-flash · 8/21/2026 · answers are capped and redacted
What's inside
The instructions your model reads when the skill loads.
SKILL.md525 lines7 files
Scientific Critical Thinking
Overview
Critical thinking is a systematic process for evaluating scientific rigor. Assess methodology, experimental design, statistical validity, biases, confounding, and evidence quality using GRADE and Cochrane ROB frameworks. Apply this skill for critical analysis of scientific claims.
When to Use This Skill
This skill should be used when:
Evaluating research methodology and experimental design
Assessing statistical validity and evidence quality
Identifying biases and confounding in studies
Reviewing scientific claims and conclusions
Conducting systematic reviews or meta-analyses
Applying GRADE or Cochrane risk of bias assessments
Providing critical analysis of research papers
Core Capabilities
1. Methodology Critique
Evaluate research methodology for rigor, validity, and potential flaws.
Apply when:
Reviewing research papers
Assessing experimental designs
Evaluating study protocols
Planning new research
Evaluation framework:
Study Design Assessment
Is the design appropriate for the research question?
Can the design support causal claims being made?
Are comparison groups appropriate and adequate?
Consider whether experimental, quasi-experimental, or observational design is justified
Validity Analysis
Internal validity: Can we trust the causal inference?