Systematic framework for evaluating scholarly and research work based on the ScholarEval methodology. This skill should be used when assessing research papers, evaluating literature reviews, scoring research methodologies, analyzing scientific writing quality, or applying structured evaluation criteria to academic work. Provides comprehensive assessment across multiple dimensions including problem formulation, literature review, methodology, data collection, analysis, results interpretation, and
SkillScore82Maintained
Automatic
◆Research pack
Last verified 8/21/2026
What it changes
Passed 18 of 22 test cases with the skill, and 13 of 22 without it.
Without skill59%
With skill82%
Checks it passed that the model alone missed
Uses a 5-point quality scale ranging from 1 (Poor) to 5 (Excellent) for section ratings
Directs the user to references/evaluation_framework.md for detailed criteria and rubrics
Rejects 100-point or letter grade scales in favor of a 5-point scale where 1 is Poor and 5 is Excellent
and 4 more in the full report
6 fixed12 passed either way3 still failing1 broke
Pass-rate lift
+23 pp
Tokens
+74%
Agent turns
0%
Response time
-31%
Model gemini-3.6-flashMeasured 8/21/2026v118 of 22 cases passed with skill
Tokens, turns and time describe resource use, not a dollar price.
See it in action
One of 6 test cases the skill fixed. Same model, same prompt, with and without the skill.
1 of 6
Prompt
Which primary peer-reviewed literature paper introduced the ScholarEval retrieval-augmented evaluation framework for assessing research ideas based on soundness and contribution?
What was checked, without and with the skill
Checked
Without skill
With skill
Cites the paper by Moussa et al. (2025) titled ScholarEval: Research Idea Evaluation Grounded in Literature
Missed
Passed
case-10 · gemini-3.6-flash · 8/21/2026 · answers are capped and redacted
What's inside
The instructions your model reads when the skill loads.
SKILL.md232 lines3 filesincludes scripts
Scholar Evaluation
Overview
Apply the ScholarEval framework to systematically evaluate scholarly and research work. This skill provides structured evaluation methodology based on peer-reviewed research assessment criteria, enabling comprehensive analysis of academic papers, research proposals, literature reviews, and scholarly writing across multiple quality dimensions.
When to Use This Skill
Use this skill when:
Evaluating research papers for quality and rigor
Assessing literature review comprehensiveness and quality
Reviewing research methodology design
Scoring data analysis approaches
Evaluating scholarly writing and presentation
Providing structured feedback on academic work
Benchmarking research quality against established criteria
Evaluation Workflow
Step 1: Initial Assessment and Scope Definition
Begin by identifying the type of scholarly work being evaluated and the evaluation scope:
Work Types:
Full research paper (empirical, theoretical, or review)
Research proposal or protocol
Literature review (systematic, narrative, or scoping)
Thesis or dissertation chapter
Conference abstract or short paper
Evaluation Scope:
Comprehensive (all dimensions)
Targeted (specific aspects like methodology or writing)
Comparative (benchmarking against other work)
Ask the user to clarify if the scope is ambiguous.
Step 2: Dimension-Based Evaluation
Systematically evaluate the work across the ScholarEval dimensions. For each applicable dimension, assess quality, identify strengths and weaknesses, and provide scores where appropriate.