▸case-22 Perform an academic evaluation of an ecology paper studying coral bleaching. Give an overall assessment where confidence is measured as a percentage (e.g. 90% confidence). | pass→pass | — | — | — | — | — | — | — | — | — | — | — | — |
▸case-07 I have written an empirical trial paper on a new hypertension drug trial. I only want you to evaluate the Methodology and Data & Evidence dimensions of my paper, as I already had the introduction reviewed. Provide a targeted evaluation report. | fail→pass | — | — | — | — | — | — | — | — | — | — | — | — |
▸case-08 Compare two preprint manuscripts on quantum key distribution protocols, 'QKD-Alpha' and 'QKD-Beta'. I want a comparative academic evaluation comparing their methodology, evidence, and security claim rigor, scoring both on a 5-point scale. | fail→fail | — | — | — | — | — | — | — | — | — | — | — | — |
▸case-11 Conduct a scholar evaluation on a theoretical astrophysics paper deriving dark matter annihilation cross-sections. The paper has no empirical clinical data or human participants. Should the data and methodology sections be penalized for lacking empirical sample sizes? | fail→pass | — | — | — | — | — | — | — | — | — | — | — | — |
▸case-14 Evaluate a manuscript on solid-state battery electrolytes where the abstract claims a 10x energy density increase, but the results section only demonstrates a 1.5x increase in laboratory tests. Provide a complete evaluation report. | fail→pass | — | — | — | — | — | — | — | — | — | — | — | — |
▸case-19 Evaluate an epidemiological paper studying asthma prevalence in urban cohorts where 35% of participant survey responses were missing, but the authors dropped missing records without discussing selection bias or imputation. Deliver an evaluation report. | fail→fail | — | — | — | — | — | — | — | — | — | — | — | — |
▸case-16 Evaluate a narrative review manuscript on micro-RNA markers in oncology. The text simply lists study after study chronologically without synthesizing common findings or pointing out gaps. Provide a full scholar evaluation. | fail→pass | — | — | — | — | — | — | — | — | — | — | — | — |
▸case-18 Evaluate a submission to Nature Materials regarding perovskite solar cell stability. The authors claim that because the paper is targeted for a top-tier journal with famous co-authors, the analysis and evidence can be assumed flawless. How should this paper be evaluated? | fail→fail | — | — | — | — | — | — | — | — | — | — | — | — |
▸case-21 Provide a scholar evaluation report for a computer vision draft on object detection in low-light conditions. Ensure all standard evaluation sections are included. | fail→pass | — | — | — | — | — | — | — | — | — | — | — | — |
▸case-03 I have drafted a systematic literature review on microplastic detection methods in coastal marine ecosystems. Please complete a thorough scientific critique of this draft. Organize your feedback into an evaluation report that provides an overall score and summary, a detailed rubric table scoring areas like methodology, analysis, and citations, a section pointing out major critical issues, and specific guidelines on concrete next edits. | fail→fail | — | — | — | — | — | — | — | — | — | — | — | — |
▸case-20 Critique a history of medicine manuscript that cites secondary review papers for original experimental discoveries made in the 1950s instead of primary historical papers. Evaluate this under the citations criteria. | fail→fail | — | — | — | — | — | — | — | — | — | — | — | — |
▸case-15 Critique the methodology section of a bioinformatics manuscript on RNA-seq pipeline optimization. The authors describe their algorithm conceptually but omit software versions, random seed settings, and dataset repository links. Score this manuscript. | fail→pass | — | — | — | — | — | — | — | — | — | — | — | — |
▸case-01 I am preparing to submit a manuscript titled 'Evaluating Transformer Compression in Edge Computing Environments' to a peer-reviewed journal. Please conduct a rigorous academic evaluation on the draft text below. I need a structured evaluation report that includes an overall numerical assessment with a confidence rating, a breakdown table evaluating distinct research dimensions along with evidence and revision priorities, followed by dedicated sections for critical dealbreakers, actionable revisions, and statements that require evidence checks. | fail→fail | — | — | — | — | — | — | — | — | — | — | — | — |
▸case-12 Assess a technical report on large language model safety red-teaming. The report relies heavily on preprints and arXiv papers published in the last 6 months. How should these citation sources be evaluated? | fail→fail | — | — | — | — | — | — | — | — | — | — | — | — |
▸case-06 Please proofread and copyedit this abstract for a paper on CRISPR-Cas9 gene editing off-target effects. Fix any grammatical errors, passive voice overuse, and typos, while keeping the technical meaning intact. | fail→fail | — | — | — | — | — | — | — | — | — | — | — | — |
▸case-13 Evaluate a 500-word extended abstract for an IEEE robotics conference regarding autonomous drone navigation in GPS-denied environments. Give me an assessment report with overall score, confidence, and dimension table. | pass→pass | — | — | — | — | — | — | — | — | — | — | — | — |
▸case-04 I am formatting the bibliography for my neuroscience manuscript on hippocampal LTP. Please convert these five references into correct APA 7th edition citation style and format the in-text citations. | fail→fail | — | — | — | — | — | — | — | — | — | — | — | — |
▸case-02 Could you perform a scholar-style evaluation on my PhD dissertation chapter regarding decentralized ledger privacy protocols? Deliver your critique as a Markdown report containing an overall assessment summary, a dimension-by-dimension scoring table with supporting rationale, a list of critical blockers that could threaten validity, and a prioritized list of suggested edits before I submit this to my advisor. | fail→pass | — | — | — | — | — | — | — | — | — | — | — | — |
▸case-10 Evaluate Chapter 3 of my sociology thesis on urban gentrification. Pay special attention to whether my cited literature actually supports my claims about demographic shifts. Provide a structured evaluation report. | fail→fail | — | — | — | — | — | — | — | — | — | — | — | — |
▸case-05 Write a formal author response letter to Peer Reviewer 2, who asked for additional baseline experiments on our graph neural network paper 'GNN-Fast'. I want to politely explain why the baseline comparison was omitted due to dataset incompatibilities. | fail→fail | — | — | — | — | — | — | — | — | — | — | — | — |
▸case-09 Evaluate my grant proposal titled 'AI-Assisted Triage in Emergency Departments'. I am worried the reviewers will reject it over ethical considerations and privacy risks. Rate the research question, methodology, data, analysis, and limitations on a 1-10 rating, with a decimal confidence score like 0.85. | fail→fail | — | — | — | — | — | — | — | — | — | — | — | — |
▸case-17 Review a psychology study evaluating cognitive therapy outcomes. The authors performed multiple hypothesis testing across 40 variables without applying p-value corrections or reporting effect sizes. Provide a scholar evaluation report. | fail→fail | — | — | — | — | — | — | — | — | — | — | — | — |