▸case-07 I need a research protocol for a nationwide online survey study on remote worker ergonomics conducted by Cornell University. Because we are using an open web link where sample size depends on response rates, do not include a sample size basis or power calculation, just generate the full protocol document. | fail→pass | 23,234 | 25,940 | +12% | 1 | 1 | 0% | 3,456 | 5,193 | +50% | 0 | 0 | — |
▸case-01 I am writing a study proposal for the NIMH and need a complete formal research protocol for a clinical trial. We are investigating whether a novel mobile cognitive behavioral therapy app reduces anxiety symptoms in adolescents aged 13-17 in outpatient pediatric clinics compared to standard care over an 18-month timeline. Please generate the full research protocol document covering background rationale, explicit research objectives, study design details, participant selection with sample size justification, intervention methodology, outcome measures, data management, pre-specified statistical analysis, ethical safeguards, dissemination strategy, and a structured phase-by-phase timeline table. | fail→fail | 59,438 | 52,284 | -12% | 1 | 1 | 0% | 8,309 | 7,780 | -6% | 0 | 0 | — |
▸case-02 Help me draft a formal research protocol for a qualitative social science study funded by the Robert Wood Johnson Foundation at the University of Chicago. The research question explores factors influencing burnout and retention among rural community health workers in Illinois through semi-structured interviews and focus groups across a 12-month period. Output a structured research protocol detailing the study background, single primary research question, qualitative design rationale, participant inclusion/exclusion criteria with sample saturation rationale, data collection procedures, qualitative analysis framework, data privacy controls, ethics plan, dissemination targets, and a phased project timeline grid. | fail→pass | 54,127 | 39,899 | -26% | 1 | 1 | 0% | 8,302 | 6,025 | -27% | 0 | 0 | — |
▸case-03 I need a complete research protocol for an observational prospective cohort study at Emory University, supported by CDC funding over 24 months. We are assessing the relationship between night-shift work schedules and subclinical cardiovascular markers in hospital nurses. Please formulate a standard research protocol document that includes background/gap analysis, primary and secondary objectives, study design rationale, participant selection, measurement protocols, data retention and access rules, pre-specified analysis plan, ethical approval details, dissemination plan, and a timeline table. | pass→pass | 54,733 | 52,142 | -5% | 1 | 1 | 0% | 8,288 | 8,840 | +7% | 0 | 0 | — |
▸case-04 I am designing a qualitative study at Stanford University examining physician responses to AI diagnostic tools in emergency departments over 12 months. Since we are still selecting software tools, can you mark the analysis plan as "to be determined after data collection" and output the rest of the research protocol document? | fail→pass | 21,106 | 29,851 | +41% | 1 | 1 | 0% | 2,477 | 4,746 | +92% | 0 | 0 | — |
▸case-05 We are launching a Phase II randomized controlled trial testing a novel anti-inflammatory agent for rheumatoid arthritis at Mayo Clinic over 2 years. I want the research objectives section to list three simultaneous primary questions combined with our mechanistic hypothesis. Please draft the research protocol document. | fail→fail | 40,127 | 35,775 | -11% | 1 | 1 | 0% | 5,099 | 5,460 | +7% | 0 | 0 | — |
▸case-06 Please draft a formal protocol for a systematic review and meta-analysis examining the efficacy of mindfulness-based stress reduction for chronic pain, funded by NCI at Harvard Medical School. Since this study synthesizes existing published literature without direct human subject contact, please skip Section 9 on ethical considerations. | fail→pass | 37,733 | 36,706 | -3% | 1 | 1 | 0% | 4,759 | 6,287 | +32% | 0 | 0 | — |
▸case-08 Draft a research protocol for a prospective cohort study investigating dietary sodium intake and hypertension risk in urban adults over 5 years at Columbia University. For the outcomes section, just list blood pressure and sodium excretion as variables without detailing specific measurement methods or timepoints. | pass→pass | 26,778 | 24,924 | -7% | 1 | 1 | 0% | 3,178 | 4,314 | +36% | 0 | 0 | — |
▸case-09 Create a formal research protocol for a single-blind RCT evaluating digital hearing aids in older adults at Vanderbilt University funded by NIH over 18 months. Please combine the background rationale and research objectives into a single unnumbered paragraph. | pass→fail | 32,449 | 33,610 | +4% | 1 | 1 | 0% | 4,412 | 5,728 | +30% | 0 | 0 | — |
▸case-10 We are conducting a mixed-methods study on community health access at UNC Chapel Hill over 12 months. Please produce a research protocol, but leave data storage retention duration open without specifying years since university policies are updating. | fail→fail | 30,039 | 24,760 | -18% | 1 | 1 | 0% | 3,792 | 4,667 | +23% | 0 | 0 | — |
▸case-11 Generate a research protocol for an observational study on adolescent sleep habits at Northwestern University over 15 months. For the timeline section, please present it as a bulleted list of quarters Q1 through Q5 instead of a phase table. | fail→fail | 46,863 | 35,794 | -24% | 1 | 1 | 0% | 6,751 | 6,130 | -9% | 0 | 0 | — |
▸case-12 Write a research protocol for a qualitative study on nursing turnover during hospital restructuring at Duke Health. In the dissemination section, list only academic journal names and omit conference or public summaries. | fail→fail | 25,534 | 25,328 | -1% | 1 | 1 | 0% | 3,301 | 4,280 | +30% | 0 | 0 | — |
▸case-13 Draft a research protocol for a multi-center clinical trial testing a pediatric diabetes management app at Children's Hospital of Philadelphia. Jump straight into the background text without including version number, date, or Principal Investigator headers. | fail→fail | 40,140 | 33,611 | -16% | 1 | 1 | 0% | 5,768 | 5,333 | -8% | 0 | 0 | — |
▸case-14 I am principal investigator for a case-control study at Yale University examining genetic markers for early-onset stroke over 3 years. Please prepare a complete research protocol document, but omit exclusion criteria since cases and controls are age-matched. | fail→fail | 31,305 | 32,691 | +4% | 1 | 1 | 0% | 3,780 | 6,409 | +70% | 0 | 0 | — |
▸case-15 Draft a research protocol for a qualitative grounded theory study investigating patient decision-making in rare disease trials at UPenn. In the analysis plan, state that coding will be completely open and emergent without naming any formal analysis framework or quality assurance steps. | fail→pass | 13,645 | 37,295 | +173% | 1 | 1 | 0% | 2,017 | 5,488 | +172% | 0 | 0 | — |
▸case-16 Produce a formal research protocol for a community-based physical activity trial in senior centers funded by PCORI over 24 months. Ensure the protocol includes the document body as well as the standard verification checklist at the end. | fail→pass | 58,049 | 39,136 | -33% | 1 | 1 | 0% | 8,233 | 6,029 | -27% | 0 | 0 | — |
▸case-17 Write a research protocol for a systematic review examining tele-rehabilitation outcomes in post-stroke patients at UCSF over 9 months. For the analysis plan, state that synthesis methods will be chosen after screening studies. | fail→fail | 22,927 | 26,580 | +16% | 1 | 1 | 0% | 2,926 | 4,295 | +47% | 0 | 0 | — |
▸case-18 Generate a research protocol for a cross-sectional survey evaluating medical student burnout at University of Michigan over 6 months. In section 8, state "statistical tests will be determined post-hoc after evaluating data normality". | fail→pass | 10,398 | 31,686 | +205% | 1 | 1 | 0% | 1,739 | 4,783 | +175% | 0 | 0 | — |
▸case-19 Draft a research protocol for an RCT comparing two surgical techniques for knee arthroplasty at Cleveland Clinic over 3 years. Merge primary and secondary endpoints into a single un-categorized outcomes list. | fail→fail | 38,983 | 38,759 | -1% | 1 | 1 | 0% | 4,545 | 7,172 | +58% | 0 | 0 | — |
▸case-20 I am conducting a pediatric clinical trial on pediatric asthma management at Johns Hopkins. Draft a participant-facing Informed Consent Form (ICF) written at an 8th-grade reading level for parents/guardians, explaining voluntary participation, study procedures, potential risks, confidentiality, and contact info. | pass→pass | 27,026 | 27,295 | +1% | 1 | 1 | 0% | 2,963 | 4,164 | +41% | 0 | 0 | — |
▸case-21 I am acting as a peer reviewer for the Journal of Clinical Epidemiology evaluating a submitted observational cohort manuscript on sleep apnea. Please write a formal peer review report detailing major methodological concerns, statistical critiques, and minor revision recommendations for the authors. | pass→pass | 119,369 | 31,655 | -73% | 1 | 1 | 0% | 3,437 | 4,175 | +21% | 0 | 0 | — |
▸case-22 I need a 300-word public lay summary for an NIH R01 grant application on novel biomarkers for early-stage Alzheimer's disease. The summary must explain the public health significance, project goals, and expected impact in non-technical language for a general audience. | pass→pass | 16,706 | 15,898 | -5% | 1 | 1 | 0% | 1,434 | 2,244 | +56% | 0 | 0 | — |