▸case-06 We want to test the claim that replacing live customer support agents with an AI chatbot decreases customer satisfaction scores by more than 10%. Please carry out a full research protocol execution for this claim. Provide the formalized hypothesis statement, experimental design, key data sources, confounding variables, evidence pros and cons, a final verdict with confidence level, and actionable recommendations. | pass→pass | 24,713 | 30,153 | +22% | 1 | 1 | 0% | 3,890 | 5,139 | +32% | 0 | 0 | — |
▸case-07 Evaluate the claim that using adjustable standing desks for at least 3 hours per workday reduces lower back pain intensity in office workers over a 12-week period. Many managers assume any ergonomics produce identical outcomes, so run a thorough research test with protocol design, evidence analysis, confounders, verdict, and next steps. | pass→pass | 23,751 | 29,663 | +25% | 1 | 1 | 0% | 3,995 | 5,324 | +33% | 0 | 0 | — |
▸case-01 Write a Python script using scipy.stats to run a two-sample t-test on two lists of numerical data representing test scores, returning the calculated t-statistic and p-value. | pass→pass | 6,968 | 19,401 | +178% | 1 | 1 | 0% | 1,356 | 3,384 | +150% | 0 | 0 | — |
▸case-02 Provide a standard narrative literature review summarizing existing published academic research on the cognitive effects of sleep deprivation in medical residents, focusing on working memory and reaction time. | pass→pass | 26,943 | 27,075 | +0% | 1 | 1 | 0% | 4,041 | 4,437 | +10% | 0 | 0 | — |
▸case-03 Draft a 5-question Likert-scale survey questionnaire for gathering customer feedback on a mobile banking application's user interface. | pass→pass | 7,710 | 10,999 | +43% | 1 | 1 | 0% | 1,288 | 2,065 | +60% | 0 | 0 | — |
▸case-04 I want to test the claim that implementing a 4-day workweek increases overall employee productivity in software engineering teams. Please design and run a complete research protocol to evaluate this. I need you to state the hypothesis, outline the study design and required data sources, note potential confounding factors, summarize evidence both for and against, deliver a final verdict with a confidence rating, and outline actionable next steps in a recommendations section. | pass→pass | 30,923 | 30,020 | -3% | 1 | 1 | 0% | 4,654 | 4,690 | +1% | 0 | 0 | — |
▸case-05 Can you scientifically evaluate the hypothesis that taking 500mg of Vitamin C daily reduces the duration of common cold symptoms in adults? Please execute a research analysis on this statement. Include the study methodology, data sources, potential confounders, a balanced summary of evidence, a confidence score for your verdict, and concrete recommendations for further validation. | pass→pass | 21,446 | 21,566 | +1% | 1 | 1 | 0% | 3,461 | 3,672 | +6% | 0 | 0 | — |
▸case-08 Run a research protocol evaluation on the hypothesis that consuming 200mg of caffeine prior to morning aerobic exercise increases fat oxidation rate during steady-state cardio in healthy adults. Some fitness blogs claim caffeine has no measurable effect on metabolism, so analyze the evidence rigorously, outline design, data sources, confounders, verdict, and recommendations. | pass→pass | 23,008 | 24,926 | +8% | 1 | 1 | 0% | 4,158 | 5,058 | +22% | 0 | 0 | — |
▸case-09 Design and execute a research evaluation testing whether adding digital achievement badges to a language learning app increases 30-day user retention by at least 15%. Stakeholders assume gamification always works universally, so provide a scientific protocol execution with confounding factors, data sources, verdict confidence, and recommendations. | pass→pass | 31,760 | 23,460 | -26% | 1 | 1 | 0% | 6,201 | 5,149 | -17% | 0 | 0 | — |
▸case-10 Evaluate the hypothesis that software engineering organizations operating on a 3-day in-office hybrid model achieve 20% faster deployment velocity than fully remote teams. Run a full scientific research protocol evaluation, detailing required data sources, confounding variables, evidence for and against, verdict, and recommendations. | pass→pass | 31,713 | 30,874 | -3% | 1 | 1 | 0% | 4,936 | 5,137 | +4% | 0 | 0 | — |
▸case-11 Perform a complete research protocol assessment on the claim that 3-minute cold water immersion at 10 degrees Celsius immediately post-workout reduces delayed onset muscle soreness (DOMS) at 24 hours. Evaluate the evidence, confounding variables, sample size considerations, data sources, and provide a verdict with recommendations. | fail→pass | 21,043 | 22,756 | +8% | 1 | 1 | 0% | 3,851 | 4,189 | +9% | 0 | 0 | — |
▸case-12 Test the hypothesis that breaking corporate compliance training into 5-minute daily micro-learning modules yields higher 90-day knowledge retention than a single 2-hour annual webinar. Run the complete research protocol evaluation including data sources, confounders, evidence summary, verdict, and actionable next steps. | pass→pass | 20,644 | 23,315 | +13% | 1 | 1 | 0% | 3,683 | 4,553 | +24% | 0 | 0 | — |
▸case-13 Execute a research protocol analysis on the hypothesis that 15 minutes of daily guided mindfulness meditation via a smartphone app lowers systolic blood pressure in adults with stage 1 hypertension after 8 weeks. Examine data sources, potential confounders, evidence balance, verdict confidence, and next steps. | pass→pass | 18,566 | 20,322 | +9% | 1 | 1 | 0% | 3,366 | 3,953 | +17% | 0 | 0 | — |
▸case-14 Run a research evaluation on the claim that requiring two peer reviewers for every pull request reduces critical production bugs by 30% compared to single-reviewer workflows in cloud software development. Design and execute the evaluation with data sources, confounders, evidence, verdict, and next steps. | fail→pass | 23,033 | 28,934 | +26% | 1 | 1 | 0% | 3,872 | 5,458 | +41% | 0 | 0 | — |
▸case-15 Evaluate the claim that wearing blue-light blocking glasses 2 hours before bed reduces sleep onset latency in adults who use digital screens in the evening. Execute a full scientific research protocol analysis detailing methodology, confounders, evidence summary, verdict with confidence score, and recommendations. | pass→pass | 27,819 | 23,285 | -16% | 1 | 1 | 0% | 4,539 | 4,611 | +2% | 0 | 0 | — |
▸case-16 Test the claim that enabling system-wide OLED dark mode on smartphones increases battery endurance by at least 15% during web browsing. Execute a research evaluation covering study design, key data sources, confounding factors, evidence balance, verdict confidence, and recommendations. | pass→pass | 28,534 | 21,015 | -26% | 1 | 1 | 0% | 4,746 | 4,125 | -13% | 0 | 0 | — |
▸case-17 Analyze the hypothesis that holding daily 15-minute standing scrum meetings decreases project delivery delays by 25% in IT infrastructure projects. Execute a comprehensive research assessment detailing data sources, confounders, evidence summary, verdict, and next steps. | pass→pass | 24,791 | 25,313 | +2% | 1 | 1 | 0% | 4,010 | 4,391 | +10% | 0 | 0 | — |
▸case-18 Conduct a research protocol execution on the claim that daily 5g creatine monohydrate supplementation improves working memory test scores in sleep-deprived healthy young adults. Provide the research protocol execution including data sources, confounding variables, pros/cons evidence, verdict confidence, and next steps. | pass→pass | 27,532 | 27,430 | -0% | 1 | 1 | 0% | 4,164 | 4,793 | +15% | 0 | 0 | — |
▸case-19 Evaluate the hypothesis that continuous pair programming reduces defect density in complex backend service development by at least 20% relative to solo development. Run a research evaluation detailing research design, data sources, potential confounders, evidence summary, verdict, and next steps. | pass→pass | 21,148 | 22,318 | +6% | 1 | 1 | 0% | 3,633 | 4,127 | +14% | 0 | 0 | — |
▸case-20 Execute a research evaluation of the hypothesis that a 16:8 time-restricted feeding schedule improves fasting insulin sensitivity in overweight adults after 12 weeks. Provide research design, data sources, confounders, evidence breakdown, verdict confidence, and recommendations. | pass→pass | 22,806 | 23,772 | +4% | 1 | 1 | 0% | 3,923 | 4,742 | +21% | 0 | 0 | — |
▸case-21 Design and execute a research evaluation on the hypothesis that installing pink noise sound masking systems in open-plan office spaces increases focused work duration by 20%. Include data sources, confounders, evidence summary, verdict, confidence level, and actionable recommendations. | pass→pass | 21,019 | 29,517 | +40% | 1 | 1 | 0% | 3,150 | 5,104 | +62% | 0 | 0 | — |
▸case-22 Evaluate the claim that utilizing spaced repetition algorithm flashcards yields 40% higher 6-month vocabulary retention in second-language learners compared to traditional massed cramming. Perform a research analysis with design, sources, confounders, evidence summary, verdict, and recommendations. | pass→pass | 25,667 | 29,739 | +16% | 1 | 1 | 0% | 4,520 | 5,670 | +25% | 0 | 0 | — |