▸case-01 I am researching quantum computing algorithms for optimization problems. Can you structure my initial research notes for this topic into a clear summary? Make sure to organize the discoveries with source metadata and confidence labels, outline any conflicting statements between references, and highlight areas where evidence is currently lacking. | fail→fail | 22,186 | 13,208 | -40% | 1 | 1 | 0% | 3,606 | 2,966 | -18% | 0 | 0 | — |
▸case-02 Please help me plan and execute a multi-phase investigation on recent breakthroughs in solid-state battery technology. Conduct broad discovery followed by targeted verification, then structure the findings into key takeaways with source references and confidence levels, noted contradictions across literature, and identified research gaps. | fail→fail | 18,207 | 6,528 | -64% | 1 | 1 | 0% | 2,932 | 903 | -69% | 0 | 0 | — |
▸case-03 I need to evaluate a set of sources I gathered regarding global microchip supply chain vulnerabilities. Can you assess these references against standard source credibility benchmarks, rate their reliability based on author credentials and publication recency, and synthesize the verified facts into structured notes highlighting confidence levels and discrepancies? | fail→fail | 7,274 | 4,838 | -33% | 1 | 1 | 0% | 1,312 | 1,337 | +2% | 0 | 0 | — |
▸case-04 I am beginning a research project on CRISPR gene editing application safety. I want to plan my initial broad discovery search strategy before doing deep dives. What specific approach and targets should I focus on during this initial phase? | fail→pass | 14,268 | 11,887 | -17% | 1 | 1 | 0% | 2,529 | 2,588 | +2% | 0 | 0 | — |
▸case-05 After completing broad searches on grid-scale vanadium redox flow batteries, I am ready for phase two to collect exact performance metrics and technical details. How should I execute this specific phase? | pass→pass | 18,239 | 13,132 | -28% | 1 | 1 | 0% | 2,876 | 2,943 | +2% | 0 | 0 | — |
▸case-06 I have gathered several economic forecasts regarding carbon taxation impact. I am entering phase three to verify these findings before writing my final report. What specific checks belong in this phase? | fail→pass | 13,563 | 13,654 | +1% | 1 | 1 | 0% | 2,347 | 2,811 | +20% | 0 | 0 | — |
▸case-07 I have five source types discussing autonomous vehicle collision liability: a peer-reviewed IEEE journal article, a US Department of Transportation official doc, a Reuters news article, an expert robotics blog post, and a Reddit forum thread. In what order should these be ranked for inherent reliability? | pass→pass | 10,707 | 5,320 | -50% | 1 | 1 | 0% | 1,941 | 1,513 | -22% | 0 | 0 | — |
▸case-08 In my research on room-temperature superconductor claims, I found a single highly authoritative peer-reviewed Nature journal paper making a specific claim. No other authoritative source has evaluated it yet. What confidence label should I attach to this finding in my note file? | fail→pass | 10,260 | 3,935 | -62% | 1 | 1 | 0% | 1,608 | 1,194 | -26% | 0 | 0 | — |
▸case-09 While investigating mRNA vaccine oncology efficacy, I found three separate peer-reviewed medical journal papers that all report the same clinical trial response rate. What confidence rating should be assigned to this finding? | fail→pass | 11,807 | 6,360 | -46% | 1 | 1 | 0% | 2,079 | 1,541 | -26% | 0 | 0 | — |
▸case-10 In my investigation of GPU architecture optimizations, I found a single personal blog post claiming a 40% speedup, with no other confirming sources. What confidence label applies here? | pass→pass | 6,128 | 3,657 | -40% | 1 | 1 | 0% | 1,012 | 1,080 | +7% | 0 | 0 | — |
▸case-11 While researching fusion reactor energy gain ratios, I found two news outlets citing directly contradictory experimental yield numbers from the same facility run. What confidence tag should be assigned to this claim? | pass→pass | 8,775 | 4,576 | -48% | 1 | 1 | 0% | 1,552 | 1,288 | -17% | 0 | 0 | — |
▸case-12 While researching legacy software configuration workarounds, three separate user posts on Stack Overflow share the exact same user-tested solution without official vendor documentation backing. What confidence rating should be applied? | fail→pass | 9,617 | 4,099 | -57% | 1 | 1 | 0% | 1,647 | 1,289 | -22% | 0 | 0 | — |
▸case-13 I am evaluating a white paper published by a diagnostic imaging company claiming 99% AI accuracy. What checklist criteria should I use to systematically rate this source? | fail→fail | 14,627 | 13,506 | -8% | 1 | 1 | 0% | 2,477 | 2,904 | +17% | 0 | 0 | — |
▸case-14 I am reviewing a 2024 article discussing enterprise ransomware trends. The article bases its core statistics on a survey published in 2017. What specific research pitfall does this represent? | pass→pass | 7,776 | 3,477 | -55% | 1 | 1 | 0% | 1,257 | 1,047 | -17% | 0 | 0 | — |
▸case-15 I came across an online article analyzing DeFi protocol market security that makes numerical claims about past hack losses but provides zero citations or source links. How should I treat this source under methodology rules? | pass→pass | 13,894 | 9,733 | -30% | 1 | 1 | 0% | 2,149 | 2,099 | -2% | 0 | 0 | — |
▸case-16 A research summary notes that students who used a specific math software application scored higher on standardized tests than non-users, concluding that the software caused the improvement. What critical analytical flaw should be noted? | pass→pass | 6,145 | 5,290 | -14% | 1 | 1 | 0% | 1,095 | 1,423 | +30% | 0 | 0 | — |
▸case-17 A preliminary study with 12 human subjects reports significant reductions in blood pressure from a plant extract supplement. What key limitation should be documented in the research notes? | pass→pass | 6,084 | 4,867 | -20% | 1 | 1 | 0% | 1,108 | 1,392 | +26% | 0 | 0 | — |
▸case-18 I need to set up a research note file in markdown for offshore wind turbine policy in Northern Europe. Produce a populated note template following systematic note-taking rules, including sub-topic title, key findings with full metadata and confidence tags, contradictions, and missing data areas. | fail→pass | 19,276 | 8,968 | -53% | 1 | 1 | 0% | 3,345 | 2,177 | -35% | 0 | 0 | — |
▸case-19 In my literature review on nuclear thermal propulsion, NASA official specs list a specific impulse of 900 seconds, whereas an independent defense blog states it cannot exceed 750 seconds. Under what section header should this discrepancy be recorded in the note template? | fail→fail | 10,428 | 3,090 | -70% | 1 | 1 | 0% | 1,427 | 1,049 | -26% | 0 | 0 | — |
▸case-20 During research on deep sea mining environmental impacts, extensive searches turned up no empirical data on benthic plume recovery timelines. Where should this absence of data be recorded in the markdown note template? | fail→pass | 9,006 | 3,317 | -63% | 1 | 1 | 0% | 1,495 | 1,030 | -31% | 0 | 0 | — |
▸case-21 I have gathered 500 customer satisfaction survey responses in a CSV file. Can you write a Python script using SciPy to perform a two-sample t-test comparing group A and group B scores? | pass→pass | 9,539 | 11,136 | +17% | 1 | 1 | 0% | 2,094 | 2,856 | +36% | 0 | 0 | — |
▸case-22 I have written a research paper on solar cell efficiency degradation and want to submit it to the Journal of Materials Chemistry. Please draft a formal cover letter to the Editor-in-Chief introducing our submission. | pass→pass | 9,835 | 9,343 | -5% | 1 | 1 | 0% | 1,684 | 2,198 | +31% | 0 | 0 | — |
▸case-23 I need to write a laboratory bench protocol for extracting plasmid DNA from E. coli cultures using alkaline lysis. What chemical reagents and centrifugation steps are required? | pass→pass | 14,680 | 14,539 | -1% | 1 | 1 | 0% | 2,909 | 3,219 | +11% | 0 | 0 | — |