▸case-01 I am trying to write a master's thesis proposal on training a custom 70B parameter LLM from scratch specifically for localized financial sentiment analysis, but I only have 4 months and access to a single RTX 4090 GPU. My initial topic is way too ambitious for my available setup. Can you help me adapt this research question into something practical that I can actually execute? I need a revised research focus that preserves the underlying value, along with a clear summary of what trade-offs I am accepting. | fail→pass | 20,631 | 34,922 | +69% | 1 | 1 | 0% | 3,604 | 4,425 | +23% | 0 | 0 | — |
▸case-02 Our team wanted to conduct a multi-year global field study measuring microplastic ingestion rates across 20 coastal cities, but our grant was severely cut and we only have 6 months before our deadline. Could you re-scope this study focus so that it fits our constrained timeline and limited funding? Please provide a couple of pragmatic alternative directions we could take and specify a realistic final research question. | fail→fail | 15,617 | 17,218 | +10% | 1 | 1 | 0% | 2,426 | 3,571 | +47% | 0 | 0 | — |
▸case-03 We have finalized our research question: 'Does a 12-week low-carbohydrate diet reduce HbA1c levels in type 2 diabetes patients compared to standard care?' We have full funding, 2 years of clinical staff, and 200 enrolled patients. Please draft the statistical analysis plan detailing primary outcome measures, hypothesis testing, and sample size calculations. | pass→fail | 15,449 | 24,985 | +62% | 1 | 1 | 0% | 2,949 | 5,406 | +83% | 0 | 0 | — |
▸case-04 We have a fully feasible, peer-reviewed research project investigating urban heat island mitigation through green roof coverage in Chicago over 1 year with a secured $500,000 grant. Please write the 'Project Significance and Expected Impact' section for our NSF grant application following standard NSF proposal guidelines. | pass→fail | 16,871 | 17,479 | +4% | 1 | 1 | 0% | 2,530 | 3,423 | +35% | 0 | 0 | — |
▸case-05 I need a comprehensive literature review synthesis summarizing the current academic consensus on transformer architecture attention mechanisms in natural language processing from 2017 to 2023. Summarize the major seminal papers and key thematic developments. | pass→pass | 35,417 | 33,266 | -6% | 1 | 1 | 0% | 6,186 | 6,556 | +6% | 0 | 0 | — |
▸case-06 I want to train a 100-billion parameter multimodal vision-language model to diagnose rare dermatological conditions across 500 medical centers, but I only have 2 NVIDIA A100 GPUs and 6 weeks. I am tempted to completely abandon medical AI and just write a literature review. How can I reshape my original research question while maintaining its core research value? | fail→pass | 19,190 | 21,210 | +11% | 1 | 1 | 0% | 3,229 | 4,182 | +30% | 0 | 0 | — |
▸case-07 A university lab wants to study the long-term cognitive impact of sleep deprivation on medical residents over a 10-year cohort study, but the primary investigator's contract ends in 8 months. The team wants to skip feasibility analysis and just run an unapproved 2-month study with 5 students. Help re-formulate the research question properly for an 8-month window. | fail→pass | 13,241 | 17,807 | +34% | 1 | 1 | 0% | 2,201 | 3,290 | +49% | 0 | 0 | — |
▸case-08 A researcher wants to study private internal sales data and real-time customer behavior logs from Amazon to analyze price elasticity during Black Friday, but Amazon refuses to grant API access or release private logs. The researcher considers giving up or using fake synthetic data. How should the research question be reformulated? | fail→pass | 14,639 | 15,954 | +9% | 1 | 1 | 0% | 2,287 | 3,028 | +32% | 0 | 0 | — |
▸case-09 A computer science PhD student wants to develop a novel wet-lab synthetic biology gene-editing algorithm, but has zero biological background and no lab equipment. They are thinking of spending 3 years taking undergraduate biology courses first. How can they adjust their research focus today? | fail→pass | 15,057 | 14,567 | -3% | 1 | 1 | 0% | 2,164 | 2,769 | +28% | 0 | 0 | — |
▸case-10 A consortium wants to deploy sensor networks across 50 Amazon rainforest sites to track biodiversity loss over 5 years. They face severe constraints: 70% budget cut, no satellite data access, tight 1-year window, and no field staff in 40 of the sites. I need a full constraint impact analysis, multiple adjustment options, and a phased deployment plan. | fail→fail | 24,482 | 24,432 | -0% | 1 | 1 | 0% | 3,759 | 4,496 | +20% | 0 | 0 | — |
▸case-11 I have 2 weeks and $0 budget to study high school student engagement with AI tutoring tools. I originally wanted to conduct a nationwide randomized controlled trial across 50 schools. Provide a single pragmatic adjustment option and a direct feasible research question. | fail→fail | 9,078 | 7,768 | -14% | 1 | 1 | 0% | 1,435 | 1,902 | +33% | 0 | 0 | — |
▸case-12 A social science team wants to measure exact direct household income changes across 10,000 rural families following a regional infrastructure project, but tax records are confidential and survey door-to-door costs are prohibitive. The team wants to abandon the study of economic impact entirely. Suggest how to use proxy metrics to preserve the research core. | fail→pass | 17,990 | 16,563 | -8% | 1 | 1 | 0% | 2,612 | 3,447 | +32% | 0 | 0 | — |
▸case-13 I am adjusting my research topic on global climate migration patterns. My original study covered 100 countries over 50 years, but due to a 3-month deadline, I am narrowing it to 1 coastal region over 10 years. Formulate this feasible research question and explicitly articulate what generalizability or scope was sacrificed. | pass→pass | 10,724 | 13,334 | +24% | 1 | 1 | 0% | 1,755 | 2,814 | +60% | 0 | 0 | — |
▸case-14 I am evaluating a revised research proposal on solar panel efficiency degradation in urban microclimates. My original idea was to monitor 1,000 roofs across 10 climate zones, but I only have access to 5 roofs in 1 city. Provide a structured evaluation of this revised focus using the FINER framework, paying special attention to Feasibility. | pass→pass | 16,354 | 14,592 | -11% | 1 | 1 | 0% | 2,600 | 2,942 | +13% | 0 | 0 | — |
▸case-15 Our lab project on drug-target interaction prediction is stalled. We lack high-throughput screening equipment (data constraint), have only 1 GPU node (compute constraint), and must submit our draft in 2 months (time constraint). Categorize these constraints and outline a 4-step adjustment plan. | pass→pass | 13,728 | 17,210 | +25% | 1 | 1 | 0% | 2,292 | 3,511 | +53% | 0 | 0 | — |
▸case-16 A healthcare startup wants to validate an AI diagnostic workflow across 10 major hospital networks, but clinical trial regulatory approval takes 18 months and they need preliminary results in 3 months for seed funding. Should they abandon the study or how can they phase it? | fail→pass | 15,018 | 20,506 | +37% | 1 | 1 | 0% | 2,337 | 3,904 | +67% | 0 | 0 | — |
▸case-17 A graduate student wanted to predict ICU mortality using proprietary real-time telemetry streaming data from a private hospital network, but hospital legal counsel blocked data access. The student wants to change topics to basic NLP sentiment analysis on Twitter. How can the original medical prediction topic be saved using open data? | pass→pass | 14,339 | 18,587 | +30% | 1 | 1 | 0% | 2,351 | 3,742 | +59% | 0 | 0 | — |
▸case-18 Our research group planned to evaluate autonomous vehicle safety across winter weather conditions in 5 countries over 2 years. We lost 50% of our budget and 1 year of timeline. Provide 2 to 3 adjustment options with a comparison table, a recommended feasible research question, and a trade-off statement. | pass→pass | 12,947 | 13,894 | +7% | 1 | 1 | 0% | 1,993 | 2,801 | +41% | 0 | 0 | — |
▸case-19 When scaling down a massive oceanographic microplastic sampling research question to a single local estuary due to boat budget cuts, how should we define concrete success criteria so the study remains scientifically valuable despite reduced scope? | fail→pass | 18,099 | 17,613 | -3% | 1 | 1 | 0% | 2,719 | 3,180 | +17% | 0 | 0 | — |
▸case-20 A neuroscience lab wants to study brain connectivity changes in patients with an extremely rare genetic mutation (only 12 known living patients globally). Travel restrictions make visiting them impossible. How can the study object or method be adjusted without abandoning brain network research? | fail→pass | 16,203 | 16,985 | +5% | 1 | 1 | 0% | 2,525 | 3,330 | +32% | 0 | 0 | — |
▸case-21 An NLP team wants to pre-train a domain-specific BERT variant from scratch on 50GB of legal documents, but cloud compute credits ran out and only 1 desktop GPU remains. Re-formulate the research strategy to fit this single-GPU constraint. | fail→pass | 19,718 | 14,642 | -26% | 1 | 1 | 0% | 3,297 | 3,065 | -7% | 0 | 0 | — |
▸case-22 An economics student wanted to conduct in-person interviews with 500 small business owners across 5 states, but has 1 month and no budget or research assistants. Re-scope this study to make it feasible. | fail→pass | 13,082 | 12,638 | -3% | 1 | 1 | 0% | 2,072 | 2,762 | +33% | 0 | 0 | — |
▸case-23 A researcher studying urban transit accessibility wanted to install physical GPS trackers on 1,000 public buses, but the transit authority denied permission. The researcher feels forced to pivot to an completely unrelated topic like social media analytics. Show how preserving the core question using open transit feeds (GTFS) is superior. | pass→pass | 16,373 | 13,409 | -18% | 1 | 1 | 0% | 2,536 | 2,623 | +3% | 0 | 0 | — |
▸case-24 A team wants to build a custom quantum computing algorithm for drug discovery, but they have no quantum hardware access, no quantum physics expertise on team, and 3 months until grant review. Formulate a realistic research path. | fail→pass | 18,228 | 19,254 | +6% | 1 | 1 | 0% | 2,766 | 3,630 | +31% | 0 | 0 | — |
▸case-25 I am trying to research the impact of corporate ESG ratings on stock volatility during financial crises. I originally wanted high-frequency tick data across 10,000 global firms over 20 years, but Bloomberg terminal access was revoked and I only have free Yahoo Finance daily data and 500 S&P 500 firms. Walk me through the reference flow and finalize with context-checkpoint. | fail→pass | 15,593 | 18,259 | +17% | 1 | 1 | 0% | 2,685 | 3,739 | +39% | 0 | 0 | — |