▸case-05 Here is our analysis of synthetic biology applications (gene editing tools, lab-grown leather, agricultural biostimulants). Please generate a complete 5-question interview form upfront so I can answer all questions about my preferences in one go. | fail→fail | 5,954 | 9,666 | +62% | 1 | 1 | 0% | 751 | 1,600 | +113% | 0 | 0 | — |
▸case-01 I've uploaded my background notes and market analysis. Could you outline the overview of potential domain areas along with key metrics and suggestions for each, then guide me through a step-by-step Q&A to narrow down my top 1 or 2 options and record my reasoning for choosing them? | fail→pass | 31,732 | 27,662 | -13% | 1 | 1 | 0% | 2,255 | 1,785 | -21% | 0 | 0 | — |
▸case-02 Please present a breakdown of the candidate research areas including metrics and recommendations for each option. Walk me through a single-question-at-a-time interview to capture which ones I like or dislike and why, culminating in a short list of my top one or two target areas with my underlying rationale. | fail→pass | 17,725 | 16,719 | -6% | 1 | 1 | 0% | 2,135 | 1,912 | -10% | 0 | 0 | — |
▸case-03 Can you display the landscape overview of target industry sectors with key performance indicators and recommendations, then engage in a conversation asking me about my preferences one question at a time so we can isolate my primary one or two focus sectors along with the reasons behind my picks? | fail→pass | 14,219 | 8,642 | -39% | 1 | 1 | 0% | 1,571 | 1,383 | -12% | 0 | 0 | — |
▸case-04 We are reviewing potential AI hardware subfields (neuromorphic chips, photonics, custom ASIC design) for our strategic pivot. I have configured an autonomous subagent delegation framework in our environment. Should you launch a subagent task force to handle this user preference Q&A interview, or execute it inline directly in this dialogue thread? | pass→pass | 16,477 | 29,554 | +79% | 1 | 1 | 0% | 1,648 | 1,415 | -14% | 0 | 0 | — |
▸case-06 We have summarized four clean energy storage sectors (flow batteries, compressed air, thermal storage, sodium-ion) along with efficiency metrics and recommendations. Before we begin gathering preferences, shouldn't you first ask about my team's investment budget and risk tolerance? | fail→pass | 9,315 | 12,393 | +33% | 1 | 1 | 0% | 1,615 | 1,404 | -13% | 0 | 0 | — |
▸case-07 In our previous turn, I told you that in the quantum computing hardware landscape, I am interested in Trapped Ion systems and Photonic Quantum Computing because of their scalability potential. What question should you ask me next in our single-question interview? | fail→pass | 10,824 | 23,114 | +114% | 1 | 1 | 0% | 848 | 1,593 | +88% | 0 | 0 | — |
▸case-08 In our earlier conversation about edge AI deployment targets, I selected microcontroller micro-models as my top interest and noted that I rejected browser-based WebAssembly inference due to performance limits. What is the final question you must ask me before we conclude our selection? | fail→pass | 14,365 | 7,565 | -47% | 1 | 1 | 0% | 1,241 | 561 | -55% | 0 | 0 | — |
▸case-09 I've answered all three of your interview questions regarding industrial robotics markets: I like autonomous mobile robots (AMRs) and collaborative arms for low-latency warehouse automation, I reject underwater inspection ROVs, and I want to explore drone-based inventory auditing. Please summarize my choices now. | fail→pass | 9,283 | 9,724 | +5% | 1 | 1 | 0% | 515 | 883 | +71% | 0 | 0 | — |
▸case-10 I need an overview of potential open-source database engine focus areas (vector databases, graph databases, time-series engines) so we can pick our project's next focus. A colleague suggested just listing the project names and descriptions without numerical metrics. Please present the summary overview and start our interactive Q&A. | fail→fail | 17,561 | 11,316 | -36% | 1 | 1 | 0% | 1,986 | 1,252 | -37% | 0 | 0 | — |
▸case-11 Please present the field overview for satellite internet downlink technologies (phased array, optical inter-satellite links, direct-to-cell). Make sure to stay completely neutral without providing any recommendations for any option, then begin asking me questions to capture my preferences. | fail→fail | 19,989 | 16,105 | -19% | 1 | 1 | 0% | 2,525 | 1,969 | -22% | 0 | 0 | — |
▸case-12 I just informed you that in the autonomous vehicle sensors landscape (LiDAR, FMCW radar, thermal camera, HD vision), I am interested in FMCW radar due to all-weather operation. Rather than asking me what I dislike, please generate a full SWOT matrix for all four sensors. | fail→fail | 19,327 | 24,633 | +27% | 1 | 1 | 0% | 2,768 | 3,195 | +15% | 0 | 0 | — |
▸case-13 I've shared that I like vertical farming in controlled environment agriculture and that I reject open-air urban rooftop farming due to climate variability. Before you produce my final choice summary, what single question should you ask me? | fail→fail | 11,483 | 14,250 | +24% | 1 | 1 | 0% | 1,050 | 1,553 | +48% | 0 | 0 | — |
▸case-14 We are preparing a strategic choice dialogue for cybersecurity infrastructure niches (zero trust network access, extended detection and response, cloud security posture management). Our workflow engine supports spawning background agent threads to conduct Q&A. How should this interactive Q&A session be conducted? | fail→pass | 25,424 | 13,457 | -47% | 1 | 1 | 0% | 3,151 | 1,382 | -56% | 0 | 0 | — |
▸case-15 Present a summary of space tech manufacturing niches (in-space assembly, orbital refueling, microgravity material synthesis) with key metrics and recommendations, then start our single-question-at-a-time interview to pick my focus. | pass→pass | 21,316 | 15,950 | -25% | 1 | 1 | 0% | 2,545 | 2,332 | -8% | 0 | 0 | — |
▸case-16 Here is the summary of novel drug delivery platforms (lipid nanoparticles, exosomes, polymeric micelles). Ask me all three of your preference gathering questions at once in bullet points so I can write back a comprehensive reply. | fail→fail | 8,683 | 7,270 | -16% | 1 | 1 | 0% | 705 | 1,221 | +73% | 0 | 0 | — |
▸case-17 I have provided my feedback across four commercial drone software sectors. I liked autonomous flocking, mapping photogrammetry, BVLOS routing, and crop analytics, giving detailed reasons for all four. Please output my top choices based on our dialogue. | fail→fail | 4,341 | 13,462 | +210% | 1 | 1 | 0% | 559 | 1,229 | +120% | 0 | 0 | — |
▸case-18 Here is our panorama of green hydrogen production techniques (alkaline electrolysis, PEM, solid oxide). Instead of asking which ones interest me, can you ask me to rate each technique on a scale of 1 to 10 for commercial readiness? | fail→fail | 9,337 | 6,168 | -34% | 1 | 1 | 0% | 656 | 1,067 | +63% | 0 | 0 | — |
▸case-19 During our strategic session on alternative protein tech (precision fermentation, cultivated meat, plant-based isolates), I stated that precision fermentation interests me because of high yield efficiency. What is the exact next question you should present to me? | fail→pass | 13,503 | 11,361 | -16% | 1 | 1 | 0% | 1,256 | 808 | -36% | 0 | 0 | — |
▸case-20 We have already selected North American Cold-Chain Logistics SaaS as our sole target expansion area after extensive review. Please draft a 5-page strategic business proposal covering pricing model, target go-to-market channels, and key hire roles for this single pre-selected domain. | pass→fail | 58,206 | 17,279 | -70% | 1 | 1 | 0% | 8,244 | 1,938 | -76% | 0 | 0 | — |
▸case-21 Write a Python script using pandas to parse a CSV file containing market growth metrics for 12 telecommunication sectors and output a sorted table by CAGR. | pass→fail | 19,036 | 12,627 | -34% | 1 | 1 | 0% | 2,679 | 2,801 | +5% | 0 | 0 | — |
▸case-22 Create a static competitor comparison table between Snowflake and Databricks based on official documentation for query performance, pricing structure, and data governance capabilities. | pass→fail | 15,640 | 19,994 | +28% | 1 | 1 | 0% | 2,634 | 3,398 | +29% | 0 | 0 | — |