▸case-02 We are conducting a 30-minute expert interview tomorrow with Dr. Elena Rostova, a veteran biotech executive, to inform our firm's decision on whether to acquire an early-stage enzymatic DNA synthesis platform. We currently believe that enzymatic synthesis will achieve cost parity with chemical synthesis within 18 months, though our data on yield stability is spotty. Please generate a comprehensive interview prep plan for me. It should include a summary of her known public commentary, a categorized and prioritized flow of questions designed for a tight timeframe, specific probing strategies and belief-testing prompts, and an actionable plan for capturing and grading the reliability of the notes we take. | fail→fail | 21,177 | 16,846 | -20% | 1 | 1 | 0% | 3,788 | 4,070 | +7% | 0 | 0 | — |
▸case-01 I have a 45-minute consultation call coming up with Dr. Aris Thorne, a former senior systems architect at AWS. Our team is trying to decide whether to migrate our microservices infrastructure off managed Kubernetes onto bare EC2 instances. Right now, our working assumption is that managed control planes are responsible for our 30% tail-latency spikes in US-East. I need a complete briefing document for this interview that summarizes what he's already publicly stated on this topic, outlines a structured sequence of questions starting with quick baseline checks moving into our core decision and high-level edge cases, provides techniques for probing deeper into unexpected answers, and details how we should record and categorize his insights after the call. | fail→pass | 27,120 | 19,682 | -27% | 1 | 1 | 0% | 4,892 | 4,809 | -2% | 0 | 0 | — |
▸case-03 I'm speaking with Sarah Jenkins, a fintech regulatory consultant, for a 60-minute session to guide our upcoming decision on expanding our cross-border payments product into the EU market. Our current thesis is that MiCA compliance will double our customer onboarding drop-off rate. Could you help me prepare a full briefing kit for this meeting? I need a summary of her past public statements on MiCA, a structured list of questions that ramps up from quick background checks to our key strategic unknowns, a set of follow-up tactics to dig into surprising details, and a post-call capture outline for processing her claims versus opinions. | fail→pass | 20,626 | 20,844 | +1% | 1 | 1 | 0% | 3,626 | 4,798 | +32% | 0 | 0 | — |
▸case-04 I am scheduling a 45-minute consultation with database architect Dr. Marcus Vance to decide whether our SaaS startup should implement database sharding or vertical scaling for our PostgreSQL cluster. Our belief is that table partitioning will solve our write bottlenecks. Please prepare an interview guide. Make sure you don't jump straight into hard technical questions; give me a couple of quick opening questions to test if his public positions are still up to date before we get to our main unknowns. | fail→pass | 16,332 | 21,868 | +34% | 1 | 1 | 0% | 2,779 | 4,896 | +76% | 0 | 0 | — |
▸case-05 We have a 60-minute interview with Dr. Lin Chen, a GPU hardware analyst, to help us decide whether to commit $2M to custom ASIC development versus standard Nvidia H100 clusters. Our current working belief is that ASIC development will yield a 4x inference cost reduction within 12 months. Prepare our interview prep document, ensuring our core assumption is directly challenged. | fail→fail | 25,960 | 19,757 | -24% | 1 | 1 | 0% | 4,333 | 4,687 | +8% | 0 | 0 | — |
▸case-06 Prepare a 30-minute expert call plan with SaaS pricing strategist Marcus Vance. Our leadership team must decide by Friday whether to transition from seat-based pricing to usage-based pricing. We have several questions about customer churn risk, bill predictability, and billing system complexity. Provide a prioritized question flow where every core question explicitly links back to our pricing model decision. | fail→pass | 15,084 | 14,502 | -4% | 1 | 1 | 0% | 2,651 | 3,612 | +36% | 0 | 0 | — |
▸case-07 I have a 30-minute expert call with DevOps consultant Sandra K. regarding our migration from AWS ECS to bare EC2 instances. I often get bogged down in deep technical discussions and run out of time before reaching my critical decision questions. Build an interview prep brief for me that includes a concrete time rule to keep the meeting on track. | fail→fail | 13,521 | 17,879 | +32% | 1 | 1 | 0% | 2,288 | 4,449 | +94% | 0 | 0 | — |
▸case-08 I'm interviewing cybersecurity expert Rachel Adams for 60 minutes to evaluate zero-trust security vendors for our enterprise network. I already know her public stance on micro-segmentation, but I need questions that push beyond public knowledge into edge cases and areas where conventional wisdom is wrong. Generate the prep document. | fail→pass | 18,890 | 18,167 | -4% | 1 | 1 | 0% | 3,239 | 4,401 | +36% | 0 | 0 | — |
▸case-09 We are interviewing battery chemist Dr. Lars Lindqvist for 45 minutes to decide whether to invest in solid-state lithium battery production lines. He published a paper 18 months ago praising silicon anode technology. Build an interview prep plan that summarizes his past work and includes a mechanism to ensure his opinion hasn't shifted since that publication. | fail→pass | 17,006 | 18,248 | +7% | 1 | 1 | 0% | 3,192 | 4,452 | +39% | 0 | 0 | — |
▸case-10 Generate a prep brief for a 60-minute expert call with semiconductor analyst James Thorne regarding chip foundry capacity constraints. Our team needs to distinguish between verified production figures and his personal industry intuition during note-taking, and evaluate how much reliance to place on a single expert call. | pass→pass | 17,782 | 23,025 | +29% | 1 | 1 | 0% | 2,948 | 4,935 | +67% | 0 | 0 | — |
▸case-11 We are conducting a 45-minute call with logistics specialist Maria Garcia to decide whether to automate our main distribution center in Ohio. I am worried our team will take days to organize the notes and lose the nuances of her responses. Build a complete call prep plan addressing note synthesis timing. | pass→pass | 16,793 | 20,785 | +24% | 1 | 1 | 0% | 3,101 | 4,712 | +52% | 0 | 0 | — |
▸case-12 Draft an interview preparation guide for a 30-minute call with enterprise sales consultant David Miller to inform our enterprise go-to-market strategy. My colleague wants to rush through a checklist of 12 distinct topics during the 30 minutes, but I want to ensure we dig deep when he gives surprising answers. Include an explicit rule in the guide that resolves this conflict. | pass→pass | 16,857 | 18,276 | +8% | 1 | 1 | 0% | 2,945 | 4,370 | +48% | 0 | 0 | — |
▸case-13 Prepare a prep brief for a 45-minute consultation with open-source maintainer Alex Rivera regarding our decision to adopt or fork a major open-source web framework. We want to demonstrate that we've read his blog posts so he knows we aren't wasting his time with basic questions. | fail→fail | 17,938 | 14,844 | -17% | 1 | 1 | 0% | 2,917 | 3,679 | +26% | 0 | 0 | — |
▸case-14 Create an expert interview prep document for a tight 30-minute session with cloud cost specialist Karen Wu to evaluate reserved instance vs savings plan commitments. Given the strict 30-minute time box, design the question structure and time management mechanisms accordingly. | fail→pass | 18,522 | 20,675 | +12% | 1 | 1 | 0% | 3,314 | 4,751 | +43% | 0 | 0 | — |
▸case-15 We are interviewing retail supply chain advisor Tom Bradley for 45 minutes. Our team currently assumes that localized micro-fulfillment centers will cut our last-mile delivery costs by 20%. Instead of asking an open-ended question about micro-fulfillment, build a question into the toolkit that directly stakes our assumption for him to critique. | pass→pass | 7,950 | 12,233 | +54% | 1 | 1 | 0% | 1,330 | 3,178 | +139% | 0 | 0 | — |
▸case-16 We have an upcoming 60-minute interview with AI compliance attorney Sarah Jenkins to decide whether our healthcare application requires FDA software-as-a-medical-device clearance. Prepare our interview prep kit, focusing on how we store and grade her input alongside our existing research repository. | pass→pass | 22,891 | 14,988 | -35% | 1 | 1 | 0% | 3,798 | 4,343 | +14% | 0 | 0 | — |
▸case-17 Prepare a complete expert call prep document for a 60-minute conversation with biotech CTO Dr. Hugo Meyer. We are deciding whether to license a proprietary CRISPR gene-editing platform. Ensure the toolkit contains a time-based checkpoint specifically calibrated for a 60-minute duration. | fail→fail | 19,038 | 21,764 | +14% | 1 | 1 | 0% | 4,186 | 4,747 | +13% | 0 | 0 | — |
▸case-18 Draft an expert interview plan for a 45-minute call with macroeconomist Dr. Laura Vance regarding foreign exchange volatility hedging for our international expansion into South America. Make sure the note-taking guidelines explicitly distinguish empirical data from expert predictions. | fail→pass | 17,761 | 20,953 | +18% | 1 | 1 | 0% | 2,981 | 4,710 | +58% | 0 | 0 | — |
▸case-19 Create an interview prep brief for a 45-minute session with autonomous vehicles engineer Ray Tanaka to evaluate purchasing LiDAR sensors vs camera-only perception systems. He made public comments on LiDAR costs two years ago; include a dedicated check in the prep document for whether those facts have changed. | pass→pass | 18,810 | 17,530 | -7% | 1 | 1 | 0% | 3,099 | 3,930 | +27% | 0 | 0 | — |
▸case-20 Our team needs to conduct a secondary desk research sprint on the market size, competitive landscape, and regulatory outlook for enterprise Kubernetes management platforms in Europe. We are not speaking with any individual experts or scheduling calls. Please outline a desk research plan, including key search queries, industry databases to query, and primary document categories to review. | pass→pass | 15,896 | 19,627 | +23% | 1 | 1 | 0% | 2,955 | 4,588 | +55% | 0 | 0 | — |
▸case-21 We completed an expert interview yesterday with cloud architect Dr. Aris Thorne. Here are our raw transcript notes: Thorne stated that managed control plane latencies account for <5% of tail latency in AWS US-East, and that network security group contention is our likely culprit. Based on these raw notes, please write a final 1-page investment decision memo for our CTO recommending our infrastructure path. | pass→pass | 13,317 | 10,190 | -23% | 1 | 1 | 0% | 2,224 | 2,861 | +29% | 0 | 0 | — |
▸case-22 We are hiring fintech regulatory consultant Sarah Jenkins for an advisory engagement. Please draft a standard professional consulting Scope of Work (SOW) agreement covering engagement deliverables, hourly billing rates, confidentiality/NDA terms, and intellectual property assignment. | pass→pass | 16,635 | 14,707 | -12% | 1 | 1 | 0% | 3,097 | 3,918 | +27% | 0 | 0 | — |