▸case-01 We are planning to launch a subscription box for rare indoor tropical plants. To test if there is real market demand without building inventory, generate a structured validation proposal. Start with a market engagement hypothesis framing target users and desired behavior, then detail 3 low-cost experiments. Outline the method, metric, and target threshold for each experiment to test genuine user commitment. | fail→pass | 23,224 | 16,721 | -28% | 1 | 1 | 0% | 2,902 | 3,318 | +14% | 0 | 0 | — |
▸case-02 I want to test a concept for an AI-powered personal style assistant app for busy executives. Help me design a lean experiment setup to validate this new product idea. I need a primary hypothesis that defines target audience engagement, followed by a couple of pretotype testing approaches. Ensure each experiment clearly lists the method, metric, and pass/fail criteria based on actual user actions. | fail→pass | 14,216 | 15,349 | +8% | 1 | 1 | 0% | 2,277 | 3,152 | +38% | 0 | 0 | — |
▸case-03 We are running a standard two-sample A/B test comparing baseline checkout conversion against a variation with 80% statistical power and alpha = 0.05. State the exact statistical distribution used in the two-proportion z-test formula, and distinguish standard A/B testing from pretotyping. | pass→pass | 13,254 | 12,597 | -5% | 1 | 1 | 0% | 2,558 | 2,742 | +7% | 0 | 0 | — |
▸case-04 We are conducting customer discovery interviews for an automated invoice reconciliation tool. A team member suggested asking interviewees: 'Would you pay $50 per month for this solution if we built it?' Explain the methodological flaw in asking hypothetical payment questions, and state the correct question type to ask instead. | pass→pass | 11,692 | 13,676 | +17% | 1 | 1 | 0% | 1,723 | 2,236 | +30% | 0 | 0 | — |
▸case-05 A founder presents a Gartner market research report on global B2B logistics spend as proof that their specific logistics SaaS startup will succeed. In Alberto Savoia's pretotyping methodology, what specific term classifies third-party industry reports, and why is it insufficient for validating demand? | pass→pass | 8,016 | 5,917 | -26% | 1 | 1 | 0% | 1,428 | 1,545 | +8% | 0 | 0 | — |
▸case-06 We want to launch a B2B automated freight dispatching platform. Investors suggested running a 50-person focus group to ask logistics managers if they like the feature set. Instead of surveys, design a lean validation experiment using a landing page. We need a quantitative hypothesis framing target market engagement percentage and 2 pretotype experiments with metrics. | pass→pass | 15,708 | 14,027 | -11% | 1 | 1 | 0% | 2,582 | 2,880 | +12% | 0 | 0 | — |
▸case-07 We are considering a subscription service for rare single-origin coffee beans delivered within 24 hours of roasting. Our advisor suggested using industry coffee industry association reports to prove demand. How can we collect our own behavioral data instead? Provide a structured validation plan with a quantitative hypothesis and a concierge experiment. | pass→pass | 20,804 | 20,097 | -3% | 1 | 1 | 0% | 2,738 | 3,916 | +43% | 0 | 0 | — |
▸case-08 We want to test interest in a VR-based surgical training module for medical students. The team wants to release a promo video on YouTube and measure video views and likes. How should we restructure this test so it measures actual commitment? Give us a target hypothesis framing engagement percentage and experiment setup. | pass→pass | 12,485 | 19,262 | +54% | 1 | 1 | 0% | 2,091 | 3,132 | +50% | 0 | 0 | — |
▸case-09 We are developing an instant micro-loan app for gig workers. We plan to send an opinion survey asking gig workers 'Would you pay $5 for instant payout?'. Reframe this approach to test true willingness to pay with skin in the game. Include a quantitative market hypothesis and an email or waitlist pretotype setup. | pass→pass | 18,487 | 16,519 | -11% | 1 | 1 | 0% | 3,023 | 3,452 | +14% | 0 | 0 | — |
▸case-10 We want to validate a continuous hydration tracking wristband. The marketing team proposed a hypothesis: 'Fitness enthusiasts will love our hydration band.' Improve this into a quantitative hypothesis with a target percentage, and outline an outbound email pretotype experiment with success metrics. | pass→pass | 16,337 | 15,884 | -3% | 1 | 1 | 0% | 2,763 | 3,164 | +15% | 0 | 0 | — |
▸case-11 We are planning an on-demand luxury dog walking app with live GPS tracking. The dev team wants 3 months to build the mobile app and backend. Design a manual MVP experiment that tests demand immediately with minimal tech, supported by a quantitative engagement hypothesis. | pass→pass | 18,045 | 14,298 | -21% | 1 | 1 | 0% | 2,367 | 2,868 | +21% | 0 | 0 | — |
▸case-12 We have a concept for an automated global payroll engine for remote startups. Instead of calculating market size from Gartner reports, we want to run a pre-order campaign. Outline a validation setup starting with a quantitative hypothesis and a pre-order experiment. | pass→pass | 17,837 | 16,928 | -5% | 1 | 1 | 0% | 3,026 | 3,600 | +19% | 0 | 0 | — |
▸case-13 We are designing an automated indoor hydro-planter for apartments. Our team wants to cite Kickstarter sales of competing products to prove our product will sell. Explain how to generate our own data using a landing page pretotype, and provide a quantitative engagement hypothesis. | pass→pass | 12,253 | 16,617 | +36% | 1 | 1 | 0% | 2,299 | 3,452 | +50% | 0 | 0 | — |
▸case-14 We are pitching an AI contract negotiation assistant for enterprise legal teams. Our sales director wants to do 20 interviews asking 'How much would you pay for this?'. Convert this into an explainer video pretotype test with a quantitative hypothesis and commitment metrics. | pass→pass | 14,017 | 17,677 | +26% | 1 | 1 | 0% | 2,363 | 3,589 | +52% | 0 | 0 | — |
▸case-15 We want to launch an organic chef-prepared meal kit service for elderly citizens. Rather than asking family members for feedback on the idea, propose a waitlist pretotype experiment to gather behavioral data. Start with a quantitative hypothesis. | pass→pass | 15,824 | 13,797 | -13% | 1 | 1 | 0% | 2,643 | 2,853 | +8% | 0 | 0 | — |
▸case-16 We are testing a peer-to-peer vintage car rental marketplace concept. Instead of buying vehicles or building a platform, design a concierge pretotype where we facilitate bookings manually. Frame a quantitative hypothesis and document the experiment parameters. | pass→pass | 17,310 | 21,253 | +23% | 1 | 1 | 0% | 2,799 | 3,369 | +20% | 0 | 0 | — |
▸case-17 We want to build a VR rhythm game for calorie burning. Our co-founder wants to launch a $50k Kickstarter right away. Recommend an outbound email campaign pretotype to test interest first, complete with a quantitative hypothesis and metrics. | pass→pass | 16,696 | 24,431 | +46% | 1 | 1 | 0% | 2,779 | 3,432 | +23% | 0 | 0 | — |
▸case-18 We want to test demand for 5-minute executive audiobook summaries. The team wants to produce 50 complete audiobooks before launching. Propose a fake-door landing page experiment to test demand first, starting with a quantitative hypothesis. | pass→pass | 15,921 | 16,279 | +2% | 1 | 1 | 0% | 2,717 | 3,215 | +18% | 0 | 0 | — |
▸case-19 We are validating an AI itinerary generator for solo travelers. A consultant suggested measuring user interest with a 10-question Net Promoter Score survey. Reframe the validation using a skin-in-the-game experiment with a quantitative hypothesis. | pass→pass | 13,520 | 15,574 | +15% | 1 | 1 | 0% | 2,217 | 3,261 | +47% | 0 | 0 | — |
▸case-20 We want to launch a robotic solar panel cleaning subscription for residential roofs. The founder wants to hold a focus group with homeowners. Design a manual service MVP experiment to test willingness to pay, preceded by a quantitative hypothesis. | pass→pass | 19,240 | 15,558 | -19% | 1 | 1 | 0% | 2,935 | 3,209 | +9% | 0 | 0 | — |
▸case-21 We are building an automated security audit bot for GitHub repositories. We plan to write a whitepaper and track PDF downloads to test commercial demand. Upgrade this to a pre-order pretotype experiment with a quantitative hypothesis. | pass→pass | 14,682 | 21,911 | +49% | 1 | 1 | 0% | 2,612 | 3,299 | +26% | 0 | 0 | — |
▸case-22 We want to test an accent-reduction app for non-native English software engineers. The product manager wants to survey engineers on Reddit asking if they would buy it. Propose an explainer video experiment with a quantitative hypothesis. | pass→pass | 15,800 | 18,757 | +19% | 1 | 1 | 0% | 2,603 | 2,979 | +14% | 0 | 0 | — |