▸case-01 We're launching a B2B AI design platform for mid-market creative teams and need a full pricing strategy. Can you help us establish our core value metric, structure a multi-tier subscription packaging plan, and lay out a roadmap for testing customer willingness to pay? | fail→fail | 21,645 | 24,727 | +14% | 1 | 1 | 0% | 3,461 | 4,549 | +31% | 0 | 0 | — |
▸case-02 Our cloud workflow automation product hasn't adjusted its prices in over three years, and our unit economics suggest we're under-monetizing our user base. Please draft a pricing change recommendation that details how to roll out updated rates to existing legacy accounts without sparking high customer churn. | fail→fail | 24,506 | 23,785 | -3% | 1 | 1 | 0% | 3,895 | 4,505 | +16% | 0 | 0 | — |
▸case-03 I am building a developer infrastructure tool and trying to decide whether a freemium offering, a free trial, or a hybrid usage-based structure makes the most strategic sense. Could you evaluate these monetization models for our product and recommend research methods to measure price sensitivity across our user segments? | fail→fail | 26,802 | 21,866 | -18% | 1 | 1 | 0% | 4,148 | 4,186 | +1% | 0 | 0 | — |
▸case-04 We run a SaaS project management tool with $50 ACV, 80% gross margins, targeting SMB tech startups. We want to conduct quantitative pricing research to identify our acceptable price range and optimal price point. We have prepared a 20-question rating scale asking users to rate $10, $20, $30, $40 on a 1 to 5 agreement scale. Evaluate this survey method and outline the standard 4-question methodology designed specifically for price sensitivity modeling. | pass→pass | 18,759 | 17,889 | -5% | 1 | 1 | 0% | 3,209 | 3,488 | +9% | 0 | 0 | — |
▸case-05 We are redesigning tiers for a high-volume B2B data pipeline platform (500 enterprise customers, $25k ACV, 85% margin). We need to determine which features drive enterprise buyers' willingness to pay versus which features are table-stakes. Our team proposed asking users to 'Rate each feature on a scale of 1-10'. Analyze why this approach fails and prescribe the choice-based trade-off research method suited for feature value packaging. | pass→pass | 41,340 | 26,191 | -37% | 1 | 1 | 0% | 7,320 | 5,403 | -26% | 0 | 0 | — |
▸case-06 Our B2B video processing platform serves mid-market marketing teams ($12k ACV, 75% gross margin, goal: maximize retention and revenue alignment). We currently charge a flat $200/month for unlimited video renders and 10GB storage. Our team is considering charging per registered user seat or per gigabyte of stored video. Evaluate these options and identify the primary value metric that directly correlates with usage value and customer cost structure. | pass→pass | 17,363 | 18,412 | +6% | 1 | 1 | 0% | 2,763 | 3,731 | +35% | 0 | 0 | — |
▸case-07 We operate a developer API developer logging service ($1,200 ACV, 92% gross margin, self-serve onboarding, low marginal cost per free user, viral word-of-mouth adoption model). We need to choose between a 14-day free trial or a permanent freemium tier with a generous free monthly limit. Analyze which model best fits our unit economics and acquisition loops. | pass→pass | 20,119 | 18,311 | -9% | 1 | 1 | 0% | 3,235 | 3,808 | +18% | 0 | 0 | — |
▸case-08 Our product is an AI video synthesis engine ($3,600 ACV, target: enterprise marketing agencies). Each video generation incurs $2.50 in direct GPU infrastructure cost, and onboarding requires a 30-minute technical setup call. Our product manager wants to launch a permanent free-forever plan with 50 video generations per month. Critique this proposal and recommend the appropriate trial model. | pass→pass | 20,600 | 20,236 | -2% | 1 | 1 | 0% | 3,044 | 4,250 | +40% | 0 | 0 | — |
▸case-09 We build a customer support helpdesk SaaS ($30-$300/mo range, targeting Solopreneurs, Growing Teams, and Scaleups). We currently have 7 distinct paid subscription tiers with overlapping feature limits. Propose a streamlined tier structure following standard SaaS packaging practices and specify the recommended number of core tiers. | pass→pass | 18,129 | 13,431 | -26% | 1 | 1 | 0% | 3,081 | 3,095 | +0% | 0 | 0 | — |
▸case-10 Our B2B CRM product ($5M ARR, 400 customers, 95% net retention) is raising prices by 25% across all tiers to reflect major feature additions over the past two years. We want to apply the price hike immediately on next month's billing cycle to all long-term legacy accounts without prior notice. Evaluate this strategy and detail a risk-mitigated rollout strategy for legacy customers. | pass→pass | 22,167 | 25,004 | +13% | 1 | 1 | 0% | 3,580 | 4,923 | +38% | 0 | 0 | — |
▸case-11 We are selecting a value metric for an email marketing platform ($500 ACV, SMB market). We are evaluating three options: 'number of email templates saved', 'number of active contacts in database', and 'number of login sessions'. Provide a validation assessment for a good value metric and select the passing metric. | pass→pass | 12,656 | 12,575 | -1% | 1 | 1 | 0% | 2,196 | 2,957 | +35% | 0 | 0 | — |
▸case-12 Our cloud database service ($15k ACV, mid-market/enterprise focus) wants to combine predictable monthly subscription revenue with usage-based scaling to capture upside from heavy queries. Define the structural components of a hybrid pricing model that balances predictable ARR for buyers with usage elasticity. | pass→pass | 16,385 | 19,039 | +16% | 1 | 1 | 0% | 2,558 | 3,550 | +39% | 0 | 0 | — |
▸case-13 We are packaging a cybersecurity SaaS platform into Starter, Professional, and Enterprise tiers. We need to decide which features belong in Enterprise versus Starter. The team wants to put basic 2-factor authentication in Enterprise only. Evaluate this tiering decision and list proper differentiation levers for Enterprise tiers. | pass→pass | 16,020 | 13,529 | -16% | 1 | 1 | 0% | 2,587 | 2,950 | +14% | 0 | 0 | — |
▸case-14 We are launching a new add-on module for our ERP software ($50k ACV, 200 existing clients). We need to determine the willingness to pay (WTP) before setting list prices. Our team proposed running public A/B price split tests on our live marketing website showing different prices to different site visitors. Critique this method and specify a direct customer research approach for B2B WTP testing. | pass→pass | 17,650 | 16,270 | -8% | 1 | 1 | 0% | 2,752 | 3,412 | +24% | 0 | 0 | — |
▸case-15 Our enterprise sales team ($40k ACV SaaS) frequently gives unapproved 50% ad-hoc discounts to close monthly deals, creating severe price realization erosion across our customer base. Design a structured discounting policy and governance framework to maintain price integrity. | fail→pass | 20,416 | 18,982 | -7% | 1 | 1 | 0% | 3,161 | 3,763 | +19% | 0 | 0 | — |
▸case-16 We run an HR management SaaS ($10k ACV, 300 customers) and haven't evaluated pricing in 4 years. Win rates in sales are above 85%, prospects sign contracts immediately without negotiating price, and major enterprise features were added recently. Analyze these business indicators and state whether a pricing review is indicated. | pass→pass | 13,814 | 12,589 | -9% | 1 | 1 | 0% | 2,091 | 2,903 | +39% | 0 | 0 | — |
▸case-17 Our B2B productivity app ($120 ACV) launched a freemium plan and currently has a 0.2% free-to-paid conversion rate across 100,000 monthly active users. Our team is arguing whether 0.2% is healthy. Analyze this conversion rate against standard industry benchmarks for B2B freemium products and recommend tier adjustment levers. | pass→pass | 17,895 | 19,196 | +7% | 1 | 1 | 0% | 2,915 | 3,969 | +36% | 0 | 0 | — |
▸case-18 We need to create an executive pricing strategy document for our SaaS executive board ($10M ARR company). Context: B2B CRM, moving from seat-based to hybrid. Outline the essential sections required in a complete pricing strategy document to guide executive decision-making. | pass→pass | 20,298 | 22,827 | +12% | 1 | 1 | 0% | 3,246 | 3,996 | +23% | 0 | 0 | — |
▸case-19 We are increasing pricing by 15% for our project management SaaS ($20M ARR, 2,000 customers). Describe the key principles for communicating this price increase to customers to minimize churn and preserve trust. | pass→pass | 17,584 | 17,077 | -3% | 1 | 1 | 0% | 2,729 | 3,552 | +30% | 0 | 0 | — |
▸case-20 We run a cloud photo storage and sharing app ($60/year target paid ACV, 80% gross margin, individual consumers and freelancers). We are designing our freemium tier limits. Evaluate whether to restrict high-resolution RAW file downloads or total storage gigabytes as the primary upgrade trigger to turn free users into paying subscribers. | pass→pass | 18,054 | 22,016 | +22% | 1 | 1 | 0% | 2,928 | 4,196 | +43% | 0 | 0 | — |
▸case-21 We have finalized our SaaS tier strategy (Starter at $29/mo, Pro at $99/mo, Enterprise custom). Now we need the frontend code to render this on our marketing website. Write a React component using Tailwind CSS that displays these three pricing cards with monthly/annual toggle buttons and a 'Most Popular' badge on the Pro tier. | fail→fail | 20,338 | 9,271 | -54% | 1 | 1 | 0% | 4,370 | 2,322 | -47% | 0 | 0 | — |
▸case-22 We are implementing our subscription billing backend in Node.js with Express and Stripe. Write a webhook endpoint route handler that listens for 'customer.subscription.updated' and 'invoice.payment_failed' events and updates our Postgres database records accordingly. | pass→fail | 21,467 | 15,064 | -30% | 1 | 1 | 0% | 3,621 | 3,199 | -12% | 0 | 0 | — |
▸case-23 We are setting up a technical experiment infrastructure in Python to assign incoming web users to either control group 'price_a' ($49/mo) or treatment group 'price_b' ($69/mo) using deterministic user hashing. Write a Python function that hashes a user_id with MD5 and assigns them to 'price_a' or 'price_b' with 50/50 probability. | pass→pass | 13,475 | 14,571 | +8% | 1 | 1 | 0% | 2,203 | 3,379 | +53% | 0 | 0 | — |