▸case-01 Our checkout completion rate fell by 18% right after yesterday's mobile release. I need a comprehensive diagnostic breakdown that synthesizes our analytics and user feedback, categorizes the underlying friction points, and outputs an experiment brief we can share with UX and engineering. | fail→fail | 24,726 | 29,341 | +19% | 1 | 1 | 0% | 3,477 | 3,096 | -11% | 0 | 0 | — |
▸case-08 We finished analyzing friction points across our subscription sign-up flow and generated a list of recommendations. Format the remediation tracking table to ensure cross-functional execution accountability. | pass→pass | 14,839 | 14,142 | -5% | 1 | 1 | 0% | 2,120 | 2,322 | +10% | 0 | 0 | — |
▸case-02 We're seeing a severe drop in average order value across our paid acquisition channels this week. Please build a conversion diagnostic document containing a segmented issue grid, prioritized action items, and a standup agenda for our cross-functional alignment war room. | fail→fail | 27,097 | 14,350 | -47% | 1 | 1 | 0% | 3,980 | 2,381 | -40% | 0 | 0 | — |
▸case-03 Our e-commerce funnel is leaking traffic at the payment step. Create a diagnostic workbook that maps out our data signals, breaks down technical versus UX issues, and produces a prioritized backlog of experiment hypotheses with tracked KPIs. | fail→fail | 29,105 | 31,306 | +8% | 1 | 1 | 0% | 4,340 | 5,205 | +20% | 0 | 0 | — |
▸case-04 Our product detail page bounce rate jumped unexpectedly on desktop browsers. The analytics team wants to look purely at Google Analytics bounce rates. Outline a complete quantitative and qualitative signal gathering plan to isolate the conversion issue. | pass→pass | 20,644 | 24,769 | +20% | 1 | 1 | 0% | 2,963 | 3,622 | +22% | 0 | 0 | — |
▸case-05 A DTC clothing brand observed a conversion decline during a weekend promo. The team only planned to segment data by mobile versus desktop devices. Provide a comprehensive multi-dimensional segmentation strategy to locate where the conversion drop is isolated. | pass→pass | 20,850 | 17,958 | -14% | 1 | 1 | 0% | 2,952 | 2,711 | -8% | 0 | 0 | — |
▸case-06 During a website audit, we discovered missing shipping policy details, a broken payment gateway error, ambiguous checkout CTA wording, and outdated promotional banner pricing. Map these four findings into standard diagnostic issue taxonomy buckets. | pass→pass | 8,956 | 5,955 | -34% | 1 | 1 | 0% | 1,403 | 1,163 | -17% | 0 | 0 | — |
▸case-07 Our growth team has 6 proposed conversion experiment ideas. The lead wants to rank them using standard RICE (Impact, Confidence, Ease). Provide a complete prioritization scoring formula that explicitly accounts for potential negative impacts on core business metrics. | pass→pass | 23,044 | 22,638 | -2% | 1 | 1 | 0% | 3,862 | 3,767 | -2% | 0 | 0 | — |
▸case-09 A high-velocity flash sale launched this morning, but conversion dropped by 30% in the first hour. The marketing director suggests planning a 2-week deep-dive investigation. Define the target turnaround time required for diagnosing high-velocity campaign drops. | fail→pass | 12,952 | 6,255 | -52% | 1 | 1 | 0% | 1,854 | 1,140 | -39% | 0 | 0 | — |
▸case-10 Engineering and Marketing are arguing over why cart abandonment spiked. Marketing blames confusing CTA copy, while engineering claims the page is loading fast enough. Recommend a presentation strategy that uses qualitative evidence to build stakeholder consensus around quantitative drops. | pass→pass | 21,616 | 19,199 | -11% | 1 | 1 | 0% | 2,794 | 2,800 | +0% | 0 | 0 | — |
▸case-11 Our analytics team wants to automate weekly reporting for unexpected conversion drops across our e-commerce store. What specific automated CLI command should be integrated into our workflow to generate automated conversion drop reports? | fail→pass | 13,971 | 3,403 | -76% | 1 | 1 | 0% | 2,344 | 720 | -69% | 0 | 0 | — |
▸case-12 We are preparing to test a new express checkout flow to fix mobile conversion drops. Instead of writing a full engineering specification, structure a concise experiment brief template tailored for conversion testing. | pass→pass | 10,958 | 9,568 | -13% | 1 | 1 | 0% | 1,598 | 1,674 | +5% | 0 | 0 | — |
▸case-13 We are organizing a daily conversion war room to tackle checkout drops across engineering, UX, and marketing. Provide a standup meeting agenda template specifically tailored for cross-functional alignment war rooms. | pass→pass | 16,507 | 13,480 | -18% | 1 | 1 | 0% | 2,224 | 2,258 | +2% | 0 | 0 | — |
▸case-14 We need to structure a standardized conversion diagnostic workbook for our CRO team to evaluate quarterly funnel drops. List the essential structural sections required in this diagnostic workbook template. | pass→pass | 16,881 | 11,883 | -30% | 1 | 1 | 0% | 2,511 | 2,020 | -20% | 0 | 0 | — |
▸case-15 During an international checkout audit, European users abandoned carts because local credit card authentication failed and VAT taxes were hidden until final confirmation. Categorize these specific conversion barriers into the diagnostic issue taxonomy. | fail→fail | 10,981 | 7,229 | -34% | 1 | 1 | 0% | 1,625 | 1,234 | -24% | 0 | 0 | — |
▸case-16 Ad traffic for a $50 shoe discount lands on a product detail page where the item shows as full price ($100) and out-of-stock in key sizes. Categorize this friction point within the conversion issue taxonomy. | fail→pass | 11,353 | 6,280 | -45% | 1 | 1 | 0% | 1,740 | 1,236 | -29% | 0 | 0 | — |
▸case-17 On mobile devices, our product listing page takes 6.2 seconds to render, and the filter API returns 504 errors intermittently. Categorize these issues within the conversion diagnostic framework. | fail→pass | 12,882 | 10,696 | -17% | 1 | 1 | 0% | 1,871 | 1,881 | +1% | 0 | 0 | — |
▸case-18 Our SaaS sign-up conversion rate dipped 10%, but mobile vs desktop and US vs EU breakdowns show identical relative drops. Suggest additional critical segmentation dimensions to isolate whether specific user groups are driving the drop. | pass→pass | 16,699 | 14,879 | -11% | 1 | 1 | 0% | 2,355 | 2,240 | -5% | 0 | 0 | — |
▸case-19 UX wants to redesign the whole product page, Engineering claims server lag is the real culprit, and Marketing blames ad targeting. Explain how deploying a conversion diagnostic kit framework resolves this cross-functional priority deadlock. | fail→fail | 16,957 | 14,962 | -12% | 1 | 1 | 0% | 2,344 | 2,475 | +6% | 0 | 0 | — |
▸case-20 We are running an A/B test on our payment CTA button. Our baseline conversion rate is 4%, and we want to detect a 10% relative lift with 80% statistical power at a 5% significance level. Calculate the required sample size per variation and explain the statistical formula. | pass→pass | 17,091 | 14,692 | -14% | 1 | 1 | 0% | 3,285 | 3,200 | -3% | 0 | 0 | — |
▸case-21 We need to configure Google Tag Manager to track clicks on our checkout 'Place Order' button. Write the custom JavaScript trigger code and explain how to send custom event parameters to Google Analytics 4. | pass→pass | 14,727 | 15,656 | +6% | 1 | 1 | 0% | 2,471 | 2,845 | +15% | 0 | 0 | — |
▸case-22 Write a SQL query for BigQuery that calculates daily step-by-step conversion rates through our funnel tables (`page_views`, `add_to_cart`, `checkout_start`, `order_complete`) over the past 30 days. | pass→pass | 16,631 | 12,740 | -23% | 1 | 1 | 0% | 3,186 | 2,827 | -11% | 0 | 0 | — |