▸case-01 I'm launching a peer-to-peer rental marketplace app and struggling with user activation after account creation. Can you help us design an onboarding strategy and post-signup flow that drives early user engagement? Please request any product context or metrics you require to tailor the strategy. | fail→fail | 15,387 | 16,509 | +7% | 1 | 1 | 0% | 2,507 | 2,635 | +5% | 0 | 0 | — |
▸case-02 Our team wants to overhaul our B2C app's initial user experience to reduce immediate drop-offs and improve habit formation. We need a comprehensive onboarding audit and an experiment plan to boost retention. How should we structure this analysis, and what preliminary details about our setup do you need from me? | fail→pass | 17,663 | 9,637 | -45% | 1 | 1 | 0% | 3,041 | 2,529 | -17% | 0 | 0 | — |
▸case-03 We are running paid search ad campaigns on Google Ads for a project management tool. Our customer acquisition cost (CAC) is $120 and our target CAC is $80. What bidding strategies and ad group structural changes should we implement to lower our acquisition costs? | pass→fail | 20,523 | 15,042 | -27% | 1 | 1 | 0% | 3,423 | 3,370 | -2% | 0 | 0 | — |
▸case-04 We offer a B2B productivity software platform and need to restructure our pricing page tiers from flat-rate to feature-gated plans (Free, Pro, Enterprise). How should we price and distribute features across these tiers to maximize monthly recurring revenue? | pass→pass | 20,247 | 17,715 | -13% | 1 | 1 | 0% | 3,245 | 3,716 | +15% | 0 | 0 | — |
▸case-05 Our e-commerce website is experiencing crawl budget inefficiency and slow indexing for our product category pages. What technical SEO fixes should we apply to robots.txt, XML sitemaps, and canonical tags to resolve indexing issues? | pass→pass | 23,223 | 18,128 | -22% | 1 | 1 | 0% | 3,363 | 4,094 | +22% | 0 | 0 | — |
▸case-06 We are developing a B2B developer analytics platform where users connect their GitHub repositories. We want to immediately launch a modal-driven guided tour showing users all 15 reporting dashboards right after sign-up. Can you write the exact tooltip copy and tour script for all 15 screens right now? | fail→fail | 17,526 | 16,866 | -4% | 1 | 1 | 0% | 2,969 | 3,583 | +21% | 0 | 0 | — |
▸case-07 We run a freelance service marketplace connecting buyers and sellers. We want to measure activation, so we plan to define 'activated user' simply as anyone who completes account registration and verifies their email address. Can you confirm this activation benchmark and build our email campaign around it? | pass→pass | 15,594 | 14,895 | -4% | 1 | 1 | 0% | 2,585 | 3,160 | +22% | 0 | 0 | — |
▸case-08 In our mobile fitness app, as soon as a user clicks 'Sign Up', we display a 6-screen slide carousel explaining our company story and vision, followed by a request for push notification permissions, location access, and contacts permission. Is this immediate post-signup experience optimal for driving retention? | pass→pass | 15,199 | 13,997 | -8% | 1 | 1 | 0% | 2,406 | 3,238 | +35% | 0 | 0 | — |
▸case-09 We manage a complex B2B workflow tool with multiple configuration steps (invite team, set up integration, create first project, set up billing). Should we present these as mandatory gating modal screens that block app access until all 4 are completed, or how should we structure this setup experience? | pass→pass | 14,815 | 16,840 | +14% | 1 | 1 | 0% | 2,410 | 3,660 | +52% | 0 | 0 | — |
▸case-10 When new users log into our team chat application for the first time, the main workspace view is completely blank with text saying 'No messages yet.' Should we leave this blank state clean and minimalist to avoid cluttering the UI? | pass→pass | 13,779 | 12,941 | -6% | 1 | 1 | 0% | 2,102 | 2,989 | +42% | 0 | 0 | — |
▸case-11 Our HR management software requires new signups to fill out a 24-field profile wizard (including company tax ID, address, employee count, and benefit plans) before they can view the dashboard. Should we keep this mandatory setup wizard at sign-up to ensure complete data collection? | pass→pass | 13,690 | 13,709 | +0% | 1 | 1 | 0% | 2,270 | 3,219 | +42% | 0 | 0 | — |
▸case-12 We want to train new users on our data visualization tool by setting up an automatic 12-step sequential modal product tour that highlights every icon in the sidebar nav upon first login. Will this ensure high feature adoption? | pass→pass | 12,873 | 12,189 | -5% | 1 | 1 | 0% | 1,977 | 2,857 | +45% | 0 | 0 | — |
▸case-13 We send our automated onboarding email sequence based strictly on static time delays (Day 1, Day 2, Day 3, Day 5) regardless of whether the user has already completed setup or logged into the app daily. Is this fixed time-based email drip effective? | pass→pass | 15,086 | 15,089 | +0% | 1 | 1 | 0% | 2,358 | 3,451 | +46% | 0 | 0 | — |
▸case-14 We noticed 60% of our new signups log in once, do not create a project, and never return. We plan to send them a generic newsletter with company updates and blog links every week. Is this the right approach to re-engage inactive users? | pass→pass | 12,918 | 14,269 | +10% | 1 | 1 | 0% | 2,072 | 3,433 | +66% | 0 | 0 | — |
▸case-15 Our mobile habit tracker app triggers the native iOS push notification permission dialogue on the second screen of the app launch, before the user creates an account or sees the app interface. Should we keep this early system prompt? | pass→pass | 11,356 | 11,582 | +2% | 1 | 1 | 0% | 1,797 | 2,799 | +56% | 0 | 0 | — |
▸case-16 We want users to return to our document editing tool daily. We plan to pop up a daily toast notification saying 'Don't forget to edit documents today!' every morning at 9:00 AM. Will this push notification habit loop drive long-term engagement? | pass→pass | 12,695 | 12,261 | -3% | 1 | 1 | 0% | 2,104 | 3,002 | +43% | 0 | 0 | — |
▸case-17 We are designing a multi-step user onboarding flow. We currently show a progress bar that starts at 0% completed on step 1 of 5. Is starting at 0% the best way to motivate users to complete the onboarding flow? | pass→pass | 11,305 | 11,236 | -1% | 1 | 1 | 0% | 1,935 | 2,832 | +46% | 0 | 0 | — |
▸case-18 In our video editing web app, we show new users a 3-minute video tutorial explaining how to trim clips before letting them enter the app editor. Is watching a demo video the best way to onboard users to software tools? | pass→pass | 14,251 | 13,055 | -8% | 1 | 1 | 0% | 2,196 | 3,094 | +41% | 0 | 0 | — |
▸case-19 When a user sends their first email newsletter campaign using our email marketing tool, the app simply redirects them to a quiet campaign list view. Should we add a milestone celebration at this moment? | pass→pass | 12,333 | 13,468 | +9% | 1 | 1 | 0% | 1,919 | 2,889 | +51% | 0 | 0 | — |
▸case-20 Our signup conversion funnel drops off significantly: 10,000 visitors hit landing page -> 1,000 register account -> 800 verify email -> 50 invite team members -> 10 upload data -> 5 convert to paid. The product team wants to focus all optimization efforts on redesigning the landing page. Where should optimization focus actually prioritize? | pass→pass | 15,634 | 15,603 | -0% | 1 | 1 | 0% | 2,669 | 3,644 | +37% | 0 | 0 | — |
▸case-21 We need copy for our B2B project management software's immediate welcome modal shown right after email confirmation. Our marketing team suggested using: 'Welcome to PlatformX! We are an industry-leading synergistic enterprise collaboration framework designed to empower cross-functional paradigms. Click Next to begin our guided overview.' How should this copy be rewritten? | pass→pass | 10,713 | 12,693 | +18% | 1 | 1 | 0% | 1,855 | 3,120 | +68% | 0 | 0 | — |
▸case-22 We want to run an experiment on our SaaS onboarding flow. Variant A is our current 8-step wizard requiring profile setup, team invite, theme choice, notification settings, and bio creation. We want to test Variant B. How should Variant B be designed for a flow simplification experiment? | pass→pass | 14,041 | 15,033 | +7% | 1 | 1 | 0% | 2,253 | 3,363 | +49% | 0 | 0 | — |