▸case-01 We're launching a new team workspace feature for our SaaS platform next week. Could you help us construct a complete user communication plan? Please detail the activation conditions, suitable UI prompt styles, audience criteria, performance tracking indicators, and accessibility guidelines. | fail→fail | 17,276 | 17,308 | +0% | 1 | 1 | 0% | 2,815 | 2,704 | -4% | 0 | 0 | — |
▸case-02 We are designing a nudge strategy for our analytics tool's new automated reporting module. The team plans to rely purely on click/action events like clicking 'Create Report'. How should we structure our trigger model to catch users at the right moment? | pass→pass | 15,261 | 13,604 | -11% | 1 | 1 | 0% | 2,469 | 2,457 | -0% | 0 | 0 | — |
▸case-03 For our B2B CRM product, our product manager wants to send an in-app feature announcement for Advanced Lead Scoring to every Enterprise-tier Sales Manager. How should we expand our targeting rules beyond plan and persona? | pass→pass | 14,390 | 14,276 | -1% | 1 | 1 | 0% | 2,165 | 2,505 | +16% | 0 | 0 | — |
▸case-04 We are building an onboarding modal for our video editing web app. The team proposed listing four action buttons: 'Watch 2-Min Demo', 'Start Interactive Walkthrough', 'Invite Team Members', and 'Dismiss'. How should we refine the call-to-action strategy? | pass→pass | 13,179 | 11,411 | -13% | 1 | 1 | 0% | 2,226 | 1,999 | -10% | 0 | 0 | — |
▸case-05 Our SaaS messaging system sends in-app banners as soon as a milestone event fires, even if a user is in the middle of a high-intensity workflow at late hours. How should we regulate message timing to prevent fatigue? | pass→pass | 14,219 | 15,254 | +7% | 1 | 1 | 0% | 2,326 | 2,552 | +10% | 0 | 0 | — |
▸case-06 We are expanding our mobile app to global markets (Japan, Brazil, Germany) and preparing localization guidelines for in-app microcopy. What structural elements should our localization and accessibility specification include besides translated strings? | fail→fail | 20,529 | 17,285 | -16% | 1 | 1 | 0% | 3,143 | 2,795 | -11% | 0 | 0 | — |
▸case-07 Our marketing team wants a standardized brief template for requesting new in-app nudges from engineering. What specific structural fields should be mandated in every message brief? | pass→pass | 12,184 | 13,422 | +10% | 1 | 1 | 0% | 2,015 | 2,564 | +27% | 0 | 0 | — |
▸case-08 We are running A/B tests on three different tooltip variants for our self-serve checkout feature. How should we set up our experiment tracking log to ensure actionable insights? | pass→pass | 17,807 | 15,606 | -12% | 1 | 1 | 0% | 2,808 | 2,670 | -5% | 0 | 0 | — |
▸case-09 Our customer success team uses email workflows while product uses in-app banners and support uses chat prompts. Users are getting duplicate onboarding messages across channels. How should we coordinate lifecycle messaging? | pass→pass | 13,322 | 15,288 | +15% | 1 | 1 | 0% | 2,311 | 2,640 | +14% | 0 | 0 | — |
▸case-10 We are introducing a complex multi-step workspace setup process for new project managers. Should we use full-screen overlay popups for every single step, or is there a better messaging pattern combination? | fail→pass | 14,507 | 10,391 | -28% | 1 | 1 | 0% | 2,170 | 1,754 | -19% | 0 | 0 | — |
▸case-11 We placed a prominent modal prompt pushing free users to upgrade to paid. CTR is up 25%. Is measuring CTR and upgrade conversions sufficient to evaluate this campaign's success? | pass→pass | 13,367 | 12,213 | -9% | 1 | 1 | 0% | 1,934 | 2,059 | +6% | 0 | 0 | — |
▸case-12 Our technical writer prepared a 300-word explanation of our new encryption key management feature to put inside a feature introduction tooltip. How should we adapt this copy for in-app delivery? | fail→pass | 10,091 | 11,000 | +9% | 1 | 1 | 0% | 1,748 | 2,040 | +17% | 0 | 0 | — |
▸case-13 Our design and engineering teams are spending weeks coding custom popups from scratch for every product announcement. What artifact should we establish to streamline in-app message implementation? | pass→pass | 12,537 | 11,153 | -11% | 1 | 1 | 0% | 2,020 | 2,000 | -1% | 0 | 0 | — |
▸case-14 We are experiencing low delivery rates for our system password reset emails and magic login links. Our DKIM, SPF, and DMARC records are configured on AWS SES. How should we optimize our DNS record alignment and dedicated IP warming schedule to fix deliverability? | pass→pass | 19,400 | 18,120 | -7% | 1 | 1 | 0% | 3,243 | 3,267 | +1% | 0 | 0 | — |
▸case-15 We are refactoring our core Figma UI kit and CSS implementation to establish a 3-tier design token structure (Global, Alias, Component) for primary and secondary action buttons. What color variable naming convention and contrast math (WCAG 2.1 AA) should we use for our design system foundation? | pass→pass | 20,937 | 24,058 | +15% | 1 | 1 | 0% | 4,253 | 5,476 | +29% | 0 | 0 | — |
▸case-16 Our marketing team wants to improve organic keyword rankings and conversion rates on the Google Play Store listing and public marketing landing page for our budgeting app. How should we structure our title tags, meta descriptions, and screenshot captions for search engine optimization? | pass→pass | 18,624 | 17,237 | -7% | 1 | 1 | 0% | 3,205 | 3,222 | +1% | 0 | 0 | — |
▸case-17 We want to show advanced productivity shortcuts in our document editor to increase engagement. Which user cohort should receive these prompts during their journey? | pass→pass | 14,761 | 8,576 | -42% | 1 | 1 | 0% | 2,207 | 1,534 | -30% | 0 | 0 | — |
▸case-18 When a user navigates to the 'Cancel Subscription' settings page and hovers over 'Delete Account', we want to offer assistance. What messaging pattern is best suited for responsive contextual help without locking the interface? | pass→pass | 11,494 | 10,786 | -6% | 1 | 1 | 0% | 1,975 | 1,924 | -3% | 0 | 0 | — |
▸case-19 We want to promote our automated workflow builder feature to users who have been signed up for 30 days, regardless of how many workflows or tasks they have created. Is account age sufficient? | pass→pass | 11,269 | 11,193 | -1% | 1 | 1 | 0% | 1,708 | 1,986 | +16% | 0 | 0 | — |
▸case-20 In our accessibility guidelines for in-app onboarding guides, we have included ARIA labels and screen reader support. What option should be provided if an assistive technology user gets stuck during an automated UI guide? | fail→pass | 11,221 | 7,914 | -29% | 1 | 1 | 0% | 1,885 | 1,468 | -22% | 0 | 0 | — |
▸case-21 We have a cloud storage app where users reach 95% disk capacity. Should we trigger a low-space warning banner only when they attempt an upload action? | pass→pass | 13,864 | 13,152 | -5% | 1 | 1 | 0% | 2,047 | 2,242 | +10% | 0 | 0 | — |
▸case-22 Our users often fail CSV file uploads due to incorrect column headers. Where and when should the CSV format help prompt be displayed to maximize relevance? | pass→pass | 13,662 | 11,181 | -18% | 1 | 1 | 0% | 2,148 | 2,042 | -5% | 0 | 0 | — |