▸case-01 We are redesigning our e-commerce mobile checkout flow to reduce drop-offs and improve satisfaction. Can you help us build a structured UX metric plan to evaluate this design change? Please outline key indicators across user actions, user sentiment, and business impact, and provide complete specifications for each metric including how to track it and who manages it. | fail→pass | 32,036 | 14,079 | -56% | 1 | 1 | 0% | 6,209 | 2,945 | -53% | 0 | 0 | — |
▸case-02 Our product team is refreshing the onboarding workflow for our SaaS web application. I need a comprehensive measurement strategy to evaluate whether the new design is successful. Please define actionable success metrics spanning user behaviors and attitudes, along with structured tracking details for each operationalizing step. | fail→pass | 16,181 | 18,344 | +13% | 1 | 1 | 0% | 2,897 | 3,665 | +27% | 0 | 0 | — |
▸case-03 I'm leading a redesign of our customer service portal and need to prove the value of our UI improvements to stakeholders. Could you establish a clear UX measurement framework for us? Include balanced metrics that connect our design changes to user experience and business goals, fully detailed in a standardized format. | fail→pass | 19,287 | 17,236 | -11% | 1 | 1 | 0% | 3,565 | 3,343 | -6% | 0 | 0 | — |
▸case-04 We are updating the main analytics dashboard for our enterprise SaaS platform. We want to evaluate the user experience impact of this UI revamp using Google's user-centered framework. Could you structure a metric plan using Happiness, Engagement, Adoption, Retention, and Task Success for this dashboard? | fail→fail | 16,085 | 16,468 | +2% | 1 | 1 | 0% | 2,669 | 3,036 | +14% | 0 | 0 | — |
▸case-05 Our mobile banking app team wants to track 12 different usability and business signals after releasing a new peer-to-peer payment flow. What primary metrics should we track to avoid overwhelming the product team while keeping track of design impact? | pass→pass | 13,212 | 12,439 | -6% | 1 | 1 | 0% | 2,198 | 2,368 | +8% | 0 | 0 | — |
▸case-12 Please draft a fully specified metric card for 'Checkout Form Error Rate' following a standardized UX metric structure. | pass→pass | 18,739 | 7,238 | -61% | 1 | 1 | 0% | 3,163 | 1,470 | -54% | 0 | 0 | — |
▸case-06 We need a standard specification table for a single primary metric: 'Medication Adherence Log Completion' in our digital health application. Please provide the full parameter details needed to track this design outcome operationally. | pass→pass | 12,583 | 10,190 | -19% | 1 | 1 | 0% | 2,230 | 1,868 | -16% | 0 | 0 | — |
▸case-07 Our medical software team needs to define UX metrics for a new clinical workflow UI. The team is inclined to only track conversion rate and total revenue impact. How should we structure our metrics to ensure design quality and usability are actually measured? | pass→pass | 13,996 | 12,574 | -10% | 1 | 1 | 0% | 2,502 | 2,378 | -5% | 0 | 0 | — |
▸case-08 We are introducing a redesigned instant search bar in our video streaming platform. Provide a complete UX metric plan to evaluate feature discovery and overall user delight. | fail→fail | 18,278 | 12,710 | -30% | 1 | 1 | 0% | 3,177 | 2,755 | -13% | 0 | 0 | — |
▸case-09 Our fintech team is launching a simplified 3-step personal loan application. We want to measure user experience beyond just approval rates. What behavioral and attitudinal metrics should we establish? | pass→pass | 17,288 | 14,804 | -14% | 1 | 1 | 0% | 2,552 | 2,904 | +14% | 0 | 0 | — |
▸case-10 We are revamping our developer documentation portal to improve API key generation and code sample copy rate. Outline a UX evaluation plan with full tracking specifications for each recommended metric. | fail→pass | 19,607 | 17,704 | -10% | 1 | 1 | 0% | 3,963 | 3,623 | -9% | 0 | 0 | — |
▸case-11 Our online learning platform redesigned the student assignment submission interface. How should we structure the measurement process before launching the changes to production? | pass→pass | 16,395 | 11,611 | -29% | 1 | 1 | 0% | 2,694 | 2,446 | -9% | 0 | 0 | — |
▸case-13 Apply the HEART framework to measure the redesign of an internal HR portal used by new employees during onboarding. | fail→pass | 14,147 | 14,110 | -0% | 1 | 1 | 0% | 2,502 | 2,591 | +4% | 0 | 0 | — |
▸case-14 Delivery drivers using our mobile app report difficulty finding route updates. We are releasing a simplified notification card layout. What UX metrics should we define to track if this UI change resolves their issues? | fail→pass | 12,636 | 10,440 | -17% | 1 | 1 | 0% | 1,919 | 2,081 | +8% | 0 | 0 | — |
▸case-15 We redesigned the social feed algorithm display controls. Define engagement and retention metrics for this design update. | fail→fail | 14,272 | 16,100 | +13% | 1 | 1 | 0% | 2,346 | 2,701 | +15% | 0 | 0 | — |
▸case-16 Our telehealth app simplified the doctor appointment booking flow from 6 screens to 2 screens. Define a metric plan to measure the impact on patient experience. | fail→pass | 16,831 | 15,428 | -8% | 1 | 1 | 0% | 2,681 | 2,796 | +4% | 0 | 0 | — |
▸case-17 Security analysts use our platform to triage security alerts. We redesigned the alert detail view to reduce cognitive load. Outline a metric strategy to measure effectiveness. | fail→pass | 16,900 | 16,186 | -4% | 1 | 1 | 0% | 2,618 | 2,810 | +7% | 0 | 0 | — |
▸case-18 We are adding dark mode and custom theme settings to our desktop writing app. Define success metrics for feature discovery and adoption. | fail→pass | 12,584 | 11,629 | -8% | 1 | 1 | 0% | 2,189 | 2,344 | +7% | 0 | 0 | — |
▸case-19 Define a UX metric framework balancing attitudinal satisfaction (like CSAT) and business outcome metrics for a gaming marketplace checkout update. | pass→pass | 17,109 | 16,158 | -6% | 1 | 1 | 0% | 2,818 | 3,162 | +12% | 0 | 0 | — |
▸case-20 We are conducting a moderated usability study with 8 users for a new checkout design. Write a verbatim 5-step moderator interview script and task scenario prompt list for the facilitator to read aloud. | pass→pass | 13,396 | 12,136 | -9% | 1 | 1 | 0% | 2,436 | 2,505 | +3% | 0 | 0 | — |
▸case-21 We want to run an A/B test on our landing page button color. Current baseline conversion is 5% and we want to detect a 0.5% absolute lift at 80% statistical power and alpha 0.05. Calculate the exact required sample size per variant using standard statistical formulas. | pass→pass | 10,795 | 11,066 | +3% | 1 | 1 | 0% | 2,609 | 2,804 | +7% | 0 | 0 | — |
▸case-22 Our design system engineering team needs a standardized token naming taxonomy for color, typography, and spacing variables in CSS and Figma. Please define a 3-tier token naming convention with examples. | pass→pass | 18,555 | 13,574 | -27% | 1 | 1 | 0% | 3,950 | 2,900 | -27% | 0 | 0 | — |