▸case-01 I sell handcrafted goods on Etsy ($8k/mo) and Shopify ($22k/mo) and want to establish a trend analysis and anomaly detection framework to catch sudden revenue drops early. Could you guide me on setting up appropriate KPIs for my business stage? Please structure your response with a brief summary of findings at the beginning, standard metric benchmarks, a prioritized checklist of action items, a ⚠️ icon next to any estimated figures, and concrete next steps at the bottom. | fail→fail | 20,134 | 24,536 | +22% | 1 | 1 | 0% | 3,255 | 4,247 | +30% | 0 | 0 | — |
▸case-02 We are generating roughly $50K monthly across Amazon and TikTok Shop, but we lack visibility into SKU-level performance and customer cohort behavior. Can you help us design a cross-platform sales monitoring setup? I'd like the output to open with an overview of key findings, incorporate relevant data benchmarks, list prioritized recommendations, use a ⚠️ symbol to mark any numbers based on partial data, and conclude with direct next steps. | fail→pass | 19,632 | 17,052 | -13% | 1 | 1 | 0% | 3,049 | 3,174 | +4% | 0 | 0 | — |
▸case-03 My brand recently launched on BigCommerce and Walmart, scaling to $60K/mo total sales, and I need a structured performance tracking system to evaluate daily and weekly sales trends. Please analyze our situation and build a dashboard structure for us. In your report, please start with a summary of findings, provide industry benchmarks where relevant, organize your recommendations into prioritized action items, tag approximate values with ⚠️, and end with clear next steps. | fail→pass | 30,302 | 20,160 | -33% | 1 | 1 | 0% | 4,871 | 3,672 | -25% | 0 | 0 | — |
▸case-04 We sell on Amazon and Shopify ($40K/mo) and need to optimize our Amazon Sponsored Products campaign keyword bids to reduce advertising cost of sales (ACoS). Can you provide automated bid adjustment algorithms and negative keyword lists? | pass→pass | 25,536 | 16,489 | -35% | 1 | 1 | 0% | 4,109 | 3,217 | -22% | 0 | 0 | — |
▸case-05 We run a WooCommerce and eBay store doing $25K/mo. We keep running out of top-selling items. Can you calculate economic order quantities (EOQ) and lead-time safety stock thresholds for our physical inventory planning? | pass→pass | 15,905 | 9,252 | -42% | 1 | 1 | 0% | 2,833 | 2,099 | -26% | 0 | 0 | — |
▸case-06 We process $80K/mo across BigCommerce and Etsy. We need to determine physical and economic sales tax nexus thresholds for California and New York and configure tax rate tables. Can you evaluate our state sales tax nexus obligations? | pass→pass | 18,736 | 10,252 | -45% | 1 | 1 | 0% | 2,940 | 2,258 | -23% | 0 | 0 | — |
▸case-07 I manage a WooCommerce store selling apparel ($15K/mo) and want to start tracking performance metrics. Instead of giving me a final plan right away, ask me any needed clarifying questions. A standard AI assistant usually asks long open-ended questions, but I need you to ask them as a concise set of multiple-choice questions so I can quickly answer with shorthand like 1a 2b. | pass→pass | 5,855 | 6,989 | +19% | 1 | 1 | 0% | 1,014 | 1,726 | +70% | 0 | 0 | — |
▸case-08 We sell on eBay and Shopify generating $35K/mo. Yesterday our daily order volume dropped by 45% compared to the 30-day daily moving average. We want to configure an anomaly detection alert rule for our sales monitoring. Provide a structured guide to diagnose this anomaly, beginning with a brief summary, including concrete percentage thresholds, prioritized action steps, ⚠️ on estimated impact values, and next steps. | pass→pass | 17,987 | 19,081 | +6% | 1 | 1 | 0% | 2,779 | 3,298 | +19% | 0 | 0 | — |
▸case-09 Our Etsy and Amazon stores carry 150 SKUs totaling $50K/mo, but 10 SKUs generate 80% of revenue while several SKUs lose money. We need a SKU-level performance categorization matrix. Provide an actionable report opening with a key findings summary, standard revenue distribution benchmarks, prioritized steps, ⚠️ on estimated metrics, and concrete next steps. | pass→pass | 22,195 | 20,278 | -9% | 1 | 1 | 0% | 3,682 | 3,873 | +5% | 0 | 0 | — |
▸case-10 We operate a Shopify store generating $40K/mo in subscription and one-time sales. We want to implement cohort analysis to track 30-day, 60-day, and 90-day customer repeat purchase rates and LTV progression across monthly buyer cohorts. Please generate a cohort analysis framework report starting with a summary of findings, industry repeat rate benchmarks, prioritized action items, ⚠️ tags on estimated numbers, and concrete next steps. | pass→pass | 24,215 | 19,116 | -21% | 1 | 1 | 0% | 4,095 | 3,673 | -10% | 0 | 0 | — |
▸case-11 We sell $100K/mo across Amazon, Walmart, and TikTok Shop. We need a standard trend analysis methodology to distinguish seasonal fluctuations from true organic growth across daily, weekly, monthly, and YoY timeframes. Output a structured analysis framework starting with a summary, relevant growth benchmarks, prioritized action items, ⚠️ on estimated benchmarks, and ending with concrete next steps. | pass→pass | 21,256 | 25,125 | +18% | 1 | 1 | 0% | 3,234 | 4,705 | +45% | 0 | 0 | — |
▸case-12 I run a BigCommerce site ($20K/mo) selling electronics and want to set up automated sales alert triggers. Before giving me a detailed alerting schedule, ask me follow-up questions to understand my alert channels and sensitivity thresholds. Structure your follow-up strictly as multiple-choice questions with option codes. | pass→pass | 9,691 | 9,159 | -5% | 1 | 1 | 0% | 1,575 | 1,963 | +25% | 0 | 0 | — |
▸case-13 Our Shopify store recently hit $12K/mo selling beauty products, expanding from initial launch. What essential KPI targets and measurement frequencies should an e-commerce business at this growth stage focus on? Provide a report starting with a summary of findings, benchmark metric ranges for conversion rate and average order value, prioritized actions, ⚠️ on estimated metrics, and concrete next steps. | pass→pass | 22,596 | 15,576 | -31% | 1 | 1 | 0% | 3,534 | 2,996 | -15% | 0 | 0 | — |
▸case-14 We sell $70K/mo across TikTok Shop ($30K), Amazon ($30K), and Shopify ($10K). We suffer from fragmented platform reporting where total gross sales don't match net payouts due to platform fees and refunds. Outline a cross-platform consolidated KPI dashboard framework. Start with a summary of findings, benchmark net-to-gross ratios, prioritized action items, ⚠️ on estimates, and next steps. | pass→pass | 21,579 | 21,345 | -1% | 1 | 1 | 0% | 3,384 | 4,078 | +21% | 0 | 0 | — |
▸case-15 On our Amazon and Shopify stores ($45K/mo), sessions spiked 80% yesterday but conversion rate fell 60%, resulting in flat sales. We want to establish an automated anomaly detection workflow for conversion rate anomalies. Format your deliverable starting with a summary of findings, standard conversion rate benchmarks, prioritized action items, ⚠️ on estimated metrics, and clear next steps. | pass→pass | 25,207 | 25,556 | +1% | 1 | 1 | 0% | 3,911 | 4,437 | +13% | 0 | 0 | — |
▸case-16 We sell $80K/mo on Shopify and Amazon, and want to know whether customers acquired from Amazon have different 6-month lifetime value (LTV) than Shopify-acquired customers. Detail a cross-platform cohort tracking methodology. Please structure the output starting with a summary of findings, benchmark LTV ratios, prioritized action items, ⚠️ on approximate figures, and next steps. | pass→pass | 21,773 | 17,702 | -19% | 1 | 1 | 0% | 3,400 | 3,358 | -1% | 0 | 0 | — |
▸case-17 We sell home goods on Walmart ($15K/mo) and TikTok Shop ($25K/mo) and need a KPI dashboard setup. Rather than providing a default template immediately, ask me follow-up questions to customize the framework. Ensure all questions are formatted as multiple choice with simple codes so I can answer rapidly. | pass→pass | 7,669 | 7,591 | -1% | 1 | 1 | 0% | 1,421 | 1,862 | +31% | 0 | 0 | — |
▸case-18 Our multi-channel brand ($90K/mo on Amazon, eBay, and WooCommerce) has 300 SKUs. We suspect high-volume SKUs are eroding margins due to hidden return rates and fulfillment fees. Outline a SKU-level contribution margin tracking framework. Structure your response starting with a summary of findings, standard return rate benchmarks, prioritized action items, ⚠️ on estimated fee percentages, and next steps. | pass→pass | 23,298 | 19,846 | -15% | 1 | 1 | 0% | 3,607 | 3,852 | +7% | 0 | 0 | — |
▸case-19 We sell $110K/mo across BigCommerce, Amazon, and Walmart. We want to implement immediate alert notifications when revenue falls below daily baseline expectations or refund rates spike. Formulate an alerting rule engine blueprint. Start with a summary of findings, benchmark refund rate thresholds, prioritized action items, ⚠️ on estimated threshold values, and concrete next steps. | pass→pass | 24,472 | 22,451 | -8% | 1 | 1 | 0% | 4,125 | 4,224 | +2% | 0 | 0 | — |
▸case-20 Our Etsy and Shopify stores ($30K/mo) experience heavy Q4 holiday spikes (3x baseline) followed by Q1 slumps. We need a trend analysis framework that normalizes seasonal peaks to assess true underlying month-over-month growth. Deliver a guide starting with a summary of findings, seasonality benchmarks, prioritized action steps, ⚠️ on estimated seasonal indices, and concrete next steps. | fail→pass | 26,572 | 16,644 | -37% | 1 | 1 | 0% | 4,413 | 3,376 | -23% | 0 | 0 | — |
▸case-21 We sell auto parts on Amazon ($40K/mo) and eBay ($15K/mo). We want to set up an executive KPI overview. Before outputting the dashboard recommendations, ask me follow-up questions using a multiple-choice format with shorthand answer options to clarify our primary monitoring priorities. | pass→pass | 8,315 | 6,112 | -26% | 1 | 1 | 0% | 1,414 | 1,474 | +4% | 0 | 0 | — |
▸case-22 Our apparel brand generates $150K/mo across Shopify, Amazon, and TikTok Shop. We are in a mature scaling stage and need advanced KPI target setting (e.g., Marketing Efficiency Ratio, CAC payback period, ROAS vs Net Margin). Deliver a structured framework starting with a summary of findings, mature stage KPI benchmarks, prioritized action items, ⚠️ on estimated metrics, and concrete next steps. | pass→pass | 25,439 | 20,963 | -18% | 1 | 1 | 0% | 4,008 | 4,237 | +6% | 0 | 0 | — |