▸case-01 We are onboarding several new growth marketers and need a standard operating guide for UTM parameters and channel tracking governance. Please generate a complete playbook layout that includes taxonomy standards, data contract requirements, and a checklist for pre-launch QA. | fail→fail | 25,881 | 43,170 | +67% | 1 | 1 | 0% | 4,339 | 5,372 | +24% | 0 | 0 | — |
▸case-02 We keep finding broken tracking links and discrepancies between CRM and analytics platforms during quarterly reviews. Provide a structured audit runbook with a taxonomy framework, deduplication check routines, and a change control process for our tracking setup. | fail→fail | 27,818 | 28,306 | +2% | 1 | 1 | 0% | 4,175 | 4,625 | +11% | 0 | 0 | — |
▸case-03 We are building a tracking taxonomy document for our performance marketing team. A team member suggested focusing solely on channel, campaign, and ad creative naming standards since experiments are handled ad-hoc inside Optimizely. Design the taxonomy framework outline. | pass→pass | 20,330 | 14,860 | -27% | 1 | 1 | 0% | 3,007 | 2,480 | -18% | 0 | 0 | — |
▸case-04 Our analytics team wants to document our attribution options. Someone proposed just outlining first-touch and last-touch since those are simplest. Provide a comprehensive attribution model catalog framework. | pass→pass | 21,818 | 23,987 | +10% | 1 | 1 | 0% | 3,377 | 3,952 | +17% | 0 | 0 | — |
▸case-05 We are setting up data contracts between our marketing automation software and customer data platform. The team only documented the field data types (string, integer, timestamp). Outline the required sections for marketing data contracts. | fail→pass | 17,721 | 14,399 | -19% | 1 | 1 | 0% | 2,632 | 2,377 | -10% | 0 | 0 | — |
▸case-06 When writing data contracts for ad spend and conversion ingestion, engineers argue that listing required fields and schema types is sufficient. What critical operational specification must be added to govern data freshness? | pass→pass | 10,333 | 10,959 | +6% | 1 | 1 | 0% | 1,490 | 1,733 | +16% | 0 | 0 | — |
▸case-07 Our QA process for campaign tracking currently consists of clicking test links and checking if rows appear in GA4. What critical data integrity validation steps should be added to the QA checklist? | fail→fail | 17,938 | 15,643 | -13% | 1 | 1 | 0% | 2,520 | 2,538 | +1% | 0 | 0 | — |
▸case-08 We are planning to adjust our multi-touch attribution weights next month. The team created a quick pull request to update the SQL definitions. Outline the complete change management framework required before pushing weight updates. | fail→pass | 17,192 | 18,061 | +5% | 1 | 1 | 0% | 2,522 | 2,704 | +7% | 0 | 0 | — |
▸case-09 We need a template for campaign managers to generate UTM links. Most teams just build a basic Excel formula sheet with concatenations. What essential feature must be included alongside the builder to prevent bad data entry? | pass→pass | 10,927 | 10,404 | -5% | 1 | 1 | 0% | 1,663 | 1,932 | +16% | 0 | 0 | — |
▸case-14 When defining our campaign tagging taxonomy standards, our lead marketer drafted rules for channel and campaign naming. What remaining core dimensions belong in a complete tracking taxonomy? | fail→fail | 12,708 | 11,769 | -7% | 1 | 1 | 0% | 2,149 | 1,997 | -7% | 0 | 0 | — |
▸case-10 Leadership wants to evaluate changing our attribution model from last-click to algorithmic multi-touch. What template structure should be provided to compare historical spend and credit allocations across different models? | pass→pass | 16,600 | 17,199 | +4% | 1 | 1 | 0% | 2,760 | 2,994 | +8% | 0 | 0 | — |
▸case-11 We need standard templates for checking tracking health. The team proposed creating a single one-off checklist used only when launching new Facebook campaigns. What broader QA templates should be established? | pass→pass | 16,517 | 16,473 | -0% | 1 | 1 | 0% | 2,447 | 2,691 | +10% | 0 | 0 | — |
▸case-12 Marketing is updating the attribution model weights, which will shift lead credit from paid search to organic content. Before rolling out this change across executive dashboards, what cross-functional alignment step must occur? | pass→pass | 12,279 | 6,639 | -46% | 1 | 1 | 0% | 1,354 | 1,186 | -12% | 0 | 0 | — |
▸case-13 Our team keeps running into the same recurring UTM tagging errors (e.g. uppercase vs lowercase channel names, mixed delimiters) every quarter. What governance practice prevents repeating these historical tracking mistakes? | fail→fail | 14,835 | 15,481 | +4% | 1 | 1 | 0% | 2,076 | 2,471 | +19% | 0 | 0 | — |
▸case-15 When conducting a pre-launch tracking QA, engineers want to run automated unit tests on the tracking scripts. What manual verification step should marketing ops perform with test traffic? | pass→pass | 10,290 | 8,964 | -13% | 1 | 1 | 0% | 1,440 | 1,476 | +3% | 0 | 0 | — |
▸case-16 A growth analyst wants to unilaterally change the lookback window in Salesforce from 30 days to 90 days. What governance control should stop unannounced configuration changes? | pass→pass | 9,429 | 9,203 | -2% | 1 | 1 | 0% | 1,402 | 1,500 | +7% | 0 | 0 | — |
▸case-17 We have populated our model comparison matrix with historical attribution numbers, but leadership needs a clear executive story to make a decision. What complementary tool or methodology should be paired with this playbook for decision-ready narratives? | fail→pass | 16,203 | 11,987 | -26% | 1 | 1 | 0% | 2,224 | 1,956 | -12% | 0 | 0 | — |
▸case-18 Our CMO wants to know if we should jump straight to data-driven attribution or stick with position-based attribution. How should the attribution model catalog address this choice? | pass→pass | 16,045 | 15,470 | -4% | 1 | 1 | 0% | 2,293 | 2,458 | +7% | 0 | 0 | — |
▸case-19 We noticed paid social managers are putting ad creative names into the utm_content parameter inconsistently (some use ad IDs, others use creative concepts). What taxonomy rule fixes this? | pass→pass | 15,067 | 9,987 | -34% | 1 | 1 | 0% | 2,186 | 1,634 | -25% | 0 | 0 | — |
▸case-20 We have a dataset of user conversion paths: Path A (Search -> Social -> Convert = $100), Path B (Social -> Convert = $50). Compute the exact Shapley value attribution credit for Search and Social using cooperative game theory. | pass→pass | 12,557 | 13,032 | +4% | 1 | 1 | 0% | 2,382 | 2,622 | +10% | 0 | 0 | — |
▸case-21 Write a dbt SQL model stg_utm_events.sql that parses query parameters from raw HTTP request URLs using Snowflake URL parsing functions PARSE_URL and extracts utm_source, utm_medium, and utm_campaign. | pass→pass | 9,222 | 12,677 | +37% | 1 | 1 | 0% | 1,674 | 2,435 | +45% | 0 | 0 | — |
▸case-22 Provide the Terraform infrastructure configuration file to deploy a Google Tag Manager Server-Side container on AWS ECS Fargate with an Application Load Balancer and SSL certificate. | pass→pass | 26,293 | 29,067 | +11% | 1 | 1 | 0% | 5,345 | 6,061 | +13% | 0 | 0 | — |