▸case-01 We are preparing for a major product launch next month and need to set up proactive site performance monitoring to prevent outages or slowdowns. Please design a comprehensive site performance watch framework that includes a tracking breakdown, an alerting and escalation workflow, and a standardized status report template to keep business and technical teams aligned. | fail→fail | 21,307 | 26,049 | +22% | 1 | 1 | 0% | 3,459 | 3,352 | -3% | 0 | 0 | — |
▸case-02 We noticed a sudden dip in online checkout conversions and suspect web page speed or backend service latency might be the issue. Provide an incident response and diagnostic workflow to help us investigate performance anomalies, log technical root causes, and structure real-time communications across engineering and merchandising leads. | fail→fail | 25,836 | 22,342 | -14% | 1 | 1 | 0% | 3,726 | 3,628 | -3% | 0 | 0 | — |
▸case-03 Ahead of our upcoming holiday traffic surge, I need an operational site performance watch plan. Outline a full monitoring setup detailing key web/API metrics to track, traffic segmentation approaches, alerting trigger protocols, and a stakeholder escalation matrix template. | fail→pass | 25,412 | 23,192 | -9% | 1 | 1 | 0% | 3,969 | 3,645 | -8% | 0 | 0 | — |
▸case-04 We are migrating our e-commerce frontend to an Nginx reverse proxy on Ubuntu Linux. Provide the Nginx configuration block to terminate TLS 1.3 using Let's Encrypt certificates and enable HTTP/2 support. | pass→pass | 13,036 | 14,621 | +12% | 1 | 1 | 0% | 2,532 | 3,074 | +21% | 0 | 0 | — |
▸case-05 Our PostgreSQL database CPU utilization spikes to 100% during high-traffic catalog search queries. Explain how to write an EXPLAIN ANALYZE query to identify unindexed foreign keys and missing index scans on the product catalog tables. | pass→pass | 19,182 | 17,904 | -7% | 1 | 1 | 0% | 3,013 | 3,100 | +3% | 0 | 0 | — |
▸case-06 We need a Terraform HCL snippet to create an AWS CloudWatch metric alarm that triggers an SNS notification when an Application Load Balancer HTTP 5XX error rate exceeds 2% over a 5-minute period. | pass→pass | 13,275 | 11,269 | -15% | 1 | 1 | 0% | 2,656 | 2,448 | -8% | 0 | 0 | — |
▸case-07 When designing our e-commerce store monitoring architecture, engineering suggests relying solely on automated synthetic headless browser tests executed every 5 minutes. What dual monitoring approach should we implement to ensure localized regional issues are not missed? | pass→pass | 15,257 | 13,800 | -10% | 1 | 1 | 0% | 2,083 | 2,188 | +5% | 0 | 0 | — |
▸case-08 During a flash sale event, checkout API latency spikes past 3 seconds and CLS breaches acceptable thresholds. Marketing wants to deploy a new promotional banner overlay immediately to boost sales. What operational action should be taken regarding site changes? | pass→pass | 10,619 | 7,504 | -29% | 1 | 1 | 0% | 1,519 | 1,283 | -16% | 0 | 0 | — |
▸case-09 During a global promotion, automated synthetic canary tests from the primary cloud region report normal 200ms API response times. However, customer support reports high checkout drop-offs in South America. Should engineering increase synthetic canary test frequency or deploy Real User Monitoring (RUM) to isolate the issue? | pass→pass | 11,001 | 12,470 | +13% | 1 | 1 | 0% | 1,536 | 1,906 | +24% | 0 | 0 | — |
▸case-10 We are setting up automated alerting in Datadog for our retail platform. What four core structural components must be defined within the alerting rules setup? | fail→pass | 10,815 | 8,406 | -22% | 1 | 1 | 0% | 1,563 | 1,442 | -8% | 0 | 0 | — |
▸case-11 When defining the technical diagnostics capabilities for our web application performance monitoring system, what specific logging, tracing, and inspection hooks must be incorporated? | pass→pass | 21,694 | 20,314 | -6% | 1 | 1 | 0% | 3,288 | 3,102 | -6% | 0 | 0 | — |
▸case-12 Our DevOps leads are preparing an incident communications kit for major shopping holidays. What three specific communication artifacts should be included in this kit? | fail→fail | 12,495 | 7,039 | -44% | 1 | 1 | 0% | 1,633 | 1,256 | -23% | 0 | 0 | — |
▸case-13 Engineering management wants a standard template for post-incident reviews following speed degradations. What mandatory sections must be present in the incident log template? | pass→pass | 17,580 | 10,332 | -41% | 1 | 1 | 0% | 2,551 | 1,796 | -30% | 0 | 0 | — |
▸case-14 Executive management requested a lightweight visual scorecard dashboard to review overall store health across key landing pages. What visual formatting element and baseline comparison should be embedded in the performance scorecard template? | pass→pass | 9,673 | 4,633 | -52% | 1 | 1 | 0% | 1,435 | 971 | -32% | 0 | 0 | — |
▸case-15 We are building an executive performance monitoring dashboard for our online store. Which metrics form the complete core KPI stack for technical performance watch? | fail→fail | 13,860 | 14,818 | +7% | 1 | 1 | 0% | 2,193 | 2,612 | +19% | 0 | 0 | — |
▸case-16 Our telemetry pipeline ingests high-volume real user metrics. Along which five specific categorical dimensions should performance data be segmented to isolate regional or cohort slowdowns? | fail→fail | 12,759 | 10,044 | -21% | 1 | 1 | 0% | 1,863 | 1,734 | -7% | 0 | 0 | — |
▸case-17 During high-volume sales events, standard email alerts often get overlooked. What severe operational escalation mechanism should be configured directly within the alerting rules framework? | pass→pass | 14,230 | 6,752 | -53% | 1 | 1 | 0% | 2,112 | 1,152 | -45% | 0 | 0 | — |
▸case-18 When major store slowdowns occur during a site-wide discount event, who should be included in the incident escalation matrix alongside software engineering leads? | pass→fail | 13,797 | 11,547 | -16% | 1 | 1 | 0% | 2,068 | 1,911 | -8% | 0 | 0 | — |
▸case-19 When monitoring detects layout shifts or broken UI states during checkout on mobile Safari, what diagnostic capability allows engineers to visually review actual customer sessions? | pass→pass | 8,480 | 6,087 | -28% | 1 | 1 | 0% | 1,190 | 1,027 | -14% | 0 | 0 | — |
▸case-20 When a new store release introduces severe backend API latency during a promotional launch, what pre-prepared operational artifact within the comms kit enables immediate mitigation? | fail→pass | 10,017 | 4,319 | -57% | 1 | 1 | 0% | 1,388 | 937 | -32% | 0 | 0 | — |
▸case-21 Why is synthetic canary monitoring insufficient on its own when evaluating site performance for global customer bases during major promotional campaigns? | pass→pass | 17,457 | 15,661 | -10% | 1 | 1 | 0% | 2,433 | 2,298 | -6% | 0 | 0 | — |
▸case-22 How should alerting rules filter out brief 5-second transient spikes in backend checkout latency before alerting on-call engineers? | pass→pass | 15,104 | 15,100 | -0% | 1 | 1 | 0% | 2,232 | 2,516 | +13% | 0 | 0 | — |