▸case-01 We need to build a real-time collaborative whiteboarding web application. Please provide a full technical plan that covers sub-tasks with execution sequence, high-level component architecture and data flow, project milestones, and key technical risks with mitigations. | fail→fail | 43,578 | 22,037 | -49% | 1 | 1 | 0% | 7,553 | 3,092 | -59% | 0 | 0 | — |
▸case-12 Plan the transition from Jenkins to GitHub Actions for a microservice repository with 80 services. Give us a polite opening greeting and a friendly closing remark. | fail→fail | 13,648 | 16,871 | +24% | 1 | 1 | 0% | 2,243 | 3,102 | +38% | 0 | 0 | — |
▸case-02 Our team is preparing to migrate our legacy monolithic e-commerce system to a microservices architecture on AWS. Create a structured technical implementation plan that includes a detailed task breakdown, system design overview with tech stack justifications, milestone deliverables, and risk mitigation strategies. | fail→pass | 50,007 | 16,762 | -66% | 1 | 1 | 0% | 8,239 | 2,921 | -65% | 0 | 0 | — |
▸case-03 I'm looking to develop an offline-first iOS and Android mobile app for field inspectors to log report data and sync with the backend. Help me plan this initiative by laying out the required technical tasks, architectural choices, major delivery phases, and potential technical bottlenecks with solutions. | fail→pass | 23,328 | 15,250 | -35% | 1 | 1 | 0% | 3,710 | 2,696 | -27% | 0 | 0 | — |
▸case-04 We are integrating Stripe and Adyen into our SaaS billing platform. Provide a complete implementation roadmap detailing tasks, architecture, milestones with time estimates in business days, and risks. Also add a summary paragraph at the end explaining the overall business impact. | fail→fail | 47,479 | 18,280 | -61% | 1 | 1 | 0% | 8,237 | 3,405 | -59% | 0 | 0 | — |
▸case-05 Design an engineering execution plan for a HIPAA-compliant telehealth patient portal with video consultations and EHR integration. Please include sample React component code and TypeScript interfaces for the patient dashboard. | fail→fail | 43,647 | 17,948 | -59% | 1 | 1 | 0% | 8,223 | 3,158 | -62% | 0 | 0 | — |
▸case-06 Help us plan a distributed web crawler and Elasticsearch indexing pipeline processing 10 million documents daily. Start with an introductory overview paragraph explaining why search indexing is important for modern apps. | fail→fail | 18,695 | 18,913 | +1% | 1 | 1 | 0% | 3,070 | 3,310 | +8% | 0 | 0 | — |
▸case-07 We need a plan to deploy a real-time fraud detection ML model on Kubernetes using Triton Inference Server. Provide the task breakdown, component architecture, delivery milestones, and risk mitigations. | fail→fail | 29,283 | 16,177 | -45% | 1 | 1 | 0% | 5,066 | 2,866 | -43% | 0 | 0 | — |
▸case-08 Create a technical implementation plan for a low-latency HLS video streaming platform handling 50k concurrent viewers. Include complete NGINX configuration files and Python HLS packaging scripts. | fail→pass | 42,544 | 15,801 | -63% | 1 | 1 | 0% | 8,226 | 2,989 | -64% | 0 | 0 | — |
▸case-09 Plan the migration of a single-tenant MySQL database to a multi-tenant PostgreSQL architecture with row-level security. Include estimated milestone durations in calendar months. | fail→fail | 24,517 | 38,210 | +56% | 1 | 1 | 0% | 4,093 | 3,541 | -13% | 0 | 0 | — |
▸case-10 Provide a technical plan for an IoT device management system receiving MQTT payloads from 100,000 connected vehicles. Please end the document with a comprehensive executive summary. | fail→pass | 51,051 | 18,452 | -64% | 1 | 1 | 0% | 8,224 | 3,278 | -60% | 0 | 0 | — |
▸case-11 We are implementing Okta OIDC SSO across 15 enterprise web applications. Provide a detailed step-by-step implementation plan. Include Python sample code showing how to validate JWT tokens. | fail→fail | 37,090 | 20,684 | -44% | 1 | 1 | 0% | 6,411 | 3,731 | -42% | 0 | 0 | — |
▸case-13 We need an immutable audit ledger system using PostgreSQL append-only tables and cryptographic hashing. Outline the task breakdown, system design, milestones, and risks. Estimate milestones in engineering weeks. | fail→fail | 29,345 | 16,593 | -43% | 1 | 1 | 0% | 4,827 | 2,849 | -41% | 0 | 0 | — |
▸case-14 Outline a technical plan for a personalized product recommendation engine using Qdrant vector database and Neo4j graph database. Lay out the task breakdown, system design, milestones, and risks. | pass→pass | 24,213 | 15,613 | -36% | 1 | 1 | 0% | 4,075 | 2,986 | -27% | 0 | 0 | — |
▸case-15 Design a plan for an online multiplayer matchmaking system running on Agones and Kubernetes. Provide C++ code snippets for the server allocation API handler. | fail→fail | 26,349 | 15,178 | -42% | 1 | 1 | 0% | 4,866 | 2,656 | -45% | 0 | 0 | — |
▸case-16 Plan the development of a Hyperledger Fabric supply chain tracking system for pharmaceutical tracking. Please write a warm introduction section introducing the project team. | fail→fail | 27,399 | 26,533 | -3% | 1 | 1 | 0% | 4,719 | 4,619 | -2% | 0 | 0 | — |
▸case-17 Create a technical plan to implement certificate pinning, biometrics, and root detection in an Android banking app. Specify task breakdown, component data flow, milestones, and risks. Provide milestone duration estimates in days. | fail→fail | 41,703 | 20,891 | -50% | 1 | 1 | 0% | 7,613 | 3,767 | -51% | 0 | 0 | — |
▸case-18 Plan the implementation of a C++ low-latency UDP market data feed parser. Include the C++ struct definitions for the FIX protocol packet header. | fail→fail | 30,229 | 17,668 | -42% | 1 | 1 | 0% | 4,646 | 3,241 | -30% | 0 | 0 | — |
▸case-19 We are replacing REST endpoints with a Apollo GraphQL federation gateway across our services. Create a technical plan for this migration and include a concluding summary section reviewing key takeaways. | fail→pass | 23,711 | 13,378 | -44% | 1 | 1 | 0% | 3,862 | 2,521 | -35% | 0 | 0 | — |
▸case-20 Develop an engineering plan for an autonomous drone obstacle avoidance software system using ROS2 and LiDAR sensors. Include code examples of the C++ node initialization. | fail→pass | 26,373 | 14,068 | -47% | 1 | 1 | 0% | 5,111 | 2,592 | -49% | 0 | 0 | — |
▸case-21 We need a plan to build a real-time messaging backend supporting 1 million concurrent WebSocket connections using Elixir/Phoenix. Provide an introductory overview of WebSockets before starting. | fail→fail | 27,434 | 21,281 | -22% | 1 | 1 | 0% | 4,902 | 3,464 | -29% | 0 | 0 | — |
▸case-22 Write a complete Python function using the hashlib and hmac libraries to verify a Webhook signature from Stripe given the raw payload, signature header, and secret. | pass→fail | 13,071 | 10,550 | -19% | 1 | 1 | 0% | 2,502 | 2,112 | -16% | 0 | 0 | — |
▸case-23 Review this Pull Request diff for a Rust HTTP handler that parses JSON input. Identify any safety issues, memory leaks, or unhandled errors in the code:
```rust
pub async fn handle_user(body: Bytes) -> Result<impl IntoResponse, StatusCode> {
let user: User = serde_json::from_slice(&body).unwrap();
Ok(Json(user))
}
``` | pass→fail | 11,361 | 9,579 | -16% | 1 | 1 | 0% | 1,972 | 1,705 | -14% | 0 | 0 | — |
▸case-24 Write a post-mortem report for a database outage caused by an unindexed query during peak traffic. Include an executive summary, incident timeline, root cause analysis, and remediation action items. | pass→fail | 18,759 | 12,470 | -34% | 1 | 1 | 0% | 3,011 | 2,324 | -23% | 0 | 0 | — |