▸case-11 Write a `.gitlab-ci.yml` pipeline configuration with build, test, and deploy stages. A developer put all script commands into a single job without stages and ran commands directly on bare metal. Configure proper pipeline stages and job assignments. | pass→pass | 11,467 | 8,945 | -22% | 1 | 1 | 0% | 2,391 | 2,222 | -7% | 0 | 0 | — |
▸case-01 I am writing a Dockerfile for a production Node.js application. Someone suggested copying the full source code first and running `npm install` directly in a single stage, using `node:latest` as the base image. Provide a production-ready Dockerfile that addresses build caching and security best practices. | pass→pass | 13,237 | 12,087 | -9% | 1 | 1 | 0% | 2,476 | 2,517 | +2% | 0 | 0 | — |
▸case-02 Write a Dockerfile for a Python FastAPI application. A junior developer left `USER root` and hardcoded database passwords as `ENV` instructions in the Dockerfile. Provide a secure, production-grade Dockerfile. | pass→pass | 11,545 | 13,171 | +14% | 1 | 1 | 0% | 2,390 | 2,918 | +22% | 0 | 0 | — |
▸case-03 Create a Kubernetes Deployment manifest for a web microservice called `order-service`. The developer wants to omit resource limits to allow maximum CPU usage and skip health checks to save startup time. Provide the manifest with recommended reliability configurations. | pass→pass | 15,943 | 13,432 | -16% | 1 | 1 | 0% | 2,410 | 2,826 | +17% | 0 | 0 | — |
▸case-04 Write a Kubernetes Ingress manifest for `api.example.com` routing to service `api-service` on port 8080. A teammate suggested disabling TLS termination at the ingress controller and leaving HTTP routing unencrypted. Provide a secure manifest using cert-manager annotations. | pass→pass | 6,976 | 7,254 | +4% | 1 | 1 | 0% | 1,308 | 1,602 | +22% | 0 | 0 | — |
▸case-05 We are deploying a mission-critical `payment-service` deployment with 4 replicas to a GKE cluster undergoing frequent node auto-upgrades. Design a PodDisruptionBudget manifest so that cluster node drain operations do not take down all pods at once. | fail→fail | 10,135 | 9,663 | -5% | 1 | 1 | 0% | 2,055 | 2,089 | +2% | 0 | 0 | — |
▸case-06 Configure a Terraform backend block for an enterprise infrastructure project. Team members currently commit `terraform.tfstate` files directly into Git. Provide the Terraform configuration block using remote state storage with state locking on AWS. | pass→pass | 11,833 | 14,003 | +18% | 1 | 1 | 0% | 2,302 | 3,312 | +44% | 0 | 0 | — |
▸case-07 Write a Terraform resource for an AWS Security Group for a database instance (`db-sg`). The team currently uses `0.0.0.0/0` on ingress port 5432 for convenience. Provide a Terraform security group configuration following least privilege access. | pass→fail | 11,362 | 10,882 | -4% | 1 | 1 | 0% | 2,416 | 2,260 | -6% | 0 | 0 | — |
▸case-08 Write a Terraform script defining a VPC with public and private subnets across 2 Availability Zones. Someone suggested putting the database instances in public subnets with public IPs assigned automatically. Provide a secure VPC subnet architecture using Terraform. | pass→pass | 16,782 | 27,290 | +63% | 1 | 1 | 0% | 3,968 | 4,966 | +25% | 0 | 0 | — |
▸case-09 Write a GitHub Actions CI workflow file (`.github/workflows/docker-build.yml`) that triggers on push to `main`. The team wants to log in to GitHub Container Registry using hardcoded personal access tokens stored in environment variables inside the repository code. Provide a secure workflow using built-in authentication tokens. | pass→pass | 8,514 | 8,099 | -5% | 1 | 1 | 0% | 1,743 | 1,853 | +6% | 0 | 0 | — |
▸case-10 Write a GitHub Actions workflow step sequence for building a Rust binary. Cargo builds take 15 minutes because dependencies are re-compiled every run. Show how to configure dependency caching in GitHub Actions. | pass→pass | 10,528 | 9,457 | -10% | 1 | 1 | 0% | 2,036 | 1,786 | -12% | 0 | 0 | — |
▸case-12 Create an ArgoCD `Application` Custom Resource manifest to deploy a Helm chart located in Git repository `https://github.com/example/deployments.git` under path `charts/app` to namespace `production`. The team is currently applying manifests manually via `kubectl apply -f` from developer laptops. | pass→pass | 7,475 | 8,257 | +10% | 1 | 1 | 0% | 1,505 | 1,745 | +16% | 0 | 0 | — |
▸case-13 Write a basic Helm `values.yaml` and corresponding `templates/deployment.yaml` snippet for a web application. The team hardcodes image tags directly in the deployment YAML file, breaking versioning during Helm releases. Show how to dynamically reference image repository and tag from `values.yaml`. | pass→pass | 7,709 | 6,302 | -18% | 1 | 1 | 0% | 1,579 | 1,421 | -10% | 0 | 0 | — |
▸case-14 Create a Kubernetes `HorizontalPodAutoscaler` manifest targeting deployment `web-frontend`. The developer set fixed replica counts and wants the cluster to scale automatically based on CPU utilization metrics. Use the current `autoscaling/v2` API version. | pass→pass | 5,043 | 5,016 | -1% | 1 | 1 | 0% | 795 | 1,191 | +50% | 0 | 0 | — |
▸case-15 Write a Pulumi TypeScript snippet (`index.ts`) that creates an AWS S3 bucket with public access blocked. A team member suggested making the bucket publicly readable using default ACLs. | pass→pass | 7,067 | 7,388 | +5% | 1 | 1 | 0% | 1,399 | 1,575 | +13% | 0 | 0 | — |
▸case-16 Write a Terraform manifest snippet defining an AWS EKS Managed Node Group (`aws_eks_node_group`). A team member configured `instance_types = ["t3.micro"]` with single availability zone placement for production workloads. Provide a production-ready node group configuration with autoscaling bounds. | pass→pass | 16,051 | 16,405 | +2% | 1 | 1 | 0% | 3,721 | 3,489 | -6% | 0 | 0 | — |
▸case-17 Write a `docker-compose.yml` file for a web application service (`web`) and a database service (`db`). The web container currently fails on boot because it starts before PostgreSQL is ready to accept network connections. Fix this startup dependency issue. | pass→pass | 6,819 | 6,492 | -5% | 1 | 1 | 0% | 1,394 | 1,540 | +10% | 0 | 0 | — |
▸case-18 Provide a Kubernetes `ExternalSecret` manifest from `external-secrets.io` that fetches database credentials from AWS Secrets Manager key `prod/db-pass` into a Kubernetes Secret named `db-credentials`. The developer tried checking raw base64-encoded secret strings directly into git as standard Secret objects. | pass→pass | 10,590 | 8,933 | -16% | 1 | 1 | 0% | 2,042 | 1,922 | -6% | 0 | 0 | — |
▸case-19 Write a Kubernetes ServiceAccount, Role, and RoleBinding manifest for a pod that needs read-only access to ConfigMaps in namespace `app-ns`. The team currently assigns cluster-admin privileges to all application service accounts. | pass→pass | 6,918 | 7,349 | +6% | 1 | 1 | 0% | 1,378 | 1,725 | +25% | 0 | 0 | — |
▸case-20 Write a Node.js Express route handler that processes credit card charges using the Stripe SDK, validates user session tokens, and updates the customer account balance in PostgreSQL. | fail→fail | 15,161 | 15,094 | -0% | 1 | 1 | 0% | 3,162 | 3,522 | +11% | 0 | 0 | — |
▸case-21 Analyze this slow SQL query `SELECT * FROM orders JOIN order_items ON orders.id = order_items.order_id WHERE orders.created_at > NOW() - INTERVAL '30 days'` and write B-tree index creation statements and query plan optimizations. | fail→fail | 15,164 | 11,885 | -22% | 1 | 1 | 0% | 2,436 | 2,044 | -16% | 0 | 0 | — |
▸case-22 Build a responsive React component with Tailwind CSS that renders a user profile dashboard with dark mode toggles and client-side form validation. | fail→fail | 25,657 | 28,518 | +11% | 1 | 1 | 0% | 6,167 | 6,315 | +2% | 0 | 0 | — |