▸case-01 We are building an e-commerce checkout service in Node.js that calls the Stripe REST API to process credit card payments. Developers currently execute live network requests to Stripe sandbox keys during unit tests, causing slow build times and flaky failures when offline. Draft a unit testing mocking strategy for this external HTTP dependency. | pass→pass | 19,620 | 20,886 | +6% | 1 | 1 | 0% | 3,571 | 4,275 | +20% | 0 | 0 | — |
▸case-02 Our engineering organization is migrating a monolithic order management system into 15 distributed microservices using gRPC and HTTP. Developers propose running a full end-to-end environment with all 15 microservices deployed in Docker Compose for every pull request test run, causing build times over 45 minutes. Propose an architectural test strategy for inter-service communication that eliminates full environment cluster requirements. | pass→pass | 16,667 | 22,250 | +33% | 1 | 1 | 0% | 2,833 | 4,090 | +44% | 0 | 0 | — |
▸case-03 A fintech backend team achieving 95% statement coverage on an authentication module suffered a production bug because a multi-condition branch was never evaluated when secondary flags were false. The team wants to raise their statement coverage target to 100% to prevent this. Explain why 100% statement coverage is insufficient and identify the specific coverage metric they should track. | pass→pass | 15,211 | 14,305 | -6% | 1 | 1 | 0% | 2,554 | 2,196 | -14% | 0 | 0 | — |
▸case-04 A healthcare application calculates drug dosages based on patient weight and age. All unit tests pass with 100% line and branch coverage, but a bug where greater-than was swapped with greater-than-or-equal-to in a threshold check bypassed code review because no assertion checked the exact boundary value. Suggest an automated testing technique to detect non-asserting or weak unit test suites. | pass→pass | 12,162 | 10,438 | -14% | 1 | 1 | 0% | 2,176 | 1,831 | -16% | 0 | 0 | — |
▸case-05 An online ticketing application experiences memory leaks and database connection pool exhaustion that only occur after 12 hours of steady traffic during peak sales events. The team currently runs 5-minute load bursts and detects no issues. Propose the performance test design required to uncover this failure mode. | pass→pass | 17,259 | 18,384 | +7% | 1 | 1 | 0% | 2,572 | 3,044 | +18% | 0 | 0 | — |
▸case-11 A HIPAA-compliant health tech startup wants to populate its staging database for integration and load testing. Engineers suggest taking a nightly dump of the production MySQL database containing unencrypted patient medical histories and restoring it directly to staging. Propose a compliant test data architecture strategy. | pass→pass | 18,624 | 19,764 | +6% | 1 | 1 | 0% | 3,031 | 3,000 | -1% | 0 | 0 | — |
▸case-06 A REST API endpoint accepts JSON payload parameters for user search queries. The engineering team currently relies solely on static code analysis in CI. What dynamic security testing strategy should be introduced to validate input sanitization against SQL injection and parameter tampering at runtime? | pass→pass | 18,023 | 22,274 | +24% | 1 | 1 | 0% | 2,884 | 3,770 | +31% | 0 | 0 | — |
▸case-07 A team building a serverless REST API backed by AWS DynamoDB and AWS Lambda is attempting to follow the traditional Test Pyramid with 80% isolated unit tests with mocked AWS SDK calls. However, bugs keep slipping into production due to IAM permissions and DynamoDB query syntax errors. Recommend an alternative test architecture distribution tailored for integration-heavy cloud services. | pass→pass | 19,776 | 20,224 | +2% | 1 | 1 | 0% | 2,787 | 3,766 | +35% | 0 | 0 | — |
▸case-08 A PostgreSQL-backed Rails backend test suite runs 2,000 integration tests in parallel, but tests frequently fail randomly because test cases read and mutate shared database records created by prior runs. The team proposes adding automated retry loops to all failing tests. What test isolation architecture strategy should be implemented instead? | pass→pass | 14,169 | 13,169 | -7% | 1 | 1 | 0% | 2,392 | 2,393 | +0% | 0 | 0 | — |
▸case-09 A flash-sale e-commerce platform needs to test how its checkout API handles zero traffic exploding to 50,000 requests per second within 5 seconds when a drop opens. The team plans to run a standard ramp-up load test that increases traffic by 10% every 5 minutes up to 50,000 requests per second over an hour. Evaluate this plan and specify the correct load profile. | pass→pass | 13,222 | 17,219 | +30% | 1 | 1 | 0% | 2,304 | 3,177 | +38% | 0 | 0 | — |
▸case-10 An enterprise web app implements OAuth 2.0 PKCE authentication. The QA team needs a security test plan covering JWT token validation vulnerabilities. What specific token validation attack vectors and edge cases should be included in the test plan? | pass→pass | 21,358 | 24,828 | +16% | 1 | 1 | 0% | 3,704 | 4,162 | +12% | 0 | 0 | — |
▸case-12 A legacy monolithic application takes 4 hours to run its full 10,000-case regression test suite. Developers want to run the complete suite on every pull request commit, causing massive CI build bottlenecks. How should the regression testing strategy be redesigned to provide fast PR feedback without sacrificing release quality? | pass→pass | 14,380 | 11,979 | -17% | 1 | 1 | 0% | 2,598 | 2,091 | -20% | 0 | 0 | — |
▸case-13 A Java Spring Boot application uses complex SQL queries with PostgreSQL JSONB operators and window functions. Developers are currently mocking the repository interface layer with unit mocks, but SQL syntax errors are frequently slipping past CI into production. What strategy should be used for database testing? | pass→pass | 14,366 | 12,902 | -10% | 1 | 1 | 0% | 2,227 | 2,724 | +22% | 0 | 0 | — |
▸case-14 A React single-page application interacts with a GraphQL backend API. The QA team is creating 300 browser-based end-to-end UI tests to verify that GraphQL schema field modifications do not break client views. The test pipeline takes 2 hours and breaks on minor CSS changes. What test plan design change should be made? | pass→pass | 11,599 | 11,007 | -5% | 1 | 1 | 0% | 1,740 | 2,087 | +20% | 0 | 0 | — |
▸case-15 A software team wants to add security checks to their GitHub Actions pull request workflow to catch hardcoded AWS access keys, database passwords, and unsafe SQL string concatenations before code is merged. Outline the automated security testing components for this CI integration. | pass→pass | 15,729 | 11,848 | -25% | 1 | 1 | 0% | 2,545 | 2,152 | -15% | 0 | 0 | — |
▸case-16 An SLA requires that 99% of API requests complete under 200ms. A load test report indicates an average response time of 85ms across 100,000 requests, so the team marked the performance test as passed. However, 2,000 requests actually took over 3,000ms. Explain why the load test analysis was flawed and specify the exact latency metric that must be evaluated. | pass→pass | 10,568 | 8,454 | -20% | 1 | 1 | 0% | 1,615 | 1,789 | +11% | 0 | 0 | — |
▸case-17 A web application automated test suite uses hardcoded absolute XPath selectors like `/html/body/div[3]/div[2]/form/input[1]` across 150 test files. Every minor HTML markup modification breaks dozens of tests. Recommend a resilient UI test architectural pattern and DOM targeting strategy. | pass→pass | 12,046 | 18,172 | +51% | 1 | 1 | 0% | 2,371 | 3,761 | +59% | 0 | 0 | — |
▸case-18 A cloud microservices cluster running on Kubernetes must handle pod crashes, network latency, and third-party service outages gracefully. Standard load tests pass fine when all pods are healthy. What specialized performance and reliability test methodology should be added to the test plan to evaluate system resilience under failure conditions? | pass→pass | 12,850 | 17,508 | +36% | 1 | 1 | 0% | 2,137 | 2,831 | +32% | 0 | 0 | — |
▸case-19 A web application allows users to upload profile pictures and PDF documents. The engineering team needs a security test plan to verify protection against malicious file uploads. What specific security test cases should be included in the test plan? | pass→pass | 23,173 | 22,009 | -5% | 1 | 1 | 0% | 3,600 | 3,906 | +9% | 0 | 0 | — |
▸case-20 Write a complete GitHub Actions workflow YAML file (`.github/workflows/deploy.yml`) that builds a Docker image, pushes it to Amazon ECR, and deploys it to an AWS ECS Fargate cluster on push to main branch. | pass→pass | 14,458 | 13,495 | -7% | 1 | 1 | 0% | 2,559 | 2,844 | +11% | 0 | 0 | — |
▸case-21 Draft an end-user customer support manual and user guide explaining how non-technical retail customers can reset their account password, update billing information, and manage email notification preferences in our mobile app. | pass→pass | 16,025 | 12,617 | -21% | 1 | 1 | 0% | 2,465 | 2,502 | +2% | 0 | 0 | — |
▸case-22 Write the production Python FastAPI backend code for a REST endpoint `/api/v1/calculate-tax` that calculates state sales tax rates based on zip code and returns a JSON payload with tax breakdown. | fail→pass | 18,993 | 16,975 | -11% | 1 | 1 | 0% | 4,008 | 3,737 | -7% | 0 | 0 | — |