▸case-01 We are setting up a lightweight single-user desktop application that needs local persistence with zero network overhead. Should we configure PostgreSQL with a local socket or use an embedded file-based relational storage engine? | pass→pass | 12,475 | 11,068 | -11% | 1 | 1 | 0% | 2,085 | 1,833 | -12% | 0 | 0 | — |
▸case-02 We are setting up a multi-node web backend requiring concurrent write operations, row-level locking, and strict ACID compliance across hosts. Should we use an embedded SQLite database file on shared NFS or a dedicated client-server relational database engine? | pass→pass | 12,069 | 15,436 | +28% | 1 | 1 | 0% | 2,049 | 1,924 | -6% | 0 | 0 | — |
▸case-03 We are configuring local session caching for a distributed web service where sub-millisecond key-value retrieval is required across multiple service instances. Should we store sessions in local memory variables on each host or use a dedicated in-memory key-value data store engine? | pass→pass | 17,802 | 12,402 | -30% | 1 | 1 | 0% | 2,647 | 2,065 | -22% | 0 | 0 | — |
▸case-04 We want to validate our engine configuration files and print the planned directory initialization steps without modifying the underlying file system. Which CLI flag standardly simulates the execution plan? | pass→pass | 5,061 | 2,943 | -42% | 1 | 1 | 0% | 854 | 443 | -48% | 0 | 0 | — |
▸case-05 Our project setup needs isolated, reproducible execution environments across macOS, Linux, and Windows development machines. Should we write platform-specific shell scripts or use a containerization runtime engine? | fail→pass | 15,333 | 13,361 | -13% | 1 | 1 | 0% | 2,561 | 2,214 | -14% | 0 | 0 | — |
▸case-06 When bootstrapping project settings from the OS environment, how should application-specific settings be namespaced to prevent collisions with system variables? | pass→pass | 13,211 | 11,391 | -14% | 1 | 1 | 0% | 2,307 | 2,389 | +4% | 0 | 0 | — |
▸case-07 We need an HTML template rendering engine for NodeJS setup generation that enforces strict separation of logic and view presentation without executing arbitrary JavaScript inside templates. Should we use EJS or Handlebars? | pass→pass | 9,910 | 7,222 | -27% | 1 | 1 | 0% | 1,679 | 1,318 | -22% | 0 | 0 | — |
▸case-08 During automated CI setup, the engine initialization step hangs indefinitely if an external dependency is unreachable. What setting prevents infinite blocking during setup initialization? | pass→pass | 6,938 | 15,201 | +119% | 1 | 1 | 0% | 1,307 | 2,521 | +93% | 0 | 0 | — |
▸case-09 We are setting up a Python web service that offloads long-running video transcoding tasks to background workers. Should we execute these synchronously inside the HTTP request loop or route them through an asynchronous task queue engine? | pass→pass | 15,489 | 14,205 | -8% | 1 | 1 | 0% | 2,191 | 2,431 | +11% | 0 | 0 | — |
▸case-10 What standard development port allocation should be configured for a newly initialized web service engine when no PORT environment variable is explicitly provided? | pass→pass | 10,192 | 6,341 | -38% | 1 | 1 | 0% | 1,806 | 1,095 | -39% | 0 | 0 | — |
▸case-11 Our project already uses PostgreSQL for relational data and now requires similarity search over 50,000 text embeddings. Should we spin up a separate standalone vector database cluster or integrate an extension into our existing database engine? | pass→pass | 15,758 | 12,768 | -19% | 1 | 1 | 0% | 2,238 | 1,865 | -17% | 0 | 0 | — |
▸case-12 Where should persistent engine runtime state, lockfiles, and local PID records be stored on Linux systems following standard file system hierarchy conventions? | pass→fail | 11,907 | 10,027 | -16% | 1 | 1 | 0% | 2,378 | 1,844 | -22% | 0 | 0 | — |
▸case-13 We are designing a microservices project setup that requires message queuing with complex routing keys, publish/subscribe patterns, and guaranteed message delivery. Should we use simple HTTP polling or an AMQP message broker engine? | pass→pass | 12,817 | 11,198 | -13% | 1 | 1 | 0% | 2,127 | 1,831 | -14% | 0 | 0 | — |
▸case-14 What logging verbosity level should be set by default in the project configuration template during initial development setup to expose detailed execution traces? | fail→fail | 7,432 | 6,482 | -13% | 1 | 1 | 0% | 1,228 | 1,032 | -16% | 0 | 0 | — |
▸case-15 We are initializing a backend service where frontend clients need to request flexible, nested data structures in a single round-trip. Should we build rigid REST endpoints for every permutation or adopt a GraphQL schema engine? | pass→pass | 16,453 | 10,977 | -33% | 1 | 1 | 0% | 2,330 | 1,749 | -25% | 0 | 0 | — |
▸case-16 When configuring a background setup engine on a build machine with multi-core CPUs, how should worker thread concurrency defaults be determined dynamically? | pass→pass | 16,570 | 14,747 | -11% | 1 | 1 | 0% | 2,871 | 2,597 | -10% | 0 | 0 | — |
▸case-17 We are setting up an e-commerce catalog platform requiring full-text search, fuzzy matching, and multi-faceted aggregation over millions of documents. Should we run SQL LIKE queries or deploy a dedicated full-text search engine? | pass→pass | 15,657 | 13,596 | -13% | 1 | 1 | 0% | 2,593 | 2,322 | -10% | 0 | 0 | — |
▸case-18 Which OS termination signal should the project setup engine trap to clean up temporary resources and release file locks before exiting? | pass→pass | 8,750 | 7,472 | -15% | 1 | 1 | 0% | 1,536 | 1,087 | -29% | 0 | 0 | — |
▸case-19 We are setting up a Java enterprise application where business analysts frequently modify complex conditional pricing policies independently of code deployments. Should we hardcode if-else statements or use a declarative business rules engine? | pass→pass | 14,199 | 13,375 | -6% | 1 | 1 | 0% | 2,288 | 2,177 | -5% | 0 | 0 | — |
▸case-20 We have finished selecting and initializing our project engine. How do we author a GitHub Actions workflow YAML file to run npm test on every git push? | pass→pass | 8,502 | 7,807 | -8% | 1 | 1 | 0% | 1,645 | 1,479 | -10% | 0 | 0 | — |
▸case-21 Our production server log files are growing unbounded in /var/log/app.log. How do we configure logrotate on Ubuntu to compress and rotate these daily? | pass→pass | 9,525 | 8,482 | -11% | 1 | 1 | 0% | 1,793 | 1,660 | -7% | 0 | 0 | — |
▸case-22 A schema migration deployed to production added a faulty column constraint in PostgreSQL. How do we write a SQL migration rollback script to drop the constraint safely without data loss? | pass→pass | 12,295 | 7,875 | -36% | 1 | 1 | 0% | 1,905 | 1,653 | -13% | 0 | 0 | — |