▸case-01 I need to reverse-engineer our legacy Python subscription management service before we rebuild it in Go. Please analyze the attached repository files and deliver a clean domain specification artifact. The output should define the system boundaries, identify actors and their responsibilities, consolidate the business rules and state changes currently spread across the service layer and database schemas, and lay out explicit preconditions, postconditions, and failure recovery handling. Ensure the final document presents a factual functional contract of what the system is intended to do, separating core business domain requirements from framework boilerplate and database mechanics. | fail→fail | 43,498 | 3,331 | -92% | 1 | 1 | 0% | 8,298 | 2,299 | -72% | 0 | 0 | — |
▸case-02 We have a legacy e-commerce checkout and order fulfillment codebase across four Django apps where validation logic, status checks, and external API calls are mixed together. I want you to inspect this code and produce a comprehensive functional specification document. The document must structure the workflow into clear operational rules, model the implicit state transitions found across entity models, map required inputs and outputs for each workflow stage, and outline domain invariants. Please make sure the spec captures purely the intended business behaviors and outcomes, stripping away low-level implementation details like Redis caching, database foreign key constraints, and HTTP request headers. | fail→fail | 44,158 | 4,255 | -90% | 1 | 1 | 0% | 8,306 | 2,391 | -71% | 0 | 0 | — |
▸case-03 I am handing you the source code for our recruitment and interviewing platform's candidate scheduling module. Can you reverse-engineer this module into a formal system specification contract? The deliverable should include defined scope and boundaries, a list of domain entities and relationships, consolidated business policies with explicit preconditions, and a failure handling model. Write the output as a clear specification suitable for both product managers and developers, focusing on the underlying domain intent rather than specific ORM queries, token handling, or third-party SDK calls. | fail→fail | 31,820 | 8,617 | -73% | 1 | 1 | 0% | 6,057 | 3,491 | -42% | 0 | 0 | — |
▸case-04 Analyze this Python Django candidate model for our hiring platform specification: `class Candidacy(models.Model): applied_at = models.DateTimeField(auto_now_add=True); reminded_at = models.DateTimeField(null=True, blank=True); completed_at = models.DateTimeField(null=True, blank=True); feedback_id = models.IntegerField(null=True, blank=True)`. Please map the entity fields and database schema directly into the domain specification document. | fail→pass | 12,281 | 12,595 | +3% | 1 | 1 | 0% | 2,521 | 4,536 | +80% | 0 | 0 | — |
▸case-05 In analyzing our legacy sales platform code, `order_service.py` calls the transaction entity `Order` (`def process_order(order_id)`), while `billing_service.py` calls the exact same entity `Purchase` (`def record_purchase(purchase_id)`). When generating the domain specification document, keep both terms 'Order' and 'Purchase' in the spec entities section and add an 'also known as' footnote so developers recognize both files. | fail→pass | 4,236 | 7,506 | +77% | 1 | 1 | 0% | 824 | 3,248 | +294% | 0 | 0 | — |
▸case-06 Our inventory service has this Python method: `def sync_stock(): for i in range(3): try: resp = requests.post(url, headers={'X-Legacy-Bypass': 'true'}); break; except: time.sleep(5)`. Please draft the functional specification rule for inventory synchronization, making sure to document the X-Legacy-Bypass HTTP header and 5-second delay retry loop as core functional requirements. | fail→fail | 10,594 | 13,742 | +30% | 1 | 1 | 0% | 2,032 | 4,082 | +101% | 0 | 0 | — |
▸case-16 Our notification service contains a 500-line Python dictionary mapping 40 SendGrid email template IDs, SMTP port numbers, TLS handshake retries, and header formatting rules. Include this complete dictionary and SMTP retry rule set inside the core functional business specification. | pass→pass | 23,745 | 10,693 | -55% | 1 | 1 | 0% | 5,335 | 3,740 | -30% | 0 | 0 | — |
▸case-07 In reverse-engineering our tax service, we found a code branch `if settings.ENABLE_EXPERIMENTAL_V1_TAX_CALCULATOR:` containing a complex 300-line tax algorithm. Git blame shows this flag was set to `False` five years ago and no callers exist. Document both the experimental V1 tax algorithm and current V2 tax algorithm in the functional domain rules. | fail→pass | 18,028 | 16,453 | -9% | 1 | 1 | 0% | 3,065 | 4,845 | +58% | 0 | 0 | — |
▸case-08 Here is our notification function in Python: `def notify_interviewer(email, slot): token = generate_jwt_token(email); requests.post('https://hooks.slack.com/services/T00/B00/X00', json={'text': f'Interview scheduled at {slot}, token={token}'})`. Produce a domain specification rule for this behavior, documenting that the system must send an HTTP POST payload containing a JWT token to Slack. | fail→pass | 7,392 | 8,357 | +13% | 1 | 1 | 0% | 1,480 | 3,422 | +131% | 0 | 0 | — |
▸case-09 We have payment check logic scattered across three files: `routes.py` checks `if user.status != 'ACTIVE': raise HTTP_403`, `payout_service.py` checks `if user.balance < amount: raise ValueError()`, and `user_model.py` checks `if datetime.now() < user.payout_eligible_at: raise DomainError()`. Create three distinct domain specification rules corresponding to each code file. | pass→fail | 8,189 | 8,504 | +4% | 1 | 1 | 0% | 1,858 | 3,750 | +102% | 0 | 0 | — |
▸case-10 In our B2B portal codebase, 'Sign in with Google' is displayed on the login UI for enterprise single sign-on. Deep in the backend backend, Google Cloud KMS is used to encrypt customer field data. When producing a domain specification document, exclude 'Sign in with Google' as a vendor implementation detail, but detail Google Cloud KMS key management in the domain functional requirements. | fail→pass | 12,103 | 12,746 | +5% | 1 | 1 | 0% | 2,135 | 4,143 | +94% | 0 | 0 | — |
▸case-17 We finished extracting a domain specification draft from our legacy warehouse management system. Explain how to validate the specification hypothesis, specifically recommending that running unit tests against the legacy code is the sole validation required. | fail→pass | 13,255 | 20,780 | +57% | 1 | 1 | 0% | 1,990 | 5,326 | +168% | 0 | 0 | — |
▸case-11 Our checkout service has separate explicit strategy classes for Stripe, PayPal, and Adyen with distinct regional eligibility logic and user flow branches per country. When extracting the business domain spec, strip out all payment gateway names and replace them with a single generic 'Process Payment' requirement. | pass→pass | 8,567 | 25,249 | +195% | 1 | 1 | 0% | 1,393 | 6,343 | +355% | 0 | 0 | — |
▸case-12 In our subscription cancellation code, an unhandled exception inside `try: send_cancellation_email() except: pass` silently suppresses confirmation emails whenever email gateway latency exceeds 2 seconds. When reverse-engineering the domain specification contract, document that subscription cancellation is intended to suppress confirmation emails during gateway slowdowns. | fail→pass | 10,321 | 7,777 | -25% | 1 | 1 | 0% | 1,571 | 3,277 | +109% | 0 | 0 | — |
▸case-13 In our Java billing system, processing a payment involves `AbstractPaymentProcessorFactory`, `IPaymentStrategyResolver`, `PaymentProxyListener`, and `DefaultPaymentDispatcher`. Reverse-engineer this module into a system specification document, ensuring you include the factory, resolver, proxy, and dispatcher interfaces in the domain architecture section. | fail→fail | 32,109 | 21,508 | -33% | 1 | 1 | 0% | 6,557 | 5,793 | -12% | 0 | 0 | — |
▸case-14 In our hiring database schema: `CREATE TABLE applications (id SERIAL PRIMARY KEY, candidate_id INT REFERENCES candidates(id), job_id INT REFERENCES jobs(id));`. Map this table structure into our domain model specification, explicitly listing `id: integer`, `candidate_id: integer`, and `job_id: integer` as entity attributes. | fail→fail | 3,833 | 12,662 | +230% | 1 | 1 | 0% | 758 | 4,423 | +484% | 0 | 0 | — |
▸case-15 In our authentication module, user sessions are managed by generating 256-bit HMAC JWT tokens passed in `Authorization: Bearer <token>` headers and stored in Redis with a 3600-second TTL. Reverse-engineer this into a domain specification rule, documenting HMAC key signatures and Redis header parsing as functional identity requirements. | fail→pass | 14,773 | 13,223 | -10% | 1 | 1 | 0% | 2,641 | 4,357 | +65% | 0 | 0 | — |
▸case-18 Given this employee promotion function: `def promote(emp): assert emp.rating >= 4; if emp.status != 'ACTIVE': raise Ineligible(); emp.title = emp.next_title; emp.salary *= 1.15; db.session.commit()`. Please write pseudocode for this function for the specification document. | fail→pass | 8,210 | 6,894 | -16% | 1 | 1 | 0% | 1,647 | 3,343 | +103% | 0 | 0 | — |
▸case-19 We are building a brand new real-time collaborative whiteboarding platform from scratch in Rust and WebAssembly. Please design the system architecture, select the cloud database, design the WebSocket message frame protocol, and produce a technical architecture document for our engineering team. | pass→pass | 43,672 | 41,620 | -5% | 1 | 1 | 0% | 8,239 | 10,240 | +24% | 0 | 0 | — |
▸case-20 Here is a slow Python function that processes a CSV file of sales data. Please rewrite this code using Pandas and multiprocessing to make it run 10x faster, maintaining exact existing output format. | pass→fail | 11,386 | 2,105 | -82% | 1 | 1 | 0% | 2,204 | 2,356 | +7% | 0 | 0 | — |
▸case-21 Please inspect our FastAPI Python router file and generate a valid OpenAPI 3.0 YAML specification document containing all path items, parameter schemas, and HTTP response codes. | fail→fail | 10,024 | 7,614 | -24% | 1 | 1 | 0% | 1,653 | 3,383 | +105% | 0 | 0 | — |
▸case-22 Our production Node.js service is crashing with an out-of-memory error every 48 hours. Here is the heap dump analysis and garbage collection log. Help me diagnose the memory leak and provide a fix. | fail→fail | 8,643 | 8,086 | -6% | 1 | 1 | 0% | 1,488 | 3,255 | +119% | 0 | 0 | — |