▸case-01 A team claims that their vLLM setup achieves sub-50ms Time To First Token (TTFT) on an NVIDIA A100 GPU based on a benchmark with 128-token prompts. Map the complete set of operational and workload parameters required to determine the true validity boundaries of this latency claim. | pass→fail | 48,163 | 40,907 | -15% | 1 | 1 | 0% | 7,578 | 4,763 | -37% | 0 | 0 | — |
▸case-02 A microservices engineer asserts that setting a 3-second timeout with a circuit breaker failure threshold of 5 will prevent cascading outages across microservices. Map the environmental and traffic parameters needed to determine where this claim holds or fails. | pass→pass | 28,322 | 39,622 | +40% | 1 | 1 | 0% | 3,730 | 6,393 | +71% | 0 | 0 | — |
▸case-03 An EV manufacturer claims their battery pack recharges from 10% to 80% in 15 minutes without cell degradation. Identify the full set of physical, environmental, and operational parameters governing the validity space of this fast-charging claim. | pass→pass | 31,595 | 45,619 | +44% | 1 | 1 | 0% | 4,156 | 6,813 | +64% | 0 | 0 | — |
▸case-04 A research paper reports a 94% Dice similarity coefficient for a deep learning model segmenting lung nodules in CT scans. Map the data and clinical parameters that define the boundary conditions under which this accuracy claim remains valid. | fail→pass | 25,055 | 32,658 | +30% | 1 | 1 | 0% | 3,202 | 4,375 | +37% | 0 | 0 | — |
▸case-05 A database benchmark report claims an 8-node NoSQL cluster handles 500,000 writes per second with sub-5ms latency using 1KB records. Map the key structural and operational dimensions necessary to evaluate where this throughput claim breaks down. | fail→pass | 22,017 | 48,349 | +120% | 1 | 1 | 0% | 3,549 | 6,380 | +80% | 0 | 0 | — |
▸case-06 A blockchain project advertises zk-SNARK proof generation times under 2 seconds on consumer hardware. Map the algorithmic and hardware execution parameters required to establish the precise validity envelope for this proving speed claim. | pass→pass | 34,870 | 35,725 | +2% | 1 | 1 | 0% | 4,692 | 5,873 | +25% | 0 | 0 | — |
▸case-07 A solar energy startup claims their bifacial PV panels produce 30% more energy per square meter than monofacial panels. Identify the environmental and geometric parameters that determine the validity space of this yield advantage. | pass→fail | 25,075 | 32,348 | +29% | 1 | 1 | 0% | 3,122 | 5,345 | +71% | 0 | 0 | — |
▸case-08 A consensus protocol paper asserts that a novel BFT algorithm achieves finality in 2 network round-trips even when up to 33% of nodes are malicious. Map the network topology and adversarial parameters that define the validity envelope of this claim. | fail→fail | 25,244 | 36,941 | +46% | 1 | 1 | 0% | 4,054 | 4,373 | +8% | 0 | 0 | — |
▸case-09 An autonomous driving vendor claims its vision-only perception system detects pedestrians and initiates full emergency braking within 15 meters at 45 mph. Identify the perceptual, environmental, and vehicle parameters needed to map the validity space. | pass→pass | 25,884 | 22,234 | -14% | 1 | 1 | 0% | 4,073 | 4,444 | +9% | 0 | 0 | — |
▸case-10 A cloud architecture guide states that AWS Lambda functions running Node.js have a maximum cold start delay of 200ms. Identify the configuration and deployment parameters required to map the complete parameter space for this performance claim. | pass→pass | 20,982 | 17,294 | -18% | 1 | 1 | 0% | 3,411 | 2,826 | -17% | 0 | 0 | — |
▸case-11 An aeronautics paper claims adding micro-vortex generators to a wing design reduces drag by 8% during high-angle attack maneuvers. Map the aerodynamic and geometric dimensions that define the operational regime where this claim holds. | pass→pass | 20,543 | 35,670 | +74% | 1 | 1 | 0% | 3,458 | 5,796 | +68% | 0 | 0 | — |
▸case-12 A quantum research laboratory claims 99.9% two-qubit gate fidelity on a superconducting processor. Identify the physical and environmental parameters that constrain the validity parameter space of this fidelity benchmark. | fail→fail | 22,347 | 35,310 | +58% | 1 | 1 | 0% | 3,604 | 5,386 | +49% | 0 | 0 | — |
▸case-13 A hardware vendor claims an embedded NPU delivers 60 FPS real-time object detection on 4K video streams continuously. Map the thermal, power, and algorithmic parameters required to establish the operational boundaries of this continuous performance claim. | pass→pass | 60,695 | 33,435 | -45% | 1 | 1 | 0% | 8,236 | 5,684 | -31% | 0 | 0 | — |
▸case-14 An environmental engineering firm claims a biological nutrient removal reactor achieves 95% nitrogen removal from municipal wastewater. Map the biochemical and operational parameters governing the validity domain of this removal rate. | fail→fail | 30,739 | 47,228 | +54% | 1 | 1 | 0% | 5,439 | 8,339 | +53% | 0 | 0 | — |
▸case-15 A storage drive datasheet specifies an endurance rating of 1 Drive Write Per Day (DWPD) for 5 years under enterprise workloads. Map the workload and storage engine parameters that dictate whether this endurance rating remains valid. | fail→pass | 22,786 | 27,569 | +21% | 1 | 1 | 0% | 3,783 | 4,419 | +17% | 0 | 0 | — |
▸case-16 A biotechnology study asserts a novel Cas9 variant exhibits zero detectable off-target cleavage events across the human genome. Identify the genomic, concentration, and analytical parameters required to map the parameter space of this claim. | fail→fail | 31,203 | 22,029 | -29% | 1 | 1 | 0% | 3,619 | 3,688 | +2% | 0 | 0 | — |
▸case-17 A networking vendor claims an enterprise Wi-Fi 6 access point achieves 4.8 Gbps aggregate throughput serving 64 simultaneous client devices. Map the RF environment and spatial parameters that govern the validity space of this aggregate capacity claim. | pass→pass | 203,579 | 122,012 | -40% | 1 | 1 | 0% | 5,626 | 8,351 | +48% | 0 | 0 | — |
▸case-18 A civil engineering paper reports an ultra-high-performance concrete mix achieving 150 MPa compressive strength after 28 days of curing. Identify the material, environmental, and temporal parameters that define the validity boundaries for marine deployment. | fail→pass | 23,157 | 48,623 | +110% | 1 | 1 | 0% | 3,542 | 5,312 | +50% | 0 | 0 | — |
▸case-19 A quantitative trading firm asserts their automated execution engine captures cross-exchange price arbitrage with zero slippage across major cryptocurrency pairs. Map the market microstructural and network parameters determining where this claim fails. | pass→pass | 35,345 | 36,673 | +4% | 1 | 1 | 0% | 3,807 | 5,734 | +51% | 0 | 0 | — |
▸case-20 A researcher provides a dataset of 20 lab measurements: [12.1, 12.4, 11.9, 12.3, 12.0, 12.5, 12.2, 11.8, 12.1, 12.4, 12.0, 12.2, 12.3, 11.9, 12.1, 12.5, 12.0, 12.2, 12.3, 12.1]. Calculate the sample mean and sample standard deviation of this numerical data directly. | fail→fail | 16,450 | 18,511 | +13% | 1 | 1 | 0% | 4,309 | 4,633 | +8% | 0 | 0 | — |
▸case-21 Refactor the following Python function that parses a CSV file into three smaller functions: one for reading raw CSV rows, one for transforming line item amounts, and one for summarizing total sales. Output the refactored code directly. | pass→pass | 6,444 | 9,242 | +43% | 1 | 1 | 0% | 1,252 | 1,871 | +49% | 0 | 0 | — |
▸case-22 Convert an OpenAPI 3.0 YAML schema defining a GET /users/{id} endpoint with fields 'id', 'email', and 'created_at' into an equivalent GraphQL schema type definition. Provide the GraphQL definition directly. | pass→pass | 5,019 | 12,541 | +150% | 1 | 1 | 0% | 855 | 815 | -5% | 0 | 0 | — |
▸case-23 An AI research group claims that quantizing a Transformer model from FP16 to INT4 using post-training quantization results in less than 0.5% perplexity degradation on language tasks. Map the model architecture, dataset, and quantization parameters required to evaluate this claim's validity. | pass→pass | 26,250 | 30,885 | +18% | 1 | 1 | 0% | 4,411 | 4,967 | +13% | 0 | 0 | — |
▸case-24 A materials engineering team claims 3D-printed titanium (Ti-6Al-4V) components produced via Selective Laser Melting achieve tensile strength equal to forged titanium. Map the process, structural, and thermal parameters governing the validity space of this equivalence claim. | fail→fail | 33,316 | 42,124 | +26% | 1 | 1 | 0% | 5,548 | 6,886 | +24% | 0 | 0 | — |
▸case-25 A climate technology company claims their solid-sorbent direct air capture system captures CO2 from ambient air at an energy cost of 1.2 MWh per ton. Map the atmospheric, thermodynamic, and physical parameters governing the validity boundaries of this energy claim. | pass→pass | 39,011 | 50,617 | +30% | 1 | 1 | 0% | 6,713 | 8,355 | +24% | 0 | 0 | — |