▸case-04 Transform these research notes on surface codes and cat-qubit error correction into a publication-ready piece. While a quick 200-word overview might seem tempting, produce a full article that thoroughly blends the technical research notes and performance metrics. | fail→fail | 38,405 | 38,481 | +0% | 1 | 1 | 0% | 6,191 | 6,210 | +0% | 0 | 0 | — |
▸case-05 We have economic reports on LFP batteries, pumped hydro storage, and vanadium redox flow batteries. Write a detailed, comprehensive piece that synthesizes these datasets and cost digests, rather than offering a simple bullet list of storage types. | fail→fail | 40,425 | 37,900 | -6% | 1 | 1 | 0% | 6,186 | 6,205 | +0% | 0 | 0 | — |
▸case-06 Review these three research papers on LLM memory systems (RAG, episodic memory, parameter tuning). Produce an extensive article synthesizing these sources into a unified analysis, avoiding summarizing each paper independently. | fail→fail | 33,383 | 36,954 | +11% | 1 | 1 | 0% | 5,418 | 6,198 | +14% | 0 | 0 | — |
▸case-01 I have research notes on urban microclimates. Turn these notes into a 5-part Twitter/X post thread optimized for quick reading, avoiding long-form text. | fail→fail | 8,239 | 9,668 | +17% | 1 | 1 | 0% | 1,450 | 1,408 | -3% | 0 | 0 | — |
▸case-02 Here is a completed draft about autonomous drone logistics. Edit the draft line-by-line for grammar and spelling errors only. Do not rewrite, re-organize, or synthesize new material. | fail→fail | 1,871 | 2,311 | +24% | 1 | 1 | 0% | 273 | 459 | +68% | 0 | 0 | — |
▸case-03 I have provided three research digests on agricultural soil carbon sequestration. Provide an un-synthesized, bulleted extraction of facts from each document individually without writing an article narrative. | fail→fail | 2,828 | 4,470 | +58% | 1 | 1 | 0% | 390 | 590 | +51% | 0 | 0 | — |
▸case-07 Combine our regulatory filings, clinical trial outcome reports, and lipid nanoparticle delivery digests for CRISPR therapies into an in-depth article. Avoid producing a short executive briefing summary. | fail→fail | 38,418 | 38,762 | +1% | 1 | 1 | 0% | 6,174 | 6,193 | +0% | 0 | 0 | — |
▸case-08 We need a comprehensive analysis piece on EUV vs High-NA EUV lithography using these ASML spec sheets and semiconductor industry digests. Rather than providing a raw comparison table, construct a full article integrating these engineering details. | fail→pass | 35,636 | 39,422 | +11% | 1 | 1 | 0% | 6,186 | 6,205 | +0% | 0 | 0 | — |
▸case-09 Synthesize sensor fusion research papers and ISO 26262 compliance digests into a thorough, structured piece on self-driving vehicle safety architecture. Do not output a brief press release. | pass→pass | 40,637 | 37,100 | -9% | 1 | 1 | 0% | 6,179 | 6,198 | +0% | 0 | 0 | — |
▸case-10 Using magnetics research data and plasma confinement time digests for tokamaks and stellarators, construct an in-depth analytical piece. Resist the temptation to output a brief forum comment or simple opinion blurb. | fail→fail | 38,798 | 35,705 | -8% | 1 | 1 | 0% | 6,180 | 6,199 | +0% | 0 | 0 | — |
▸case-11 We have orbital tracking papers, active debris removal mechanism digests, and space law policy frameworks. Write a long-form piece that synthesizes all three domains, rather than creating a 3-bullet presentation slide. | fail→fail | 40,328 | 41,497 | +3% | 1 | 1 | 0% | 6,183 | 6,202 | +0% | 0 | 0 | — |
▸case-12 Synthesize monetary policy papers, CBDC architecture designs, and privacy protection digests into a comprehensive, extended piece. Avoid returning a brief dictionary-style definition. | pass→fail | 36,868 | 37,046 | +0% | 1 | 1 | 0% | 6,172 | 6,191 | +0% | 0 | 0 | — |
▸case-13 Combine spike-timing-dependent plasticity research notes and hardware benchmark digests for Loihi 2 and TrueNorth into a long-form piece. Do not write a 1-paragraph summary. | pass→fail | 40,054 | 36,242 | -10% | 1 | 1 | 0% | 6,152 | 6,198 | +1% | 0 | 0 | — |
▸case-14 Using spider silk protein synthesis papers, fermentation cost digests, and textile scalability analysis, write a detailed long-form piece. Do not produce a short product marketing brochure blurb. | fail→pass | 36,718 | 38,252 | +4% | 1 | 1 | 0% | 6,176 | 6,195 | +0% | 0 | 0 | — |
▸case-15 Synthesize benthic oceanography impact studies, cobalt/nickel demand digests, and ISA regulatory frameworks into a thorough long-form piece. Avoid outputting a simple pro-con bullet list. | fail→fail | 38,743 | 35,199 | -9% | 1 | 1 | 0% | 6,178 | 5,491 | -11% | 0 | 0 | — |
▸case-16 Synthesize electrolyte dendrite research papers, manufacturing yield digests, and OEM adoption timelines into a full detailed piece. Resist giving a 2-paragraph news snippet. | fail→fail | 39,961 | 37,124 | -7% | 1 | 1 | 0% | 6,173 | 6,192 | +0% | 0 | 0 | — |
▸case-17 We have solid sorbent thermodynamic research, liquid solvent digests, and energy penalty economic models. Construct an extensive long-form piece synthesizing these materials, avoiding a bulleted summary. | fail→fail | 33,775 | 39,218 | +16% | 1 | 1 | 0% | 5,294 | 6,195 | +17% | 0 | 0 | — |
▸case-18 Integrate vagus nerve signaling papers, gut microbiota sequencing digests, and clinical depression trial results into a full long-form piece. Avoid outputting a general high-level wellness blog blurb. | fail→fail | 36,620 | 36,075 | -1% | 1 | 1 | 0% | 6,180 | 6,199 | +0% | 0 | 0 | — |
▸case-19 Synthesize CFD shockwave simulation digests, high-temperature ceramic matrix composite papers, and scramjet test data into a deep long-form piece. Do not provide a quick list of top 5 facts. | pass→pass | 46,603 | 32,432 | -30% | 1 | 1 | 0% | 6,182 | 6,201 | +0% | 0 | 0 | — |
▸case-20 Combine passive safety system technical notes, NRC licensing timeline digests, and factory fabrication economics into an extensive piece. Avoid writing a short press release. | fail→fail | 38,182 | 40,280 | +5% | 1 | 1 | 0% | 6,169 | 6,188 | +0% | 0 | 0 | — |
▸case-21 Using NIST candidate algorithm benchmarks (Kyber, Dilithium), HSM hardware research, and legacy migration digests, produce a detailed long-form piece. Do not output a quick algorithm recommendation list. | pass→pass | 42,572 | 32,448 | -24% | 1 | 1 | 0% | 6,180 | 6,199 | +0% | 0 | 0 | — |
▸case-22 Synthesize zk-SNARK vs zk-STARK comparative digests, trusted setup mechanics, and Layer-2 roll-up throughput research into a comprehensive long-form piece. Avoid writing a tweet-style overview. | fail→pass | 37,415 | 35,873 | -4% | 1 | 1 | 0% | 6,183 | 6,203 | +0% | 0 | 0 | — |