▸case-01 I need a complete, standalone HTML documentation page for our new REST Auth API. Please structure it as a single file containing a three-column layout—a left navigation bar, middle documentation content, and right-hand table of contents section. Include realistic endpoint details, code examples, and callout boxes. Return the HTML wrapped inside an artifact block using type="text/html" and an appropriate title, with a single introductory sentence before the tag and no text after it. | fail→fail | 25,832 | 25,539 | -1% | 1 | 1 | 0% | 6,236 | 6,904 | +11% | 0 | 0 | — |
▸case-02 Can you build a full HTML documentation page for a CLI deployment tool named deploy-cli? It should be delivered as a single self-contained HTML file with three distinct regions: a sidebar menu for topic links, a main article body for the command reference and setup instructions, and a right-side section anchor menu. Ensure the response format uses an <artifact> element with type="text/html" and an identifier like docs-deploy-cli, preceded by exactly one summary sentence and no trailing commentary. | fail→fail | 25,525 | 26,574 | +4% | 1 | 1 | 0% | 6,242 | 6,910 | +11% | 0 | 0 | — |
▸case-03 Please generate a realistic documentation page for our Python database SDK (db-client-py). I want a self-contained HTML document with a three-panel design—a sticky site navigation column on the left, the primary guide prose with code blocks and a table in the center, and an on-page section TOC on the right. Output the result inside an HTML artifact tag (<artifact identifier="docs-db-client" type="text/html" title="...">), preceded by just one sentence of explanation and with zero text following the closing tag. | fail→fail | 26,574 | 25,449 | -4% | 1 | 1 | 0% | 6,251 | 6,919 | +11% | 0 | 0 | — |
▸case-04 Build a documentation page in HTML for an event streaming framework called StreamFlow. It must be delivered as a single self-contained HTML artifact (<artifact identifier="docs-streamflow" type="text/html" title="StreamFlow Documentation">). Provide three columns that automatically support right-to-left language flipping by using standard logical CSS layout rules instead of physical left/right CSS properties. | fail→pass | 27,276 | 24,441 | -10% | 1 | 1 | 0% | 6,219 | 6,887 | +11% | 0 | 0 | — |
▸case-05 Create an HTML documentation page for a container orchestration tool named PodMatrix. Deliver it inside an HTML artifact tag block (<artifact identifier="docs-podmatrix" type="text/html" title="PodMatrix Docs">). Standard web design often uses flexbox for column layouts, but I need this page structured strictly using CSS Grid for the three-panel layout. | pass→pass | 25,567 | 24,968 | -2% | 1 | 1 | 0% | 6,213 | 6,881 | +11% | 0 | 0 | — |
▸case-14 Write a single-file HTML documentation page for a background worker queue named TaskRunner. Enclose it inside an artifact tag (<artifact identifier="docs-taskrunner" type="text/html" title="TaskRunner Manual">). The currently active page link in the left menu must be styled with a prominent vertical border stripe. | pass→pass | 24,645 | 25,638 | +4% | 1 | 1 | 0% | 6,206 | 6,874 | +11% | 0 | 0 | — |
▸case-06 Write a complete single-file HTML manual page for a JavaScript UI library named Quartz Components. Enclose the document in an artifact tag (<artifact identifier="docs-quartz" type="text/html" title="Quartz Docs">). Make sure structural sections use custom data attributes for automated UI testing identification. | fail→fail | 25,880 | 26,357 | +2% | 1 | 1 | 0% | 6,201 | 6,869 | +11% | 0 | 0 | — |
▸case-07 Generate a single-file HTML doc page for a cache service named QuickMem. Return it inside an artifact tag (<artifact identifier="docs-quickmem" type="text/html" title="QuickMem Guide">). The side panels for site navigation and page section anchors must remain fixed in view as the user scrolls through long article content. | fail→pass | 26,637 | 25,081 | -6% | 1 | 1 | 0% | 6,209 | 6,877 | +11% | 0 | 0 | — |
▸case-08 Draft an HTML documentation page for a key-value store named KeyVault. Output it within an artifact tag block (<artifact identifier="docs-keyvault" type="text/html" title="KeyVault Reference">). Ensure the center article column restricts line length for comfortable reading. | pass→pass | 25,149 | 25,331 | +1% | 1 | 1 | 0% | 6,197 | 6,865 | +11% | 0 | 0 | — |
▸case-09 Construct a full HTML guide page for an API gateway called GateKeeper. Format it inside an artifact tag (<artifact identifier="docs-gatekeeper" type="text/html" title="GateKeeper Docs">). Every H2 and H3 section heading in the main content must be directly targetable by anchor links in the right-hand TOC. | fail→fail | 24,681 | 26,286 | +7% | 1 | 1 | 0% | 6,210 | 6,878 | +11% | 0 | 0 | — |
▸case-10 Generate an HTML documentation page for a Rust logging crate named Timber. Wrap it inside an artifact block (<artifact identifier="docs-timber" type="text/html" title="Timber Crate Docs">). Code blocks in the content should visually indicate that commands can be copied, without requiring active JavaScript execution. | fail→fail | 27,614 | 25,472 | -8% | 1 | 1 | 0% | 6,202 | 6,870 | +11% | 0 | 0 | — |
▸case-11 Create an HTML documentation page for an image processing service called PixelShift. Return it inside an artifact tag (<artifact identifier="docs-pixelshift" type="text/html" title="PixelShift Docs">). Provide a thorough written guide rather than placeholder text. | fail→fail | 26,399 | 24,704 | -6% | 1 | 1 | 0% | 6,193 | 6,861 | +11% | 0 | 0 | — |
▸case-12 Build a single HTML documentation page for an ORM named QueryCraft. Deliver it within an artifact element (<artifact identifier="docs-querycraft" type="text/html" title="QueryCraft Docs">). The main text body must include a shell command, a multi-line code block, a callout message box, and a structured data table. | fail→fail | 26,195 | 26,539 | +1% | 1 | 1 | 0% | 6,212 | 6,880 | +11% | 0 | 0 | — |
▸case-13 Generate a full HTML documentation page for a search engine service called SearchPulse. Format the response inside an artifact block (<artifact identifier="docs-searchpulse" type="text/html" title="SearchPulse Docs">). The left navigation sidebar must contain grouped navigation sections rather than a flat list of links. | fail→fail | 27,652 | 25,423 | -8% | 1 | 1 | 0% | 6,202 | 6,870 | +11% | 0 | 0 | — |
▸case-15 Create a complete HTML docs page for an analytics SDK called MetricHub. Output it within an artifact tag block (<artifact identifier="docs-metrichub" type="text/html" title="MetricHub Docs">). Make sure the CSS includes media queries to adapt the layout on narrower screen widths below 900px. | fail→pass | 24,891 | 25,149 | +1% | 1 | 1 | 0% | 6,207 | 6,875 | +11% | 0 | 0 | — |
▸case-16 Produce an HTML documentation page for an object storage API named CloudBucket. Put the document in an artifact container (<artifact identifier="docs-cloudbucket" type="text/html" title="CloudBucket Docs">). Adhere strictly to output formatting: write exactly one sentence of text before opening the artifact tag, and append zero text after the closing tag. | pass→pass | 25,369 | 33,201 | +31% | 1 | 1 | 0% | 6,212 | 6,880 | +11% | 0 | 0 | — |
▸case-17 Generate an HTML documentation page for a GraphQL client named GraphLight. Format it inside an artifact tag (<artifact identifier="docs-graphlight" type="text/html" title="GraphLight Guide">). The right column table of contents section should feature an explicit heading introducing on-page anchor navigation. | fail→fail | 24,512 | 26,015 | +6% | 1 | 1 | 0% | 6,201 | 6,869 | +11% | 0 | 0 | — |
▸case-18 Author an HTML documentation page for a web framework named MicroWeb. Return it inside an artifact tag (<artifact identifier="docs-microweb" type="text/html" title="MicroWeb Reference">). Code snippets should be formatted with designated monospace design tokens rather than generic unstyled system monospace fonts. | pass→pass | 27,403 | 26,509 | -3% | 1 | 1 | 0% | 6,202 | 6,870 | +11% | 0 | 0 | — |
▸case-19 Build an HTML documentation page for a message broker system named EventGrid. Output it within an artifact tag (<artifact identifier="docs-eventgrid" type="text/html" title="EventGrid Docs">). Include visual callout elements for notes and warnings in the main article body. | pass→fail | 27,412 | 27,012 | -1% | 1 | 1 | 0% | 6,198 | 6,866 | +11% | 0 | 0 | — |
▸case-20 Write a React component file in JSX that renders a documentation sidebar navigation tree with expandable group folders and search filtering. | pass→fail | 23,061 | 25,696 | +11% | 1 | 1 | 0% | 5,216 | 6,831 | +31% | 0 | 0 | — |
▸case-21 Write a comprehensive README.md file in Markdown for a Python CLI tool, including installation instructions, usage examples, and a contribution guide. | pass→fail | 15,550 | 25,901 | +67% | 1 | 1 | 0% | 2,937 | 6,836 | +133% | 0 | 0 | — |
▸case-22 Generate an OpenAPI 3.0 specification in YAML format for a REST API that handles user authentication, token refresh, and user profile management. | pass→fail | 19,739 | 25,431 | +29% | 1 | 1 | 0% | 3,718 | 6,837 | +84% | 0 | 0 | — |