▸case-21 Draft an Aeon skill that compiles TypeScript projects and fixes build errors. Ensure the SKILL.md file checks required tool availability prior to running build commands. | pass→pass | 16,550 | 13,373 | -19% | 1 | 1 | 0% | 3,224 | 2,358 | -27% | 0 | 0 | — |
▸case-01 I want to author an Aeon skill that converts plain text requests into database SQL queries using a schema. Please convert these functional requirements into the standard skill file layout with all proper metadata sections. | fail→fail | 16,773 | 13,776 | -18% | 1 | 1 | 0% | 2,002 | 2,536 | +27% | 0 | 0 | — |
▸case-19 Author an Aeon skill that checks Python code against PEP 8 style guidelines. Ensure the skill file tells the agent how to inspect local project context configuration files like setup.cfg or pyproject.toml. | pass→pass | 16,839 | 18,665 | +11% | 1 | 1 | 0% | 3,012 | 3,011 | -0% | 0 | 0 | — |
▸case-02 I have an existing SKILL.md for log parsing located in my workspace. I want to execute its benchmark tests against my sample log files to generate a pass/fail summary report. How do I run the test suite for this existing skill? | pass→fail | 12,588 | 15,076 | +20% | 1 | 1 | 0% | 2,240 | 1,915 | -15% | 0 | 0 | — |
▸case-03 I need a Python script using the official openai library to call gpt-4o-mini with a custom system message that formats customer feedback into JSON. Please write the Python script. | pass→fail | 10,874 | 14,786 | +36% | 1 | 1 | 0% | 2,287 | 2,478 | +8% | 0 | 0 | — |
▸case-04 I need a standard GitHub README.md for an open-source Rust CLI tool that includes installation steps, usage examples, and license info. Please draft the README file. | pass→fail | 10,800 | 18,964 | +76% | 1 | 1 | 0% | 2,135 | 3,759 | +76% | 0 | 0 | — |
▸case-05 I want to create an Aeon skill for reviewing pull requests for security vulnerabilities. I've heard some agents put instructions in a JSON config or top-level string. Draft the skill definition following agent skill packaging standards. | pass→pass | 17,613 | 11,215 | -36% | 1 | 1 | 0% | 3,278 | 1,884 | -43% | 0 | 0 | — |
▸case-06 Draft an Aeon skill for refactoring legacy Python 2 syntax to Python 3. Base models often name files with spaces or uppercase letters like 'Python Refactor Skill.md'. Write the full skill definition adhering to standard skill file conventions. | pass→pass | 20,285 | 15,764 | -22% | 1 | 1 | 0% | 3,749 | 3,037 | -19% | 0 | 0 | — |
▸case-07 Create an Aeon skill that automates running git commands to resolve merge conflicts. I am tempted to write bash scripts embedded in a JSON config file. Provide the standard SKILL.md file structure specifying required tooling access. | pass→pass | 14,918 | 14,430 | -3% | 1 | 1 | 0% | 2,475 | 2,096 | -15% | 0 | 0 | — |
▸case-08 Build an Aeon skill for generating OpenAPI 3.0 documentation from Fastapi route definitions. Ensure the skill file clearly specifies when an agent should invoke this skill. | fail→pass | 22,420 | 15,165 | -32% | 1 | 1 | 0% | 3,436 | 3,083 | -10% | 0 | 0 | — |
▸case-09 Create an Aeon skill that audits AWS S3 bucket policies for public access risks. I want to make sure the agent doesn't receive a single unstructured paragraph of instructions. Format the skill appropriately. | pass→pass | 15,367 | 11,404 | -26% | 1 | 1 | 0% | 2,822 | 2,185 | -23% | 0 | 0 | — |
▸case-10 Author an Aeon skill that extracts metadata from PDF invoices and outputs standardized JSON. Output the standard skill file layout, explicitly defining expected input parameters and output schema constraints. | pass→pass | 16,464 | 28,684 | +74% | 1 | 1 | 0% | 3,410 | 4,141 | +21% | 0 | 0 | — |
▸case-20 Create an Aeon skill for generating conventional commit messages from git diff outputs. Provide the complete SKILL.md file with a rigid output template. | pass→pass | 22,187 | 12,232 | -45% | 1 | 1 | 0% | 2,796 | 2,121 | -24% | 0 | 0 | — |
▸case-11 Create an Aeon skill for translating natural language into GraphQL queries. Provide the SKILL.md file, ensuring it contains explicit instructions for handling ambiguous or invalid schema fields. | pass→pass | 16,430 | 12,705 | -23% | 1 | 1 | 0% | 2,877 | 2,269 | -21% | 0 | 0 | — |
▸case-12 Author an Aeon skill for generating Dockerfiles for Node.js microservices. A common mistake is using triple backticks at the top of the file for metadata. Write the correct skill file header format. | fail→pass | 10,723 | 10,017 | -7% | 1 | 1 | 0% | 1,960 | 1,883 | -4% | 0 | 0 | — |
▸case-13 Draft an Aeon skill for analyzing Kubernetes deployment manifests for resource requests and limits. Make sure the skill file establishes the role and goal clearly for the agent. | fail→pass | 12,684 | 12,287 | -3% | 1 | 1 | 0% | 2,131 | 2,098 | -2% | 0 | 0 | — |
▸case-14 Build an Aeon skill that transforms raw CSV data into Markdown tables. Provide the skill definition using SKILL.md conventions, including sample input/output pairs to guide model performance. | pass→pass | 27,709 | 10,808 | -61% | 1 | 1 | 0% | 2,203 | 2,108 | -4% | 0 | 0 | — |
▸case-15 Write an Aeon skill for running database migrations using Prisma. The skill must explicitly instruct agents on actions they must never perform, such as dropping production databases without flags. Format this as a SKILL.md file. | pass→pass | 13,401 | 11,549 | -14% | 1 | 1 | 0% | 2,315 | 2,004 | -13% | 0 | 0 | — |
▸case-16 Author an Aeon skill that converts terraform templates to Pulumi scripts. How should the skill file be structured to ensure inputs are validated before execution? | pass→pass | 16,319 | 17,843 | +9% | 1 | 1 | 0% | 3,004 | 3,425 | +14% | 0 | 0 | — |
▸case-17 Create an Aeon skill definition for summarizing Git commit histories into release notes. Specify project metadata in the top section following standard agent skill frontmatter patterns. | pass→pass | 14,772 | 12,455 | -16% | 1 | 1 | 0% | 2,275 | 2,266 | -0% | 0 | 0 | — |
▸case-18 Design an Aeon skill for automated refactoring of React class components to functional components with hooks. Express the complex workflow in SKILL.md format. | pass→pass | 22,721 | 20,447 | -10% | 1 | 1 | 0% | 4,253 | 3,822 | -10% | 0 | 0 | — |
▸case-22 Author an Aeon skill that acts as a code review assistant for security vulnerabilities in Go web applications. Format as a SKILL.md file specifying precise output structure and style guidelines. | pass→pass | 16,397 | 18,570 | +13% | 1 | 1 | 0% | 1,940 | 3,520 | +81% | 0 | 0 | — |
▸case-23 Author an Aeon skill for deploying serverless functions to AWS Lambda. Ensure the skill instructions cover recovery steps when a deployment fails due to timeout or missing permissions. | pass→pass | 19,376 | 13,936 | -28% | 1 | 1 | 0% | 3,760 | 2,861 | -24% | 0 | 0 | — |