Creates and configures agent.yaml files, writes SOUL.md personality definitions, and sets up agent directory structures with skills, tools, and knowledge.
SkillScore100Maintained
Automatic
◆AI Engineer pack
Last verified 8/10/2026
What it changes
Passed 22 of 22 test cases with the skill, and 6 of 22 without it.
Without skill27%
With skill100%
Checks it passed that the model alone missed
Includes heading Must Never
Includes heading Must Always
Sets timeout under runtime block
and 23 more in the full report
16 fixed6 passed either way0 still failing0 broke
Pass-rate lift
+73 pp
Tokens
-12%
Agent turns
0%
Response time
-55%
Model gemini-3.6-flashMeasured 8/10/2026v122 of 22 cases passed with skill
Tokens, turns and time describe resource use, not a dollar price.
See it in action
One of 16 test cases the skill fixed. Same model, same prompt, with and without the skill.
1 of 16
Prompt
Create a standalone tool manifest YAML file for a db-query tool that takes a mandatory string input called sql_query.
What was checked, without and with the skill
Checked
Without skill
With skill
Uses input_schema object with type and properties
Missed
Passed
Lists sql_query under required array in input_schema
Missed
Passed
case-17 · gemini-3.6-flash · 8/10/2026 · answers are capped and redacted
What's inside
The instructions your model reads when the skill loads.