Network device automation via pyATS - run show commands, ping, apply config, learn config/logging, list devices, run Linux commands, execute dynamic tests on Cisco IOS-XE/NX-OS devices.
SkillScore59Maintained
Automatic
◆DevOps & SRE pack
Last verified 8/16/2026
What it changes
Passed 8 of 13 test cases with the skill, and 4 of 13 without it.
Without skill27%
With skill59%
Checks it passed that the model alone missed
Includes $MCP_CALL in the shell command line invocation.
Instantiates Genie Diff using before.info and after.info.
Omits import of the os module from the test script content.
and 6 more in the full report
8 fixed5 passed either way8 still failing1 broke
Pass-rate lift
+32 pp
Tokens
+162%
Agent turns
0%
Response time
-14%
Model gemini-3.6-flashMeasured 8/16/2026v113 of 22 cases passed with skill · 13 comparable
Tokens, turns and time describe resource use, not a dollar price.
See it in action
One of 8 test cases the skill fixed. Same model, same prompt, with and without the skill.
1 of 8
Prompt
Apply a new interface configuration to R1. The proposed CLI commands start with 'configure terminal', followed by 'interface GigabitEthernet2', 'description Uplink', 'no shutdown', and end with 'end'. Prepare the tool call parameters.
What was checked, without and with the skill
Checked
Without skill
With skill
Omits configure terminal and end from the config_commands parameter list.
Missed
Passed
case-07 · gemini-3.6-flash · 8/16/2026 · answers are capped and redacted
What's inside
The instructions your model reads when the skill loads.