Nautobot IPAM & source of truth — IP address queries, prefix lookups, VRF/tenant/site filtering, IPAM search, connection testing.
SkillScore68Maintained
Automatic
◆DevOps & SRE pack
Last verified 8/16/2026
What it changes
Passed 13 of 19 test cases with the skill, and 10 of 19 without it.
Without skill55%
With skill68%
Checks it passed that the model alone missed
States that the Nautobot tools are strictly read-only.
Uses get_prefixes with the site parameter set to Dallas-HQ.
Sets the role parameter to loopback when calling get_ip_addresses.
and 1 more in the full report
4 fixed11 passed either way6 still failing1 broke
Pass-rate lift
+14 pp
Tokens
+67%
Agent turns
0%
Response time
-34%
Model gemini-3.6-flashMeasured 8/16/2026v115 of 22 cases passed with skill · 19 comparable
Tokens, turns and time describe resource use, not a dollar price.
See it in action
One of 4 test cases the skill fixed. Same model, same prompt, with and without the skill.
1 of 4
Prompt
We want to query Nautobot IPAM for all active router loopback IP addresses across the network while excluding regular host assignments. Which parameter and value in get_ip_addresses targets loopback addresses?
What was checked, without and with the skill
Checked
Without skill
With skill
Sets the role parameter to loopback when calling get_ip_addresses.
Missed
Passed
case-20 · gemini-3.6-flash · 8/16/2026 · answers are capped and redacted
What's inside
The instructions your model reads when the skill loads.