Evaluate, select, and contract with vendors and SaaS tools.
SkillScore80Maintained
Automatic
◆Procurement pack
Last verified 8/20/2026
What it changes
Passed 19 of 24 test cases with the skill, and 5 of 24 without it.
Without skill20%
With skill80%
Checks it passed that the model alone missed
Ratings are standardized on a 1 to 5 scale.
The vendor scorecard weights Functional fit at 40 percent.
The document includes a build versus buy decision section.
and 16 more in the full report
15 fixed5 passed either way5 still failing0 broke
Pass-rate lift
+60 pp
Tokens
+71%
Agent turns
0%
Response time
-17%
Model gemini-3.6-flashMeasured 8/20/2026v220 of 25 cases passed with skill · 24 comparable
Tokens, turns and time describe resource use, not a dollar price.
See it in action
One of 15 test cases the skill fixed. Same model, same prompt, with and without the skill.
1 of 15
Prompt
When scoring candidates like Zendesk or ServiceNow under the Operational Fit dimension on the vendor scorecard, what weight is allocated to Operational Fit and what specific operational items must be tested?
What was checked, without and with the skill
Checked
Without skill
With skill
Operational fit is weighted at 10 percent on the scorecard.
Missed
Passed
Operational fit testing includes submitting a test ticket to vendor support.
Missed
Passed
case-21 · gemini-3.6-flash · 8/20/2026 · answers are capped and redacted
What's inside
The instructions your model reads when the skill loads.
SKILL.md278 lines2 files
Vendor Evaluation
Pick the right tool or service, negotiate fair terms, and avoid the lock-in traps. Stack-agnostic. Applies to SaaS, infrastructure providers, agencies, and any external dependency.