Profile inference latency profiler operations. Auto-activating skill for ML Deployment.
NewMaintained
Automatic
◆AI Engineer pack
Last verified 8/29/2026
What it changes
Passed 16 of 22 test cases with the skill, and 16 of 22 without it.
Without skill73%
With skill73%
Checks it passed that the model alone missed
Execute benchmark_serving.py against the OpenAI-compatible HTTP endpoint.
1 fixed15 passed either way5 still failing1 broke
Pass-rate lift
0 pp
Tokens
+27%
Agent turns
0%
Response time
+12%
Model gemini-3.6-flashMeasured 8/29/2026v116 of 22 cases passed with skill
Tokens, turns and time describe resource use, not a dollar price.
See it in action
A test case the skill fixed. Same model, same prompt, with and without the skill.
Prompt
When measuring time-to-first-token (TTFT) and inter-token latency (ITL) for streaming LLM serving, which reference benchmarking script provided in the vLLM codebase measures these end-to-end metrics?
What was checked, without and with the skill
Checked
Without skill
With skill
Execute benchmark_serving.py against the OpenAI-compatible HTTP endpoint.
Missed
Passed
case-07 · gemini-3.6-flash · 8/29/2026 · answers are capped and redacted
What's inside
The instructions your model reads when the skill loads.
SKILL.md60 linessingle file
Inference Latency Profiler
Overview
This skill provides automated assistance for inference latency profiler tasks within the ML Deployment domain.
When to Use
This skill activates automatically when you:
Mention "inference latency profiler" in your request
Ask about inference latency profiler patterns or best practices
Need help with machine learning deployment skills covering model serving, mlops pipelines, monitoring, and production optimization.
Instructions
Provides step-by-step guidance for inference latency profiler
Follows industry best practices and patterns
Generates production-ready code and configurations
Validates outputs against common standards
Examples
Example: Basic Usage
Request: "Help me with inference latency profiler"
Result: Provides step-by-step guidance and generates appropriate configurations