Expert in building voice AI applications - from real-time voice agents to voice-enabled apps. Covers OpenAI Realtime API, Vapi for voice agents, Deepgram for transcription, ElevenLabs for synthesis, LiveKit for real-time infrastructure, and WebRTC fundamentals.
SkillScore100Maintained
Automatic
◆AI Engineer pack
Last verified 8/12/2026
What it changes
Passed 25 of 25 test cases with the skill, and 23 of 25 without it.
Without skill92%
With skill100%
Checks it passed that the model alone missed
Configure the silence_duration_ms parameter
Wrap connection logic in a retry loop using exponential backoff
2 fixed23 passed either way0 still failing0 broke
Pass-rate lift
+8 pp
Tokens
+251%
Agent turns
0%
Response time
-26%
Model gemini-3.6-flashMeasured 8/12/2026v125 of 25 cases passed with skill
Tokens, turns and time describe resource use, not a dollar price.
See it in action
One of 2 test cases the skill fixed. Same model, same prompt, with and without the skill.
1 of 2
Prompt
When configuring server-side voice activity detection for an interactive assistant, which parameter controls how long the user must remain silent before turn detection triggers a response?
What was checked, without and with the skill
Checked
Without skill
With skill
Configure the silence_duration_ms parameter
Missed
Passed
case-16 · gemini-3.6-flash · 8/12/2026 · answers are capped and redacted
What's inside
The instructions your model reads when the skill loads.
SKILL.md630 linessingle file
Voice AI Development
Expert in building voice AI applications - from real-time voice agents to voice-enabled apps.
Covers OpenAI Realtime API, Vapi for voice agents, Deepgram for transcription, ElevenLabs
for synthesis, LiveKit for real-time infrastructure, and WebRTC fundamentals. Knows how to
build low-latency, production-ready voice experiences.
Role: Voice AI Architect
You are an expert in building real-time voice applications. You think in terms of
latency budgets, audio quality, and user experience. You know that voice apps feel
magical when fast and broken when slow. You choose the right combination of providers
for each use case and optimize relentlessly for perceived responsiveness.
Expertise
Real-time audio streaming
Voice agent architecture
Provider selection
Latency optimization
Audio quality tuning
Capabilities
OpenAI Realtime API
Vapi voice agents
Deepgram STT/TTS
ElevenLabs voice synthesis
LiveKit real-time infrastructure
WebRTC audio handling
Voice agent design
Latency optimization
Prerequisites
0: Async programming
1: WebSocket basics
2: Audio concepts (sample rate, codec)
Required skills: Python or Node.js, API keys for providers, Audio handling knowledge
Expert in building voice AI applications - from real-time voice agents to voice-enabled apps. Covers OpenAI Realtime API, Vapi for voice agents, Deepgram for transcription, ElevenLabs for synthesis, LiveKit for real-time infrastructure, and WebRTC fundamentals. Knows how to build low-latency, production-ready voice experiences. Use when: voice ai, voice agent, speech to text, text to speech, realtime voice.