Guide for creating production-grade ChatKit chatbots that integrate OpenAI Agents SDK with MCP tools and custom backends.
SkillScore96Maintained
Automatic
◆AI Engineer pack
Last verified 8/21/2026
What it changes
Passed 22 of 23 test cases with the skill, and 12 of 23 without it.
Without skill52%
With skill96%
Checks it passed that the model alone missed
Overrides the async respond method.
Reads access_token from localStorage.
Executes task agent using Runner.run_streamed.
and 12 more in the full report
11 fixed11 passed either way0 still failing1 broke
Pass-rate lift
+43 pp
Tokens
+129%
Agent turns
0%
Response time
-20%
Model gemini-3.6-flashMeasured 8/21/2026v122 of 23 cases passed with skill
Tokens, turns and time describe resource use, not a dollar price.
See it in action
One of 11 test cases the skill fixed. Same model, same prompt, with and without the skill.
1 of 11
Prompt
When a user sends a new message to the ChatKit server `respond` method, what store method persists the incoming message item to the conversation thread before agent execution?
What was checked, without and with the skill
Checked
Without skill
With skill
Calls store.add_thread_item to persist incoming message.
Missed
Passed
case-18 · gemini-3.6-flash · 8/21/2026 · answers are capped and redacted
What's inside
The instructions your model reads when the skill loads.
SKILL.md504 lines5 files
ChatKit Botbuilder
Overview
Create production-grade chatbots using the OpenAI ChatKit framework. This skill enables building chatbots that:
Integrate AI Agents: Use OpenAI Agents SDK for intelligent conversation handling