Loading skill
Install any skill in seconds. Free to start, no credit card required.
Get Started Free →ai-sdk
Answer questions about the AI SDK and help build AI-powered features.
Passed 11 of 17 test cases with the skill, and 5 of 17 without it.
and 10 more in the full report
10 fixed4 passed either way6 still failing2 broke
Tokens, turns and time describe resource use, not a dollar price.
This benchmark measured an earlier version of the skill.
A newer attempt on gemini-3.6-flash on 9/30/2026 did not produce a publishable comparison (not comparable). The snapshot above is the previously measured run.
One of 10 test cases the skill fixed. Same model, same prompt, with and without the skill.
I need to configure a text generation endpoint in my app that targets the latest available OpenAI model on the Vercel AI Gateway. I want to ensure I don't hardcode an obsolete model name. What command should I run to inspect all current active models?
| Checked | Without skill | With skill |
|---|---|---|
| Uses a curl request targeting https://ai-gateway.vercel.sh/v1/models. | Missed | Passed |
| Parses the gateway response with jq without truncating output. | Passed | Passed |
The instructions your model reads when the skill loads.
The AI SDK by Vercel (the ai package on npm) is a TypeScript toolkit for building AI applications. It provides a unified API across model providers for text generation, structured output, tool calling, agents, embeddings, and framework UI integrations.
Whatever you remember about the AI SDK is likely outdated. The SDK changes frequently across versions - APIs are renamed, removed, and added. Your training data almost certainly contains obsolete APIs, deprecated patterns, and model IDs that no longer exist. UI hooks like useChat are among the most frequently changed APIs, so be especially careful with client code.
Never write AI SDK code from memory. Always verify every API, option, and pattern against the documentation and source code for the version that is actually installed in the project.
The ai package ships its full documentation and source code inside node_modules. These always match the installed version, so trust them over anything you remember.
ai is installed. Check node_modules/ai/ or locate the workspace package in a monorepo that depends on ai (e.g. apps/<name>/node_modules/ai/). If ai is not installed anywhere in the project, install only the ai package into the target package using the project's package manager (e.g. pnpm add ai --filter <pkg> or npm install ai). Install provider packages (e.g. @ai-sdk/openai) and framework packages (e.g. @ai-sdk/react) later, when the task requires them.node_modules/ai/docs/ (or <package>/node_modules/ai/docs/) and the source at node_modules/ai/src/.node_modules/@ai-sdk/<name>/docs/ (or <package>/node_modules/@ai-sdk/<name>/docs/)..md to any docs page URL to get its markdown, and search via https://ai-sdk.dev/api/search-docs?q=your_query.The Vercel AI Gateway is the fastest way to get started with the AI SDK. It provides access to models from OpenAI, Anthropic, Google, and other providers through a single API, without installing provider packages or managing multiple API keys.
To set it up:
AI_GATEWAY_API_KEY environment variable.provider/model strings.For exact setup, authentication, and usage, read the bundled guide and the AI Gateway docs.
Never use model IDs from memory — models are released and retired frequently. Fetch the current list before writing code that references a model. Do not truncate the list (e.g. with head) so you can find the newest models:
test cases passed, vs 5 / 17 without
Published skills whose descriptions closely match this one, with their headline benchmark lift.
More skills from the same source and nearby in the registry, with their headline benchmark lift.