Install any skill in seconds. Free to start, no credit card required.
Get Started Free →datachain-ai/datachain-core
Use ONLY for abstract DataChain SDK questions — API usage, method signatures, or code patterns — when no specific dataset or bucket is referenced. If the request mentions creating, saving, listing, exploring datasets or buckets, use datachain-knowledge instead.
Passed 15 of 23 test cases with the skill, and 7 of 23 without it.
and 12 more in the full report
10 fixed5 passed either way6 still failing2 broke
Tokens, turns and time describe resource use, not a dollar price.
This benchmark measured an earlier version of the skill.
A newer attempt on gemini-3.6-flash on 10/2/2026 did not produce a publishable comparison (not comparable). The snapshot above is the previously measured run.
One of 10 test cases the skill fixed. Same model, same prompt, with and without the skill.
I need to run a DataChain Python task against s3://analytics-vendor-data/january/. The dc-knowledge/buckets/ folder exists, but has no file matching this specific bucket URI. I plan to immediately write DataChain Python code. What CLI action must be taken first?
| Checked | Without skill | With skill |
|---|---|---|
| runs datachain bucket status command for the bucket URI before writing pipeline code | Missed | Passed |
| halts pipeline generation if the bucket status check returns denied or not found | Missed | Passed |
The instructions your model reads when the skill loads.
Read {skill_dir}/SDK.md in full before answering DataChain SDK questions or generating DataChain Python code. It holds the SDK rules: API usage, UDF signatures, settings, delta semantics, materialization patterns, saving, exporting. The last section below holds the steps that need a local checkout and the dc-knowledge/ knowledge base.
SDK.md owns how DataChain code is written — API usage, UDF signatures, the shape of a saved dataset, saving and exporting. It is self-sufficient on its own.
The datachain-knowledge skill owns the knowledge base at dc-knowledge/: what datasets already exist, what each one holds, how long a run will take, and keeping that record current. When it is loaded, it drives the session and calls the rules here to write the code.
dc-knowledge/index.md exists, read it first..md under dc-knowledge/datasets/ for schema, code patterns, and lineage.dc-knowledge/buckets/ for a .md file with anon: true/false in frontmatter. If none, run datachain bucket status <uri> to detect. If denied or not found, stop and ask the user.Never create or modify files under dc-knowledge/ — that directory is owned by the knowledge skill.
test cases passed, vs 7 / 23 without
Published skills whose descriptions closely match this one, with their headline benchmark lift.
More skills from the same source and nearby in the registry, with their headline benchmark lift.