Ready to supercharge your AI agents?

Install any skill in seconds. Free to start, no credit card required.

Get Started Free →

Config Schema Validator · a5c-ai | DecimalAI

a5c-ai/config-schema-validator

SkillScore59Maintained

Generate Zod/JSON Schema configuration validators with defaults and error messages.

codingby a5c-ai

Links this skill to your agents and keeps it current with the author’s updates.

Automatic

Coding pack

1 · One-time — install the CLI (docs ↗)

pip install decimalai

2 · Get the skill — writes .claude/skills/a5c-ai-config-schema-validator/SKILL.md

decimalai skills pull a5c-ai-config-schema-validator --out .claude/skills/

No CLI? Get the same file — curl · raw file

curl -fsSL --create-dirs -o .claude/skills/a5c-ai-config-schema-validator/SKILL.md https://app.decimal.ai/s/a5c-ai-config-schema-validator/SKILL.md

Raw file: /s/a5c-ai-config-schema-validator/SKILL.md ↗ · machine-readable summary at /s/a5c-ai-config-schema-validator.json ↗

In productionGlobal

how this skill behaves on real traffic · last 30 days

Runs

all versions · 30d

Anonymized aggregate across every org using this skill — proof from real production use, not a demo.

Does this skill help? · Benchmark: with vs. withoutsign in to run this on your agents

22 test cases from the publisher’s eval.yaml · each run twice on gemini-3.6-flash — with the skill injected, then without · last run 58d ago

Yes — +55% lift-23% tokens0% turns59% of whole cases pass with skill (13/22)

Test case	Without → With	Effect	Δ tokens	Δ turns
case-01	✗→✓	▲ Improved	-46%	0%
case-02	✗→✓	▲ Improved	-35%	0%
case-03	✗→✓	▲ Improved	12%	0%
case-09	✗→✓	▲ Improved	-36%	0%
case-10	✗→✓	▲ Improved	-18%	0%

Showing 5 of 22 cases

SkillSafety

✓ 3 of 3 passed

Code scan15 of 15 checks clean

0 critical · 0 warning · 0 info — scanner v4 — 7/31/2026

live_secretremote_code_executionreverse_shelldata_exfiltrationssrf_metadataagent_snoopinganti_refusaldestructive_commandsobfuscated_unicodeunicode_homoglyphopaque_blobsuspicious_urltool_overreachtrigger_abuseprompt_injection_phrasing

IntentSafe

LLM judge · does the skill do what it claims

ContentClean

LLM judge · policy & harmful-content review

Source

Imported

a5c-ai / babysitter

library/specializations/cli-mcp-development/skills/config-schema-validator/SKILL.md

View on GitHub ↗

License MITImported 7/31/2026Version v1

Skill contents

SKILL.md

Config Schema Validator

Generate configuration schema validators.

Generated Patterns

typescript
import { z } from 'zod';

export const configSchema = z.object({
  server: z.object({
    host: z.string().default('localhost'),
    port: z.number().int().min(1).max(65535).default(3000),
    cors: z.object({
      origins: z.array(z.string().url()).default(['*']),
      credentials: z.boolean().default(false),
    }).default({}),
  }).default({}),
  logging: z.object({
    level: z.enum(['debug', 'info', 'warn', 'error']).default('info'),
    format: z.enum(['json', 'pretty']).default('pretty'),
  }).default({}),
}).strict();

export type Config = z.infer<typeof configSchema>;

export function validateConfig(input: unknown): Config {
  return configSchema.parse(input);
}

export function getConfigWithDefaults(partial: Partial<Config> = {}): Config {
  return configSchema.parse(partial);
}

Target Processes

configuration-management-system
mcp-tool-implementation
cli-application-bootstrap

Illustrative Want to see what a5c-ai/config-schema-validator would put in front of your model? Preview the rendered body and check its trigger phrases — no LLM call, no signup.

Latest benchmark · publisher runVerified

8/1/2026, 01:01 UTC · 22 cases

Lift

+55%

59% vs 5%

Agent turns

1.0 vs 1.0

Tokens

-23%

1,571.27 vs 2,029.5

fail → pass · 12pass → pass · 1fail → fail · 9

Per-case results (22)

Case	Status	Duration (ms)			Turns			Tokens			Tool calls
Case	Status	Without	With	Δ	Without	With	Δ	Without	With	Δ	Without	With	Δ
case-01 I am bootstrapping a TypeScript CLI application and need a configuration validation module using Zod. Please provide a strict schema setup that validates host, port, CORS, and logging options, exporting the inferred config type along with helper functions for parsing raw input and populating default values.	fail→pass	15,809	7,248	-54%	1	1	0%	3,389	1,831	-46%	0	0	—
case-02 For an MCP tool implementation, I need a Zod schema file to handle runtime configuration parsing. Can you generate a TypeScript file that defines a strict config schema with nested server and log configurations, plus functions to parse unknown inputs and apply defaults?	fail→pass	14,677	7,841	-47%	1	1	0%	2,440	1,584	-35%	0	0	—
case-03 We are setting up a central configuration management module in TypeScript. Please generate a Zod-based config validator that rejects unknown properties, defines inferred types, and exports utility functions for validating unknown payloads and partial configuration objects.	fail→pass	12,211	11,598	-5%	1	1	0%	2,646	2,963	+12%	0	0	—
case-04 Create a runtime configuration validation schema module for a Web API server application. Models usually default server host to '0.0.0.0' or port to 8080. Generate the standard server configuration schema block with defaults and strict constraints.	fail→fail	11,399	4,843	-58%	1	1	0%	2,560	1,265	-51%	0	0	—
case-05 Define the CORS configuration sub-schema inside a server config module. A typical framework default is allowing all origins and disabling credentials. Generate the exact CORS object schema structure.	pass→pass	7,217	5,233	-27%	1	1	0%	1,772	1,428	-19%	0	0	—
case-06 Generate the logging configuration sub-schema for runtime settings. Many modules default log format to 'json' and level to 'debug'. Generate the schema defining allowed levels and formats.	fail→fail	8,160	5,278	-35%	1	1	0%	1,656	1,407	-15%	0	0	—
case-07 When defining the top-level configuration validator, standard practice in some libraries allows extra unknown keys by default. Show how the top-level schema restricts unexpected properties.	fail→fail	9,711	5,139	-47%	1	1	0%	1,793	1,234	-31%	0	0	—
case-08 Create the helper function that takes untrusted runtime data (like parsed JSON from disk) and validates it against the runtime configuration schema. How is this function typed and implemented?	fail→fail	13,611	10,136	-26%	1	1	0%	2,711	2,353	-13%	0	0	—
case-09 Create the helper function that accepts an optional partial configuration object and fills in all default values according to the schema. What is the function signature and implementation?	fail→pass	11,337	8,001	-29%	1	1	0%	2,430	1,567	-36%	0	0	—
case-10 Generate the TypeScript type export for the validated runtime configuration object derived directly from the schema instance.	fail→pass	5,513	3,729	-32%	1	1	0%	1,089	893	-18%	0	0	—
case-11 In the configuration schema, if the caller provides an empty object `{}` as input, how does the top-level server block behave?	fail→pass	8,912	5,897	-34%	1	1	0%	1,510	1,290	-15%	0	0	—
case-12 How does the logging block inside the configuration schema handle being omitted completely from the input object?	fail→pass	12,604	4,656	-63%	1	1	0%	2,070	1,128	-46%	0	0	—
case-13 When constructing the server sub-schema, how is the nested cors field initialized when no CORS configuration is provided in the input object?	fail→pass	9,690	3,318	-66%	1	1	0%	1,663	942	-43%	0	0	—
case-14 In the server config, port numbers must be valid network ports. What specific numeric constraints are applied to the port field in the schema?	fail→fail	5,583	2,711	-51%	1	1	0%	948	809	-15%	0	0	—
case-15 In the CORS schema configuration, origin items should be valid URLs. How is the origins array item schema defined?	fail→fail	8,914	4,256	-52%	1	1	0%	1,712	1,063	-38%	0	0	—
case-16 What enum values are specified for the logging level field in the schema?	fail→pass	2,809	1,695	-40%	1	1	0%	384	469	+22%	0	0	—
case-17 What enum values are specified for the logging output format field in the schema?	fail→pass	3,494	1,646	-53%	1	1	0%	568	531	-7%	0	0	—
case-18 Write a CLI application config schema module that provides standard server and logging defaults for CLI tools.	fail→pass	17,950	8,395	-53%	1	1	0%	3,085	2,218	-28%	0	0	—
case-19 Provide the runtime config module for an MCP tool implementation requiring strict validation and defaults.	fail→pass	11,714	9,096	-22%	1	1	0%	2,542	2,428	-4%	0	0	—
case-20 I need to produce a standard JSON Schema draft-07 file for our server configuration file so IDEs can offer autocomplete on config.json. How should I structure the raw JSON schema artifact?	fail→fail	14,310	7,909	-45%	1	1	0%	2,993	1,929	-36%	0	0	—
case-21 I am writing a plain Node.js script that reads process.env variables into process.env overrides without compiling TypeScript or using schema validation libraries. How should I construct a basic env parsing helper?	fail→fail	13,207	11,666	-12%	1	1	0%	2,626	2,896	+10%	0	0	—
case-22 We are migrating an existing JSON configuration from schema v1 (where port was a string under legacyPort) to schema v2. Can you write a TypeScript transformation function that maps v1 config objects to v2 config objects?	fail→fail	10,325	9,483	-8%	1	1	0%	2,062	2,340	+13%	0	0	—

These cases were also screened by the skill’s intent / safety pass.See the Trust review ↗Reproduce this benchmark in Colab ↗

How this skill was measured

DecimalAI ran this skill against gemini-3.6-flash twice over the same eval suite — once with the skill loaded and once without — and compared the two runs case by case. 22 cases were attempted. The headline lift of +55 percentage points is the difference between those two pass rates over the 22 comparable cases. 1 case got worse with the skill loaded, and it is included in that figure.

Model measured: gemini-3.6-flash
Graded by: gemini-3.6-flash
Grading method: judged
Verification: verified
Pass rate without the skill: 4.6%
Pass rate with the skill: 59.1%
Cases attempted: 22
Cases counted toward lift: 22
Cases that regressed: 1
Skill version measured: v1
Run completed: 8/1/2026, 01:01 UTC

Measured example — same prompt, with vs. without the skill · from the benchmark run · case case-01

Prompt

I am bootstrapping a TypeScript CLI application and need a configuration validation module using Zod. Please provide a strict schema setup that validates host, port, CORS, and logging options, exporting the inferred config type along with helper functions for parsing raw input and populating default values.

Without the skill loaded, the model failed this case. With it loaded, the same prompt on the same model passed. This is one improved case from the latest verified run; every case, including any that regressed, is in the table above.

Show both answers

SkillScore blends 4 signals1 of 4 complete

BenchmarkPass rate WITH skill on a verified run59

Live evalNeeds ≥10 evaluated traces in 30 days

AI ratingNeeds ≥10 rated traces

AdoptionNeeds ≥10 serves across ≥2 orgs in 30 days

Efficiency · separate axis (at equal correctness)+0% turns-19% tokens

Shown for transparency; not credited unless a verified run shows no correctness regression.

Backed by 1 of 4 signals — each added signal makes the score more robust.

Verified on gemini-3.6-flash · re-tested 57 days ago

Other measured skills in the registry, with their headline benchmark lift.