Ready to supercharge your AI agents?

Install any skill in seconds. Free to start, no credit card required.

agent-qa Authoring · vostride | DecimalAI

testingby vostride

agent-qa Authoring

vostride/agent-qa-authoring

Source vostride/agent-qa ↗License NOASSERTION

Use when creating, editing, validating, or running agent-qa tests, suites, or hooks. Prefer agent-qa MCP tools, enforce canonical agent-qa IDs, and use the bundled schema reference to avoid hallucinated config keys or YAML fields.

SkillScore78Maintained

Automatic

QA & Test Engineering pack

Last verified 9/8/2026

What it changes

Passed 16 of 20 test cases with the skill, and 3 of 20 without it.

Without skill13%

With skill78%

Checks it passed that the model alone missed

States that run IDs start with the prefix r_.
States that test IDs start with the prefix t_.
States that hook IDs start with the prefix h_.

and 14 more in the full report

17 fixed1 passed either way3 still failing2 broke

Pass-rate lift: +65 pp
Tokens: -34%
Agent turns: 0%
Response time: -45%

Model gemini-3.6-flashMeasured 9/8/2026v118 of 23 cases passed with skill · 20 comparable

Tokens, turns and time describe resource use, not a dollar price.

Use this skill

Save it into your project's skills folder. Claude Code picks it up in its next session.

curl -fsSL --create-dirs -o .claude/skills/vostride-agent-qa-authoring/SKILL.md https://app.decimal.ai/s/vostride-agent-qa-authoring/SKILL.md

Want it pinned and updatable? pip install "decimalai>=0.15", then decimalai skills add vostride-agent-qa-authoring, and start Claude Code with claude --plugin-dir "$(git rev-parse --show-toplevel)/.agents"

1 · One-time — install the CLI (docs ↗)

pip install "decimalai>=0.15"

2 · Get the skill — writes .agents/skills/vostride-agent-qa-authoring/ and pins it in .decimal/skills.lock

decimalai skills add vostride-agent-qa-authoring

No CLI? Get the same file — curl · raw file

curl -fsSL --create-dirs -o .claude/skills/vostride-agent-qa-authoring/SKILL.md https://app.decimal.ai/s/vostride-agent-qa-authoring/SKILL.md

Raw file: /s/vostride-agent-qa-authoring/SKILL.md ↗ · machine-readable summary at /s/vostride-agent-qa-authoring.json ↗

Safety checks: 3 of 3 passed

Code scan CleanIntent PassedContent Clean

See it in action

One of 17 test cases the skill fixed. Same model, same prompt, with and without the skill.

1 of 17

Prompt

When validating a suite object using `agent_qa_validate_definition` before saving, what exact string value must be assigned to the `kind` field?

What was checked, without and with the skill
Checked	Without skill	With skill
Sets the kind parameter to suite when validating suite definitions with agent_qa_validate_definition.	Missed	Passed

case-10 · gemini-3.6-flash · 9/8/2026 · answers are capped and redacted

What's inside

The instructions your model reads when the skill loads.

SKILL.md42 lines2 files

agent-qa Authoring

Workflow

Discover the local surface with agent_qa_discover.
Inspect active config with agent_qa_get_config, especially targets, devices, providers, and services.mcp.
Load references/agent-qa-contracts.json when you need exact schema fields or ID contracts.
Generate every new ID with agent-qa tooling:
- MCP: agent_qa_generate_id
- CLI fallback: agent-qa ids generate <test|suite|hook|run|observation>
- npx fallback: npx --yes agent-qa ids generate <type>
Never hand-write IDs. Validate existing IDs with agent_qa_validate_id or agent-qa ids validate <type> <id> --json.
Validate definitions before saving:
- Tests: agent_qa_validate_test or agent_qa_validate_definition with kind: "test"
- Suites: agent_qa_validate_suite or agent_qa_validate_definition with kind: "suite"
- Hooks: agent_qa_validate_definition with kind: "hooks"
Prefer MCP authoring mutations:
- Tests: agent_qa_create_test, agent_qa_update_test, agent_qa_delete_test
- Suites: agent_qa_create_suite, agent_qa_update_suite, agent_qa_delete_suite
- Hooks: agent_qa_create_hook, agent_qa_update_hook, agent_qa_delete_hook
Use CLI/YAML fallback only when MCP is unavailable. Keep file paths matched by workspace.testMatch or workspace.suiteMatch.

Required ID Contracts

Test IDs: t_ + 10 id-agent words.
Suite IDs: s_ + 10 id-agent words.
Hook IDs: h_ + 10 id-agent words.
Run IDs: r_ + 10 id-agent words.
Observation IDs: obs_ + 10 id-agent words.

Before Running

Validate YAML first.
Prefer agent_qa_enqueue_test_run and agent_qa_enqueue_suite_run over shelling out.
If using CLI fallback, run only after validation succeeds.

Do Not

Do not invent config keys.
Do not use legacy root config buckets.

Track record

Benchmark

16 / 20

test cases passed, vs 3 / 20 without

Adoption

Users: 0
Times used: 0

Safety and source details

SkillSafety

✓ 3 of 3 passed

Code scan15 of 15 checks clean

0 critical · 0 warning · 0 info — scanner v5 — 8/17/2026

View 15 scanner checks

live_secretremote_code_executionreverse_shelldata_exfiltrationssrf_metadataagent_snoopinganti_refusaldestructive_commandsobfuscated_unicodeunicode_homoglyphopaque_blobsuspicious_urltool_overreachtrigger_abuseprompt_injection_phrasing

IntentSafe

LLM judge · does the skill do what it claims

ContentClean

LLM judge · policy & harmful-content review

Source

Imported

vostride / agent-qa

skills/agent-qa-authoring/SKILL.md

View on GitHub ↗

License NOASSERTIONImported 8/17/2026Version v1Bundled 1 file

Other skills for the same job

Published skills whose descriptions closely match this one, with their headline benchmark lift.

sickn33/agent-qa-authoringCreate, edit, validate, and run Agent QA tests, suites, and hooks through MCP or CLI while preserving canonical IDs and schema contracts.Close match+61 pp pass-rate lift

More skills from the same source and nearby in the registry, with their headline benchmark lift.

Ready to supercharge your AI agents?

See it in action

What's inside

agent-qa Authoring

Workflow

Required ID Contracts

Before Running

Do Not

Track record

Benchmark

Adoption

SkillSafety

Source

Other skills for the same job

Related skills