Ready to supercharge your AI agents?

Install any skill in seconds. Free to start, no credit card required.

Get Started Free →

Test Automation — measured AI agent skill | DecimalAI

a5c-ai/test-automation

SkillScore65Maintained

Execute Vitest and Playwright test suites with result collection and failure analysis.

by a5c-ai

Links this skill to your agents and keeps it current with the author’s updates.

Automatic

QA & Test Engineering pack

decimalai skills pull a5c-ai-test-automation

Get this skill — curl · raw file

curl -fsSL https://app.decimal.ai/s/a5c-ai-test-automation/SKILL.md

Raw file: /s/a5c-ai-test-automation/SKILL.md ↗ · machine-readable summary at /s/a5c-ai-test-automation.json ↗

In productionGlobal

how this skill behaves on real traffic · last 30 days

No production data for this skill yet — usage numbers appear here once agents start running it.

Anonymized aggregate across every org using this skill — proof from real production use, not a demo.

Does this skill help? · Benchmark: with vs. withoutsign in to run this on your agents

23 test cases from the publisher’s eval.yaml · each run twice on gemini-3.6-flash — with the skill injected, then without · last run 9d ago

Yes — +57% lift-53% tokens0% turns65% of whole cases pass with skill (15/23)

Test case	Without → With	Effect	Δ tokens	Δ turns
case-01	✗→✓	▲ Improved	151%	0%
case-02	✗→✓	▲ Improved	-53%	0%
case-08	✗→✓	▲ Improved	-80%	0%
case-09	✗→✓	▲ Improved	-68%	0%
case-12	✗→✓	▲ Improved	-79%	0%

Showing 5 of 23 cases

SkillSafety

✓ 3 of 3 passed

Code scan15 of 15 checks clean

0 critical · 0 warning · 0 info — scanner v4 — 7/31/2026

live_secretremote_code_executionreverse_shelldata_exfiltrationssrf_metadataagent_snoopinganti_refusaldestructive_commandsobfuscated_unicodeunicode_homoglyphopaque_blobsuspicious_urltool_overreachtrigger_abuseprompt_injection_phrasing

IntentSafe

LLM judge · does the skill do what it claims

ContentClean

LLM judge · policy & harmful-content review

Source

Imported

a5c-ai / babysitter

library/methodologies/automaker/skills/test-automation/SKILL.md

View on GitHub ↗

License MITImported 7/31/2026Version v1

Skill contents

SKILL.md

Test Automation

Execute Vitest and Playwright test suites with result collection and failure analysis.

Agent

Test Runner - automaker-test-runner

Workflow

Navigate to worktree path
Run Vitest unit tests (npx vitest run --reporter=json)
Run Playwright E2E tests (npx playwright test --reporter=json)
Collect pass/fail counts per suite
Extract failure messages and stack traces
Measure code coverage
Identify flaky tests
Analyze failure root causes for convergence

Inputs

projectName - Project name
featureId - Feature identifier
worktreePath - Path to isolated worktree
testFramework - Framework: 'vitest', 'playwright', 'both'
changedFiles - Files changed by implementation

Outputs

Test results with allPassed, counts, failures, coverage, flaky tests

Process Files

automaker-orchestrator.js - Phase 3 (testing)
automaker-agent-execution.js - Stages 4-5
automaker-review-ship.js - Integration testing

Want to see if a5c-ai/test-automation would activate on your phrasing? Try it before you install — no LLM call, no signup.

Other measured skills in the registry, with their headline benchmark lift.