Ready to supercharge your AI agents?

Install any skill in seconds. Free to start, no credit card required.

CodexBar Live QA · steipete | DecimalAI

testingby steipete

CodexBar Live QA

steipete/qa-test

Source steipete/codexbar ↗License MIT

CodexBar live QA/e2e testing: run provider usage matrix checks, validate real app config, use Peekaboo for menu proof, use Browser Use/official docs for API spec or logged-in dashboard checks, and handle 1Password credentials safely.

SkillScore86Maintained

Automatic

QA & Test Engineering pack

Last verified 8/11/2026

What it changes

Passed 16 of 19 test cases with the skill, and 8 of 19 without it.

Without skill41%

With skill86%

Checks it passed that the model alone missed

Invokes mcporter call chrome-devtools.list_pages
States that Groq usage checks query the Prometheus metrics API
Requires executing op commands inside a single persistent tmux session

and 7 more in the full report

10 fixed9 passed either way3 still failing0 broke

Pass-rate lift: +45 pp
Tokens: +29%
Agent turns: 0%
Response time: -57%

Model gemini-3.6-flashMeasured 8/11/2026v119 of 22 cases passed with skill · 19 comparable

Tokens, turns and time describe resource use, not a dollar price.

Use this skill

Save it into your project's skills folder. Claude Code picks it up in its next session.

curl -fsSL --create-dirs -o .claude/skills/steipete-qa-test/SKILL.md https://app.decimal.ai/s/steipete-qa-test/SKILL.md

Want it pinned and updatable? pip install "decimalai>=0.15", then decimalai skills add steipete-qa-test, and start Claude Code with claude --plugin-dir "$(git rev-parse --show-toplevel)/.agents"

1 · One-time — install the CLI (docs ↗)

pip install "decimalai>=0.15"

2 · Get the skill — writes .agents/skills/steipete-qa-test/ and pins it in .decimal/skills.lock

decimalai skills add steipete-qa-test

No CLI? Get the same file — curl · raw file

curl -fsSL --create-dirs -o .claude/skills/steipete-qa-test/SKILL.md https://app.decimal.ai/s/steipete-qa-test/SKILL.md

Raw file: /s/steipete-qa-test/SKILL.md ↗ · machine-readable summary at /s/steipete-qa-test.json ↗

Safety checks: 3 of 3 passed

Code scan CleanIntent PassedContent Clean

See it in action

One of 9 test cases the skill fixed. Same model, same prompt, with and without the skill.

1 of 9

Prompt

Run a live provider matrix check specifically for OpenAI, Zai, and DeepSeek only, ignoring all other providers. What command parameter should be supplied?

What was checked, without and with the skill
Checked	Without skill	With skill
Uses --providers openai,zai,deepseek with .agents/skills/qa-test/scripts/live_provider_matrix.sh	Missed	Passed

case-09 · gemini-3.6-flash · 8/11/2026 · answers are capped and redacted

What's inside

The instructions your model reads when the skill loads.

SKILL.md113 lines3 filesincludes scripts

CodexBar Live QA

Use for live provider testing, release smoke tests, menu verification, or debugging “provider works/fails” reports.

Rules

Work from the CodexBar repo checkout.
Use the packaged CLI first: CodexBar.app/Contents/Helpers/CodexBarCLI.
Do not use CodexBar.app/Contents/MacOS/codexbar; that is the app binary and may appear to hang as a CLI.
Never run broad env, set, or secret regex dumps.
Use $one-password for secrets: all op commands inside one persistent tmux session, service account first, no raw secret output.
Treat browser-cookie/keychain flows as prompt-risky. Prefer CLI/API-token checks and KeychainNoUIQuery-safe tests unless the user explicitly requested live UI.
For current API behavior, browse official provider docs only.

CLI Matrix

Run the bundled script:

.agents/skills/qa-test/scripts/live_provider_matrix.sh --enabled

Useful modes:

.agents/skills/qa-test/scripts/live_provider_matrix.sh --provider all
.agents/skills/qa-test/scripts/live_provider_matrix.sh --providers openai,zai,deepseek
.agents/skills/qa-test/scripts/live_provider_matrix.sh --default

Interpretation:

--enabled asks CodexBarCLI config providers for enabled providers, honoring CODEXBAR_CONFIG and default toggles.
--default runs the app-facing default command with no provider override.
--provider all forces every registered provider and is expected to fail for providers without sessions/keys.
A green app config needs --enabled and --default clean; --provider all is a discovery/triage tool.

Config QA

Validate config:

Track record

Benchmark

16 / 19

test cases passed, vs 8 / 19 without

Adoption

Users: 0
Times used: 0

Safety and source details

SkillSafety

✓ 3 of 3 passed

Code scan15 of 15 checks clean

0 critical · 0 warning · 0 info — scanner v4 — 8/3/2026

View 15 scanner checks

live_secretremote_code_executionreverse_shelldata_exfiltrationssrf_metadataagent_snoopinganti_refusaldestructive_commandsobfuscated_unicodeunicode_homoglyphopaque_blobsuspicious_urltool_overreachtrigger_abuseprompt_injection_phrasing

IntentSafe

LLM judge · does the skill do what it claims

ContentClean

LLM judge · policy & harmful-content review

Source

Imported

steipete / codexbar

.agents/skills/qa-test/SKILL.md

View on GitHub ↗

License MITImported 8/3/2026Version v1Bundled 2 files · scripts

More skills from the same source and nearby in the registry, with their headline benchmark lift.

Ready to supercharge your AI agents?

See it in action

What's inside

CodexBar Live QA

Rules

CLI Matrix

Config QA

Track record

Benchmark

Adoption

SkillSafety

Source

Related skills