Ready to supercharge your AI agents?

Install any skill in seconds. Free to start, no credit card required.

Senpi QA · code-yeongyu | DecimalAI

testingby code-yeongyu

Senpi QA

code-yeongyu/senpi-qa

Source code-yeongyu/oh-my-openagent ↗License NOASSERTION

QA the omo Senpi adapter (packages/omo-senpi, packages/senpi-task) against the REAL senpi binary in strict isolation, and write every artifact to the one canonical evidence path .omo/evidence/omo-senpi-adapter/<slug>/. The live drivers under packages/omo-senpi/scripts/qa/ create their own isolated SENPI_CODING_AGENT_DIR and ignore the caller's, so the real ~/.senpi/agent is never written. Ships scripts/resolve-evidence-dir.mjs, which is the ONLY sanctioned way to pick an evidence directory: it r

SkillScore77Maintained

Automatic

QA & Test Engineering pack

Last verified 9/26/2026

What it changes

Passed 13 of 17 test cases with the skill, and 3 of 17 without it.

Without skill18%

With skill77%

Checks it passed that the model alone missed

The package type check uses tsgo with the --noEmit flag.
The driver execution passes SENPI_BIN resolved via command -v.
The execution sets SENPI_BIN dynamically using command -v senpi.

and 24 more in the full report

15 fixed2 passed either way3 still failing2 broke

Pass-rate lift: +59 pp
Tokens: +8%
Agent turns: 0%
Response time: -60%

Model gemini-3.6-flashMeasured 9/26/2026v117 of 22 cases passed with skill · 17 comparable

Tokens, turns and time describe resource use, not a dollar price.

Use this skill

Save it into your project's skills folder. Claude Code picks it up in its next session.

curl -fsSL --create-dirs -o .claude/skills/code-yeongyu-senpi-qa/SKILL.md https://app.decimal.ai/s/code-yeongyu-senpi-qa/SKILL.md

Want it pinned and updatable? pip install "decimalai>=0.15", then decimalai skills add code-yeongyu-senpi-qa, and start Claude Code with claude --plugin-dir "$(git rev-parse --show-toplevel)/.agents"

1 · One-time — install the CLI (docs ↗)

pip install "decimalai>=0.15"

2 · Get the skill — writes .agents/skills/code-yeongyu-senpi-qa/ and pins it in .decimal/skills.lock

decimalai skills add code-yeongyu-senpi-qa

No CLI? Get the same file — curl · raw file

curl -fsSL --create-dirs -o .claude/skills/code-yeongyu-senpi-qa/SKILL.md https://app.decimal.ai/s/code-yeongyu-senpi-qa/SKILL.md

Raw file: /s/code-yeongyu-senpi-qa/SKILL.md ↗ · machine-readable summary at /s/code-yeongyu-senpi-qa.json ↗

Safety checks: 3 of 3 passed

Code scan CleanIntent PassedContent Clean

See it in action

One of 15 test cases the skill fixed. Same model, same prompt, with and without the skill.

1 of 15

Prompt

Before committing changes to the omo-senpi adapter, what is the exact typechecking command that must be run to verify the adapter package configuration?

What was checked, without and with the skill
Checked	Without skill	With skill
The package type check uses tsgo with the --noEmit flag.	Missed	Passed
The command targets packages/omo-senpi/tsconfig.json.	Passed	Passed

case-20 · gemini-3.6-flash · 9/26/2026 · answers are capped and redacted

What's inside

The instructions your model reads when the skill loads.

SKILL.md75 lines3 filesincludes scripts

Senpi QA

QA the omo Senpi adapter (packages/omo-senpi/) and the task engine (packages/senpi-task/) by driving the REAL senpi binary. Unit tests never count as live QA here: bun run test:senpi is the package gate, the drivers in packages/omo-senpi/scripts/qa/ are the harness proof.

Golden rules

Evidence lives at exactly one path. Every artifact goes under .omo/evidence/omo-senpi-adapter/<slug>/. Pick it with scripts/resolve-evidence-dir.mjs and nothing else — a hand-typed path is how runs end up somewhere like local-ignore/qa-evidence/, which no reviewer reads and the PR cannot cite.
The real agent dir stays untouched. The live drivers build their own isolated SENPI_CODING_AGENT_DIR and deliberately IGNORE a caller-provided one, so ~/.senpi/agent is never used as the sandbox. Report the driver's realSenpiUntouched / changed-path fields and the isolated agent-dir path; treat a whole-directory digest as supporting evidence, not proof by itself.
No binary means SKIP, not silence. When senpi is absent the live drivers report SKIP or FAIL in their final JSON rather than degrading to the real home. A SKIP is not a pass — say so in the evidence README.
The captured JSON is the evidence. No file on disk means the QA did not happen, which means no commit and no push.

Resolve the evidence directory first

ev="$(node .agents/skills/senpi-qa/scripts/resolve-evidence-dir.mjs \
  --repo-root "$(git rev-parse --show-toplevel)" --slug <YYYYMMDD>-<short-slug>)"
mkdir -p "$ev"

The resolver returns an absolute path and creates nothing, so the caller decides when the directory appears. A slug is ONE relative segment of lowercase letters, digits, and hyphens (20260820-senpi-qa-contract). Separators, ./.., traversal, absolute paths, and a non-git root are rejected with a non-zero exit and a message naming the offending slug.

Router: pick your case

Track record

Benchmark

13 / 17

test cases passed, vs 3 / 17 without

Adoption

Users: 0
Times used: 0

Safety and source details

SkillSafety

✓ 3 of 3 passed

Code scan15 of 15 checks clean

0 critical · 0 warning · 0 info — scanner v5 — 8/24/2026

View 15 scanner checks

live_secretremote_code_executionreverse_shelldata_exfiltrationssrf_metadataagent_snoopinganti_refusaldestructive_commandsobfuscated_unicodeunicode_homoglyphopaque_blobsuspicious_urltool_overreachtrigger_abuseprompt_injection_phrasing

IntentSafe

LLM judge · does the skill do what it claims

ContentClean

LLM judge · policy & harmful-content review

Source

Imported

code-yeongyu / oh-my-openagent

.agents/skills/senpi-qa/SKILL.md

View on GitHub ↗

License NOASSERTIONImported 8/24/2026Version v1Bundled 2 files · scripts

More skills from the same source and nearby in the registry, with their headline benchmark lift.

Ready to supercharge your AI agents?

See it in action

What's inside

Senpi QA

Golden rules

Resolve the evidence directory first

Router: pick your case

Track record

Benchmark

Adoption

SkillSafety

Source

Related skills