Ready to supercharge your AI agents?

Install any skill in seconds. Free to start, no credit card required.

Get Started Free →

Plugin Development Workflow · oliver-kriska | DecimalAI

agent toolingby oliver-kriska

Plugin Development Workflow

oliver-kriska/plugin-dev-workflow

Source oliver-kriska/claude-elixir-phoenix ↗License MIT

Guide plugin development workflow — editing skills, agents, hooks, or eval framework in this repo.

SkillScore95Maintained

Automatic

Coding pack

Last verified 8/19/2026

What it changes

Passed 21 of 22 test cases with the skill, and 5 of 22 without it.

Without skill23%

With skill95%

Checks it passed that the model alone missed

Requires running make test
Recommends running make eval-all
Recommends running make eval-fix

and 26 more in the full report

17 fixed4 passed either way0 still failing1 broke

Pass-rate lift: +73 pp
Tokens: +1%
Agent turns: 0%
Response time: -66%

Model gemini-3.6-flashMeasured 8/19/2026v121 of 22 cases passed with skill

Tokens, turns and time describe resource use, not a dollar price.

Use this skill

Save it into your project's skills folder. Claude Code picks it up in its next session.

curl -fsSL --create-dirs -o .claude/skills/oliver-kriska-plugin-dev-workflow/SKILL.md https://app.decimal.ai/s/oliver-kriska-plugin-dev-workflow/SKILL.md

Want it pinned and updatable? pip install "decimalai>=0.15", then decimalai skills add oliver-kriska-plugin-dev-workflow, and start Claude Code with claude --plugin-dir "$(git rev-parse --show-toplevel)/.agents"

1 · One-time — install the CLI (docs ↗)

pip install "decimalai>=0.15"

2 · Get the skill — writes .agents/skills/oliver-kriska-plugin-dev-workflow/ and pins it in .decimal/skills.lock

decimalai skills add oliver-kriska-plugin-dev-workflow

No CLI? Get the same file — curl · raw file

curl -fsSL --create-dirs -o .claude/skills/oliver-kriska-plugin-dev-workflow/SKILL.md https://app.decimal.ai/s/oliver-kriska-plugin-dev-workflow/SKILL.md

Raw file: /s/oliver-kriska-plugin-dev-workflow/SKILL.md ↗ · machine-readable summary at /s/oliver-kriska-plugin-dev-workflow.json ↗

Safety checks: 3 of 3 passed

Code scan CleanIntent PassedContent Clean

See it in action

One of 17 test cases the skill fixed. Same model, same prompt, with and without the skill.

1 of 17

Prompt

I am writing a detailed explanation section inside a skill document. To prevent evaluation failures, what is the maximum allowed line count for any single section inside a skill file?

What was checked, without and with the skill
Checked	Without skill	With skill
States a maximum section limit of 45 lines	Missed	Passed

case-11 · gemini-3.6-flash · 8/19/2026 · answers are capped and redacted

What's inside

The instructions your model reads when the skill loads.

SKILL.md111 linessingle file

Plugin Development Workflow

This repo is the Elixir/Phoenix Claude Code plugin. When editing plugin files, follow this workflow to ensure quality.

Before You Start

Run make help to see all available commands:

make eval          # Quick: lint + score changed skills/agents
make eval-all      # Full: all 51 skills + 26 agents
make eval-fix      # Auto-fix + show failures
make test          # 220 pytest tests for eval framework and port tooling
make ci            # Full CI pipeline

Scoring Individual Files (CLI)

IMPORTANT: Always use -m module syntax, never run scorer.py directly.

# Score ONE skill (use -m, NOT direct file path)
python3 -m lab.eval.scorer plugins/elixir-phoenix/skills/verify/SKILL.md

# Score ONE skill with pretty output
python3 -m lab.eval.scorer plugins/elixir-phoenix/skills/verify/SKILL.md --pretty

# Score all skills
python3 -m lab.eval.scorer --all

# Score ONE agent
python3 -m lab.eval.agent_scorer plugins/elixir-phoenix/agents/verification-runner.md

# Score all agents
python3 -m lab.eval.agent_scorer --all
make ci            # Full CI pipeline

When Editing Skills (plugins/elixir-phoenix/skills/*/SKILL.md)

Track record

Benchmark

21 / 22

test cases passed, vs 5 / 22 without

Adoption

Users: 0
Times used: 0

Safety and source details

SkillSafety

✓ 3 of 3 passed

Code scan15 of 15 checks clean

0 critical · 0 warning · 0 info — scanner v4 — 8/3/2026

View 15 scanner checks

live_secretremote_code_executionreverse_shelldata_exfiltrationssrf_metadataagent_snoopinganti_refusaldestructive_commandsobfuscated_unicodeunicode_homoglyphopaque_blobsuspicious_urltool_overreachtrigger_abuseprompt_injection_phrasing

IntentSafe

LLM judge · does the skill do what it claims

ContentClean

LLM judge · policy & harmful-content review

Source

Imported

oliver-kriska / claude-elixir-phoenix

.claude/skills/plugin-dev-workflow/SKILL.md

View on GitHub ↗

License MITImported 8/3/2026Version v1

More skills from the same source and nearby in the registry, with their headline benchmark lift.

Ready to supercharge your AI agents?

See it in action

What's inside

Plugin Development Workflow

Before You Start

Scoring Individual Files (CLI)

When Editing Skills (plugins/elixir-phoenix/skills/*/SKILL.md)

Track record

Benchmark

Adoption

SkillSafety

Source

Related skills