Ready to supercharge your AI agents?

Install any skill in seconds. Free to start, no credit card required.

Benchmark · code-saurabh | DecimalAI

testingby code-saurabh

Benchmark

code-saurabh/benchmark

Source code-saurabh/openskills ↗License MIT

Performance benchmarking skill — baseline and compare page load times, Core Web Vitals, bundle sizes, and API response times.

SkillScore91Maintained

Automatic

QA & Test Engineering pack

Last verified 8/4/2026

What it changes

Passed 20 of 22 test cases with the skill, and 13 of 22 without it.

Without skill59%

With skill91%

Checks it passed that the model alone missed

Defines budgetPath pointing to lighthouse-budget.json
Runs Lighthouse CLI at least 3 times to derive median results
Saves benchmark results inside the benchmark-results/ directory

and 7 more in the full report

8 fixed12 passed either way1 still failing1 broke

Pass-rate lift: +32 pp
Tokens: +170%
Agent turns: 0%
Response time: -25%

Model gemini-3.6-flashMeasured 8/4/2026v120 of 22 cases passed with skill

Tokens, turns and time describe resource use, not a dollar price.

Use this skill

Save it into your project's skills folder. Claude Code picks it up in its next session.

curl -fsSL --create-dirs -o .claude/skills/code-saurabh-benchmark/SKILL.md https://app.decimal.ai/s/code-saurabh-benchmark/SKILL.md

Want it pinned and updatable? pip install "decimalai>=0.15", then decimalai skills add code-saurabh-benchmark, and start Claude Code with claude --plugin-dir "$(git rev-parse --show-toplevel)/.agents"

1 · One-time — install the CLI (docs ↗)

pip install "decimalai>=0.15"

2 · Get the skill — writes .agents/skills/code-saurabh-benchmark/ and pins it in .decimal/skills.lock

decimalai skills add code-saurabh-benchmark

No CLI? Get the same file — curl · raw file

curl -fsSL --create-dirs -o .claude/skills/code-saurabh-benchmark/SKILL.md https://app.decimal.ai/s/code-saurabh-benchmark/SKILL.md

Raw file: /s/code-saurabh-benchmark/SKILL.md ↗ · machine-readable summary at /s/code-saurabh-benchmark.json ↗

Safety checks: 3 of 3 passed

Code scan CleanIntent PassedContent Clean

See it in action

One of 8 test cases the skill fixed. Same model, same prompt, with and without the skill.

1 of 8

Prompt

We have two metric JSON snapshot files, `baseline.json` and `candidate.json`. Write the CLI command to execute the project's Python metric comparison script on these files.

What was checked, without and with the skill
Checked	Without skill	With skill
Invokes python scripts/compare_metrics.py baseline.json candidate.json	Missed	Passed
References metric-contract.md prior to running metric comparisons	Missed	Passed

case-06 · gemini-3.6-flash · 8/4/2026 · answers are capped and redacted

What's inside

The instructions your model reads when the skill loads.

SKILL.md328 lines3 filesincludes scripts

Benchmark

Benchmarking without a baseline is noise. A benchmark that can't be reproduced is a guess. Every benchmark in this skill produces a number, a method, and a comparison — not an impression.

Performance is a feature. Regressions ship silently. This skill makes regressions visible before they reach users.

Benchmark Principles

Measure before you optimize. An optimization without a before measurement is an assumption. Always baseline first.
Reproduce exactly. A benchmark is only valid if another engineer can reproduce it with the same setup. Document the environment, the command, and the conditions.
Medians lie. Use percentiles. P50 hides the users who are suffering. Always report P75, P95, and P99 alongside the median.
Synthetic vs real-user data. Lighthouse in a lab tells you what's possible. RUM (Real User Monitoring) tells you what's happening. Use both.
One change at a time. If two things change between benchmarks, you can't attribute the delta to either.
A regression is a regression. A 10% slowdown on a fast page is still a regression. Set thresholds and enforce them.

Step 0: Establish the Baseline

Before any optimization or PR review, establish the baseline. Without it, "after" numbers are meaningless.

# Run Lighthouse baseline (3 runs, take median)
npx lighthouse https://your-app.com/key-page \
  --output json \
  --output-path ./baseline.json \
  --chrome-flags="--headless" \
  --throttling-method=simulate \
  --preset=desktop

# Run 3 times and average — single runs are noisy
for i in 1 2 3; do
  npx lighthouse https://your-app.com/key-page \
    --output json \
    --output-path "./baseline-run-$i.json" \
    --chrome-flags="--headless"
done

Track record

Benchmark

20 / 22

test cases passed, vs 13 / 22 without

Adoption

Users: 0
Times used: 0

Safety and source details

SkillSafety

✓ 3 of 3 passed

Code scan15 of 15 checks clean

0 critical · 0 warning · 0 info — scanner v4 — 8/1/2026

View 15 scanner checks

live_secretremote_code_executionreverse_shelldata_exfiltrationssrf_metadataagent_snoopinganti_refusaldestructive_commandsobfuscated_unicodeunicode_homoglyphopaque_blobsuspicious_urltool_overreachtrigger_abuseprompt_injection_phrasing

IntentSafe

LLM judge · does the skill do what it claims

ContentClean

LLM judge · policy & harmful-content review

Source

Imported

code-saurabh / openskills

benchmark/SKILL.md

View on GitHub ↗

License MITImported 8/1/2026Version v1Bundled 2 files · scripts

Other skills for the same job

Published skills whose descriptions closely match this one, with their headline benchmark lift.

More skills from the same source and nearby in the registry, with their headline benchmark lift.

Ready to supercharge your AI agents?

See it in action

What's inside

Benchmark

Benchmark Principles

Step 0: Establish the Baseline

Track record

Benchmark

Adoption

SkillSafety

Source

Other skills for the same job

Related skills