Ready to supercharge your AI agents?

Install any skill in seconds. Free to start, no credit card required.

Paid Media Experiment · agricidaniel | DecimalAI

marketingby agricidaniel

Paid Media Experiment

agricidaniel/ads-test

Source agricidaniel/claude-ads ↗License MIT

Design and evaluate paid-ad experiments with hypotheses, randomization units, sample-size and duration assumptions, guardrails, platform experiment tools, analysis, and decision rules.

SkillScore78Maintained

Automatic

Marketing & Content pack

Last verified 8/12/2026

What it changes

Passed 17 of 22 test cases with the skill, and 7 of 22 without it.

Without skill30%

With skill78%

Checks it passed that the model alone missed

The output format is versioned JSON.
The output contains a schema version key.
The output is formatted as versioned JSON.

and 16 more in the full report

14 fixed4 passed either way2 still failing3 broke

Pass-rate lift: +48 pp
Tokens: +38%
Agent turns: 0%
Response time: +21%

Model gemini-3.6-flashMeasured 8/12/2026v118 of 23 cases passed with skill · 22 comparable

Tokens, turns and time describe resource use, not a dollar price.

Use this skill

Save it into your project's skills folder. Claude Code picks it up in its next session.

curl -fsSL --create-dirs -o .claude/skills/agricidaniel-ads-test/SKILL.md https://app.decimal.ai/s/agricidaniel-ads-test/SKILL.md

Want it pinned and updatable? pip install "decimalai>=0.15", then decimalai skills add agricidaniel-ads-test, and start Claude Code with claude --plugin-dir "$(git rev-parse --show-toplevel)/.agents"

1 · One-time — install the CLI (docs ↗)

pip install "decimalai>=0.15"

2 · Get the skill — writes .agents/skills/agricidaniel-ads-test/ and pins it in .decimal/skills.lock

decimalai skills add agricidaniel-ads-test

No CLI? Get the same file — curl · raw file

curl -fsSL --create-dirs -o .claude/skills/agricidaniel-ads-test/SKILL.md https://app.decimal.ai/s/agricidaniel-ads-test/SKILL.md

Raw file: /s/agricidaniel-ads-test/SKILL.md ↗ · machine-readable summary at /s/agricidaniel-ads-test.json ↗

Safety checks: 3 of 3 passed

Code scan CleanIntent PassedContent Clean

See it in action

One of 13 test cases the skill fixed. Same model, same prompt, with and without the skill.

1 of 13

Prompt

Here are the campaign metrics from our two-week search ad test evaluating target CPA versus automated bidding on Google Ads. Please check the data for completeness, calculate the outcome and uncertainty, and tell us whether we should switch strategies. Format the full readout in structured JSON accompanied by a clear plain-language decision.

What was checked, without and with the skill
Checked	Without skill	With skill
The JSON output contains a top-level version attribute.	Missed	Passed
The readout explicitly verifies data completeness prior to outcome calculations.	Passed	Passed
The output includes statistical uncertainty bounds for the estimated effect size.	Missed	Passed

case-02 · gemini-3.6-flash · 8/12/2026 · answers are capped and redacted

What's inside

The instructions your model reads when the skill loads.

SKILL.md15 linessingle file

Paid Media Experiment

State the decision, causal hypothesis, treatment, control, randomization unit, population, primary metric, guardrails, minimum effect, and stopping rule.
Check platform constraints, overlapping experiments, conversion lag, seasonality, interference, and measurement quality.
Calculate sample and duration from declared assumptions; disclose approximations.
Change one decision surface unless the design explicitly estimates interactions.
Pre-register exclusions, quality checks, analysis, and decision thresholds.
For readout, verify assignment integrity and data completeness before estimating effect and uncertainty.
Return setup or readout in versioned JSON with a plain-language decision.

Do not repeatedly peek and stop on a favorable result, call underpowered noise a winner, or generalize beyond the tested population.

Track record

Benchmark

17 / 22

test cases passed, vs 7 / 22 without

Adoption

Users: 0
Times used: 0

Safety and source details

SkillSafety

✓ 3 of 3 passed

Code scan15 of 15 checks clean

0 critical · 0 warning · 0 info — scanner v4 — 8/3/2026

View 15 scanner checks

live_secretremote_code_executionreverse_shelldata_exfiltrationssrf_metadataagent_snoopinganti_refusaldestructive_commandsobfuscated_unicodeunicode_homoglyphopaque_blobsuspicious_urltool_overreachtrigger_abuseprompt_injection_phrasing

IntentSafe

LLM judge · does the skill do what it claims

ContentClean

LLM judge · policy & harmful-content review

Source

Imported

agricidaniel / claude-ads

skills/ads-test/SKILL.md

View on GitHub ↗

License MITImported 8/3/2026Version v1

Other skills for the same job

Published skills whose descriptions closely match this one, with their headline benchmark lift.

aaron-he-zhu/ad-test-designerUse when the user asks to "design an A/B test", "set up a creative/landing test", "run an incrementality test", or "is this result statistically and practically material?"; produces a hypothesis, variant matrix, sample-size/duration/power plan, and a documented effect/uncertainty read from own exported results. It applies only a precommitted owner-approved action rule; the statistical helper never chooses a business action. Not for producing variants — use ad-creative-builder; not for reading baClose match+28 pp pass-rate lift

More skills from the same source and nearby in the registry, with their headline benchmark lift.

Ready to supercharge your AI agents?

See it in action

What's inside

Paid Media Experiment

Track record

Benchmark

Adoption

SkillSafety

Source

Other skills for the same job

Related skills