Design and execute marketing A/B tests for landing pages, email campaigns, ad creatives, and pricing with proper test design and result analysis.
SkillScore73Maintained
Automatic
◆Marketing & Content pack
Last verified 8/28/2026
What it changes
Passed 16 of 22 test cases with the skill, and 9 of 22 without it.
Without skill41%
With skill73%
Checks it passed that the model alone missed
Includes level-2 section header '## Design'.
Advises testing only one variable at a time.
Includes level-2 section header '## Decision'.
and 8 more in the full report
7 fixed9 passed either way6 still failing0 broke
Pass-rate lift
+32 pp
Tokens
+31%
Agent turns
0%
Response time
-13%
Model gemini-3.6-flashMeasured 8/28/2026v116 of 22 cases passed with skill
Tokens, turns and time describe resource use, not a dollar price.
See it in action
One of 7 test cases the skill fixed. Same model, same prompt, with and without the skill.
1 of 7
Prompt
We want to execute self-tests on the Python script used for sample-size planning and hypothesis calculations in our marketing pipeline. Which command line option executes its built-in verification suite?
case-13 · gemini-3.6-flash · 8/28/2026 · answers are capped and redacted
What's inside
The instructions your model reads when the skill loads.
SKILL.md97 lines3 filesincludes scripts
Marketing A/B Testing
Framework
IRON LAW: One Variable at a Time
If you change the headline AND the image AND the CTA simultaneously,
you cannot know which change caused the result. Test ONE variable per
experiment. If you need to test multiple changes, use sequential tests
or multivariate testing (MVT) with sufficient traffic.
What to Test (by Impact)
Element
Expected Lift
Traffic Needed
Priority
Offer/Pricing
10-50%
Medium
Highest
Headline/Subject line
5-30%
Low
High
CTA (text, color, placement)
5-20%
Low
High
Page layout
5-15%
Medium
Medium
Image/Video
3-15%
Medium
Medium
Form fields
5-25% (reduction = higher CVR)
Low
Medium
Social proof placement
3-10%
Medium
Lower
Test Design
Hypothesis: "Changing [variable] from [A] to [B] will increase [metric] by [X%] because [reasoning]"
Primary metric: ONE metric that determines winner (conversion rate, revenue per visitor, signup rate)
Guardrail metrics: Metrics that must NOT degrade (bounce rate, page load time, revenue per user)
Traffic split: 50/50 between control and variant (standard)
Sample size: Calculate before starting (see stat-ab-testing for formula)
Duration: Minimum 1-2 full business weeks (capture day-of-week effects)
Conduct technical and on-page SEO audits covering crawlability, site speed, mobile-friendliness, and content optimization. Use this skill when the user needs to improve search rankings, diagnose traffic drops, audit a website for SEO issues, or plan an SEO strategy — even if they say 'why is our traffic dropping', 'audit our SEO', 'how do we rank higher on Google', or 'our site is slow'.