Passed 12 of 17 test cases with the skill, and 5 of 17 without it.
Without skill27%
With skill68%
Checks it passed that the model alone missed
Check for agency SOP files at ~/.claude-marketing/sops/
Ask the user whether to set up a brand first using the brand setup skill
Pass min-confidence 0.3 as the default threshold parameter to the query script
and 8 more in the full report
11 fixed4 passed either way5 still failing2 broke
Pass-rate lift
+41 pp
Tokens
+39%
Agent turns
0%
Response time
-18%
Model gemini-3.6-flashMeasured 8/17/2026v1 · latest is v215 of 22 cases passed with skill · 17 comparable
Tokens, turns and time describe resource use, not a dollar price.
This benchmark measured an earlier version of the skill.
See it in action
One of 11 test cases the skill fixed. Same model, same prompt, with and without the skill.
1 of 11
Prompt
Before querying the intelligence graph for evergreen SEO content learnings targeting software engineers, which brand configuration file path must be read first to identify the current brand slug?
What was checked, without and with the skill
Checked
Without skill
With skill
Read ~/.claude-marketing/brands/_active-brand.json to get the active brand slug
Missed
Passed
case-12 · gemini-3.6-flash · 8/17/2026 · answers are capped and redacted
What's inside
The instructions your model reads when the skill loads.
SKILL.md37 linessingle file
/digital-marketing-pro:recall
Script location. If your host does not set ${CLAUDE_PLUGIN_ROOT}, the scripts are in this plugin's scripts/ folder, next to skills/. Run them with Python 3.10 or newer: python, or python3 where python is not found (macOS, many Linux systems).
Purpose
Retrieve relevant learnings from the brand's compound intelligence graph. Given a context — channel, audience, objective, or situation — return the most relevant validated insights ranked by confidence and recency. Turns accumulated marketing knowledge into an actionable playbook for any scenario, so past learnings directly inform current decisions without relying on memory or searching through old reports.
Input Required
The user must provide (or will be prompted for):
Query context: The situation to recall learnings for — specified as one or more of the following dimensions: channel (email, social, paid search, SEO, content, SMS, etc.), audience segment (developers, marketers, executives, SMB owners, enterprise buyers, etc.), objective (awareness, conversion, retention, upsell, win-back, etc.), campaign type (product launch, seasonal, evergreen, nurture, event, etc.), or a freeform situation description that captures the scenario in natural language (e.g., "planning a Black Friday email campaign targeting lapsed customers" or "launching a new product to a developer audience via content marketing")
Confidence threshold (optional): Minimum confidence score to include — defaults to 0.3 (includes hypotheses and above). Set to 0.7+ for only validated insights, or 0.0 to see everything including early-stage observations
Time range (optional): Filter learnings by when they were recorded — "last 30 days", "this quarter", "all time" (default). Recent learnings may be more relevant for fast-changing channels like paid social, while evergreen learnings about audience psychology may be valuable regardless of age
Max results (optional): Number of learnings to return — defaults to 10. Increase for comprehensive research or decrease for quick decision support
Process
Load brand context: Read ~/.claude-marketing/brands/_active-brand.json for the active slug, then load ~/.claude-marketing/brands/{slug}/profile.json. Apply brand industry, audience segments, and active channels to contextualize the query and boost relevance of matching learnings. Check for agency SOPs at ~/.claude-marketing/sops/. If no brand exists, ask: "Set up a brand first (/digital-marketing-pro:brand-setup)?" — or proceed with defaults.
Query the intelligence graph: Execute python "${CLAUDE_PLUGIN_ROOT}/scripts/intelligence-graph.py" --brand {slug} --action query-relevant --context '{context_json}' --min-confidence {threshold}. The query matches against all indexed conditions — channel, audience, objective, campaign type — and also performs semantic matching for freeform situation descriptions. --min-confidence applies the confidence-threshold filter; apply the time-range preference during ranking (step 3), not as a query flag.
Rank results: Score each returned learning by a composite of relevance (how closely the learning's conditions match the query context), confidence (how validated the insight is based on accumulated evidence), and recency (how recently the learning was recorded or last updated, with a decay curve that weights recent learnings higher for volatile channels). Return the top results by composite score.
Group into actionable themes: Cluster the ranked learnings into coherent themes — e.g., "Content & Messaging" (what to say), "Timing & Frequency" (when to say it), "Audience Behavior" (how they respond), "Channel Tactics" (platform-specific techniques), and "Things to Avoid" (validated anti-patterns). Each theme gets a summary sentence synthesizing the grouped insights.
Highlight conflicting insights: Identify any learnings within the results that contradict each other — flag these explicitly with both sides of the conflict, their respective confidence scores, and conditions that may explain the difference (e.g., "true for SMB but not enterprise"). Recommend which to follow based on confidence and recency, or suggest an A/B test to resolve the conflict.
Present as actionable playbook: Format the output as a decision-ready playbook — themed sections with ranked learnings, a "quick wins" callout for high-confidence actionable insights, a "test these" callout for lower-confidence hypotheses worth validating, and a "watch out" callout for validated anti-patterns and conflicts.
Output
Relevant learnings ranked by confidence: Each learning displayed with its insight text, confidence score, source, date recorded, and matching context conditions — sorted by composite relevance-confidence-recency score
Grouped by theme: Learnings organized into actionable theme clusters (content, timing, audience, channel tactics, anti-patterns) with a synthesis sentence per theme summarizing the collective insight
Conflicting insights flagged: Any contradictions within the results highlighted with both perspectives, their confidence scores, qualifying conditions, and a recommendation on which to follow or how to test
Actionable recommendations: A synthesized playbook section translating the raw learnings into specific recommendations for the queried situation — what to do, what to avoid, and what to test
Intelligence base stats: Total learnings in the brand's graph, number matching this query, average confidence of matched results, and age distribution of matched learnings
Agents Used
intelligence-curator — Query execution against the intelligence graph with multi-dimensional context matching and semantic search for freeform queries, relevance-confidence-recency composite ranking, thematic clustering of results into actionable groups, conflict detection across returned learnings with resolution recommendations, and playbook formatting that translates raw intelligence into decision-ready recommendations