Install any skill in seconds. Free to start, no credit card required.
Get Started Free →Preview, submit, inspect, and manage Alpaca paper-trading orders across US equities, options, and crypto. Use this skill when you want your AI agent to take a strategy signal — from a backtest, manual idea, or automated system — and execute it safely in your Alpaca paper-trading environment. This generic version works with any Alpaca SDK, REST API call, or agent tool that can reach the Trading API.
.claude/skills/alpacahq-alpaca-trading-paper-trading/SKILL.md| Test case | Without → With | Effect | Δ tokens | Δ turns |
|---|---|---|---|---|
| case-01 | ✗→✓ | ▲ Improved | 743% | 0% |
| case-03 | ✗→✓ | ▲ Improved | 559% | 0% |
| case-04 | ✗→✓ | ▲ Improved | 15129% | 0% |
| case-06 | ✗→✓ | ▲ Improved | 19568% | 0% |
| case-08 | ✗→✓ | ▲ Improved | 619% | 0% |
Use this skill when you want your AI agent to preview, submit, inspect, and manage paper-trading orders using Alpaca's Trading API.
This skill is written for you, a Trading API user working with your own Alpaca paper-trading account, credentials, and local workspace. Your agent should make assumptions visible, protect secrets, and confirm order details before submission.
This is the generic (implementation-agnostic) version of the paper-trading skill. It describes the workflow, safety gates, and output contract without binding to any specific execution tool. You can use the Alpaca Python SDK (alpaca-py), the REST API directly, JavaScript/TypeScript, Go, C#, or any tool that speaks to the Trading API. CLI-specific and MCP-specific companion skills exist for users who prefer those execution paths — see §10 for links.
paper- prefix, or a profile set to live — your agent stops immediately and warns you. This is a hard block, not a soft warning.APCA_API_KEY_ID, APCA_API_SECRET_KEY) or SDK/CLI profile — never pasted into chathttps://paper-api.alpaca.markets (for REST) or appropriate SDK configuration pointing to the paper environmentalpaca-py (recommended)@alpacahq/alpaca-trade-api (v4+, first-party and actively maintained)github.com/alpacahq/alpaca-trade-api-go/v3 — the /v3 suffix is required; without it you pull the v1 pathAlpaca.Markets (first-party). Community SDKs exist for Java and others.curl, httpx, requests, or any HTTP clientpaper-api.alpaca.markets)| Input | Description | Default | |---|---|---| | signal_source | Where the trade idea comes from (backtest, manual, automation) | Must be provided | | symbol | Ticker symbol (e.g., AAPL, BTC/USD, AAPL250718C00200000 for options) | Must be provided | | side | buy or sell | Must be provided | | qty_or_notional | Number of shares/contracts OR dollar amount (use qty for shares/contracts, notional for dollar amount) | Must be provided | | order_type | market, limit, stop, stop_limit, trailing_stop — supported values vary by asset class, see below | market | | time_in_force | day, gtc, ioc, fok, opg, cls — supported values vary by asset class, see below | day for equities; gtc for crypto |
The API rejects combinations outside this matrix, so your agent validates before submitting rather than after:
| Asset class | Order types | Time-in-force | Order classes | |---|---|---|---| | us_equity | market, limit, stop, stop_limit, trailing_stop | day, gtc, opg, cls, ioc, fok | simple, bracket, oco, oto | | us_option | market, limit, stop, stop_limit (stop types single-leg only) | day, gtc | simple, mleg | | crypto | market, limit, stop_limit | gtc, ioc — stop_limit is gtc-only, and ioc applies only to market and limit | simple |
Treat this as guidance for constructing orders, not as a hard pre-submission gate. Alpaca's sources disagree on the options row: the OpenAPI TimeInForce/OrderType descriptions say market/limit with day only, while the Options Trading page and the Placing Orders matrix both allow gtc and both allow stop/stop_limit on single-leg orders. The two product pages agree against the spec blob, so this table follows them. Default to day for options as the conservative choice, but let Alpaca reject rather than pre-blocking something the matrix permits.
Constraints that cut across order type:
limit type with day or gtc TIF. Everything else is rejected.day and gtc.qty and cannot be replaced — cancel and resubmit instead. For equities they additionally require market type with day TIF; crypto notional orders are market-type and use the crypto TIF set (gtc/ioc), so the equities day restriction does not apply to them.day or gtc, and do not support extended hours.mleg carries up to 4 legs and is how multi-leg options strategies are expressed.| Input | Description | Default | |---|---|---| | limit_price | Required for limit and stop_limit orders | None | | stop_price | Required for stop and stop_limit orders | None | | trail_price or trail_percent | For trailing stop orders (one or the other, not both) | None | | extended_hours | Allow extended-hours execution (equities only; limit type with day or gtc TIF) | false | | client_order_id | User-supplied idempotency key (max 128 chars) | Auto-generated UUID | | confirmation_mode | Whether your agent asks for explicit confirmation before each order | on | | risk_controls | Max position size, max notional, max loss threshold | None (recommended to set) | | asset_class | us_equity, us_option, crypto | Inferred from symbol format | | order_class | simple, bracket, oco, oto, mleg — see the per-asset-class matrix above | simple | | position_intent | buy_to_open, buy_to_close, sell_to_open, sell_to_close (options only) | Inferred from context |
Before proceeding past the configuration phase, your agent must confirm each of these with you:
| Source | URL | Used for | |---|---|---| | Trading API overview | https://docs.alpaca.markets/us/docs/trading-api | API capabilities and structure | | Working with orders | https://docs.alpaca.markets/us/docs/working-with-orders | Order submission, replacement, cancellation | | Orders on Alpaca | https://docs.alpaca.markets/us/docs/orders-at-alpaca | Order types, TIF values, status lifecycle | | Paper trading | https://docs.alpaca.markets/us/docs/paper-trading | Paper environment behavior and limitations | | Working with positions | https://docs.alpaca.markets/us/docs/working-with-positions | Position retrieval and management | | Working with account | https://docs.alpaca.markets/us/docs/working-with-account | Account state, buying power, day trade count | | Working with assets | https://docs.alpaca.markets/us/docs/working-with-assets | Tradability checks, asset attributes | | Options trading | https://docs.alpaca.markets/us/docs/options-trading | Options order specifics, approval levels | | Crypto trading | https://docs.alpaca.markets/us/docs/crypto-trading | Crypto order specifics, supported pairs | | Alpaca disclosures | https://alpaca.markets/disclosures | Required disclosure language |
Step 1 — Identify the signal source. Your agent determines where the trade idea comes from:
notes.md, summary.json) to extract the strategy logic, confirmed parameters, and the last signal. Parse the signal for symbol, side, quantity, and any price targets.Step 2 — Reiterate the strategy logic. Your agent restates the complete strategy interpretation in plain language:
Step 3 — Confirm the interpretation. Your agent asks you to confirm or correct the restatement. It does not proceed until you confirm. If you correct it, your agent restates the corrected version and asks again.
Step 4 — Gather all order parameters. Using the inputs table from §2, your agent collects every required and optional parameter. It asks for anything not already specified.
Step 5 — Show parameter attribution. For each parameter, your agent shows:
Example:
Symbol: AAPL (provided)
Side: buy (provided)
Quantity: 50 shares (provided)
Order type: limit (provided)
Limit price: $180.00 (provided)
TIF: day (defaulted — standard for equities)
Extended hrs: false (defaulted)
Client order: a7b3c9d1-... (auto-generated)Step 6 — Confirm timing. Your agent confirms execution timing:
If the timing is not immediate, your agent explains what tooling you'd need and whether it can help set it up (see §4 Phase 8 for deployment guidance).
Step 7 — Confirm asset class specifics.
For US Equity:
extended_hours is true (only limit orders qualify)For US Options:
AAPL250718C00200000For Crypto:
BTC/USD, ETH/USD)Step 8 — Confirm risk controls. Your agent asks about risk controls:
If you haven't set any risk controls, your agent recommends you consider them. It asks whether you want to set them now or proceed without them. If you proceed without them, your agent notes this in the session log.
Step 9 — Confirm margin usage. Your agent checks:
account.multiplier — the account object has no account_type field. 1 is a limited-margin, cash-style account; 2 is a Reg T margin account with 2x intraday and overnight buying power; 4 is a PDT account with 4x intraday and 2x overnightaccount.shorting_enabled), since the strategy may require itaccount.buying_power) and, for options, account.options_buying_poweraccount.equity)account.maintenance_margin)Step 10 — Verify the environment is paper. Your agent checks the base URL, SDK configuration, or CLI profile to confirm the environment is paper, not live.
| Check | Paper | Live (BLOCKED) | |---|---|---| | REST base URL | https://paper-api.alpaca.markets | https://api.alpaca.markets | | SDK config | paper=True or equivalent | paper=False or missing | | CLI profile | paper profile selected | live profile selected |
If live credentials are detected: STOP immediately. Your agent displays a clear warning and refuses to proceed. It does not offer to "switch to paper" on your behalf — you must reconfigure your credentials.
Step 11 — Fetch account status. Your agent retrieves the account and verifies:
status is ACTIVE or PAPER_ONLY — a paper-only account is valid for this skill and must not be blockedtrading_blocked is falseaccount_blocked is falsetrade_suspended_by_user is falsebuying_power is sufficient for the planned ordermultiplier for margin classification, which is also the only PDT signal availableThe Trading API account object carries no pattern_day_trader or daytrade_count field. Your agent must not read them. A multiplier of 4 indicates a PDT account; if you need day-trade counts, derive them from GET /v2/account/activities rather than the account object.
Step 12 — Verify options readiness (if trading options).
options_trading_level, not options_approved_level. The effective level is the minimum of options_approved_level and the max_options_trading_level in account configuration, and Alpaca exposes it directly as options_trading_level. An account approved for level 3 but configured to level 1 can only trade level 1.options_trading_level is 0 or below what the strategy needs, your agent stops and explains which level is required and how to request an upgradeStep 13 — Verify crypto readiness (if trading crypto).
crypto_status is ACTIVEStep 14 — Show account summary. Your agent displays a summary of the account state:
┌─────────────────────────────────────────┐
│ PAPER ACCOUNT SUMMARY │
├──────────────┬──────────────────────────┤
│ Account ID │ ****-****-****-a1b2 │
│ Status │ ACTIVE │
│ Equity │ $100,000.00 │
│ Buying Power │ $100,000.00 │
│ Cash │ $100,000.00 │
│ Positions │ 3 open │
│ Multiplier │ 2 (Reg T margin) │
│ Options Lvl │ 2 (effective) │
│ Crypto │ ACTIVE │
└──────────────┴──────────────────────────┘Step 15 — Build the order payload. Your agent constructs the complete API request body with all confirmed parameters. It sets a unique client_order_id for idempotency.
Step 16 — Display the order preview. Your agent shows a complete order preview table:
┌─────────────────────────────────────────┐
│ ORDER PREVIEW │
├──────────────┬──────────────────────────┤
│ Environment │ PAPER │
│ Symbol │ AAPL │
│ Side │ buy │
│ Quantity │ 10 shares │
│ Order Type │ limit │
│ Limit Price │ $185.50 │
│ Time-in-Force│ day │
│ Extended Hrs │ no │
│ Client Order │ abc-123-def │
│ Est. Notional│ ~$1,855.00 │
│ Buying Power │ $98,500.00 (sufficient) │
└──────────────┴──────────────────────────┘For options, the preview also shows:
AAPL 07/18/2025 $200 CallFor crypto, the preview also shows:
Step 17 — Confirmation-ON mode. If confirmation_mode is on, your agent asks:
> Submit this order? (yes / no)
It waits for your explicit yes before proceeding. Any response other than a clear affirmative is treated as "no" and your agent asks what you'd like to change.
Step 18 — Confirmation-OFF mode. If confirmation_mode is off, your agent informs you:
> Confirmation mode is OFF. This order will be submitted now. The preview is shown above for your review.
Your agent then proceeds to submission.
Step 19 — Submit the order. Your agent sends the order to the paper trading API via your chosen execution method (SDK, REST, CLI, or MCP tool). The endpoint is POST /v2/orders against the paper base URL.
Step 20 — Capture the response. On success, your agent captures:
id (order ID)client_order_idstatus — usually new, meaning Alpaca received the order and routed it. accepted means received but not yet routed and is common outside trading hours; pending_new and accepted_for_bidding are documented as rarecreated_atsubmitted_atsymbol, side, qty, type, time_in_forceStep 21 — Handle submission failure. If the submission fails, your agent:
POST /v2/orders documents exactly two error responses, and they do not mean what their generic HTTP names suggest:403 Forbidden → insufficient buying power or shares, not an auth problem. Show current buying power versus required, or current position versus the quantity being sold422 Unprocessable Entity → input parameters not recognized. Show which ones, and check them against the per-asset-class matrix in section 2429 Too Many Requests → rate limited; honor Retry-After and back off401 Unauthorized → credential problem. Stop; do not retry with the same credentialsA non-tradable or unknown symbol surfaces as 422 from the order endpoint, not 404. Your agent validates the symbol against GET /v2/assets/{symbol_or_asset_id} beforehand, where a genuinely unknown symbol does return 404. Crypto requires the old symbology without a slash (BTCUSD), and any slash that remains must be URL-encoded (/v2/assets/BTC%2FUSDT) or the request is malformed.
client_order_id first.Step 22 — Fetch order status. Immediately after a successful submission, your agent fetches the order by ID (GET /v2/orders/{id}) to confirm the current status.
Step 23 — Return post-submission summary. Your agent shows you:
Order submitted successfully.
Order ID: b1e2f3a4-5678-9012-cdef-abcdef123456
Status: accepted
Symbol: AAPL
Side: buy
Qty: 10
Type: limit
Limit Price: $185.50
TIF: day
Submitted at: 2026-07-26T15:30:00Z
Environment: PAPER
Next steps:
- Ask me to check the status of this order
- Ask me to cancel this order
- Ask me to show your current positions
- Ask me to show your portfolio summaryStep 24 — Order lifecycle updates.
Your agent tracks the order through its lifecycle and reports each transition:
Filled:
✅ Order FILLED
Order ID: b1e2f3a4-...
Symbol: AAPL
Side: buy
Filled Qty: 10 shares
Avg Fill Price: $185.32
Fill Time: 2026-07-26T15:30:05Z
Portfolio impact:
- AAPL position: 10 shares @ $185.32 (new position)
- Position value: $1,853.20
- Portfolio %: 1.85% of equity
- Buying Power: $98,146.80 (was $100,000.00)Partially filled:
⏳ Order PARTIALLY FILLED
Order ID: b1e2f3a4-...
Filled: 6 of 10 shares
Avg Fill Price: $185.35
Remaining: 4 shares (still working)Rejected:
❌ Order REJECTED
Order ID: b1e2f3a4-...
Reason: insufficient buying power
Details: Required ~$1,855.00, available $500.00
Remediation:
- Reduce order quantity
- Close existing positions to free buying power
- If this is unexpected, check your account for pending orders
consuming buying powerCanceled:
🚫 Order CANCELED
Order ID: b1e2f3a4-...
Canceled by: system
Reason: day order expired at market close (16:00 ET)
If you still want this position, consider:
- Resubmitting as a GTC order
- Waiting for the next market openReplaced:
🔄 Order REPLACED
Old Order ID: b1e2f3a4-...
New Order ID: c2d3e4f5-...
Changed:
Limit Price: $185.50 → $186.00
Quantity: 10 → 15Step 25 — Fetch updated positions and account. After a fill, your agent retrieves the current positions (GET /v2/positions) and account (GET /v2/account) to show the impact.
Step 26 — Show portfolio risk summary.
┌─────────────────────────────────────────┐
│ PORTFOLIO RISK SUMMARY │
├──────────────┬──────────────────────────┤
│ Total Equity │ $100,050.00 │
│ Buying Power │ $98,146.80 │
│ Open Pos. │ 4 positions │
│ Open Orders │ 1 working │
│ │
│ Position Concentration: │
│ AAPL │ 1.85% ($1,853.20) │
│ MSFT │ 3.20% ($3,201.00) │
│ TSLA │ 2.10% ($2,100.50) │
│ BTC/USD │ 5.00% ($5,002.30) │
│ │
│ Unrealized P&L (total): +$50.00 │
└──────────────┴──────────────────────────┘abs(position.market_value) / equity × 100 — the Position field is market_value. (position_market_value exists only on the account payload as an all-positions aggregate.)(current_price - avg_entry_price) × qty> This phase is optional. Your agent provides this guidance only when you ask about deploying or automating a strategy.
Step 27 — Provide deployment options.
If you ask how to deploy or automate the strategy, your agent outlines these paths:
Local scheduler:
cron (Linux/macOS), launchd (macOS), or Windows Task Scheduleralpaca-py that encapsulates the strategy logicCloud hosting:
Webhook-based:
Every deployed path asserts paper at startup. Scheduling, hosting, and webhook triggers differ, but they share one requirement: the artifact that runs unattended proves it is pointed at paper before it can place an order, and exits if it cannot. There is no operator watching to catch a wrong endpoint, and a live account returns the same response shape as a paper one, so nothing downstream will reveal the mistake.
Two rules make that assertion trustworthy:
alpaca-py that means constructing the client as TradingClient(key, secret, paper=True) with paper=True written literally, never paper=os.getenv(...).Naming a credential or variable "paper" is not evidence. Only the resolved endpoint is.
Important notes your agent always includes:
https://api.alpaca.markets without the paper- prefix, or the SDK/CLI profile is set to live — it must STOP and warn you immediately.client_order_id on every order to prevent duplicate submissions.client_order_id before retrying.client_order_id values are logged in the session's orders.json for audit.X-RateLimit-Limit, X-RateLimit-Remaining, and X-RateLimit-Reset; your agent slows down as Remaining approaches zero instead of waiting to be throttled. A figure of 200 requests per minute is widely cited for the Trading API but is not stated in Alpaca's current documentation, so do not hard-code it.X-RateLimit-Reset.US Equity:
extended_hours: true on a limit order with day or gtc TIF, and cover three sessions:fractionable attribute)US Options:
Crypto:
POST /v2/orders, 403 means the tradable balance or share count is insufficient — it is not an auth failure. Show current buying power, required notional, and the shortfall. Suggest reducing quantity or closing positions.422. Show the asset status and suggest checking the symbol. Offer to search for the correct symbol. GET /v2/assets/{symbol_or_asset_id} is the place a 404 legitimately appears.GET /v2/clock).client_order_id) before deciding whether to retry.Order submitted successfully.
Order ID: {order_id}
Status: {status}
Symbol: {symbol}
Side: {side}
Qty: {qty}
Type: {order_type}
TIF: {time_in_force}
Submitted at: {submitted_at}
Environment: PAPER
Next steps:
- Ask me to check the status of this order
- Ask me to cancel this order
- Ask me to show your current positions
- Ask me to show your portfolio summaryWhen the skill is used as part of a session with multiple orders, your agent writes session artifacts to a run folder:
runs/<YYYYMMDD-HHMMSS>-paper-trading/
notes.md # strategy context, confirmation choices, assumptions
orders.json # all orders submitted in this session
order_log.csv # timeline: order_id, timestamp, event, status, details
positions_snapshot.json # positions after last fill
portfolio_summary.md # human-readable portfolio state
review.md # session review and open questionsFile descriptions:
| File | Content | Format | |---|---|---| | notes.md | Strategy description, signal source, confirmation preferences, assumptions made, risk controls applied | Markdown | | orders.json | Array of all orders submitted, including request payload and response | JSON | | order_log.csv | Chronological event log: order_id, timestamp, event_type, status, details | CSV | | positions_snapshot.json | Positions at the end of the session (from GET /v2/positions) | JSON | | portfolio_summary.md | Human-readable portfolio state: equity, buying power, positions, concentration, P&L | Markdown | | review.md | Session review: what worked, what didn't, open questions, suggested improvements | Markdown |
Validate behavior against:
Run these tests mentally or against a paper account whenever modifying this skill.
> Important disclosure: This material is for informational, educational, and research purposes only. It is not investment advice, a recommendation, an offer, or a solicitation to buy or sell securities, options, cryptocurrencies, or any other financial product. All investing and trading involve risk, including possible loss of principal. Paper trading is simulated and may differ from live trading in fills, market impact, liquidity, fees, latency, and other factors. Review Alpaca's disclosures at https://alpaca.markets/disclosures.
Your agent includes this disclosure in every session summary, report, and portfolio review.
When options are involved, your agent includes:
When crypto is involved, your agent includes:
APCA_API_KEY_ID, APCA_API_SECRET_KEY), SDK configuration files, or CLI profile settings.client_order_id for idempotency).| File | Description | |---|---| | reference.md | API endpoint details, order schemas, status lifecycle diagrams, error codes |
| Skill | Description | |---|---| | alpaca-trading-paper-trading-cli | CLI-specific version using the Alpaca CLI | | alpaca-trading-paper-trading-mcp | MCP-specific version using Alpaca MCP server tools |
| Skill | Description | |---|---| | alpaca-trading-backtest | Run historical backtests that produce signals for this skill |
| Case | Status | Duration (ms) | Turns | Tokens | Tool calls | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Without | With | Δ | Without | With | Δ | Without | With | Δ | Without | With | Δ | ||
case-01 | fail→pass | 9,288 | 5,873 | -37% | 1 | 1 | 0% | 1,343 | 11,325 | +743% | 0 | 0 | — |
case-02 | fail→fail | 13,287 | 16,498 | +24% | 1 | 1 | 0% | 2,322 | 13,629 | +487% | 0 | 0 | — |
case-03 | fail→pass | 10,301 | 6,954 | -32% | 1 | 1 | 0% | 1,737 | 11,439 | +559% | 0 | 0 | — |
case-04 | fail→pass | 9,175 | 15,462 | +69% | 1 | 1 | 0% | 87 | 13,249 | +15129% | 0 | 0 | — |
case-05 | pass→pass | 26,747 | 16,767 | -37% | 1 | 1 | 0% | 4,936 | 13,508 | +174% | 0 | 0 | — |
case-06 | fail→pass | 10,378 | 27,975 | +170% | 1 | 1 | 0% | 81 | 15,931 | +19568% | 0 | 0 | — |
case-07 | pass→pass | 13,233 | 4,939 | -63% | 1 | 1 | 0% | 2,227 | 11,353 | +410% | 0 | 0 | — |
case-08 | fail→pass | 10,670 | 9,508 | -11% | 1 | 1 | 0% | 1,680 | 12,073 | +619% | 0 | 0 | — |
case-09 | pass→pass | 10,064 | 11,308 | +12% | 1 | 1 | 0% | 1,689 | 12,127 | +618% | 0 | 0 | — |
case-10 | fail→pass | 16,853 | 11,745 | -30% | 1 | 1 | 0% | 2,836 | 12,483 | +340% | 0 | 0 | — |
case-11 | pass→pass | 7,734 | 9,402 | +22% | 1 | 1 | 0% | 1,273 | 12,022 | +844% | 0 | 0 | — |
case-12 | pass→pass | 11,755 | 7,425 | -37% | 1 | 1 | 0% | 1,908 | 11,886 | +523% | 0 | 0 | — |
case-13 | fail→pass | 11,733 | 7,373 | -37% | 1 | 1 | 0% | 1,899 | 11,592 | +510% | 0 | 0 | — |
case-14 | fail→pass | 7,402 | 4,313 | -42% | 1 | 1 | 0% | 1,174 | 11,149 | +850% | 0 | 0 | — |
case-15 | pass→pass | 8,890 | 6,781 | -24% | 1 | 1 | 0% | 1,450 | 11,639 | +703% | 0 | 0 | — |
case-16 | pass→pass | 11,047 | 5,244 | -53% | 1 | 1 | 0% | 1,813 | 11,354 | +526% | 0 | 0 | — |
case-17 | pass→pass | 12,550 | 10,043 | -20% | 1 | 1 | 0% | 2,132 | 12,295 | +477% | 0 | 0 | — |
case-18 | fail→pass | 11,411 | 10,421 | -9% | 1 | 1 | 0% | 1,727 | 12,052 | +598% | 0 | 0 | — |
case-19 | pass→pass | 19,971 | 15,380 | -23% | 1 | 1 | 0% | 3,300 | 13,504 | +309% | 0 | 0 | — |
case-20 | pass→pass | 4,501 | 3,564 | -21% | 1 | 1 | 0% | 700 | 11,111 | +1487% | 0 | 0 | — |
case-21 | fail→pass | 12,806 | 5,543 | -57% | 1 | 1 | 0% | 1,778 | 11,368 | +539% | 0 | 0 | — |
case-22 | pass→pass | 8,963 | 10,809 | +21% | 1 | 1 | 0% | 1,202 | 12,416 | +933% | 0 | 0 | — |
case-23 | pass→pass | 7,243 | 3,432 | -53% | 1 | 1 | 0% | 1,044 | 10,947 | +949% | 0 | 0 | — |
case-24 | pass→pass | 9,993 | 8,672 | -13% | 1 | 1 | 0% | 1,656 | 11,929 | +620% | 0 | 0 | — |
DecimalAI ran this skill against gemini-3.6-flash twice over the same eval suite — once with the skill loaded and once without — and compared the two runs case by case. 24 cases were attempted, and 22 counted toward the lift figure. The other 2 produced results that are not comparable between the two arms, so they are excluded from the headline rather than averaged into it. The headline lift of +42 percentage points is the difference between those two pass rates over the 22 comparable cases.
Without the skill loaded, the model failed this case. With it loaded, the same prompt on the same model passed. This is one improved case from the latest verified run; every case, including any that regressed, is in the table above.
Other measured skills in the registry, with their headline benchmark lift.