Loading skill
Install any skill in seconds. Free to start, no credit card required.
Get Started Free →Juicebox incident response. Trigger: "juicebox incident", "juicebox outage".
.claude/skills/jeremylongshore-juicebox-incident-runbook/SKILL.md| Test case | Without → With | Effect | Δ tokens | Δ turns |
|---|---|---|---|---|
| case-01 | ✗→✓ | ▲ Improved | -5% | 0% |
| case-02 | ✗→✓ | ▲ Improved | 15% | 0% |
| case-04 | ✗→✓ | ▲ Improved | 20% | 0% |
| case-05 | ✗→✓ | ▲ Improved | 5% | 0% |
| case-06 | ✗→✓ | ▲ Improved | -1% | 0% |
Incident response procedures for Juicebox AI analysis platform integration failures. Covers analysis timeouts, dataset corruption, quota exhaustion, and export failures. Juicebox powers AI-driven people search and candidate analysis, so incidents disrupt recruiting pipelines, talent intelligence workflows, and automated sourcing. Classify severity immediately using the matrix below and follow the corresponding playbook.
| Level | Definition | Response Time | Example | |-------|-----------|---------------|---------| | P1 - Critical | Full API outage or dataset corruption | 15 min | Health endpoint returns 5xx, analysis results missing | | P2 - High | Analysis timeouts or export failures | 30 min | Search queries hang beyond 30s, CSV exports fail | | P3 - Medium | Quota exhaustion or rate limiting | 2 hours | 429 responses, account quota at 100% usage | | P4 - Low | Partial data or degraded result quality | 8 hours | Search returns fewer results than expected |
bash# Check API health curl -s -o /dev/null -w "HTTP %{http_code}\n" \ -H "Authorization: Bearer $JUICEBOX_API_KEY" \ https://api.juicebox.ai/v1/health # Check account quota usage curl -s -H "Authorization: Bearer $JUICEBOX_API_KEY" \ https://api.juicebox.ai/v1/account/quota | jq '.used, .limit, .remaining' # Test a minimal search request curl -s -w "\nHTTP %{http_code}\n" \ -H "Authorization: Bearer $JUICEBOX_API_KEY" \ -H "Content-Type: application/json" \ -X POST https://api.juicebox.ai/v1/search \ -d '{"query": "software engineer", "limit": 1}'
echo $JUICEBOX_API_KEY | wc -cmarkdown**Incident**: Juicebox Integration [Outage/Degradation] **Status**: [Investigating/Identified/Mitigating/Resolved] **Started**: YYYY-MM-DD HH:MM UTC **Impact**: [Search unavailable / exports failing / quota exhausted / N recruiting workflows paused] **Current action**: [Cached results active / quota upgrade requested / re-analysis running] **Next update**: HH:MM UTC
| Incident Type | Detection | Resolution | |--------------|-----------|------------| | Analysis timeout | Requests exceeding 30s SLA | Reduce query complexity, retry with smaller scope | | Dataset corruption | Missing or inconsistent analysis results | Re-trigger analysis job, verify input parameters | | Quota exhaustion | 429 responses, quota endpoint shows 0 remaining | Pause automation, request quota increase, optimize usage | | Export failure | CSV/JSON export returns error or empty payload | Verify analysis job completed, retry export with job ID |
See juicebox-observability for monitoring setup and quota tracking dashboards.
| Case | Status | Duration (ms) | Turns | Tokens | Tool calls | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Without | With | Δ | Without | With | Δ | Without | With | Δ | Without | With | Δ | ||
case-01 | fail→pass | 20,101 | 12,350 | -39% | 1 | 1 | 0% | 2,633 | 2,499 | -5% | 0 | 0 | — |
case-02 | fail→pass | 15,399 | 14,541 | -6% | 1 | 1 | 0% | 2,617 | 3,008 | +15% | 0 | 0 | — |
case-03 | pass→pass | 18,796 | 13,589 | -28% | 1 | 1 | 0% | 2,075 | 2,689 | +30% | 0 | 0 | — |
case-04 | fail→pass | 15,249 | 18,788 | +23% | 1 | 1 | 0% | 1,728 | 2,073 | +20% | 0 | 0 | — |
case-05 | fail→pass | 17,271 | 6,996 | -59% | 1 | 1 | 0% | 1,940 | 2,042 | +5% | 0 | 0 | — |
case-06 | fail→pass | 17,900 | 5,273 | -71% | 1 | 1 | 0% | 2,021 | 1,992 | -1% | 0 | 0 | — |
case-07 | fail→pass | 10,173 | 2,708 | -73% | 1 | 1 | 0% | 849 | 1,506 | +77% | 0 | 0 | — |
case-08 | fail→pass | 15,766 | 6,044 | -62% | 1 | 1 | 0% | 2,012 | 2,257 | +12% | 0 | 0 | — |
case-09 | pass→pass | 11,644 | 8,644 | -26% | 1 | 1 | 0% | 1,194 | 1,574 | +32% | 0 | 0 | — |
case-10 | fail→pass | 13,358 | 11,473 | -14% | 1 | 1 | 0% | 2,150 | 2,270 | +6% | 0 | 0 | — |
case-11 | fail→pass | 22,626 | 10,923 | -52% | 1 | 1 | 0% | 2,872 | 2,143 | -25% | 0 | 0 | — |
case-12 | fail→pass | 17,650 | 9,253 | -48% | 1 | 1 | 0% | 2,218 | 1,831 | -17% | 0 | 0 | — |
case-13 | fail→pass | 10,011 | 7,682 | -23% | 1 | 1 | 0% | 1,328 | 1,508 | +14% | 0 | 0 | — |
case-14 | pass→pass | 19,323 | 3,836 | -80% | 1 | 1 | 0% | 2,371 | 1,688 | -29% | 0 | 0 | — |
case-15 | fail→pass | 17,946 | 9,244 | -48% | 1 | 1 | 0% | 2,014 | 1,331 | -34% | 0 | 0 | — |
case-16 | fail→fail | 16,961 | 16,812 | -1% | 1 | 1 | 0% | 2,610 | 3,049 | +17% | 0 | 0 | — |
case-17 | fail→pass | 21,416 | 7,423 | -65% | 1 | 1 | 0% | 2,104 | 1,389 | -34% | 0 | 0 | — |
case-18 | fail→pass | 6,571 | 2,417 | -63% | 1 | 1 | 0% | 948 | 1,477 | +56% | 0 | 0 | — |
case-19 | pass→pass | 19,098 | 9,322 | -51% | 1 | 1 | 0% | 1,935 | 1,723 | -11% | 0 | 0 | — |
case-20 | pass→pass | 18,429 | 7,684 | -58% | 1 | 1 | 0% | 2,110 | 2,393 | +13% | 0 | 0 | — |
case-21 | fail→pass | 15,218 | 2,737 | -82% | 1 | 1 | 0% | 1,568 | 1,528 | -3% | 0 | 0 | — |
case-22 | fail→fail | 29,530 | 21,514 | -27% | 1 | 1 | 0% | 4,071 | 4,407 | +8% | 0 | 0 | — |
case-23 | fail→fail | 21,439 | 24,633 | +15% | 1 | 1 | 0% | 3,416 | 4,224 | +24% | 0 | 0 | — |
case-24 | fail→fail | 19,433 | 15,542 | -20% | 1 | 1 | 0% | 2,653 | 3,850 | +45% | 0 | 0 | — |
DecimalAI ran this skill against gemini-3.6-flash twice over the same eval suite — once with the skill loaded and once without — and compared the two runs case by case. 24 cases were attempted. The headline lift of +63 percentage points is the difference between those two pass rates over the 24 comparable cases.
Without the skill loaded, the model failed this case. With it loaded, the same prompt on the same model passed. This is one improved case from the latest verified run; every case, including any that regressed, is in the table above.
Other measured skills in the registry, with their headline benchmark lift.