Ready to supercharge your AI agents?

Install any skill in seconds. Free to start, no credit card required.

CAST AI Production Checklist — measured AI agent skill | DecimalAI

jeremylongshore/castai-prod-checklist

NewSkillScoreMaintained

Production readiness checklist for CAST AI cluster onboarding. Use when going live with CAST AI autoscaling, validating Phase 2 setup, or preparing for production cost optimization. Trigger with phrases like "cast ai production", "cast ai go-live", "cast ai checklist", "cast ai launch".

DevOpsby jeremylongshore

Links this skill to your agents and keeps it current with the author’s updates.

Automatic

DevOps & SRE pack

decimalai skills pull jeremylongshore-castai-prod-checklist

Get this skill — curl · raw file

curl -fsSL https://app.decimal.ai/s/jeremylongshore-castai-prod-checklist/SKILL.md

Raw file: /s/jeremylongshore-castai-prod-checklist/SKILL.md ↗ · machine-readable summary at /s/jeremylongshore-castai-prod-checklist.json ↗

In productionGlobal

how this skill behaves on real traffic · last 30 days

No production data for this skill yet — usage numbers appear here once agents start running it.

Anonymized aggregate across every org using this skill — proof from real production use, not a demo.

Does this skill help? · Benchmark: with vs. withoutsign in to run this on your agents

22 test cases from the publisher’s eval.yaml · each run twice on gemini-3.6-flash — with the skill injected, then without · last run 2h ago

—+7% tokens0% turns95% of whole cases pass with skill (21/22)

Test case	Without → With	Effect	Δ tokens	Δ turns
case-01	✗→✓	▲ Improved	43%	0%
case-02	✗→✓	▲ Improved	-1%	0%
case-08	✗→✓	▲ Improved	0%	0%
case-10	✗→✓	▲ Improved	25%	0%
case-11	✗→✓	▲ Improved	-36%	0%

Showing 5 of 22 cases

SkillSafety

✓ 3 of 3 passed

Code scan15 of 15 checks clean

0 critical · 0 warning · 0 info — scanner v4 — 8/3/2026

live_secretremote_code_executionreverse_shelldata_exfiltrationssrf_metadataagent_snoopinganti_refusaldestructive_commandsobfuscated_unicodeunicode_homoglyphopaque_blobsuspicious_urltool_overreachtrigger_abuseprompt_injection_phrasing

IntentSafe

LLM judge · does the skill do what it claims

ContentClean

LLM judge · policy & harmful-content review

Source

Imported

jeremylongshore / claude-code-plugins-plus-skills

skills/.curated/castai-prod-checklist/SKILL.md

View on GitHub ↗

License MITImported 8/3/2026Version v1

Skill contents

SKILL.md

CAST AI Production Checklist

Overview

Complete checklist for enabling CAST AI cost optimization on a production Kubernetes cluster. Covers Phase 1 (monitoring) through Phase 2 (full automation) with validation steps at each stage.

Prerequisites

CAST AI tested on a staging cluster first
Production API key (Full Access)
Change management approval for node lifecycle changes

Phase 1: Monitoring Only

] Agent installed with read-only key
] Agent pod healthy: kubectl get pods -n castai-agent
] Console shows cluster as "Connected"
] Savings report generating (wait 24h for full data)
] Review savings estimate before enabling automation

Phase 2: Autoscaling Enabled

] Full Access API key provisioned and stored in secrets manager
] Cluster controller installed
] Evictor installed with conservative settings (non-aggressive)
] Spot handler installed for graceful interruption handling
] Autoscaler policies configured with appropriate limits:
] clusterLimits.cpu.maxCores set to safe ceiling
] unschedulablePods.headroom configured (10-15%)
] nodeDownscaler.emptyNodes.delaySeconds >= 300 for production
] spotInstances.spotDiversityEnabled = true
] Node templates created for workload-specific needs (GPU, high-memory)
] PodDisruptionBudgets set on all critical workloads

Workload Autoscaler

] Workload autoscaler installed
] Critical deployments annotated with min/max resource bounds
] Anti-shrink cooldown set (300s minimum)
] Memory headroom >= 20% for production workloads

Security

] API key in secrets manager (not Helm values files)
] Kvisor security agent installed
] Network policies applied to castai-agent namespace
] RBAC reviewed and minimized
] Key rotation scheduled (90-day interval)

Monitoring and Alerting

] Alert on agent pod restarts: kube_pod_container_status_restarts_total{namespace="castai-agent"}
] Alert on API errors in agent logs
] CAST AI console email notifications enabled
] Savings report reviewed weekly
] Dashboard tracking spot vs on-demand node ratio

Rollback Procedure

bash
# Disable autoscaling immediately (keeps agent monitoring)
curl -X PUT -H "X-API-Key: ${CASTAI_API_KEY}" \
  -H "Content-Type: application/json" \
  "https://api.cast.ai/v1/kubernetes/clusters/${CASTAI_CLUSTER_ID}/policies" \
  -d '{"enabled": false}'

# Or remove all CAST AI components
helm uninstall castai-evictor -n castai-agent
helm uninstall cluster-controller -n castai-agent
# Keep the agent for monitoring if desired

Validation Commands

bash
# Final pre-go-live verification
echo "=== CAST AI Production Validation ==="

# Agent healthy
kubectl get pods -n castai-agent -o wide

# All components running
helm list -n castai-agent

# Policies correct
curl -s -H "X-API-Key: ${CASTAI_API_KEY}" \
  "https://api.cast.ai/v1/kubernetes/clusters/${CASTAI_CLUSTER_ID}/policies" \
  | jq '{enabled, unschedulablePods: .unschedulablePods.enabled, downscaler: .nodeDownscaler.enabled, spot: .spotInstances.enabled}'

# Savings estimate
curl -s -H "X-API-Key: ${CASTAI_API_KEY}" \
  "https://api.cast.ai/v1/kubernetes/clusters/${CASTAI_CLUSTER_ID}/savings" \
  | jq '{monthly: .monthlySavings, percent: .savingsPercentage}'

Resources

Next Steps

For version upgrades, see castai-upgrade-migration.

Want to see if jeremylongshore/castai-prod-checklist would activate on your phrasing? Try it before you install — no LLM call, no signup.

Other measured skills in the registry, with their headline benchmark lift.