Install any skill in seconds. Free to start, no credit card required.
Get Started Free →Secure CAST AI API keys, RBAC configuration, and Kvisor security agent. Use when hardening CAST AI cluster access, configuring security scanning, or implementing API key rotation procedures. Trigger with phrases like "cast ai security", "cast ai api key rotation", "cast ai rbac", "cast ai kvisor", "secure cast ai".
.claude/skills/jeremylongshore-castai-security-basics/SKILL.md| Test case | Without → With | Effect | Δ tokens | Δ turns |
|---|---|---|---|---|
| case-01 | ✗→✓ | ▲ Improved | 19% | 0% |
| case-03 | ✗→✓ | ▲ Improved | -19% | 0% |
| case-04 | ✗→✓ | ▲ Improved | 51% | 0% |
| case-05 | ✗→✓ | ▲ Improved | 128% | 0% |
| case-07 | ✗→✓ | ▲ Improved | -19% | 0% |
Review permissions against the components actually enabled. Distinguish observation, optimization, operator lifecycle, Kvisor telemetry, optional cluster proxy, and cloud-provider access instead of labeling the entire installation read-only or full-access.
Use Read and Grep to map read-only, Workload Autoscaler, Node Autoscaler, full, Kvisor options, reliability metrics, GPU or storage telemetry, operator management, and cluster proxy. Flag enabled components that lack a named business owner.
Separate human castctl login from service API keys. Verify organization role bindings, region, enterprise child targeting, storage, rotation, and revocation. Reject keys in values, URLs, Terraform output, logs, or support artifacts.
Use Bash(helm:_) to render the pinned installation and Bash(kubectl:_) for bounded RBAC inspection. Compare each service account to current documented permissions. Account for agent deployment patching, operator lifecycle permissions, Kvisor cluster reads, optional scan jobs, and feature-gated token or pod-resize permissions.
Map each AWS, GCP, Azure, or other permission to monitoring, onboarding, automation, discovery, commitments, or storage telemetry. Do not reuse an automation role for read-only monitoring when the provider supports narrower access.
Document regional egress, private connectivity, webhook destinations, telemetry classes, retention, and support-transfer controls. Do not invent a static IP allowlist or a broad 0.0.0.0/0 policy under the label of least privilege.
Use Write or Edit to mark every finding KEEP, NARROW, REMOVE, or INVESTIGATE with owner, evidence, risk, and rollback. Treat Kvisor security documentation as evolving and verify current product scope before enabling a feature.
Use Read and Grep for configuration and permission mapping. Use Write and Edit for the review record. Use Bash(helm:_) and Bash(kubectl:_) only for rendered and effective RBAC inspection; never retrieve Secret data or mutate access.
A read-only deployment retains agent snapshot reads but rejects node-provisioning cloud actions. Kvisor storage telemetry is held until its provider permissions and data audience are explicitly approved.
| Failure | Response | | ------------------------------------------ | ------------------------------------------------------------------ | | Feature mode is unknown | Inspect the release before judging permissions | | Permission has no documented feature owner | Mark it INVESTIGATE, not safe | | A key is exposed | Revoke, rotate, and remove the exposure | | Current Kvisor behavior is ambiguous | Hold the feature and verify current documentation/support guidance |
| Case | Status | Duration (ms) | Turns | Tokens | Tool calls | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Without | With | Δ | Without | With | Δ | Without | With | Δ | Without | With | Δ | ||
case-02 | fail→fail | 18,745 | 10,301 | -45% | 1 | 1 | 0% | 3,437 | 2,953 | -14% | 0 | 0 | — |
case-21 | fail→fail | 17,734 | 14,038 | -21% | 1 | 1 | 0% | 3,278 | 3,959 | +21% | 0 | 0 | — |
case-01 | fail→pass | 8,174 | 4,592 | -44% | 1 | 1 | 0% | 1,616 | 1,920 | +19% | 0 | 0 | — |
case-03 | fail→pass | 15,953 | 6,136 | -62% | 1 | 1 | 0% | 2,638 | 2,130 | -19% | 0 | 0 | — |
case-04 | fail→pass | 6,034 | 3,411 | -43% | 1 | 1 | 0% | 1,043 | 1,575 | +51% | 0 | 0 | — |
case-05 | fail→pass | 28,372 | 7,936 | -72% | 1 | 1 | 0% | 1,091 | 2,488 | +128% | 0 | 0 | — |
case-06 | pass→pass | 6,409 | 4,456 | -30% | 1 | 1 | 0% | 1,025 | 1,866 | +82% | 0 | 0 | — |
case-07 | fail→pass | 12,013 | 3,863 | -68% | 1 | 1 | 0% | 2,186 | 1,774 | -19% | 0 | 0 | — |
case-08 | fail→pass | 26,882 | 24,412 | -9% | 1 | 1 | 0% | 2,761 | 1,567 | -43% | 0 | 0 | — |
case-09 | pass→pass | 15,402 | 8,762 | -43% | 1 | 1 | 0% | 2,564 | 2,644 | +3% | 0 | 0 | — |
case-10 | fail→pass | 15,932 | 12,358 | -22% | 1 | 1 | 0% | 3,265 | 3,418 | +5% | 0 | 0 | — |
case-11 | fail→pass | 11,620 | 4,589 | -61% | 1 | 1 | 0% | 1,768 | 1,870 | +6% | 0 | 0 | — |
case-12 | pass→pass | 9,965 | 6,636 | -33% | 1 | 1 | 0% | 1,786 | 2,065 | +16% | 0 | 0 | — |
case-13 | pass→pass | 12,185 | 9,556 | -22% | 1 | 1 | 0% | 2,191 | 2,695 | +23% | 0 | 0 | — |
case-14 | pass→pass | 6,219 | 5,012 | -19% | 1 | 1 | 0% | 838 | 1,758 | +110% | 0 | 0 | — |
case-15 | pass→pass | 9,962 | 3,898 | -61% | 1 | 1 | 0% | 1,461 | 1,693 | +16% | 0 | 0 | — |
case-16 | fail→pass | 7,497 | 2,975 | -60% | 1 | 1 | 0% | 793 | 1,419 | +79% | 0 | 0 | — |
case-17 | pass→pass | 5,347 | 2,616 | -51% | 1 | 1 | 0% | 1,009 | 1,389 | +38% | 0 | 0 | — |
case-18 | fail→pass | 5,134 | 1,707 | -67% | 1 | 1 | 0% | 827 | 1,273 | +54% | 0 | 0 | — |
case-19 | fail→pass | 11,381 | 1,759 | -85% | 1 | 1 | 0% | 1,980 | 1,290 | -35% | 0 | 0 | — |
case-20 | fail→fail | 16,119 | 14,588 | -9% | 1 | 1 | 0% | 2,688 | 3,481 | +30% | 0 | 0 | — |
case-22 | fail→fail | 13,047 | 10,961 | -16% | 1 | 1 | 0% | 2,276 | 2,980 | +31% | 0 | 0 | — |
DecimalAI ran this skill against gemini-3.6-flash twice over the same eval suite — once with the skill loaded and once without — and compared the two runs case by case. 22 cases were attempted, and 21 counted toward the lift figure. The other 1 produced results that are not comparable between the two arms, so they are excluded from the headline rather than averaged into it. The headline lift of +50 percentage points is the difference between those two pass rates over the 21 comparable cases.
The publisher has shipped newer versions since this run, so these numbers describe v1, not the version currently listed.
Without the skill loaded, the model failed this case. With it loaded, the same prompt on the same model passed. This is one improved case from the latest verified run; every case, including any that regressed, is in the table above.
Other measured skills in the registry, with their headline benchmark lift.