Install any skill in seconds. Free to start, no credit card required.
Get Started Free →bartsoj/OPERATIONS.md
Consolidate the system's operations contract — deployment topology per environment, CI/CD pipelines with promotion and rollback, environment strategy, config catalogue with stable `CFG_NAME` IDs, secrets inventory with rotation policies, integration catalogue with failure behaviour, runbooks for every alert, disaster recovery with concrete RTO/RPO, observability infrastructure, change management, and an initial-setup runbook.
Passed 16 of 22 test cases with the skill, and 6 of 22 without it.
and 11 more in the full report
10 fixed6 passed either way6 still failing0 broke
Tokens, turns and time describe resource use, not a dollar price.
One of 10 test cases the skill fixed. Same model, same prompt, with and without the skill.
We are documenting response procedures for on-call alerts like ALERT-database-disk-full and ALERT-redis-latency-spike. Should we format the runbook section IDs using PROC-01 and PROC-02 or keep them as plain headings?
| Checked | Without skill | With skill |
|---|---|---|
| Prefixes each alert response runbook entry identifier with RUNBOOK- in uppercase. | Missed | Passed |
The instructions your model reads when the skill loads.
Produce an OPERATIONS.md that serves as the single source of truth for how the system runs, ships, is configured, integrates, and is recovered: per-environment deployment topology (compute, region, network, data plane, per-component placement, scaling behaviour), CI/CD pipelines with stages, gates, artifacts, promotion, and rollback, environment strategy (config differences, data strategy, access control), a config catalogue under stable CFG_NAME IDs with owner and scope per entry, a secrets inventory with storage, rotation policy, read/rotate principals, and audit trail, an integration catalogue with auth, SLA, failure behaviour, and privacy notes for every external dependency, a runbook entry for every alert named in QUALITY, a disaster-recovery plan with concrete RTO/RPO numbers and a step-by-step restore procedure, observability infrastructure (where logs, metrics, traces land — what is emitted lives in QUALITY), change management, and an initial-setup runbook executable as-is by a new operator. An agent reading this document alone can — for any environment, alert, config var, secret, or external integration — name the compute shape, the config delta, the rotation schedule, the failure mode, or the on-call response, without opening ARCHITECTURE, INTERFACES, DATA, QUALITY, or SECURITY.
OPERATIONS.md consolidates what older guidance split into DEPLOYMENT.md, RUNBOOK.md, CONFIG_CATALOG.md, and INTEGRATION_CATALOG.md, because every reader doing ops work reads them together: the on-call engineer opens a runbook, needs the config var to flip, sees which integration is degraded, and checks the rollback path — all in one page. The defining discipline — and the commonest violation — is every alert in QUALITY § 6 has a § 7 runbook entry here, every config var has a stable CFG_NAME, every external integration has a named failure behaviour, every production secret has a rotation policy. Orphan alerts page humans with no script; orphan config vars rename without deprecation and break production; orphan integrations fail silently at 3am; secrets that never rotate are the easiest persistent-access path an attacker has.
ADR-NN on runtime choice (Kubernetes vs Cloud Run vs bare metal, single-region vs multi-region, push vs pull deployment) is cited verbatim here.ALERT-* there has a matching runbook entry in § 7 here. § 9 Observability Infrastructure references storage locations whose concrete choices live here.CFG_NAME, RUNBOOK-*, and integration entry is permanent. New entries take new unused IDs. Retired entries retain their row with (retired — superseded by {new-id}).Read set size: 4 required artifacts + SECURITY and BEHAVIOR when present + optional prior OPERATIONS. Read all required inputs end-to-end. Truncated reads cause three specific failure modes: runbooks missing for alerts QUALITY catalogs (QUALITY § 6 not fully read — produces blind paging), integration catalogue missing services INTERFACES § 1 names (INTERFACES not fully read — produces "why did this fail at 3am" surprises), and backup strategy missing datastores DATA lists (DATA not fully read — produces data-loss blind spots).
Operations-contract construction proceeds in six phases: deployment and CI/CD, config and secrets, integrations, runbooks, disaster recovery and observability, change management and setup. Phases are sequential — later phases cite IDs introduced by earlier phases — but revisit earlier phases if a later one reveals a missing environment, an un-routed alert, or an un-rotated secret.
Produce §§ 1–3 together — they share the environment axis.
§ 1 Deployment Topology has one block per environment (typically dev / staging / prod; additional environments like sandbox, preview, dr get their own block when they exist). Each block fills the Output Format template: purpose and scope (who accesses, what traffic), compute (cloud provider, service type — Kubernetes / Cloud Run / Lambda / EC2 / bare metal — instance sizes), region strategy (single-region / multi-region / active-passive), network (VPCs, subnets, firewalls, ingress, egress policies), data plane (managed DBs, object storage, queues, caches — every row citing DATA), per-component mapping (which ARCHITECTURE § 2 component runs in which compute resource), scaling behaviour (horizontal / vertical, auto-scaling triggers). Every component from ARCHITECTURE § 2 appears in at least one environment's per-component mapping, or surfaces in § 13 as a missing-placement open question. A Mermaid diagram or an external link per environment illustrates the layout.
§ 2 CI/CD Pipelines has one block per pipeline. Each block fills repo and branch, stages (lint → test → build → deploy) with the tool family per stage (not specific product versions — those are /implement concerns), gates (required checks, approvals, review counts), artifacts (Docker image tag format, release version scheme — v{major}.{minor}.{patch} plus commit SHA), promotion model (staging → prod: auto with guardrails / manual with two-approver / canary with percentage ramp), rollback mechanism (image tag pinning / feature-flag flip / blue-green switch / DB-migration reverse script). Every environment in § 1 is reachable by exactly one pipeline path (or has an explicit "bootstrap-only, no CI deploy" annotation).
§ 3 Environment Strategy has three fixed subsections. Config difference matrix: a table of what varies per environment, citing CFG_NAME entries from § 4 (domains, rate limits, feature flags, retention windows). Data strategy per environment: dev = synthetic, staging = production clone (scrubbed — cite § 5 and SECURITY § 10 for scrubbing rules), prod = production. Access control per environment: who can deploy to what, who can read production logs, who can execute § 7 runbook commands — cites SECURITY § 8 roles where available.
test cases passed, vs 6 / 22 without
More skills from the same source and nearby in the registry, with their headline benchmark lift.