Closed Beta Program Playbook

Closed Beta Program Playbook

Overview

A structured playbook for running a closed beta that produces clear learning, retained design partners, and an unambiguous decision on whether to proceed to general availability. Most betas fail not because the product is wrong, but because the program is run informally: recruitment is opportunistic, success criteria are implicit, communication is sporadic, and exit gates are never defined. This skill replaces all of that with concrete templates and decision rules.

A good closed beta runs 4-8 weeks, recruits 10-30 participants from three concentric cohorts ("friends, family, fanatics"), publishes a weekly cadence the team commits to, and exits on pre-agreed criteria rather than the calendar. The outputs are a beta program plan, a recruitment script, a weekly cadence template, and an exit memo that either greenlights GA, extends the beta, or kills the feature.

Core Capabilities

• Cohort design — sequence recruitment through Friends → Family → Fanatics rings of decreasing trust and increasing signal.
• Kano scoping — decide the beta feature set (Must-be / Performance / Delight) so the beta produces quotable testimonials, not neutral feedback.
• Exit gates — quantitative + qualitative success criteria set before recruitment, resolving to Greenlight / Extend / Pivot / Kill.
• Weekly cadence — a committed Monday→Friday communication rhythm that keeps a beta from dying of silence.

When to Use

• Pre-GA validation -- A feature has cleared internal alpha but needs external validation under real workloads before a public launch.
• High-risk feature -- Significant blast radius, regulatory exposure, or pricing changes that warrant a controlled rollout to a small group first.
• Design partner program -- Recruiting a small set of customers whose feedback shapes v1 scope and pricing.
• Enterprise rollout -- New module that needs reference customers and case studies before broad sales enablement.

When NOT to Use

• Continuous trunk-based delivery where every change ships to all users behind feature flags (use launch-playbook/ and a progressive rollout instead).
• Pure usability testing with 5-7 participants (use a research protocol, not a beta program).
• Internal-only dogfooding (run a 2-week alpha with engineering and customer-facing staff).

Clarify First

Before building the beta plan, confirm these inputs. If any is unknown or vague, ASK — do not assume:

• Beta hypothesis & headline outcome — what you are trying to learn and the one result that matters (drives the whole plan and which exit gates you set)
• Exit gates — the quantitative + qualitative success criteria, agreed before recruiting (resolve to Greenlight / Extend / Pivot / Kill — the decision rule of the program)
• Target cohort & size — Friends / Family / Fanatics mix and participant count (drives the recruitment script and how you weight feedback)
• Duration — the 4-8 week window (drives the weekly cadence and when the exit memo is due)

Stop rule: ask only the 2-3 that most change the output. If the user says "just draft it," proceed and list your assumptions at the top of the artifact.

Quick Start