Install any skill in seconds. Free to start, no credit card required.
Get Started Free →Create and control a disposable named Herdr session from inside an existing Herdr session. Use for isolated Herdr runtime, pane, terminal, process, API, persistence, or agent reproductions that should be driven through the CLI/API without touching the default session.
.claude/skills/herdrdev-herdr-throwaway-repro/SKILL.md| Test case | Without → With | Effect | Δ tokens | Δ turns |
|---|---|---|---|---|
| case-07 | ✗→✓ | ▲ Improved | 73% | 0% |
| case-08 | ✗→✓ | ▲ Improved | 64% | 0% |
| case-09 | ✗→✓ | ▲ Improved | 12% | 0% |
| case-10 | ✗→✓ | ▲ Improved | 84% | 0% |
| case-14 | ✗→✓ | ▲ Improved | 47% | 0% |
Use a disposable named Herdr session when a reproduction needs a real Herdr server, panes, PTYs, agents, or socket API without risking the user's main session.
The temporary TUI only keeps the disposable session attached and supplies terminal geometry. Drive the reproduction from the parent session through Herdr's CLI/API. Do not manually operate the nested TUI unless the bug specifically requires client input.
pkill, broad process matching, or guessed PIDs for cleanup./var/tmp for reproduction directories and potentially large artifacts.The installed binary is the authority. CLI syntax may have changed since this skill was written.
Confirm the caller is inside Herdr and inspect the relevant help before doing anything:
bashtest "${HERDR_ENV:-}" = 1 herdr --version herdr --help herdr session herdr pane herdr agent
Inspect nested command help before using unfamiliar or potentially mutating commands. Do not run bare herdr for discovery because it launches or attaches the TUI.
Record which Herdr binary and version the reproduction tests. If testing a checkout build, follow the repository's instructions for running that build instead of silently substituting the installed binary.
Create a sibling shell pane in the current tab without moving focus. Use an available Herdr layout tool when the harness provides one. Otherwise use the installed pane split command after checking its help.
Use /var/tmp or a dedicated reproduction directory as the new pane's cwd. Save the returned outer pane ID. This is the only parent-session pane that cleanup may close.
Choose a short unique name such as repro-<topic>-<timestamp>.
Before launching, explicitly allow nesting in the configuration the disposable client will actually load. HERDR_ENV=1 is inherited from the outer pane, so the launch is otherwise rejected unless [experimental].allow_nested is enabled. An isolated XDG_CONFIG_HOME does not inherit this setting from the user's global config, even when nesting is enabled there.
Create a test-only config under the reproduction directory using the file-writing tool. For a default-config reproduction, its contents can be:
toml[experimental] allow_nested = true
If reproducing with the user's configuration, copy that configuration into the test directory and enable allow_nested in its existing [experimental] table (or add the table if absent). Do not create duplicate tables or keys. Never edit the user's global configuration to permit a reproduction, and do not unset HERDR_ENV to bypass the nesting check.
Pass the absolute test config path as HERDR_CONFIG_PATH when launching below. Use the same override for config validation and any commands that must load the test config. This override selects a config file; it does not isolate the saved machine catalog or other global state. Use test-only XDG_CONFIG_HOME and XDG_STATE_HOME as well when the reproduction changes saved machines, and retain those overrides on every command addressing that test environment.
Run the named session inside the new outer pane. Clear inherited session selection, socket overrides, and caller IDs so the nested runtime cannot accidentally address the parent session:
bashenv \ -u HERDR_SOCKET_PATH \ -u HERDR_CLIENT_SOCKET_PATH \ -u HERDR_SESSION \ -u HERDR_WORKSPACE_ID \ -u HERDR_TAB_ID \ -u HERDR_PANE_ID \ HERDR_CONFIG_PATH=<absolute-test-config-path> \ herdr --session <session-name>
Add reproduction-specific environment variables to this launch command when needed. Environment variables that configure the server must be present before the named server starts.
Validate the test config with herdr config check using the same config override before launch. After launch, read the outer pane to catch startup errors such as nested herdr is disabled by default; do not assume the launch succeeded merely because pane run returned successfully.
Do not continue until the named session's API is ready. Confirm readiness by addressing that session from the parent and listing its panes.
Every control command issued from the parent must clear inherited socket overrides and explicitly select the temporary session:
bashenv \ -u HERDR_SOCKET_PATH \ -u HERDR_CLIENT_SOCKET_PATH \ -u HERDR_WORKSPACE_ID \ -u HERDR_TAB_ID \ -u HERDR_PANE_ID \ HERDR_SESSION=<session-name> \ herdr pane list
Repeat this prefix for every command. Do not rely on shell state persisting between tool calls.
Read the disposable root pane ID from pane list. Confirm its cwd and foreground process before starting anything in it.
Named sessions isolate runtime state, sockets, panes, and persistence. They still share global Herdr configuration and agent manifest overrides by default. Check configuration provenance when it could affect the reproduction. Do not modify shared configuration merely to make the test pass.
Use pane commands for shells and ordinary processes:
pane run to start a command at an available shell prompt.pane wait-output to wait for deterministic output.pane read to capture terminal contents.pane send-text for literal input.pane send-keys for supported keys.pane get, pane process-info, and pane layout for runtime state.Use agent commands only after Herdr recognizes a coding agent:
agent start to launch a supported agent in an existing shell pane.agent prompt to submit one prompt atomically.agent wait to wait for working, blocked, idle, done, or unknown.agent read to capture the agent terminal.agent get and agent explain to inspect state and detection.agent send-keys for interactive responses.Run the relevant command group's help first because names and options may change.
Prefer waits over arbitrary sleeps. When timing itself is under test, record timestamps and use bounded polling. Capture state before, during, and after the transition being reproduced.
When a needed terminal key is unsupported by the high-level command, send its terminal sequence through the disposable pane only after confirming the target application's expected key. Never send raw control sequences to the parent pane.
Before launching an agent, inspect its installed --version and --help. Pass native agent arguments after Herdr's argument separator.
Use the exact model requested or approved by the user. Verify the model from the live agent screen instead of trusting an alias. Prefer low effort, safe mode, and manual permissions for a baseline when the agent supports them. Repeat with the user's real configuration only when the suspected behavior depends on hooks, plugins, or settings.
Use harmless operations for permission-state testing. Reject the pending action after evidence is captured and verify that no artifact was created.
Record enough information for another person to repeat the result:
pane read, agent read, agent explain, API output, and session logs.Read the named session directory and socket from herdr session list instead of assuming their paths. Keep large evidence under /var/tmp unless the user asks to preserve it elsewhere.
Distinguish observed facts from proposed causes. First reproduce stock behavior, then change one variable at a time.
Cleanup is part of the reproduction, including after failure.
Never delete another named session because it looks stale. Never close the pane running the current agent or any pane not created for the reproduction.
State what reproduced, what did not, and the exact transition that failed. Include cleanup status. Mention shared configuration or manifest overrides that may have influenced the result.
| Case | Status | Duration (ms) | Turns | Tokens | Tool calls | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Without | With | Δ | Without | With | Δ | Without | With | Δ | Without | With | Δ | ||
case-06 | pass→fail | 10,764 | 34,796 | +223% | 1 | 1 | 0% | 1,871 | 2,387 | +28% | 0 | 0 | — |
case-01 | fail→fail | 10,940 | 13,169 | +20% | 1 | 1 | 0% | 263 | 2,344 | +791% | 0 | 0 | — |
case-02 | fail→fail | 16,140 | 18,735 | +16% | 1 | 1 | 0% | 231 | 2,320 | +904% | 0 | 0 | — |
case-03 | fail→fail | 30,484 | 15,006 | -51% | 1 | 1 | 0% | 3,186 | 2,652 | -17% | 0 | 0 | — |
case-04 | pass→fail | 13,064 | 21,144 | +62% | 1 | 1 | 0% | 1,310 | 2,733 | +109% | 0 | 0 | — |
case-05 | fail→fail | 19,623 | 19,081 | -3% | 1 | 1 | 0% | 2,021 | 2,431 | +20% | 0 | 0 | — |
case-07 | fail→pass | 19,147 | 10,787 | -44% | 1 | 1 | 0% | 1,939 | 3,347 | +73% | 0 | 0 | — |
case-08 | fail→pass | 17,352 | 11,897 | -31% | 1 | 1 | 0% | 1,881 | 3,079 | +64% | 0 | 0 | — |
case-09 | fail→pass | 22,686 | 21,098 | -7% | 1 | 1 | 0% | 2,686 | 3,018 | +12% | 0 | 0 | — |
case-10 | fail→pass | 10,546 | 10,949 | +4% | 1 | 1 | 0% | 1,600 | 2,941 | +84% | 0 | 0 | — |
case-11 | pass→pass | 18,730 | 9,759 | -48% | 1 | 1 | 0% | 2,091 | 2,563 | +23% | 0 | 0 | — |
case-12 | pass→fail | 13,555 | 12,965 | -4% | 1 | 1 | 0% | 1,317 | 2,346 | +78% | 0 | 0 | — |
case-13 | fail→fail | 17,567 | 10,660 | -39% | 1 | 1 | 0% | 2,155 | 2,907 | +35% | 0 | 0 | — |
case-14 | fail→pass | 15,296 | 25,225 | +65% | 1 | 1 | 0% | 2,365 | 3,473 | +47% | 0 | 0 | — |
case-15 | fail→pass | 19,218 | 12,446 | -35% | 1 | 1 | 0% | 2,075 | 3,226 | +55% | 0 | 0 | — |
case-16 | pass→pass | 10,643 | 10,465 | -2% | 1 | 1 | 0% | 1,659 | 2,827 | +70% | 0 | 0 | — |
case-17 | pass→pass | 20,994 | 11,807 | -44% | 1 | 1 | 0% | 2,332 | 3,107 | +33% | 0 | 0 | — |
case-18 | fail→pass | 20,054 | 12,644 | -37% | 1 | 1 | 0% | 2,138 | 2,757 | +29% | 0 | 0 | — |
case-19 | pass→pass | 17,446 | 9,592 | -45% | 1 | 1 | 0% | 1,296 | 2,635 | +103% | 0 | 0 | — |
case-20 | fail→fail | 13,190 | 7,148 | -46% | 1 | 1 | 0% | 1,871 | 2,537 | +36% | 0 | 0 | — |
case-21 | pass→pass | 22,212 | 5,434 | -76% | 1 | 1 | 0% | 2,591 | 2,896 | +12% | 0 | 0 | — |
case-22 | fail→pass | 16,857 | 15,229 | -10% | 1 | 1 | 0% | 2,392 | 3,108 | +30% | 0 | 0 | — |
DecimalAI ran this skill against gemini-3.6-flash twice over the same eval suite — once with the skill loaded and once without — and compared the two runs case by case. 22 cases were attempted, and 15 counted toward the lift figure. The other 7 produced results that are not comparable between the two arms, so they are excluded from the headline rather than averaged into it. The headline lift of +23 percentage points is the difference between those two pass rates over the 15 comparable cases. 5 cases got worse with the skill loaded, and they are included in that figure.
Without the skill loaded, the model failed this case. With it loaded, the same prompt on the same model passed. This is one improved case from the latest verified run; every case, including any that regressed, is in the table above.
| Model | Method | Date | Lift |
|---|---|---|---|
| gemini-3.6-flash | verified | 8/10/2026 | +36% |
Other measured skills in the registry, with their headline benchmark lift.