Install any skill in seconds. Free to start, no credit card required.
Get Started Free →tldraw/shepherd-pr
Keep an eye on this PR. Review and resolve pull request comments and fix build failures autonomously.
Passed 11 of 17 test cases with the skill, and 8 of 17 without it.
and 2 more in the full report
5 fixed9 passed either way7 still failing1 broke
Tokens, turns and time describe resource use, not a dollar price.
This benchmark measured an earlier version of the skill.
A newer attempt on gemini-3.6-flash on 10/2/2026 did not produce a publishable comparison (not comparable). The snapshot above is the previously measured run.
One of 5 test cases the skill fixed. Same model, same prompt, with and without the skill.
The CI pipeline reports E2E snapshot failures after intentionally modifying button component styling on the pull request. Rather than updating files manually, what automated trigger should be added to the pull request?
| Checked | Without skill | With skill |
|---|---|---|
| Adds the update-snapshots label to the pull request via gh pr edit | Missed | Passed |
The instructions your model reads when the skill loads.
Autonomously review PR comments and build status, resolving what can be done with high confidence (>=80%) and flagging the rest for human review.
Note: this repository requires that you be using node 24. Use nvm to switch to node 24 before running any commands:
nvm use 24
# Get PR number for current branch
gh pr view --json number,headRefName,url
# Get review threads with resolution status
gh api graphql -f query='
query($owner: String!, $repo: String!, $number: Int!) {
repository(owner: $owner, name: $repo) {
pullRequest(number: $number) {
reviewThreads(first: 100) {
nodes {
id
isResolved
comments(first: 50) {
nodes {
body
path
line
author { login }
createdAt
databaseId
}
}
}
}
}
test cases passed, vs 8 / 17 without
Published skills whose descriptions closely match this one, with their headline benchmark lift.
More skills from the same source and nearby in the registry, with their headline benchmark lift.