Install any skill in seconds. Free to start, no credit card required.
Get Started Free →vellum-github-app-setup
Create and configure a GitHub App so the assistant can push commits, open PRs, and comment under its own bot identity.
Passed 16 of 20 test cases with the skill, and 5 of 20 without it.
and 16 more in the full report
13 fixed5 passed either way4 still failing0 broke
Tokens, turns and time describe resource use, not a dollar price.
One of 12 test cases the skill fixed. Same model, same prompt, with and without the skill.
The gh-app-token.mjs script is failing to generate an installation token. Which three specific vault credential fields under service github-app are required for token generation?
| Checked | Without skill | With skill |
|---|---|---|
| Specifies app_id, pem_b64, and installation_id as the three required vault fields | Missed | Passed |
The instructions your model reads when the skill loads.
This skill creates a GitHub App under a GitHub organization, giving the assistant its own bot identity for git operations. After setup, commits, PRs, and comments will attribute to <app-name>[bot] instead of the user's personal account.
Total manual effort: 7 interactions — Continue to GitHub → Create App → 3 secure credential prompts → Install on repo → (optional) upload avatar. Everything else is automated.
Note: This skill currently supports GitHub organizations only, not personal accounts.
contents:write, pull_requests:write, checks:read, metadata:read)bin/gh-app-token.mjs (in the workspace root) for refreshing auth tokensassistant credentials CLI must be availablebun in the container (for the token helper script)Run the manifest flow script on the user's host machine (it needs to open a browser and catch a localhost callback):
python3 scripts/create-github-app.py \
--org=ORG_NAME \
--name=APP_NAME \
--url="https://example.com" \
--output=/tmp/github-app-credentials.json
This starts a local server on localhost:29170, opens the browser, and guides the user through two clicks:
test cases passed, vs 5 / 20 without
More skills from the same source and nearby in the registry, with their headline benchmark lift.