Loading skill
Install any skill in seconds. Free to start, no credit card required.
Get Started Free →typescript-eval
Test TypeScript code snippets before persisting as skills
Passed 10 of 21 test cases with the skill, and 2 of 21 without it.
8 fixed2 passed either way12 still failing0 broke
Tokens, turns and time describe resource use, not a dollar price.
The instructions your model reads when the skill loads.
When you need to test a TypeScript snippet before persisting it as a managed skill, use bash directly.
bash command="mkdir -p /tmp/vellum-eval && cat > /tmp/vellum-eval/snippet.ts << 'SNIPPET_EOF'
<your code here>
SNIPPET_EOF"
bash command="bun run /tmp/vellum-eval/snippet.ts" timeout_seconds=10
If the snippet exports a default or run function, write a runner script:
bash command="cat > /tmp/vellum-eval/runner.ts << 'RUNNER_EOF'
import * as mod from './snippet.ts';
const fn = (mod as any).default ?? (mod as any).run;
const input = {}; // mock input
const result = await fn(input);
console.log(JSON.stringify(result, null, 2));
RUNNER_EOF"
Then run the runner:
bash command="bun run /tmp/vellum-eval/runner.ts" timeout_seconds=10
test cases passed, vs 2 / 21 without
More skills from the same source and nearby in the registry, with their headline benchmark lift.