Install any skill in seconds. Free to start, no credit card required.
Get Started Free →sickn33/semgrep-rule-creator
Creates custom Semgrep rules for detecting security vulnerabilities, bug patterns, and code patterns.
Passed 19 of 23 test cases with the skill, and 5 of 23 without it.
and 18 more in the full report
14 fixed5 passed either way4 still failing0 broke
Tokens, turns and time describe resource use, not a dollar price.
One of 14 test cases the skill fixed. Same model, same prompt, with and without the skill.
We need a rule to catch calls to eval() in PHP. Please create the YAML definition and test file. Make sure to format test assertions using ruleid and ok comment annotations.
| Checked | Without skill | With skill |
|---|---|---|
| Places both the YAML rule file and PHP test file inside a single directory named after the rule ID. | Missed | Passed |
| Includes safe test cases annotated with ok comments in the test file. | Passed | Passed |
The instructions your model reads when the skill loads.
Create production-quality Semgrep rules with proper testing and validation.
Ideal scenarios:
Do NOT use this skill for:
static-analysis skill)When writing Semgrep rules, reject these common shortcuts:
semgrep --test --config <rule-id>.yaml <rule-id>.<ext> to verify. Untested rules have hidden false positives/negatives.Too broad - matches everything, useless for detection:
# BAD: Matches any function call
pattern: $FUNC(...)
# GOOD: Specific dangerous function
pattern: eval(...) # security-allowlist: Semgrep sink pattern
Missing safe cases in tests - leads to undetected false positives:
test cases passed, vs 5 / 23 without
Published skills whose descriptions closely match this one, with their headline benchmark lift.
More skills from the same source and nearby in the registry, with their headline benchmark lift.