Install any skill in seconds. Free to start, no credit card required.
Get Started Free →lingxling/semgrep-rule-creator
Creates custom Semgrep rules for detecting security vulnerabilities, bug patterns, and code patterns.
Passed 12 of 18 test cases with the skill, and 7 of 18 without it.
and 7 more in the full report
7 fixed8 passed either way7 still failing0 broke
Tokens, turns and time describe resource use, not a dollar price.
One of 6 test cases the skill fixed. Same model, same prompt, with and without the skill.
We created a rule directory py-eval-injection/ containing py-eval-injection.yaml and py-eval-injection.py. What exact Semgrep CLI flag and command syntax is used to execute test validation on this rule?
| Checked | Without skill | With skill |
|---|---|---|
| Includes semgrep --test flag in the execution command. | Missed | Passed |
| Specifies the rule YAML file path in the test command. | Passed | Passed |
The instructions your model reads when the skill loads.
Create production-quality Semgrep rules with proper testing and validation.
Ideal scenarios:
Do NOT use this skill for:
static-analysis skill)When writing Semgrep rules, reject these common shortcuts:
semgrep --test --config <rule-id>.yaml <rule-id>.<ext> to verify. Untested rules have hidden false positives/negatives.Too broad - matches everything, useless for detection:
# BAD: Matches any function call
pattern: $FUNC(...)
# GOOD: Specific dangerous function
pattern: eval(...)
Missing safe cases in tests - leads to undetected false positives:
test cases passed, vs 7 / 18 without
Published skills whose descriptions closely match this one, with their headline benchmark lift.
More skills from the same source and nearby in the registry, with their headline benchmark lift.