Loading skill
Install any skill in seconds. Free to start, no credit card required.
Get Started Free →hashintel/testing-hashql
HashQL testing strategies including compiletest (UI tests), unit tests, and snapshot tests.
Passed 20 of 23 test cases with the skill, and 6 of 23 without it.
and 21 more in the full report
14 fixed6 passed either way3 still failing0 broke
Tokens, turns and time describe resource use, not a dollar price.
One of 14 test cases the skill fixed. Same model, same prompt, with and without the skill.
In HashQL compiletest files, what directive prefix at the start of a file provides human-readable documentation explaining the purpose of the test case?
| Checked | Without skill | With skill |
|---|---|---|
| Uses //@ description: directive prefix | Missed | Passed |
The instructions your model reads when the skill loads.
HashQL uses three testing approaches. compiletest is the default for testing compiler behavior.
| Scenario | Test Type | Location |
|---|---|---|
| Diagnostics/error messages | compiletest | tests/ui/ |
| Compiler pipeline phases | compiletest | tests/ui/ |
| MIR/HIR/AST pass integration | compiletest | tests/ui/ |
| MIR/HIR/AST pass edge cases | insta | tests/ui/<category>/ |
| MIR pass unit tests | MIR builder | src/**/tests.rs |
| Core crate (where needed) | insta | src/**/snapshots/ |
| Parser fragments (syntax-jexpr) | insta | src/*/snapshots/ |
| Internal functions/logic | Unit tests | src/*.rs |
Test parsing, type checking, and error reporting using J-Expr files with diagnostic annotations.
Structure:
package/tests/ui/
category/
.spec.toml # Suite specification (required)
test.jsonc # Test input
test.stdout # Expected output (run: pass)
test.stderr # Expected errors (run: fail)
test.aux.svg # Auxiliary output (some suites)
Commands:
cargo run -p hashql-compiletest run # Run all
cargo run -p hashql-compiletest run --filter "test(name)" # Filter
cargo run -p hashql-compiletest run --bless # Update expected
test cases passed, vs 6 / 23 without
More skills from the same source and nearby in the registry, with their headline benchmark lift.