Ready to supercharge your AI agents?

Install any skill in seconds. Free to start, no credit card required.

Check and Test · reflexioai | DecimalAI

testingby reflexioai

Check and Test

reflexioai/check-and-test

Source reflexioai/claude-smart ↗License Apache-2.0

Run lint checks (ruff for Python, Biome for TS/JS), type checks (pyright for Python, tsc for TS/JS), and the standard pytest tiers (unit + e2e + tests skipped during pre-commit). Investigates failures to determine if they are application bugs or test issues, and fixes application bugs rather than weakening tests. Does not run paid-LLM real-API tests or scenario probes from the test-* command family.

SkillScore68Maintained

Automatic

QA & Test Engineering pack

Last verified 8/14/2026

What it changes

Passed 14 of 20 test cases with the skill, and 12 of 20 without it.

Without skill60%

With skill68%

Checks it passed that the model alone missed

specifies pytest reflexio/tests/ -n 0 -v
uses the --ignore=reflexio/tests/e2e_tests/ flag in pytest
specifies using -n 0 to disable parallel execution in pytest

and 3 more in the full report

5 fixed12 passed either way5 still failing3 broke

Pass-rate lift: +8 pp
Tokens: +78%
Agent turns: 0%
Response time: -61%

Model gemini-3.6-flashMeasured 8/14/2026v117 of 25 cases passed with skill · 20 comparable

Tokens, turns and time describe resource use, not a dollar price.

Use this skill

Save it into your project's skills folder. Claude Code picks it up in its next session.

curl -fsSL --create-dirs -o .claude/skills/reflexioai-check-and-test/SKILL.md https://app.decimal.ai/s/reflexioai-check-and-test/SKILL.md

Want it pinned and updatable? pip install "decimalai>=0.15", then decimalai skills add reflexioai-check-and-test, and start Claude Code with claude --plugin-dir "$(git rev-parse --show-toplevel)/.agents"

1 · One-time — install the CLI (docs ↗)

pip install "decimalai>=0.15"

2 · Get the skill — writes .agents/skills/reflexioai-check-and-test/ and pins it in .decimal/skills.lock

decimalai skills add reflexioai-check-and-test

No CLI? Get the same file — curl · raw file

curl -fsSL --create-dirs -o .claude/skills/reflexioai-check-and-test/SKILL.md https://app.decimal.ai/s/reflexioai-check-and-test/SKILL.md

Raw file: /s/reflexioai-check-and-test/SKILL.md ↗ · machine-readable summary at /s/reflexioai-check-and-test.json ↗

Safety checks: 3 of 3 passed

Code scan CleanIntent PassedContent Clean

See it in action

One of 5 test cases the skill fixed. Same model, same prompt, with and without the skill.

1 of 5

Prompt

After unit tests and E2E tests pass individually, what is the exact command to run the full test suite in `reflexio/tests/` sequentially?

What was checked, without and with the skill
Checked	Without skill	With skill
specifies pytest reflexio/tests/ -n 0 -v	Missed	Passed

case-19 · gemini-3.6-flash · 8/14/2026 · answers are capped and redacted

What's inside

The instructions your model reads when the skill loads.

SKILL.md223 linessingle file

Check and Test

Run the standard check-and-test flow (lint + type-check + pytest tiers), including tests normally skipped during pre-commit hooks.

Overview

This command runs the standard check-and-test tiers:

Python lint checks via ruff (code quality, security, complexity)
Python type checks via pyright (type safety)
TypeScript/JavaScript lint checks via Biome (code quality, formatting, import sorting)
TypeScript/JavaScript type checks via tsc (type safety)
Unit tests in reflexio/tests/ (excluding e2e and tests under reflexio/tests/server/llm/)
E2E tests in reflexio/tests/e2e_tests/ (skip all the low priority test by NOT setting RUN_LOW_PRIORITY env variable)
Tests skipped during pre-commit (those decorated with @skip_in_precommit)

The key difference from pre-commit is that PRECOMMIT env var is NOT set, so all tests run.

Prerequisites

Before running tests, activate the virtual environment:

source .venv/bin/activate

Test Execution

IMPORTANT: Run all tests sequentially using -n 0 to avoid test conflicts. The default pytest config uses parallel execution (-n auto), but this can cause race conditions and shared state issues between tests.

Step 0: Run Lint and Type Checks

Run lint and type checks across the full codebase before running tests.

0a. Ruff auto-fix:

ruff check --fix reflexio/
ruff format reflexio/

0b. Ruff remaining errors:

Track record

Benchmark

14 / 20

test cases passed, vs 12 / 20 without

Adoption

Users: 0
Times used: 0

Safety and source details

SkillSafety

✓ 3 of 3 passed

Code scan15 of 15 checks clean

0 critical · 0 warning · 0 info — scanner v4 — 8/3/2026

View 15 scanner checks

live_secretremote_code_executionreverse_shelldata_exfiltrationssrf_metadataagent_snoopinganti_refusaldestructive_commandsobfuscated_unicodeunicode_homoglyphopaque_blobsuspicious_urltool_overreachtrigger_abuseprompt_injection_phrasing

IntentSafe

LLM judge · does the skill do what it claims

ContentClean

LLM judge · policy & harmful-content review

Source

Imported

reflexioai / claude-smart

.claude/commands/check-and-test/SKILL.md

View on GitHub ↗

License Apache-2.0Imported 8/3/2026Version v1

More skills from the same source and nearby in the registry, with their headline benchmark lift.

Ready to supercharge your AI agents?

See it in action

What's inside

Check and Test

Overview

Prerequisites

Test Execution

Step 0: Run Lint and Type Checks

Track record

Benchmark

Adoption

SkillSafety

Source

Related skills