Ready to supercharge your AI agents?

Install any skill in seconds. Free to start, no credit card required.

Pytest Test Generator · dicklesworthstone | DecimalAI

dicklesworthstone/pytest-test-generator

NewSkillScoreMaintained

Generate pytest test generator operations. Auto-activating skill for Test Automation. Triggers on: pytest test generator, pytest test generator Part of the Test Automation skill category. Use when writing or running tests. Trigger with phrases like "pytest test generator", "pytest generator", "pytest".

Testingby dicklesworthstone

Links this skill to your agents and keeps it current with the author’s updates.

Automatic

QA & Test Engineering pack

1 · One-time — install the CLI (docs ↗)

pip install decimalai

2 · Get the skill — writes .claude/skills/dicklesworthstone-pytest-test-generator/SKILL.md

decimalai skills pull dicklesworthstone-pytest-test-generator --out .claude/skills/

No CLI? Get the same file — curl · raw file

curl -fsSL --create-dirs -o .claude/skills/dicklesworthstone-pytest-test-generator/SKILL.md https://app.decimal.ai/s/dicklesworthstone-pytest-test-generator/SKILL.md

Raw file: /s/dicklesworthstone-pytest-test-generator/SKILL.md ↗ · machine-readable summary at /s/dicklesworthstone-pytest-test-generator.json ↗

In productionGlobal

how this skill behaves on real traffic · last 30 days

No production data for this skill yet — usage numbers appear here once agents start running it.

Anonymized aggregate across every org using this skill — proof from real production use, not a demo.

Does this skill help? · Benchmark: with vs. withoutsign in to run this on your agents

22 test cases from the publisher’s eval.yaml · each run twice on gemini-3.6-flash — with the skill injected, then without · last run 23d ago

No — -100% lift+40% tokens0% turns95% of whole cases pass with skill (21/22)

Test case	Without → With	Effect	Δ tokens	Δ turns
case-22	✓→✗	▼ Worse	49%	0%
case-01	✓→✓	＝ Same ✓	69%	0%
case-02	✓→✓	＝ Same ✓	7%	0%
case-03	✓→✓	＝ Same ✓	5%	0%
case-04	✓→✓	＝ Same ✓	62%	0%

Showing 5 of 22 cases

SkillSafety

✓ 3 of 3 passed

Code scan15 of 15 checks clean

0 critical · 0 warning · 0 info — scanner v4 — 8/10/2026

live_secretremote_code_executionreverse_shelldata_exfiltrationssrf_metadataagent_snoopinganti_refusaldestructive_commandsobfuscated_unicodeunicode_homoglyphopaque_blobsuspicious_urltool_overreachtrigger_abuseprompt_injection_phrasing

IntentSafe

LLM judge · does the skill do what it claims

ContentClean

LLM judge · policy & harmful-content review

Source

Imported

dicklesworthstone / pi_agent_rust

tests/ext_conformance/artifacts/plugins-community/skills/09-test-automation/pytest-test-generator/SKILL.md

View on GitHub ↗

License MITImported 8/10/2026Version v1

Skill contents

SKILL.md

Pytest Test Generator

Overview

This skill provides automated assistance for pytest test generator tasks within the Test Automation domain.

When to Use

This skill activates automatically when you:

Mention "pytest test generator" in your request
Ask about pytest test generator patterns or best practices
Need help with test automation skills covering unit testing, integration testing, mocking, and test framework configuration.

Instructions

Provides step-by-step guidance for pytest test generator
Follows industry best practices and patterns
Generates production-ready code and configurations
Validates outputs against common standards

Examples

Example: Basic Usage Request: "Help me with pytest test generator" Result: Provides step-by-step guidance and generates appropriate configurations

Prerequisites

Relevant development environment configured
Access to necessary tools and services
Basic understanding of test automation concepts

Output

Generated configurations and code
Best practice recommendations
Validation results

Error Handling

| Error | Cause | Solution | |-------|-------|----------| | Configuration invalid | Missing required fields | Check documentation for required parameters | | Tool not found | Dependency not installed | Install required tools per prerequisites | | Permission denied | Insufficient access | Verify credentials and permissions |

Resources

Official documentation for related tools
Best practices guides
Community examples and tutorials

Related Skills

Part of the Test Automation skill category. Tags: testing, jest, pytest, mocking, tdd

Illustrative Want to see what dicklesworthstone/pytest-test-generator would put in front of your model? Preview the rendered body and check its trigger phrases — no LLM call, no signup.

Latest benchmark · publisher runVerified

8/30/2026, 07:29 UTC · 22 cases

Lift

-100%

0% vs 100%

Agent turns

1.0 vs 1.0

Tokens

+40%

1,674.23 vs 1,195.77

pass → pass · 21pass → fail · 1

Per-case results (22)

Case	Status	Duration (ms)			Turns			Tokens			Tool calls
Case	Status	Without	With	Δ	Without	With	Δ	Without	With	Δ	Without	With	Δ
case-01 I need to test an integer validation function `validate_age(age: int)` that accepts ages between 0 and 120 inclusive. Rather than writing five individual test functions for valid boundaries and invalid numbers, construct a single compact pytest test function that checks multiple inputs and expected boolean outcomes.	pass→pass	9,740	11,435	+17%	1	1	0%	948	1,606	+69%	0	0	—
case-02 We are setting up test automation for a SQLAlchemy database service. Creating a database connection engine per test function is slowing down our test execution significantly. Write a pytest fixture for the database engine that initializes once per test run session.	pass→pass	16,325	15,472	-5%	1	1	0%	2,082	2,219	+7%	0	0	—
case-03 Write a pytest test case verifying that `parse_config('invalid.json')` raises a `ValueError` containing the error text substring 'Invalid JSON syntax'. Avoid using traditional try-except blocks.	pass→pass	10,581	8,605	-19%	1	1	0%	917	962	+5%	0	0	—
case-04 Write a pytest test for `fetch_user_data(user_id)` which calls `requests.get`. Use built-in pytest utilities to replace `requests.get` with a dummy function returning a mock response without installing third-party mock packages.	pass→pass	12,056	14,152	+17%	1	1	0%	1,445	2,345	+62%	0	0	—
case-05 Write a pytest unit test that writes binary data to a file named 'output.bin' and verifies its file size. Use pytest standard fixtures to ensure temporary files are isolated and automatically cleaned up post-execution.	pass→pass	10,433	13,045	+25%	1	1	0%	1,138	1,934	+70%	0	0	—
case-06 Write a pytest test function to verify that calling `print_status_report()` prints 'STATUS: OK' to standard output. Use built-in pytest fixtures to capture stdout.	pass→pass	9,710	10,053	+4%	1	1	0%	888	1,275	+44%	0	0	—
case-07 We are testing an asynchronous coroutine `async def fetch_metrics()`. Write a pytest test function using standard async pytest extensions without manually creating or closing event loops inside the test body.	pass→pass	11,363	11,667	+3%	1	1	0%	1,173	1,646	+40%	0	0	—
case-08 We want to tag slow-running integration tests in our test suite using `@pytest.mark.slow`. When running pytest, warnings appear stating that the mark is unknown. Provide the configuration section for `pyproject.toml` that registers this marker.	pass→pass	7,916	8,365	+6%	1	1	0%	504	954	+89%	0	0	—
case-09 Write a pytest fixture that sets the environment variable `APP_ENV` to `'testing'` before every test in the module and resets it afterward, without requiring developers to explicitly declare the fixture parameter in every test function signature.	pass→pass	12,887	13,868	+8%	1	1	0%	1,502	2,141	+43%	0	0	—
case-10 Write a pytest fixture `managed_resource()` that creates a temporary database connection object, yields it to the test function, and ensures `.close()` is called on the object after test completion.	pass→pass	12,202	12,885	+6%	1	1	0%	1,297	1,878	+45%	0	0	—
case-11 Write a pytest test function verifying that calling `deprecated_calculator(2, 3)` triggers a `DeprecationWarning`. Use pytest's built-in warning recorder or assertion tools.	pass→pass	8,964	9,195	+3%	1	1	0%	666	1,064	+60%	0	0	—
case-12 Write a pytest fixture `make_user` that allows test functions to construct multiple distinct `User` model instances with customizable names and roles within a single test execution.	pass→pass	13,792	15,997	+16%	1	1	0%	1,705	2,482	+46%	0	0	—
case-13 Write a pytest assertion verifying that a calculation result `compute_tax(100.0)` produces `15.0000001`, comparing it against an expected value of `15.0` while accommodating minor floating point inaccuracies.	pass→pass	4,142	10,361	+150%	1	1	0%	791	1,360	+72%	0	0	—
case-14 Write a pytest test function that mocks the `save` method on an instance of `UserService` using `unittest.mock.patch.object` to verify it is called once during execution.	pass→pass	10,536	6,222	-41%	1	1	0%	1,128	1,638	+45%	0	0	—
case-15 Where should shared pytest fixtures be defined so that all test files across multiple subdirectories in a test suite can access them automatically without requiring explicit module imports?	pass→pass	6,289	11,192	+78%	1	1	0%	1,327	1,495	+13%	0	0	—
case-16 We have a known bug in `calculate_discount()` that fails for negative inputs. Mark a pytest test function so that pytest expects it to fail and reports it as an expected failure rather than a test suite regression.	pass→pass	9,466	6,803	-28%	1	1	0%	809	1,593	+97%	0	0	—
case-17 Write a pytest test function that executes only when running on Linux platforms and is skipped on Windows or macOS systems.	pass→pass	5,178	5,463	+6%	1	1	0%	931	1,307	+40%	0	0	—
case-18 Write a pytest test where fixture parameters are passed indirectly through `@pytest.mark.parametrize` so that a fixture receives different configuration values during test execution.	pass→pass	14,819	14,601	-1%	1	1	0%	2,027	2,276	+12%	0	0	—
case-19 Write a pytest test function that checks binary output written directly to `sys.stdout.buffer` using pytest standard output capture capabilities.	pass→pass	11,305	11,550	+2%	1	1	0%	1,261	1,590	+26%	0	0	—
case-20 Write a React component test using Jest and React Testing Library to verify that clicking a button with text 'Submit' calls an `onClick` callback function.	pass→pass	12,860	6,199	-52%	1	1	0%	1,480	1,586	+7%	0	0	—
case-21 Write a standard Python `unittest.TestCase` subclass named `TestDatabaseService` containing a `setUpClass` class method that initializes a shared database pool.	pass→pass	5,439	6,605	+21%	1	1	0%	1,109	1,726	+56%	0	0	—
case-22 Create a TypeScript Page Object Model class named `LoginPage` for Playwright test automation that encapsulates filling the username field `#username` and submitting the form button `#login-btn`.	pass→fail	10,493	11,647	+11%	1	1	0%	1,179	1,756	+49%	0	0	—

These cases were also screened by the skill’s intent / safety pass.See the Trust review ↗Reproduce this benchmark in Colab ↗

How this skill was measured

DecimalAI ran this skill against gemini-3.6-flash twice over the same eval suite — once with the skill loaded and once without — and compared the two runs case by case. 22 cases were attempted. The headline lift of -100 percentage points is the difference between those two pass rates over the 22 comparable cases. 1 case got worse with the skill loaded, and it is included in that figure.

Model measured: gemini-3.6-flash
Graded by: gemini-3.6-flash
Grading method: judged
Verification: verified
Pass rate without the skill: 100%
Pass rate with the skill: 0%
Cases attempted: 22
Cases counted toward lift: 22
Cases that regressed: 1
Skill version measured: v1
Run completed: 8/30/2026, 07:29 UTC

SkillScore blends 4 signalsno signals yet

BenchmarkRun a verified benchmark with positive lift

Live evalNeeds ≥10 evaluated traces in 30 days

AI ratingNeeds ≥10 rated traces

AdoptionNeeds ≥10 serves across ≥2 orgs in 30 days

Efficiency · separate axis (at equal correctness)+0% turns+40% tokens

Shown for transparency; not credited unless a verified run shows no correctness regression.

No signals yet — run a benchmark or collect evaluated traces to earn a score.

Verified on gemini-3.6-flash · re-tested 22 days ago

Other measured skills in the registry, with their headline benchmark lift.