Ready to supercharge your AI agents?

Install any skill in seconds. Free to start, no credit card required.

Consistency Audit Loop · yogsoth-ai | DecimalAI

ai mlby yogsoth-ai

Consistency Audit Loop

yogsoth-ai/consistency-audit-loop

Source yogsoth-ai/de-anthropocentric-research-engine ↗License Apache-2.0

Detect preference cycles, localize inconsistent judgments, request corrections, and recompute ratings until consistency threshold is met.

SkillScore86Maintained

Automatic

AI Engineer pack

Last verified 8/22/2026

What it changes

Passed 18 of 21 test cases with the skill, and 8 of 21 without it.

Without skill36%

With skill86%

Checks it passed that the model alone missed

Selects cycle-detection as the procedure.
Selects comparison-executor as the procedure.
Passes the target pair as an input parameter.

and 11 more in the full report

11 fixed8 passed either way3 still failing0 broke

Pass-rate lift: +50 pp
Tokens: -11%
Agent turns: 0%
Response time: -36%

Model gemini-3.6-flashMeasured 8/22/2026v119 of 22 cases passed with skill · 21 comparable

Tokens, turns and time describe resource use, not a dollar price.

Use this skill

Save it into your project's skills folder. Claude Code picks it up in its next session.

curl -fsSL --create-dirs -o .claude/skills/yogsoth-ai-consistency-audit-loop/SKILL.md https://app.decimal.ai/s/yogsoth-ai-consistency-audit-loop/SKILL.md

Want it pinned and updatable? pip install "decimalai>=0.15", then decimalai skills add yogsoth-ai-consistency-audit-loop, and start Claude Code with claude --plugin-dir "$(git rev-parse --show-toplevel)/.agents"

1 · One-time — install the CLI (docs ↗)

pip install "decimalai>=0.15"

2 · Get the skill — writes .agents/skills/yogsoth-ai-consistency-audit-loop/ and pins it in .decimal/skills.lock

decimalai skills add yogsoth-ai-consistency-audit-loop

No CLI? Get the same file — curl · raw file

curl -fsSL --create-dirs -o .claude/skills/yogsoth-ai-consistency-audit-loop/SKILL.md https://app.decimal.ai/s/yogsoth-ai-consistency-audit-loop/SKILL.md

Raw file: /s/yogsoth-ai-consistency-audit-loop/SKILL.md ↗ · machine-readable summary at /s/yogsoth-ai-consistency-audit-loop.json ↗

Safety checks: 3 of 3 passed

Code scan CleanIntent PassedContent Clean

See it in action

One of 10 test cases the skill fixed. Same model, same prompt, with and without the skill.

1 of 10

Prompt

When performing an iterative matrix audit, after the execution tool returns fresh judgments for problematic pairs in iteration 1, what step must be performed before initiating cycle detection for iteration 2?

What was checked, without and with the skill
Checked	Without skill	With skill
Recomputes the full ratings before starting the next detection pass.	Missed	Passed

case-06 · gemini-3.6-flash · 8/22/2026 · answers are capped and redacted

What's inside

The instructions your model reads when the skill loads.

SKILL.md51 linessingle file

Consistency Audit Loop

Audit a comparison matrix for transitivity violations, pinpoint the most problematic judgments, request re-evaluation of those pairs, and recompute until the consistency threshold is satisfied.

Stages

Detect — cycle-detection scans the comparison matrix for cycles and computes transitivity score
Localize — inconsistency-localization identifies which pairs participate in the most cycles
Repair — comparison-executor re-evaluates the problematic pairs with explicit context about the inconsistency

Loop stages 1-3 until consistency threshold met or repair budget exhausted.

Available SOPs

Stage	SOP	Input	Output
Detect	cycle-detection	comparison_matrix	cycles[], transitivity_score
Localize	inconsistency-localization	comparison_matrix, cycles[]	problematic_pairs[]
Repair	comparison-executor	pair, context	judgment

Execution Guidance

Run detection first — if no cycles and CR < 0.1, exit immediately (no repair needed)
Localization should rank pairs by cycle participation count
When re-comparing, provide the judge with context: "A>B and B>C but you said C>A — please reconsider"
Limit repairs to top 20% most problematic pairs per iteration
After repair, recompute full ratings before next detection pass
Maximum 3 audit iterations to prevent infinite loops
Document all changes in repair log for transparency

Minimum Yield

Consistency report + correction recommendations
Consistency report: CR value, transitivity score, cycle count
List of all cycles found (before and after repair)
Repair log: which pairs were re-evaluated, old vs new judgment
Final consistency status: pass/fail with metrics

Track record

Benchmark

18 / 21

test cases passed, vs 8 / 21 without

Adoption

Users: 0
Times used: 0

Safety and source details

SkillSafety

✓ 3 of 3 passed

Code scan15 of 15 checks clean

0 critical · 0 warning · 0 info — scanner v4 — 8/3/2026

View 15 scanner checks

live_secretremote_code_executionreverse_shelldata_exfiltrationssrf_metadataagent_snoopinganti_refusaldestructive_commandsobfuscated_unicodeunicode_homoglyphopaque_blobsuspicious_urltool_overreachtrigger_abuseprompt_injection_phrasing

IntentSafe

LLM judge · does the skill do what it claims

ContentClean

LLM judge · policy & harmful-content review

Source

Imported

yogsoth-ai / de-anthropocentric-research-engine

skills/consistency-audit-loop/SKILL.md

View on GitHub ↗

License Apache-2.0Imported 8/3/2026Version v1

Other skills for the same job

Published skills whose descriptions closely match this one, with their headline benchmark lift.

yogsoth-ai/coherence-diagnosisStrategy for auditing preference consistency using Consistency Ratio, cycle enumeration, and mElo to detect and resolve intransitivities.Close match+27 pp pass-rate lift

More skills from the same source and nearby in the registry, with their headline benchmark lift.

Ready to supercharge your AI agents?

See it in action

What's inside

Consistency Audit Loop

Stages

Available SOPs

Execution Guidance

Minimum Yield

Track record

Benchmark

Adoption

SkillSafety

Source

Other skills for the same job

Related skills