Ready to supercharge your AI agents?

Install any skill in seconds. Free to start, no credit card required.

LLM Council · rohitg00 | DecimalAI

agent toolingby rohitg00

LLM Council

rohitg00/llm-council

Source rohitg00/pro-workflow ↗License Not recorded

Provider-agnostic multi-LLM deliberation. Three phases — independent responses, cross-model anonymized ranking, chairman synthesis. Provider config from env (OPENAI/ANTHROPIC/FIREWORKS/OPENROUTER/custom OpenAI-compatible base URL). Persists transcript to a wiki page when --wiki <slug> is passed.

SkillScore77Maintained

Automatic

AI Engineer pack

Last verified 8/13/2026

What it changes

Passed 15 of 19 test cases with the skill, and 7 of 19 without it.

Without skill36%

With skill77%

Checks it passed that the model alone missed

Includes --wiki monorepo-strategy in the execution command
Specifies LLM_COUNCIL_BASE_URL for setting the endpoint URL
References phase1_responses.json as the raw response artifact

and 9 more in the full report

10 fixed7 passed either way4 still failing1 broke

Pass-rate lift: +41 pp
Tokens: +9%
Agent turns: 0%
Response time: -41%

Model gemini-3.6-flashMeasured 8/13/2026v1 · latest is v217 of 22 cases passed with skill · 19 comparable

Tokens, turns and time describe resource use, not a dollar price.

This benchmark measured an earlier version of the skill.

A newer attempt on gemini-3.6-flash on 10/2/2026 did not produce a publishable comparison (not comparable). The snapshot above is the previously measured run.

Use this skill

Save it into your project's skills folder. Claude Code picks it up in its next session.

curl -fsSL --create-dirs -o .claude/skills/rohitg00-llm-council/SKILL.md https://app.decimal.ai/s/rohitg00-llm-council/SKILL.md

Want it pinned and updatable? pip install "decimalai>=0.15", then decimalai skills add rohitg00-llm-council, and start Claude Code with claude --plugin-dir "$(git rev-parse --show-toplevel)/.agents"

1 · One-time — install the CLI (docs ↗)

pip install "decimalai>=0.15"

2 · Get the skill — writes .agents/skills/rohitg00-llm-council/ and pins it in .decimal/skills.lock

decimalai skills add rohitg00-llm-council

No CLI? Get the same file — curl · raw file

curl -fsSL --create-dirs -o .claude/skills/rohitg00-llm-council/SKILL.md https://app.decimal.ai/s/rohitg00-llm-council/SKILL.md

Raw file: /s/rohitg00-llm-council/SKILL.md ↗ · machine-readable summary at /s/rohitg00-llm-council.json ↗

Safety checks: 3 of 3 passed

Code scan CleanIntent PassedContent Clean

See it in action

One of 10 test cases the skill fixed. Same model, same prompt, with and without the skill.

1 of 10

Prompt

When a session is saved to the wiki under slug 'auth-refactor', where is the generated transcript markdown stored within the wiki tree?

What was checked, without and with the skill
Checked	Without skill	With skill
Specifies wiki/derived/council/ as the destination relative folder path	Missed	Passed

case-19 · gemini-3.6-flash · 8/13/2026 · answers are capped and redacted

What's inside

The instructions your model reads when the skill loads.

SKILL.md84 lines2 filesincludes scripts

LLM Council

Karpathy's LLM Council pattern with Anthropic and OpenAI-compatible providers.

When to use

High-stakes plan review (/plan crosses N-file threshold)
Conflicting learning-rules → re-resolve via vote
User invokes /council "<query>" or /wiki council
Architecture decisions where you want multiple viewpoints captured
Persisting deliberation as a wiki page for future reference

Three phases

Independent: each model answers in parallel
Ranking: each model ranks anonymized peer responses
Synthesis: chairman model reads all responses + rankings → final answer

Provider config

Configure optional keys in the plugin configuration dialog. Use the providers MCP server's run_provider_task tool with task: "council" and args: ["run", "<query>", "--provider", "openai"]. For provider status, pass args: ["providers"]. Never request keys in chat or read them from existing credentials or shell configuration.

For standalone CLI use, explicitly set a pro-workflow-specific variable below. The first configured provider is the default; --provider selects one explicitly. See provider configuration.

Standalone CLI variable	Provider	Default base URL
`PRO_WORKFLOW_ANTHROPIC_API_KEY`	Anthropic	`https://api.anthropic.com`
`PRO_WORKFLOW_OPENAI_API_KEY`	OpenAI	`https://api.openai.com/v1`
`PRO_WORKFLOW_OPENROUTER_API_KEY`	OpenRouter	`https://openrouter.ai/api/v1`
`PRO_WORKFLOW_FIREWORKS_API_KEY`	Fireworks	`https://api.fireworks.ai/inference/v1`
`LLM_COUNCIL_BASE_URL` + `PRO_WORKFLOW_LLM_COUNCIL_API_KEY`	Custom OpenAI-compat	(user-supplied)

Override per-run with --provider openai|anthropic|openrouter|fireworks|custom.

Default model rosters per provider live in scripts/council.js and can be overridden via --models CSV and --chairman <id>.

Commands

In a plugin session, pass these runner arguments through run_provider_task. The direct commands below are for standalone CLI installations with explicit credentials.

Track record

Benchmark

15 / 19

test cases passed, vs 7 / 19 without

Adoption

Users: 0
Times used: 0

Safety and source details

SkillSafety

✓ 3 of 3 passed

Code scan15 of 15 checks clean

0 critical · 0 warning · 0 info — scanner v5 — 10/1/2026

View 15 scanner checks

live_secretremote_code_executionreverse_shelldata_exfiltrationssrf_metadataagent_snoopinganti_refusaldestructive_commandsobfuscated_unicodeunicode_homoglyphopaque_blobsuspicious_urltool_overreachtrigger_abuseprompt_injection_phrasing

IntentSafe

LLM judge · does the skill do what it claims

ContentClean

LLM judge · policy & harmful-content review

Source

Imported

rohitg00 / pro-workflow

skills/llm-council/SKILL.md

View on GitHub ↗

Imported 10/1/2026Version v2Bundled 1 file · scripts

More skills from the same source and nearby in the registry, with their headline benchmark lift.

Ready to supercharge your AI agents?

See it in action

What's inside

LLM Council

When to use

Three phases

Provider config

Commands

Track record

Benchmark

Adoption

SkillSafety

Source

Related skills