Ready to supercharge your AI agents?

Install any skill in seconds. Free to start, no credit card required.

Get Started Free →

Adversarial Quarto vs Beamer QA Workflow · brycewang-stanford | DecimalAI

testingby brycewang-stanford

Adversarial Quarto vs Beamer QA Workflow

brycewang-stanford/qa-quarto

Source brycewang-stanford/Auto-Empirical-Research-Skills ↗License NOASSERTION

Adversarial Quarto vs Beamer QA. Critic finds issues, fixer applies fixes, loops until APPROVED (max 5 rounds).

SkillScore88Maintained

Automatic

QA & Test Engineering pack

Last verified 8/9/2026

What it changes

Passed 19 of 22 test cases with the skill, and 11 of 22 without it.

Without skill50%

With skill88%

Checks it passed that the model alone missed

Names the quarto-critic agent.
Identifies this check as part of Phase 0 Pre-flight.
States that the Beamer PDF is the gold standard benchmark.

and 8 more in the full report

9 fixed12 passed either way3 still failing0 broke

Pass-rate lift: +38 pp
Tokens: -16%
Agent turns: 0%
Response time: -46%

Model gemini-3.6-flashMeasured 8/9/2026v121 of 24 cases passed with skill · 22 comparable

Tokens, turns and time describe resource use, not a dollar price.

Use this skill

Save it into your project's skills folder. Claude Code picks it up in its next session.

curl -fsSL --create-dirs -o .claude/skills/brycewang-stanford-qa-quarto/SKILL.md https://app.decimal.ai/s/brycewang-stanford-qa-quarto/SKILL.md

Want it pinned and updatable? pip install "decimalai>=0.15", then decimalai skills add brycewang-stanford-qa-quarto, and start Claude Code with claude --plugin-dir "$(git rev-parse --show-toplevel)/.agents"

1 · One-time — install the CLI (docs ↗)

pip install "decimalai>=0.15"

2 · Get the skill — writes .agents/skills/brycewang-stanford-qa-quarto/ and pins it in .decimal/skills.lock

decimalai skills add brycewang-stanford-qa-quarto

No CLI? Get the same file — curl · raw file

curl -fsSL --create-dirs -o .claude/skills/brycewang-stanford-qa-quarto/SKILL.md https://app.decimal.ai/s/brycewang-stanford-qa-quarto/SKILL.md

Raw file: /s/brycewang-stanford-qa-quarto/SKILL.md ↗ · machine-readable summary at /s/brycewang-stanford-qa-quarto.json ↗

Safety checks: 3 of 3 passed

Code scan CleanIntent PassedContent Clean

See it in action

One of 9 test cases the skill fixed. Same model, same prompt, with and without the skill.

1 of 9

Prompt

I am checking `econ101_slides.qmd` against its compiled `econ101_slides.html`. The qmd source file was updated 5 minutes ago, while the html file timestamp is from yesterday. What specific pre-flight action should be taken before running visual audit tools?

What was checked, without and with the skill
Checked	Without skill	With skill
Mandates re-rendering the Quarto presentation because the QMD source is newer than the HTML file.	Passed	Passed
Identifies this check as part of Phase 0 Pre-flight.	Missed	Passed

case-07 · gemini-3.6-flash · 8/9/2026 · answers are capped and redacted

What's inside

The instructions your model reads when the skill loads.

SKILL.md50 linessingle file

Adversarial Quarto vs Beamer QA Workflow

Compare Quarto HTML slides against their Beamer PDF benchmark using an iterative critic/fixer loop.

Philosophy: The Beamer PDF is the gold standard. The Quarto translation must be at least as good in every dimension.

Workflow

Phase 0: Pre-flight → Phase 1: Critic audit → Phase 2: Fixer → Phase 3: Re-audit → Loop until APPROVED (max 5 rounds)

Hard Gates (Non-Negotiable)

Gate	Condition
Overflow	NO content cut off
Plot Quality	Interactive charts >= static plots
Content Parity	No missing slides/equations/text
Visual Regression	Quarto >= Beamer in all dimensions
Slide Centering	Content centered, no jumping
Notation Fidelity	All math verbatim from Beamer

Phase 0: Pre-flight

Locate Beamer (.tex/.pdf) and Quarto (.qmd/.html) files
Check freshness (re-render if QMD newer than HTML)
Verify TikZ SVGs if applicable

Phase 1: Initial Audit

Launch the quarto-critic agent to compare Beamer vs Quarto comprehensively. Report saved to quality_reports/[Lecture]_qa_critic_round1.md.

Phase 2: Fix Cycle

If not APPROVED, launch quarto-fixer agent to apply fixes (Critical → Major → Minor), re-render, and verify.

Phase 3: Re-Audit

Track record

Benchmark

19 / 22

test cases passed, vs 11 / 22 without

Adoption

Users: 0
Times used: 0

Safety and source details

SkillSafety

✓ 3 of 3 passed

Code scan15 of 15 checks clean

0 critical · 0 warning · 0 info — scanner v4 — 8/2/2026

View 15 scanner checks

live_secretremote_code_executionreverse_shelldata_exfiltrationssrf_metadataagent_snoopinganti_refusaldestructive_commandsobfuscated_unicodeunicode_homoglyphopaque_blobsuspicious_urltool_overreachtrigger_abuseprompt_injection_phrasing

IntentSafe

LLM judge · does the skill do what it claims

ContentClean

LLM judge · policy & harmful-content review

Source

Imported

brycewang-stanford / Auto-Empirical-Research-Skills

skills/12-pedrohcgs-claude-code-my-workflow/dot-claude/skills/qa-quarto/SKILL.md

View on GitHub ↗

License NOASSERTIONImported 8/2/2026Version v1

Other skills for the same job

Published skills whose descriptions closely match this one, with their headline benchmark lift.

pedrohcgs/qa-quartoAdversarial Quarto-vs-Beamer parity QA. A critic agent compares the Quarto HTML render to the Beamer PDF benchmark for content/visual parity; a fixer agent applies fixes; loops until APPROVED (max 5 rounds). Use when user says "qa the quarto", "check parity", "does the html match the pdf?", "quarto matches beamer?", or after a translate-to-quarto run. Requires both the `.qmd` rendered and a `.pdf` benchmark.Near-identical description+29 pp pass-rate lift

More skills from the same source and nearby in the registry, with their headline benchmark lift.

Ready to supercharge your AI agents?

See it in action

What's inside

Adversarial Quarto vs Beamer QA Workflow

Workflow

Hard Gates (Non-Negotiable)

Phase 0: Pre-flight

Phase 1: Initial Audit

Phase 2: Fix Cycle

Phase 3: Re-Audit

Track record

Benchmark

Adoption

SkillSafety

Source

Other skills for the same job

Related skills