Loading skill
Install any skill in seconds. Free to start, no credit card required.
Get Started Free →brycewang-stanford/aamas-reproducibility
Use when strengthening AAMAS reproducibility evidence for interaction claims, including proofs and game definitions, opponent and population sets, self-play protocols, random seeds, compute, uncertainty on strategic outcomes, baselines, and consistency between what the paper claims about agents and what the artifact can actually show.
Passed 18 of 22 test cases with the skill, and 15 of 22 without it.
and 3 more in the full report
4 fixed14 passed either way3 still failing1 broke
Tokens, turns and time describe resource use, not a dollar price.
One of 4 test cases the skill fixed. Same model, same prompt, with and without the skill.
Please conduct a pre-submission reproducibility audit on our multi-agent paper and code repository for AAMAS. Format your feedback strictly using five designated headers: a claim-to-evidence inventory mapping claims to their locations, an artifact consistency assessment, a summary of interaction reproducibility gaps, a list of main PDF text revisions, and required supplementary or repository fixes.
| Checked | Without skill | With skill |
|---|---|---|
| Format response section headers using bracketed text tags `[Claim inventory]`, `[Artifact consistency]`, `[Interaction reproducibility gaps]`, `[Paper fixes]`, and `[Supplement fixes]`. | Missed | Passed |
| Include the artifact consistency classification option of complete, inconsistent, or missing. | Missed | Passed |
The instructions your model reads when the skill loads.
Use this before submission and again before camera-ready. The reproducibility question at AAMAS is not only "can I rerun the model" but "can I reproduce the interaction - the same agents, the same game, the same emergent outcome."
| Claim | Pure-theory answer | Learning-plus-game answer |
|---|---|---|
| Solution concept reached | Proof with the game and information structure stated | Plus convergence curves under other agents' adaptation |
| Opponents / population | NA if fully analytical | The exact opponent set and how it was chosen |
| Seeds and variance | NA for deterministic results | Required for every stochastic curve and payoff table |
| Compute | NA | Hardware, per-run time, and total number of self-play runs |
Claiming an equilibrium result while the evaluation only shows two fixed agents playing once is the recognizable AAMAS gap: reviewers read the mismatch between the strategic claim and the thinness of the interaction evidence as carelessness about the rest.
Consider a submission proving convergence to a coarse-correlated equilibrium in a repeated game, validated by self-play. Its reproducibility spine: the game generator and payoff scale, the learning rule and its step sizes, the opponent set, the replication seeds, the convergence
test cases passed, vs 15 / 22 without
Published skills whose descriptions closely match this one, with their headline benchmark lift.
More skills from the same source and nearby in the registry, with their headline benchmark lift.