Use when preparing or auditing a COLM submission on OpenReview — the late-March abstract and full-paper deadlines, the strict 9-page main text, double-blind rules banning acknowledgments and identity links, the Code of Ethics acknowledgment, LLM-usage disclosure, reciprocal-reviewer nomination, and pre-upload risk triage.
SkillScore91Maintained
Automatic
◆Research pack
Last verified 8/31/2026
What it changes
Passed 20 of 22 test cases with the skill, and 14 of 22 without it.
Without skill64%
With skill91%
Checks it passed that the model alone missed
Includes the header '[Format]'.
Includes the header '[Fix queue]'.
Includes the header '[Anonymity]'.
and 5 more in the full report
6 fixed14 passed either way2 still failing0 broke
Pass-rate lift
+27 pp
Tokens
+63%
Agent turns
0%
Response time
-32%
Model gemini-3.6-flashMeasured 8/31/2026v120 of 22 cases passed with skill
Tokens, turns and time describe resource use, not a dollar price.
See it in action
One of 6 test cases the skill fixed. Same model, same prompt, with and without the skill.
1 of 6
Prompt
Our research group has an author submitting 4 papers to COLM 2026. We plan to opt out of reviewer duties since senior authors are too busy. Does having 4 submissions trigger any mandatory reviewer pool entry?
What was checked, without and with the skill
Checked
Without skill
With skill
States that authors with 4 or more submissions are automatically placed into the reviewer pool.
Missed
Passed
case-08 · gemini-3.6-flash · 8/31/2026 · answers are capped and redacted
What's inside
The instructions your model reads when the skill loads.
SKILL.md124 linessingle file
COLM Submission
Everything below is the COLM 2026 cycle as read from colmweb.org on 2026-07-08.
COLM re-issues its instructions each edition and has already changed details between
2024, 2025, and 2026 — reopen the current submission-instructions page before acting
on any number here.
The 2026 mechanics
Two deadlines a week apart: abstract March 26, 2026; full paper March 31,
2026. The abstract is not decorative — it routes reviewer bidding — so submit the
real abstract, not a stub you plan to overwrite.
Platform: OpenReview, group colmweb.org/COLM/2026/Conference, opened
February 2026. Every author needs an OpenReview profile with current affiliation
and publication history before the deadline; profile gaps break conflict
detection and can strand the submission.
Format: a strict 9-page upper limit on main text, with unlimited
additional pages for citations. An optional acknowledgments section (≤ 1 page)
sits outside the limit — but in the submitted version there must be no
acknowledgments at all, because review is double-blind.
Anonymity: no author names, no acknowledgments, and no links that resolve to
you — the instructions call out GitHub links explicitly. LM papers leak identity
through unusual channels; sweep them (next section).
Code of Ethics: every author must read it and explicitly acknowledge it in the
submission form. Reviewers are encouraged to flag violations, so treat the
acknowledgment as a real audit, not a checkbox.
LLM-usage disclosure: COLM 2026 adopted the ICLR 2026 LLM policy minus minor
writing/code assistance. Disclose LLM-originated ideas, LLM-written content
(including references), LLM-generated data or plots, and LLM-based evaluation.
Fill this in truthfully; a judge-model evaluation pipeline is disclosable use.
Reciprocal reviewing: there is a per-submission and a per-reviewer
requirement; an author with 4+ submissions enters the reviewer pool
automatically, and two submissions cannot lean on the same reciprocal reviewer
unless nobody else qualifies. Decide the nominee per paper before deadline
night — group-wide, this is a constraint-satisfaction problem, not a form field.
Where LM papers leak identity
Beyond the obvious author block: Hugging Face model and dataset URLs under your org,
Weights & Biases dashboard links, API keys or org IDs left in config listings, model