Loading skill
Install any skill in seconds. Free to start, no credit card required.
Get Started Free →brycewang-stanford/colm-review-process
Use when reasoning about how COLM reviews a paper — the OpenReview pipeline from late-March submission through the May review release, the May-June rebuttal window, July decisions, reciprocal-reviewing obligations, the LLM-use rules for reviewers, and how a three-edition-old venue's norms differ from mature conferences.
Passed 16 of 22 test cases with the skill, and 12 of 22 without it.
and 4 more in the full report
5 fixed11 passed either way5 still failing1 broke
Tokens, turns and time describe resource use, not a dollar price.
One of 5 test cases the skill fixed. Same model, same prompt, with and without the skill.
Our research lab is submitting 5 papers to the Conference on Language Modeling (COLM) this year. The lab director asks if we can decline reviewing invitations to save time. What is the COLM reciprocal reviewing rule for authors submitting multiple papers? Format your response using `[Phase today]`, `[Packet triage]`, `[AC-facing issue]`, `[Deadline math]`, and `[Plan]`.
| Checked | Without skill | With skill |
|---|---|---|
| Output states that authors submitting 4 or more papers are automatically drafted into the reviewer pool. | Missed | Passed |
| Output contains the header tag `[Deadline math]`. | Passed | Passed |
The instructions your model reads when the skill loads.
COLM runs a compact, single-cycle-per-year pipeline on OpenReview, and — because the venue is three editions old — its reviewing culture is still visibly under construction. Understanding both the posted mechanics and the young-venue dynamics is what lets authors time their effort correctly.
| Phase | 2026 dates | Author-side reality |
|---|---|---|
| Abstract deadline | March 26 | Drives bidding and reviewer matching |
| Full paper deadline | March 31 | Submission freezes |
| Review writing | April - mid-May | Silence; nothing actionable |
| Reviews released | May 22 | Read-only day one; no same-day replies |
| Rebuttal | May 22 - June 8 | The 18-day window where effort pays |
| AC discussion + decisions | June - July 8 | Decisions posted July 8 |
| Camera-ready | August 7 | Accepted papers finalize |
| Conference | October 6-9, San Francisco | Main program Oct 6-8, workshops Oct 9 |
On this pack's access date — July 8, 2026 — the pipeline is at its decision moment:
rebuttals are closed and notifications land today. If you are triaging an outcome,
go directly to colm-camera-ready (accept) or the resubmission logic below
(reject).
Three structural facts shape COLM reviews:
colm-experiments
lists exactly what they check).test cases passed, vs 12 / 22 without
Published skills whose descriptions closely match this one, with their headline benchmark lift.
More skills from the same source and nearby in the registry, with their headline benchmark lift.