colt-review-process

COLT Review Process

Use this to plan around COLT's review pipeline. Process facts below were verified

against the COLT 2026 CFP on 2026-07-08; mechanics are re-decided by each edition's

program chairs, so reconfirm in the cycle you are in.

The 2026 pipeline

• Submission via Microsoft CMT by February 4, 2026 (AoE) for the 39th edition.
• Double-anonymous refereeing with a twist: reviewers do not see author names, but the

area chair handling the paper does, and may reveal identities to a reviewer during

the rebuttal period on request when needed for a proper review.

• Initial reviews go to authors before decisions; a rebuttal window follows.
• Accepted papers appear in PMLR (v291 carried COLT 2025; the 2026 volume number is

assigned at publication).

• COLT is run by the Association for Computational Learning, with program chairs

rotating yearly; the 2026 chair names were not published in a form verifiable at the

access date (待核实 — check learningtheory.org/colt2026/).

Who reviews a COLT paper

The pool is learning theorists: statistical learning, online learning and bandits,

optimization theory, RL theory, privacy, and adjacent CS theory. Practical

consequences:

• Expect at least one reviewer working within epsilon of your subfield who will

actually verify proofs, not skim them.

• "Standard techniques" claims get adjudicated by people who know the standard

techniques' exact reach — bluffing about novelty of technique fails here faster than

anywhere else in ML.

• Empirical framing earns nothing by itself; a reviewer may value an illustrative

experiment, but no reviewer will accept one in lieu of a proof.

What the scores actually track

| Dimension | Raises it | Sinks it |

|---|---|---|

| Correctness | Complete proofs, tracked constants, checked external results | One irreparable gap — usually terminal regardless of other strengths |

| Significance | Resolving a known open question; improving a known rate; a clean new model | A bound in a model nobody asked about, unmotivated |

| Novelty of technique | An argument that visibly cannot be assembled from known parts | A reduction the reviewer completes in the margin |

| Tightness / completeness | Matching upper and lower bounds; explicit regime coverage | Upper bound only, gap to the known lower bound unexamined |

| Clarity | Formal setup early, roadmap per proof, stable notation | Definitions scattered; appendix required to parse the theorem |

Decision dynamics

• One sustained correctness objection outweighs any number of enthusiasm points; the

AC's first job is deciding whether the proofs close.

• Because the AC knows author identities, arguments in rebuttal should stand on

mathematics alone — appeals to seniority or track record are visible and land badly.

• Significance disputes ("who cares about this model?") are where rebuttals genuinely

move decisions: a crisp paragraph tying the model to a named prior line, an open

problem, or an empirical phenomenon can flip a fence-sitter.

• COLT is single-track and relatively small; acceptance implies your talk enters the

entire community's field of view, and the bar reflects that.

• Some editions have used an "accept with minor revisions verified by the AC" flavor

of shepherding for fixable issues; whether the current cycle does is announced with

decisions (待核实).

Reading a COLT review

Review anatomy — where the decision signal lives:
1. Summary paragraph      -> did the reviewer parse the model correctly?
                             If not, your rebuttal's first job is the misread.
2. "Detailed comments"    -> line-numbered proof remarks; each is a verification
                             trace. Silence about App. C means C was not read.
3. Questions to authors   -> the actual decision hinges; answer these first.
4. Typo list              -> free labor; acknowledge briefly, fix silently.

Reviews that engage deeply with the proofs are good news even when negative — the

paper was taken seriously, and precise objections are answerable. The dangerous review

is the short, high-level one; it signals the significance case never landed, and that

is a framing problem the rebuttal must solve.

After the decision: reading the outcome

• Accept: the reviews still matter — camera-ready promises made in rebuttal are

expected in the final PDF, and the AC may check (colt-camera-ready keeps the

ledger).

• Reject with proof-level reviews: you received a free verification report from

three experts. Patch the mathematics, then choose between the next COLT, ALT

(the same community's sister venue, roughly anti-phased deadline), or a journal if

the fixed version grew.

• Reject with significance objections only: the theorems survived; the framing

died. Rebuild the known-vs-new ledger and the model-motivation paragraph before

resubmitting anywhere — the same reviewers may see it again in a small community.

• Reject you believe is wrong: there is no formal appeals process to rely on;

the productive channel is a stronger paper, since the community re-reviews

resubmissions on their mathematics.

Confidentiality and conduct

• Submissions are confidential; reviewers may not use or share the results before

publication.

• COLT publishes a code of conduct for participants (a 2026 page exists at

learningtheory.org); professional-conduct expectations extend to the rebuttal tone.

• Reviewer conflicts run through CMT domain and coauthor declarations — enter them

completely, since the informed-AC model depends on accurate conflict data.

• Discussing your submission publicly (talks, social media) during review is not

forbidden by anonymity rules aimed at reviewers, but volume-seeking publicity

during the review window is poor form in a community this small.

Cycle-volatility warnings

• Portal, anonymity mechanics, rebuttal format, shepherding, and decision timeline are

annual decisions. Decision dates for 2026 were not on the pages checked (待核实).

• Reviewer-volunteering expectations for submitting authors have not been a stated

COLT policy in the verified material; do not assume one either way without the

current CFP.

Output format

[Stage] pre-submission / under review / rebuttal / decision
[Score driver] correctness / significance / technique / tightness / clarity
[Reviewer engagement] deep proof-level / shallow-summary (framing failed)
[Rebuttal leverage] <the one thread that can move the decision>
[Process facts to reconfirm] <current-cycle items still 待核实>