mlsys-supplementary

MLSys Supplementary

Use this when splitting a Conference on Machine Learning and Systems submission between

body and appendix. The 2026-cycle mechanics (verified 2026-07-08): appendices are

unlimited in length, uploaded as a separate file from the main paper, due at the

same time — and reviewers are explicitly not required to read them. That last clause

is the design constraint everything below follows from.

The governing rule

The 10-page body must win the paper's acceptance alone. The appendix exists to survive

audits — a skeptical reviewer checking one specific configuration — and to serve future

readers and artifact evaluators. Anything that must be believed for acceptance goes in

the body; anything that must be checkable can go behind it.

Placement decision table

| Material | Body or appendix? | Reasoning |

|---|---|---|

| Headline comparison + strongest ablation | Body, always | Reviewers judge only what they must read |

| Full hyperparameter/configuration matrices | Appendix, cross-referenced | Audit material, not narrative |

| Baseline tuning protocol and budgets | Body (one paragraph) + appendix (full grid) | Fairness is decision-critical; the grid is evidence |

| Per-workload result breakdowns beyond the headline | Appendix table, body sentence summarizing spread | Spread claim needs body presence; rows do not |

| Workload/trace characterization (rates, lengths, mixes) | Body figure if representativeness is contested; else appendix | Representativeness is a top MLSys objection |

| Additional hardware generations or precision modes | Appendix | Strengthens generality without carrying the claim |

| Failure cases and non-wins | Body, briefly | Honesty here is scored; hiding it in the appendix reads as burying |

| Proof sketches for any theoretical guarantee | Body sketch, appendix proof | Same convention as ML venues |

| Artifact/repository description | Appendix (anonymized for research track) | Feeds later artifact evaluation |

Structuring the appendix file

Because it is a separate upload, the appendix must be navigable without the body open:

• Start with a half-page map: appendix section → the body section and claim it supports.
• Number appendix sections A, B, C... and cross-reference each at least once from the

body ("full grid in App. B"); un-pointered appendix content is effectively invisible.

• Restate the experimental setup header (hardware, workloads) at the top rather than

assuming the reviewer has the body's Section 5 in memory.

• Keep figures self-captioning: every axis, unit, and trial count readable standalone.

appendix.pdf
├── A. Claims map (body claim -> appendix evidence)
├── B. Full system + baseline configurations
│     B.1 our system   B.2 baseline-1 (tuning grid)   B.3 baseline-2
├── C. Workload characterization (trace statistics, generation scripts described)
├── D. Extended results (per-workload, per-hardware, per-precision)
├── E. Sensitivity and additional ablations
├── F. Anonymized artifact description (layout, run commands, hardware needs)
└── G. Proofs / analytical model derivations (if any)

Anonymity in supplementary material (research track)

• The appendix is part of the double-blind submission: no author names, affiliations,

cluster hostnames, internal project codenames, or company-identifying trace fields.

• Scrub trace data specifically — production traces leak identity through service

names, datacenter labels, and timestamp patterns. Rename fields and state that you did.

• Code pointers must go to anonymized mirrors; the real repository appears only at

camera-ready and artifact evaluation.

• Industrial-track supplements follow that track's looser rule (company identity may

remain; author names may not) — do not mix the two tracks' standards.

Worked split: an inference-compiler submission

A fictional paper contributes a compiler pass that fuses attention variants, claiming

1.5-1.9x kernel speedups and 1.2x end-to-end serving gains across three model families.

• Body keeps: the fusion legality insight and the pass algorithm (compressed to one

figure plus one column), the end-to-end serving comparison under a stated latency

constraint, the kernel-level speedup summary across families, one ablation isolating

the fusion from unrelated codegen wins, and the non-win (no gain on short sequences,

stated with the mechanism reason).

• Appendix takes: per-operator speedup tables for all 40 fused patterns, the full

autotuning search configuration, correctness-test methodology against reference

kernels, results on a second GPU generation, and the anonymized artifact description.

• The one judgment call: the correctness methodology gets a two-sentence summary in the

body — a compiler paper that never says how it validated correctness invites the

objection no appendix can pre-empt, because the appendix may never be opened.

The test of the split: hand a colleague only the 10-page body and ask them to argue for

acceptance; every point where they reach for the appendix is a misplacement.

Common failure modes

• The outsourced paper: body asserts, appendix proves, reviewer reads only the body

and scores the assertions as unsupported. Pull the single strongest piece of evidence

for each major claim forward.

• The stale appendix: body numbers get regenerated at the deadline, appendix tables

do not, and a careful reviewer finds the mismatch. Build both from the same logs in

the same script run.

• The dumping ground: forty pages of unreferenced plots signal an unfiltered

experiment log, not scholarship. Every appendix element should answer a question a

reviewer might actually ask.

• The forgotten upload: the appendix is a separate file with the same deadline —

assign its upload explicitly; it is not attached to the paper PDF automatically.

Interaction with later stages

The appendix outlives review. The configuration matrices and workload characterization

you file now become the skeleton of the Artifact Appendix at evaluation time

(mlsys-artifact-evaluation), and the camera-ready version de-anonymizes rather than

rewrites it — so write appendix sections as if a stranger will execute them in six

months, because at this venue one probably will. Conversely, anything you promise in

the author response ("full sweep in the appendix") must land there by camera-ready;

keep a promises ledger.

Cycle-volatility warning

The separate-upload mechanic, unlimited length, and same-deadline rule are 2026-cycle

facts; earlier cycles differed and the next may too. Confirm the current Call for

Research Papers wording before finalizing the split.

Output format

[Split status] body-sufficient / body-dependent-on-appendix (fix) / not ready
[Claims map] <major claim -> body evidence -> appendix backup>
[Appendix structure] <sections present + cross-reference check>
[Anonymity sweep] <traces/configs/code pointers cleaned?>
[Consistency] <body and appendix generated from same logs? y/n>
[Upload owner] <person responsible for the separate file>