wacv-reproducibility

WACV Reproducibility

Use this to make a WACV result checkable — by a reviewer now and by you at the Round 2

resubmission. WACV's applications framing raises the bar in one direction (a systems claim

must be reproducible as deployed), and the two-round model adds a second (paper and

artifact must not drift between rounds). Facts are the WACV 2026/2027 cycles as read on

2026-07-09.

The recipe ledger

Keep one ledger that regenerates every reported number, so the body, the supplement, and the

artifact cannot diverge:

| Ledger entry | Why WACV cares |

|---|---|

| Exact data splits and preprocessing | Applications datasets are often custom; a hidden split invalidates a comparison |

| Seeds (and sessions/devices for field work) | Reviewers distrust single hero runs |

| Hyperparameters per reported row | Lets a reviewer see the comparison was matched |

| Device, power meter, and measurement method | An applications latency/wattage claim is only reproducible if the rig is named |

| Baseline re-tuning under your constraint | Proves the comparison was fair, not defaults-vs-yours |

| Script → figure/table mapping | So a Round 2 reviewer confirms nothing changed silently |

Constraint-aware reproducibility

An Applications-track claim ("2 W, sub-10-lux, on device D") is not reproducible from

accuracy alone. Record how the constraint was measured — the meter, the device firmware, the

ambient condition — so a reviewer or a future reader can reproduce the constraint, not just

the metric. A number without its measurement rig is a claim, not evidence.

Repro smoke check before submission (and again before the R2 resubmission):
  1. Fresh checkout → run the pipeline for one reported row end to end.
  2. Confirm the produced number matches the paper within the stated spread.
  3. Diff the artifact's claims against the current paper's claims — zero drift allowed.
  4. Strip identity from the anonymous package (see wacv-artifact-evaluation).

Seed and session honesty

Report variance over seeds, and for deployed/field systems over repeated sessions or

devices. Do not report the best of many runs as "the" result. If a gap sits within the

spread, say so — an honest small margin survives review better than an inflated one that a

reviewer's own reproduction contradicts.

Sync across the two rounds

The Revise-and-Resubmit lap is where reproducibility quietly breaks: authors change an

experiment in the paper but not in the artifact, or vice versa. After every revision, re-run

the smoke check and re-diff the artifact against the paper. A Round 2 reviewer re-reading a

revised submission should find the package and the paper telling one story.

Reverify each cycle

• Whether the current guidelines request a reproducibility statement or checklist.
• Data-release and licensing rules for any dataset used as evidence.
• Supplementary size/format caps that constrain what you can ship (待核实 for 2026).

Output format

[Recipe ledger] regenerates every reported number: yes/no
[Constraint rig] device/meter/condition recorded for systems claims: yes/no
[Seeds/sessions] variance reported honestly: yes/no
[Baselines] re-tuned under your constraint and logged: yes/no
[Round sync] artifact matches current paper (zero drift): yes/no
[Gap] <the number a reviewer could not currently reproduce>