restat-referee-strategy

Referee Strategy (restat-referee-strategy)

When to trigger

• The design is settled and you want to pre-empt the obvious referee objections
• You need to decide which robustness checks belong in the paper vs the online appendix
• You want to write the intro/robustness so a referee's first question is already answered
• Before submission, to stress-test the manuscript against a REStat referee's mindset

The REStat referee mindset

REStat referees are applied economists who attack identification and measurement first. They ask: Is the design actually clean? Is everything measured well enough to support the claim? Would the result survive the specification I would run? Does the conclusion exceed the evidence? Because REStat publishes across many applied fields, expect a referee who knows your subfield's data quirks intimately. The winning manuscript answers the top objection inside the paper — one paragraph plus one exhibit — before the referee can raise it.

Threat → pre-emption map by design

| Design | The objection a REStat referee raises first | Pre-empt with |

|--------|---------------------------------------------|---------------|

| DID (staggered) | "TWFE is biased with heterogeneous timing" | Het-robust estimator (CS / Sun–Abraham) + flat event-study + Bacon decomp |

| DID (any) | "Pre-trends / parallel trends fails" | Pre-trend tests + honest-DID bounds (Rambachan–Roth) |

| RD | "The running variable is manipulated" | Density test (CJM) + covariate smoothness + bandwidth sensitivity |

| IV | "Exclusion restriction is violated / instrument is weak" | Institutional + falsification defense of exclusion; effective-F; AR weak-IV sets |

| Shift-share | "Shares/shocks are endogenous" | GPSS share-exogeneity or BHJ shock-exogeneity argument + implied estimates |

| Any | "Your key variable is measured with error" | Validation sample / attenuation correction / bounds (REStat-signature) |

| Any | "Inference ignores clustering / few clusters / many tests" | Right clustering + wild-cluster bootstrap + MHT correction |

| Any | "The conclusion overreaches the estimate" | State the estimand and scope; bound external-validity claims |

Strategy moves

1. Rank the threats. List the 4–6 objections this design invites, hardest first.
2. Answer the top one in the main text — one paragraph + one exhibit — so the referee sees it pre-empted.
3. Budget the rest between main text and online appendix; signal in the text where the appendix answers a concern.
4. Pre-write the hard concession. Where the design is genuinely limited, state the limit and bound it — this buys referee trust.
5. Match exhibits to threats (hand to restat-robustness for the suite, restat-tables-figures for presentation).

Checklist

• [ ] Top 4–6 objections for THIS design listed, hardest first
• [ ] The single hardest objection is answered in the main text (paragraph + exhibit)
• [ ] Measurement-error objection explicitly addressed (REStat referees raise it)
• [ ] Inference objection pre-empted (clustering / few-cluster / MHT)
• [ ] Scope/external-validity bounded so "overreach" cannot be the easy rejection
• [ ] Remaining checks budgeted between main text and online appendix with signposts

Anti-patterns

• Hiding the obvious objection and hoping the referee misses it (they will not)
• Burying the answer to the top objection in a footnote or deep appendix
• A defensive tone that argues instead of demonstrating with an exhibit
• Ignoring measurement quality because the identification looks clean
• Overclaiming generality, handing the referee the easiest possible rejection

Worked vignette: pre-empting the measurement objection (illustrative)

A trade paper uses a shift-share instrument and the author is braced for the usual exogeneity questions. But

the first objection a REStat referee raises is about measurement: the industry-share weights are built

from a base-year census the referee believes is mismeasured for small sectors. Anticipating this, the author

adds, in the main text, a one-paragraph defense plus one exhibit — re-estimating with shares from an

independent survey and showing the estimate barely moves — before any referee sees the paper. The exogeneity

question (shares vs shocks, BHJ) is handled in a second paragraph. By pre-empting the measurement objection,

not just the identification one, the author removes the easiest path to a critical report — the REStat-specific

move siblings often miss.

Output format

【Design】[DID / RD / IV / shift-share / measurement]
【Top objections (ranked)】1:[...] 2:[...] 3:[...] (4–6)
【Hardest answered in main text?】paragraph + exhibit? [Y/N]
【Measurement objection addressed?】[Y/N]
【Inference objection pre-empted?】[Y/N]
【Scope bounded?】external-validity claim limited? [Y/N]
【Main vs appendix budget】main: [...]; appendix: [...]
【Next step】restat-submission