psci-theory-and-hypotheses

Theory & Hypotheses (psci-theory-and-hypotheses)

Psychological Science rewards a clear theoretical claim and honest hypothesis status. Because

preregistration quality is weighed and a Research Transparency Statement is required, the cardinal

rule is: state theory and confirmatory hypotheses before the data, and label exploratory results

as exploratory.

When to trigger

• Writing the theoretical framing and hypotheses
• Preparing a preregistration / pre-analysis plan (Registered Report or OSF)
• Reconciling what you predicted with what you found
• A reviewer flagged the work as "post hoc," "atheoretical," or "HARKed"

Build the argument

1. State the theory. What mechanism or principle predicts the effect, and why. Keep it crisp —

the format does not allow a long theoretical treatise.

1. Derive directional hypotheses. Translate the theory into specific, testable predictions

(direction and, where possible, magnitude/effect-size expectations).

1. Mark hypothesis status. Separate confirmatory (preregistered, predicted in advance) from

exploratory (generated after seeing data) analyses — clearly, in the text.

1. Specify what would disconfirm. Say which results would count against the theory; this is what

makes a test credible.

1. Match to the right format. If the theory is best tested prospectively and confirmatorily, a

Registered Report makes the claim far stronger (route via psci-review-process).

Avoiding HARKing (Hypothesizing After Results are Known)

• Do not present an exploratory finding as if it were predicted.
• If you discovered something post hoc, say so and frame it as a hypothesis for future

confirmation — Psychological Science values this honesty and the Transparency Statement surfaces it.

Worked micro-example — theory to hypothesis status (illustrative)

The two-study attention package, written so hypothesis status is legible at a glance.

Theory:  Brief mindfulness induction transiently broadens attentional
         control, reducing automatic capture by emotional distractors.
H1 (confirmatory, preregistered, S1+S2):
         Induction reduces capture cost vs. control (directional; d ≥ 0.30 SESOI).
H2 (exploratory in S1 → confirmatory in S2):
         Effect is larger for high trait-anxiety participants
         (interaction; preregistered only for Study 2).
Disconfirming: a CI for H1 centered near zero, or a reversed sign, counts
         against the broadening account — stated up front.

Constraints-on-generality (a venue expectation)

Post-credibility-revolution, name the boundary of the claim explicitly rather than implying universal

scope. Confirm current wording against the journal's submission guidelines, but include the substance:

Constraints on generality: We expect H1 to hold for healthy adults under
brief laboratory inductions and screen-based capture tasks. We do not claim
it generalizes to clinical anxiety, sustained meditation training, or
real-world attentional demands without further test.

Theory-stage reviewer pushback and the venue fix

| Reviewer pushback | Psychological Science fix |

|-------------------|---------------------------|

| "Atheoretical / mechanism unclear" | state the broadening mechanism in one crisp sentence before the hypotheses |

| "This looks HARKed" | show the preregistration timestamp; relabel post hoc analyses exploratory |

| "Claims outrun the manipulation" | scale H1's scope to what the induction plausibly does; add a constraints-on-generality clause |

| "Non-directional hypothesis" | commit to a sign and, where possible, a SESOI magnitude |

Theory calibration anchors

• Theory here is crisp, not encyclopedic: one mechanism sentence and a derived, directional prediction

beat a multi-page treatise that the 2,000-word budget cannot hold.

• The cardinal honesty rule is temporal: anything specified before data is confirmatory; anything

generated after seeing data is exploratory, full stop. The Research Transparency Statement and a

graded preregistration make the distinction visible to editors and reviewers.

• Stating what would disconfirm the theory is what converts a story into a test; reviewers steeped in

the credibility revolution read an unfalsifiable framing as a red flag.

• When the theory is best tested prospectively and confirmatorily, a Registered Report makes the claim

materially stronger — confirm current Registered Report availability against the journal's submission

guidelines, then route via psci-review-process.

Anti-patterns

• Theory written to fit the result after the fact (HARKing)
• Vague, non-directional "we expect a relationship" hypotheses
• No statement of what would disconfirm the theory
• Blurring confirmatory and exploratory analyses
• A theory section so long it breaks the 2,000-word budget

Output format

【Theory】the mechanism/principle, briefly
【Hypotheses】directional, testable (H1, H2, …)
【Status】which are confirmatory (preregistered) vs exploratory
【Disconfirming evidence】what would count against the theory
【Format fit】Research Article vs Registered Report (if confirmatory + prospective)
【Next】psci-study-design

Supplementary resources

• [../../resources/external_tools.md](../../resources/external_tools.md) — preregistration templates and tools
• [../../resources/official-source-map.md](../../resources/official-source-map.md) — preregistration and transparency policy