Title

Decision Theoretic Approaches to Experiment Design and External Validity

Author(s)

Abhijit V. Banerjee Abhijit Banerjee (Massachusetts Institute of Technology (MIT))

Sylvain Chassang Sylvain Chassang (Princeton University)

Erik Snowberg Erik Snowberg (California Institute of Technology)

Abstract

A modern, decision-theoretic framework can help clarify important practical questions of experimental design. Building on our recent work, this chapter begins by summarizing our framework for understanding the goals of experimenters, and applying this to re-randomization. We then use this framework to shed light on questions related to experimental registries, pre-analysis plans, and most importantly, external validity. Our framework implies that even when large samples can be collected, external decision-making remains inherently subjective. We embrace this conclusion, and argue that in order to improve external validity, experimental research needs to create a space for structured speculation.

Creation Date

2016-04

Section URL ID

Paper Number

080_ 2016

URL

http://detc.princeton.edu/wp-content/uploads/2016/11/wp80_2016_Banerjee_Chassang_Snowberg_Decision-Theoretic-Approaches-to-Experiment-Design-and-External-Validity.pdf

File Function

Jel

B23, C90, O10

Keyword(s)

Suppress

false

Series

10