I’ve always been a little bit worried by my own ability to forecast research outcomes. There’s little data about whether academic experts are better than a smart layperson at predicting certain types of outcomes.
We ran a large online experiment where we had people quickly push the A and B buttons on a keyboard. We then asked 208 academic experts who study decision making— economists, behavioral economists, and psychologists—and several hundred students and nonexperts to forecast which incentives would motivate people to work the hardest.
Academic experts [professors] did a pretty good job forecasting the results, but by several measures they did no better than students or other nonexperts.
I’m not suggesting that when you’re not feeling well, you should go to a neighbor’s house instead of a doctor. Experts have a role to play. But if I’m at a company, perhaps trying to determine what website design format will work best, the advice of people without special expertise may be as accurate as the advice that comes from a decision-making expert.
Devin G. Pope is professor of behavioral science and Robert King Steel Faculty Fellow at Chicago Booth.
Chicago Booth behavioral science professor George Wu discusses the art of constructive criticism.
How Should You Deliver Negative Feedback?
We expect many conversations to be more awkward than they turn out to be.
You’re Underestimating the Pleasure of Talking to Strangers
Weightier topics will make you and your conversation partner happier.
Deep Conversations with Strangers Are More Fulfilling than Small TalkYour Privacy
We want to demonstrate our commitment to your privacy. Please review Chicago Booth's privacy notice, which provides information explaining how and why we collect particular information when you visit our website.