Finding the Sweet Spot
When working at Match Group, a Dallas-based company that owns multiple online dating platforms, Sushil Sharma, ’11, found that forcing users to make choices can lead to richer results.
Sharma—who now serves as chief growth officer for online mortgage company Better in New York—worked for years as chief product and revenue officer at Match. When users were presented with profiles of people they may be interested in dating, they could answer with yes, no, or maybe.
Sharma and his team observed that about 60 percent of responses fell into the maybe category.
“People did not want to make a decision,” he said. “And that was the bucket that we were trying to solve for, because maybe is not actionable. If we know it’s a no, then we can build on your preferences. If we know it’s a yes, we can find other people you like.”
The team came up with an idea: show two profiles at once and force users to choose one. If they skip both, that means that they’re saying no to both—no maybes.
“All the tests we run normally take weeks to be statistically significant,” Sharma said. “This one we launched at 11 a.m. Within a couple of hours, there was a signal. You could see double the number of yeses.”
The number of connections between users grew so rapidly that some reported feeling overwhelmedby having too many new matches. “But that’s a nice problem to have,” Sharma said.
This experiment highlights an interesting aspect of behavioral science, Urminsky commented, which is that there are often trade-offs. In this case, Match gave users more connections by forcing a decision, but the additional connections also made them feel a bit more worn out.
“There’s often an optimal level,” Urminsky said. “If you take it too far, users may drop out and say, ‘This is too pushy.’ Finding that sweet spot requires a deep understanding of the consumer and some experimentation.”
For this reason, Sharma said that anyone looking to run a similar experiment should start small and scale slowly. Forcing consumers to choose is powerful; taken to extremes, it can act as a deterrent.