Research methods

Revealed vs stated preference

What people tell a survey and what they actually do are different data. Knowing which one you’re holding is the difference between a validated idea and a flop.

Two kinds of preference

Stated preference is what someone tells you when you ask — on a survey, in an interview, in a “would you use this?” poll. Revealed preference is what they do when no one is asking: what they buy, what they complain about, what they quietly build a workaround for at 11pm.

The two diverge constantly, and predictably. Stated preference is cheap to give and socially shaped — people answer the question they think you want answered. Revealed preference costs something real, so it can’t be faked.

Why surveys flatter

A survey puts your idea in front of someone and asks them to imagine a future. Imagining is free, and most people are kind, so the answers skew positive — the classic “sure, I’d use that” that never converts to a signup.

It gets worse with price. Asked what they’d pay, respondents anchor on being agreeable rather than on their actual budget. This is why an idea can survey beautifully and still die on contact with a real checkout: you measured stated preference and shipped to revealed.

Why unprompted forum talk is closer to the truth

When someone posts on Reddit that they’ve wasted another evening fighting a problem, nobody prompted them. There’s no product in front of them to be polite about, no researcher to please — just a real frustration worth the effort of writing up.

That’s as close to revealed preference as text gets: people describing what they actually did, paid for, and abandoned, in their own words, because they wanted to — not because a survey made them.

What revealed preference looks like in a thread

The tells that someone is describing behaviour, not just an opinion:

  • A workaround they already built or bought, not a feature they’d “like”
  • A specific price they pay or left — a number with a decision behind it
  • Time spent — “an hour every morning”, not “it’s a bit annoying”
  • A tool named and judged from use, not from a landing page
  • A switch they actually made, with the trigger that caused it

The honest caveat

Reddit isn’t pure revealed preference — it’s what people choose to say, so it carries its own selection bias (the frustrated post more than the satisfied). It’s closer to behaviour than a survey, not a substitute for a live test. Treat it as the strongest cheap signal, then confirm with a real checkout.

Compare the methods directly

Surveys, interviews, and forum mining each capture a different slice — here’s when to reach for which.

Reddit vs surveys vs user interviews

Validate what people actually say, not what you wish they would.