Product managers need to always remember this:
There are lies, damned lies, and statistics.
Too often, numbers will be used as the only basis for decision-making – or they will be held up as the guiding light of “what to do.” The wikipedia article actually sums this up rather nicely:
The statement refers to the persuasive power of numbers, the use of statistics to bolster weak arguments, and the tendency of people to disparage statistics that do not support their positions.
I’m not advocating a complete disregard of numbers / stats – but if you have them, make sure you also exercise common sense. And if you can at all, try to validate any larger choice or decision by talking to real users.
Sometimes, when users click on things it’s just users clicking on things.
{ 3 comments… read them below or add one }
Statistics can be great… but can also be biased. You always have to question the source behind the provider.
Yep, for sure. I am starting to lean more and more to running simple,
quick listening labs and meshing that with actual analytics or numbers
to see how things line up.
Problem is, you want the product to mature a bit before diving in to
those activities. Not years, but a couple of months and a solid user
base.
Yep, for sure. I am starting to lean more and more to running simple,
quick listening labs and meshing that with actual analytics or numbers
to see how things line up.
Problem is, you want the product to mature a bit before diving in to
those activities. Not years, but a couple of months and a solid user
base.