7 July 2025 · Isolde Venn
What a polished dashboard still conceals
New product managers are not gullible. They are busy, and the first App Analytics screen they are given is designed to look like a finished map. Tiles, a funnel, a retention chart with a comforting shape. Three things are usually missing, and they are the whole survey: how rows were joined, which window defined a week, and whether anonymous and known users were allowed to become the same person.
Vendor defaults exist to demonstrate the product, not to describe yours. A funnel that auto-fills from page views will look continuous. A retention tile will offer D7 because D7 is a popular hole in a template. An identity setting will “unify” because unification is a feature name. None of those choices are immoral. All of them are concealed unless someone writes them on the weekly plot.
The house exercise is to sit with a new PM and ask them to narrate the tile as if engineering were in the room. When they cannot say who is in the denominator, the tile is not ready. When they can say it, they often discover the denominator is “everyone who opened the app,” which is how activation of 61 percent appears in travel products that have not yet saved a trip.
We do not teach people to distrust tools. We teach them to distrust completeness. A polished dashboard that cannot name its join, window, and stitch is a handsome cover over an unsurveyed field. The Survey Grid is the habit of lifting that cover every Monday, even when the colours are attractive.