The Questions We Never Had a Way to Ask Before

Jul 7
3 min read

Why Better Questions Often Matter More Than Better Metrics

The conversations that follow are often far more valuable than the measurement itself.

Where the Most Valuable Conversations Begin

One of the things I've noticed about audience measurement is that the most interesting conversations rarely begin with the number itself.

The number may capture everyone's attention initially. People want to know the result. They want to know whether it is higher or lower than expected. They want to compare it to previous periods and understand where it stands today.

Those reactions are natural.

What I've found, however, is that the conversations that follow are often far more valuable than the measurement itself.

A publisher calculates a new metric expecting to learn something about performance. Instead, they find themselves questioning assumptions they haven't revisited in years.

The discussion shifts.

What looked straightforward suddenly feels more complicated.

What felt obvious begins to deserve a second look.

What We've Learned

Over the past few weeks, we've explored several examples of this.

Many publishers have long assumed that audience growth and audience strength move together. Looking more closely sometimes reveals that the relationship is more complicated than that.
Many organizations think of the audience as a single group. Looking beneath the averages often reveals a collection of very different audience relationships.
Many audience reports document the moment someone arrives. Looking over longer periods of time often reveals that audience relationships persist in very different ways.

None of these observations automatically tell us what action to take.

What they do is change what we become curious about.

When Measurement Becomes Investigation

I've seen this happen repeatedly when publishers begin examining audience health through a different lens.

The initial goal is usually measurement.

The outcome is often investigation.

A number highlights something unexpected. A long-held assumption becomes less certain. Attention shifts toward a question that previously seemed unnecessary.

Why do two products with similar subscriber counts produce different patterns of ongoing participation?
Why do some audience cohorts remain highly visible while others gradually disappear from engagement reporting?
Why do audiences that appear similar in aggregate reports behave so differently over time?

These questions were always available to ask.

Most organizations simply didn't have a reason to ask them.

Seeing the Audience Differently

Traditional audience reporting was designed to measure expansion. As long as growth remained the primary focus, many deeper questions about audience behavior remained in the background. The reporting wasn't wrong. It was answering a different set of questions.

What changes is not necessarily the audience itself.

What changes is what we are able to notice.

Once a publisher begins paying attention to participation, persistence, and audience visibility over time, certain patterns become difficult to ignore. The audience starts looking more layered than it appeared before. Differences that once blended into the averages begin standing out. Questions that once felt peripheral move closer to the center of the conversation.

I've come to think that this is where many of the most valuable audience discussions begin.

Not when a metric confirms what we already believed.

When it makes us reconsider something we assumed we understood.

Why Better Questions Matter

Because the purpose of investigation isn't to produce immediate answers.

It's to develop a clearer understanding of what deserves closer examination.

The most useful measurements often do exactly that. They redirect attention. They reveal complexity that was previously hidden inside the totals. They encourage questions that wouldn't have surfaced otherwise.

Measurement vs. Investigation

Measurement	Investigation
Capture the number	Question assumptions
Compare it to previous periods	Understand what deserves closer examination
Measure expansion	Pay attention to participation, persistence, and audience visibility over time
Confirm what we already believed	Reconsider something we assumed we understood

The Bottom Line

And once those questions begin to emerge, it becomes difficult to look at the audience in quite the same way again.

That's why I've become increasingly interested in the questions audience measurements create.

Not because questions are more important than answers.

Because better questions are often the first sign that we're finally seeing the audience more clearly.