Enquiries typically fall by less than the advertising was credited with, after a delay. The difference between reported conversions and the actual drop is the number worth having.

The number nobody knows

Reporting tells you how many enquiries the advertising was involved in. It does not tell you how many of those would have arrived anyway.

Somebody who was going to phone you, who saw an advert on the way, is recorded as an advertising conversion and was not one.

Which means most businesses do not know what their advertising actually adds, only what it is credited with.

Stopping for a period is the crudest and most reliable way to find out, and it is the only method available to a business without the volume for proper testing.

What actually happens

The pattern is consistent enough to describe.

Enquiries do not stop, because referrals, repeat customers, search, your listing, and people who already knew about you continue.

They also do not stay level, and the fall is usually smaller than the reported conversion count suggested.

The fall is delayed. People in the middle of deciding continue to arrive for a week or two, so the first week looks reassuringly normal and the third does not.

And the recovery when you restart is also delayed, by roughly the same amount, which catches businesses out in the other direction.

The baseline is the useful finding

The fourth changes decisions. A campaign reporting thirty conversions that produces an actual increase of twelve has a cost per additional enquiry two and a half times what the dashboard says.

How to run it honestly

A few conditions, without which the result means nothing.

Choose a normal period, not December, not your peak, and not a month with anything unusual in it.

Stop long enough for the delay to work through, which means at least three or four weeks and preferably six.

Change nothing else at the same time: no new pages, no price changes, no push on other channels.

Count enquiries on your side, by every route including the phone, since platform reporting is precisely what you are trying to check.

And compare against the same period in previous years as well as the preceding month, so seasonality is visible.

A worked example

A firm spent steadily for two years and their reporting credited advertising with the majority of enquiries.

They stopped for six weeks in a quiet but normal stretch.

Week one was unchanged. Week two was slightly down. By week four enquiries had settled at about sixty percent of the previous level.

So the advertising was adding roughly forty percent rather than the majority, and the true cost per additional enquiry was considerably higher than the reported figure.

They restarted with a smaller budget aimed at the service where the drop had been sharpest, which turned out to be one of three they had been advertising.

Total spend fell by about a third and enquiries returned to close to the previous level, because two of the three services had been receiving credit for demand that existed anyway.

What the gap tells you

The interpretation, which differs by size of drop.

A large fall means the advertising is genuinely generating demand rather than intercepting it, which justifies the spend and possibly more.

A small fall means much of what you were paying for was arriving anyway, and the budget could be reduced or moved without losing much.

No fall at all, sustained over six weeks, means the advertising was buying visibility among people who already knew you, which is worth something and rarely worth what it costs.

Any of those is more useful than the reported figure, because it is measured on your side and does not depend on anybody's attribution model.

The cost of running the test

Worth stating plainly rather than pretending it is free.

You will lose the enquiries the advertising was genuinely producing during the period, which is the price of the information.

The campaign will also take a few weeks to return to its previous performance afterwards.

So this is worth doing when a real decision depends on it: whether to increase spend, whether to keep a supplier, whether a channel is worth continuing.

It is not worth doing annually out of curiosity, and it should be run once properly rather than repeatedly and inconclusively.

Test one thing, not everything

A refinement that reduces the cost considerably.

Rather than stopping all advertising, stop one campaign, one service, or one platform, and leave the rest running.

That isolates the contribution of the thing you are unsure about while continuing to receive the enquiries you are confident in.

It also produces a cleaner answer, since a total stop changes several variables at once and leaves you attributing the drop by guesswork.

Most businesses have one campaign they suspect is not earning its place, and that is the one to test.

The counter-case

This test is cruder than it looks and can mislead.

Advertising has effects that outlast the period it runs in, so a business that stops for six weeks may still be receiving enquiries generated by earlier spend, which understates the true fall.

Conversely, brand-building effects decay slowly, so a short stop may show less impact than a permanent one would.

For businesses with long decision periods, six weeks is not enough for the effect to appear at all, and the result will look like no impact when the impact simply has not arrived.

Treat the finding as directional rather than precise, and be more confident in a large clear difference than in a small ambiguous one.

Running it

  1. Pick a normal period, not a peak.
  2. Stop one campaign, not everything.
  3. Run it six weeks, not two.
  4. Change nothing else.
  5. Count every enquiry on your side, phone included.
  6. Compare against last year as well as last month.
  7. Restart at the previous budget.

Step three is where most attempts fail, because the first two weeks look encouraging and businesses conclude the advertising was doing nothing.

Establishing what normal looks like is covered in setting a baseline you can compare to.


Frequently asked questions

Do enquiries stop when advertising stops?

No. Referrals, repeat customers, search, and your listing continue. The fall is usually smaller than the reported conversion count suggested, and it is delayed.

Why is the fall delayed?

Because people in the middle of deciding continue to arrive for a week or two. The first week looks reassuringly normal and the third does not.

What is the useful finding?

The true increment: how many enquiries the advertising actually adds rather than is credited with. A campaign reporting thirty conversions that adds twelve has a very different real cost.

How long should I stop for?

At least three or four weeks and preferably six. Most attempts fail at two weeks, because the early period looks unchanged and businesses draw the wrong conclusion.

Should I stop everything?

No. Stop one campaign, service, or platform and leave the rest running. That isolates what you are unsure about and produces a cleaner answer.

Is the test reliable?

Directional rather than precise. Advertising has effects outlasting the period it runs in, and businesses with long decision periods may see no impact within six weeks.

West Coast Media Solutions Inc. provides web design, web development, hosting, digital marketing, and business consulting to organisations across Canada, drawing on more than twenty-five years in the field.

Not sure what your advertising adds?

Stop one campaign for six weeks in a normal month and count enquiries yourself. Two weeks will mislead you.

Start a Conversation