Tomoro Agency
SITE LOADING
How to Calculate Marketing Incrementality

How to Calculate Marketing Incrementality

A channel can look highly efficient while adding almost nothing to your sales. Branded search may capture demand created elsewhere. Retargeting may claim customers who were already on their way to buy. And a campaign launched during a strong trading period can take credit for growth it did not cause.

That is why knowing how to calculate marketing incrementality matters. It moves the conversation from attribution – who touched the customer last – to causality: what additional revenue, leads or profit happened because marketing ran? For marketing leaders under pressure to defend investment, that distinction is the difference between reporting activity and proving commercial impact.

What marketing incrementality actually measures

Marketing incrementality is the additional outcome generated by an activity compared with what would have happened without it. The missing alternative is called the counterfactual. You cannot observe it directly, so you create the fairest possible comparison through a test or statistical method.

Incrementality is not the same as platform-attributed conversions. Platforms use their own tracking windows, modelling and rules for assigning credit. Several channels can claim the same sale. An incrementality study asks a more demanding question: if we had not spent this money, would the outcome have materially changed?

The answer can be uncomfortable. A campaign with excellent reported return on ad spend might mostly be harvesting existing demand. Equally, a brand campaign that looks weak in click-through reporting may create meaningful future demand that lower-funnel channels later capture. Neither result is a failure if it leads to a better allocation of budget.

How to calculate marketing incrementality

At its simplest, the calculation compares the outcome for an exposed group with the outcome for a comparable unexposed control group.

Incremental outcomes = outcomes in the test group – expected outcomes without the activity

When test and control groups are genuinely comparable, expected outcomes without the activity can be represented by the control group’s outcome rate.

Incrementality rate = (test conversion rate – control conversion rate) / test conversion rate

Suppose 100,000 people are eligible to see a paid social campaign. You randomly hold back 10,000 people and expose 90,000. The exposed group records a 4.0% conversion rate. The holdout records 3.2%.

The campaign’s lift is 0.8 percentage points. Applied to the 90,000 exposed people, the estimated incremental conversions are 720:

90,000 x (4.0% – 3.2%) = 720

If the campaign generated 3,600 conversions in platform reporting, only 720 are estimated to be incremental. That gives an incrementality rate of 20%:

(4.0% – 3.2%) / 4.0% = 20%

From there, calculate the commercial measures that matter. Incremental revenue equals incremental conversions multiplied by average order value. Incremental profit should account for gross margin, discounts, fulfilment and returns, not just revenue. Incremental cost per acquisition is media spend divided by incremental conversions. This is often much higher than the platform CPA – and far more useful.

Start with the decision, not the data

The right test depends on what you need to decide. Are you deciding whether to keep funding paid search? Whether a new creative platform is creating demand? Whether regional investment should scale? Or whether a promotion shifts behaviour rather than simply bringing purchases forward?

Set one primary commercial outcome before the campaign starts. For an ecommerce business, this may be new-customer revenue or contribution margin. For a B2B business, it could be qualified pipeline, opportunities created or revenue closed over an agreed period. Avoid making a soft engagement metric the final measure when the investment is expected to drive sales.

Then define the audience, geography or time period that could reasonably have received the activity. A test only works if the control group is meaningfully protected from exposure. If your holdout audience still sees the campaign through another account, publisher or organic amplification, the result will understate impact.

Choose a test design that fits reality

A randomised holdout test is the cleanest option when your channels and data allow it. Split eligible customers or prospects randomly into test and control groups, withhold activity from the control group, then compare outcomes over the same period. This works especially well in CRM, paid social and display activity where audience-level suppression is possible.

For broad-reach media, regional testing is often more practical. Select matched locations, run activity in test regions and withhold it in controls. The challenge is matching areas with similar historic sales patterns, customer mix, seasonality and competitor pressure. A London versus North East comparison, for example, is unlikely to tell you much without careful adjustment.

A difference-in-differences approach improves a geographic or account-based test by comparing the change over time in test areas against the change over time in control areas. If test-region sales rise by 12% while control-region sales rise by 5%, the estimated incremental lift is closer to 7% than 12%.

For large national campaigns where a clean holdout is impossible, marketing mix modelling can estimate incremental contribution across channels using historic spend, sales and external factors. It is valuable for strategic budget allocation, but it is not a shortcut. The model needs enough variation in spend, reliable data and experienced interpretation. It is best used alongside experiments, not as an excuse to stop testing.

Make the comparison credible

The formula is simple. The credibility is not. Weak incrementality measurement usually fails because the test and control groups were never comparable, or because the test was too small to separate signal from normal variation.

Before launching, check historic conversion rates, revenue, customer value and seasonality across groups. Decide the minimum effect worth detecting and use this to calculate a sensible sample size and test duration. A small result from a tiny test is not evidence that marketing has no effect. It may only mean the study was underpowered.

Run the test long enough to capture the expected buying cycle. A seven-day assessment may be reasonable for a low-consideration product; it is inadequate for a considered B2B purchase or a campaign designed to influence future demand. At the same time, do not let a test run indefinitely while pricing, stock, website performance or competitor activity changes around it.

Keep as much else as possible consistent. Different offers, landing pages, sales-team follow-up or stock availability can distort the comparison. Record major external events, including promotions, PR activity, product launches and weather where relevant. Good measurement is not about pretending the market is controlled. It is about understanding what could have influenced the result.

Read the result without fooling yourself

A positive lift is not automatically a scale signal. Ask whether the lift is statistically credible and commercially worthwhile. A 3% incremental increase might be real but still fail to cover media costs. Conversely, a campaign with modest immediate sales lift may be worth retaining if it brings in high-value new customers who repeat.

Look at new and existing customers separately where possible. Retention activity can be profitable, but it should not be presented as acquisition. Consider payback period too. If customer value develops over six months, judging the programme only on first-order revenue can lead you to cut activity that is genuinely building profitable growth.

Be equally careful with negative or flat results. They may indicate wasted spend, a weak proposition, poor creative, insufficient reach or a test design problem. Incrementality tells you whether the activity changed the outcome. It does not, by itself, diagnose why. That requires bringing brand strategy, creative quality, channel mechanics and customer insight into the same conversation.

Use incrementality to improve the whole marketing system

The strongest teams do not run one test, publish a slide and move on. They build an evidence base. Test incrementality by channel, audience, creative approach, offer, frequency and market. Keep a record of the assumptions, design and results so that the next decision starts from knowledge rather than opinion.

This is where brand clarity has a direct performance role. A distinctive proposition and consistent creative can increase response across channels, but they may not show up in last-click reporting. Measuring incremental demand gives brand investment a fairer commercial test while exposing activity that merely chases people already convinced.

Marketing deserves more than a dashboard full of claimed conversions. Build a credible counterfactual, calculate the additional value created, and let that evidence decide what earns the next pound of budget.

Leave a Reply

Your email address will not be published.