TL;DR
The world of marketing measurement is complex and traditional attribution methods often fail to share the whole story. We believe that incrementality is a more reliable determiner of revenue outcomes than many attribution models. Incrementality is all about measuring the real impact of our ads – the stuff that wouldn't have happened without them. We measure incrementality in two ways:
To get started, we suggest running small experiments and begin building an understanding of how different media channels contribute to top-line revenue.
Listen, measuring marketing has never been easy and that’s coming from an agency that offers it as a service. We’re always plagued by so many questions.
And it’s not getting easier. As we see our ability to track most metrics and touch points decrease (goodbye cookies) these questions are getting harder to answer. To be totally honest, there’s really no single solution for every organization BUT it is possible to get to a place where we can make data-informed decisions for our marketing programs focusing on business outcomes and returns. That’s what we’re here to talk about today!
We define attribution as the identification and measurement of a set of user actions contributing to a desired outcome. These outcomes could include a purchase, a click, brand awareness, sign-ups, etc. Basically attribution is about assigning credit to digital marketing efforts based on a customer or prospects path to some action (typically a purchase or other high value action).
There are lots of types of attribution as you may already know but one that tends to get a whole lot of credit is last-click attribution. This is the simplest form of attribution and it’s where we assign all of the credit for a purchase to the most recent touch point. For example, if a user clicked on a Google Search Ad - and then made a purchase - 100% of the value of that purchase is attributed back to the ad.
More complex applications of attribution take other factors into account like first and last touch as well as other user actions. Some even go so far as using machine learning techniques to build complex models that can assign credit across many channels.
But all of these forms of attribution don’t really tell us what we need to know, they fail to tell us the true impact from marketing. They fail to measure incrementality - the true impact of your marketing.
Incrementality is the real meat in the attribution sandwich. It’s the value driven from your advertising program that wouldn’t have been driven without the advertising. It’s the money and exposure you earned that you wouldn’t have without your ads.
Let’s look at a simple example. A business currently generating $100k in monthly revenue starts a new advertising campaign with $20k in spend. The next month, sales increased to $160k in revenue. The incremental lift to revenue was $60k.
The difference between this lift and an attribution report can be sizable. An attribution report might say the advertising campaign drove $85k in revenue by association, even if the real lift to the business was only $60k.
The key thing to understand about attribution is that it’s assigning credit based on association. It’s correlation. Someone looked at an ad and they bought something – that’s attribution. But because of this, attribution does a poor job of explaining what CAUSED a purchase to happen. That’s why we like to turn to incrementality.
Let’s look at a quick user path example using last-click attribution:
In this example, if we used last-click attribution, 100% of the credit would be assigned to the Instagram ad for the purchase. Even multi-touch attribution would likely only see the Instagram ad (because we used two different devices) and attribute all of the value in the same way.
Is that the best way to attribute the value of this purchase? We say no. Would you have purchased the bag regardless of seeing the ad? Maybe you would, maybe you wouldn’t, but in either case, 100% of the credit shouldn’t be going to this ad. There were way more brand touch points unaccounted for.
Ok, so now that we know incrementality is the superior form of measurement, how do we find it? Well there are two common ways to measure the incremental impact of your advertising:
The precise details of each of these approaches would be a whole other blog post (which you can sign up to get straight to your mailbox if you leave your email here) but here is a brief overview of each, including pros and cons.
So now that we know why we need incrementality, and how to measure it, let’s talk about exactly how to understand and interpret this big topic. Specifically, let’s talk about how to incorporate it into your day-to-day using these four steps.
The best time to start trying to understand the incrementality of your marketing is right now. Besides, running small experiments isn’t too hard and the results might surprise you (maybe a campaign is driving 3x the value you thought it was… or maybe none at all). In any case, it’s better to know than not.
We strongly recommend starting with some experimentation even if you want to build an MMM model. You need some baseline prior understanding of incrementality to validate and calibrate those models.
Finally, try to test the biggest and most impactful questions you have first. We often recommend testing your entire digital advertising program all at once as a starting point. This will give you a good benchmark to start improving against.
Once you’ve established a baseline, you can start to test individual channels to understand what channels are driving the most value and which ones you can invest less in.
Understanding incremental impact is just one part of the puzzle - the next step is putting it into action. The simplest approach is to use your incrementality results as a multiplier for day-to-day decision making.
Let’s look at an example campaign:
Now that you better understand your incrementality, you can update your assumption about this campaign because you know it’s driving 1.43x the value of what you see in the advertising platform. This can help you make better media investment decisions on a day-to-day basis without having to wait for the results of your next test.
The success of a marketing program can’t (and probably shouldn’t) be entirely measured by quantitative data. The numbers can’t tell you everything.
Gathering qualitative information from prospects and customers can help you better understand how your marketing is being perceived and help you make strategic decisions. Asking customers how they heard about your product will often tell you a completely different story than your attribution reports. This information can help you understand word of mouth, social media impact, referrals, and more.
Besides, regularly speaking to customers and reading reviews can help you be a better overall marketer. You can use the information you gather to create more accurate messaging in both content and tone of voice.
No matter how good the metrics on your marketing campaigns look, the most important factor is how they contribute to overall business goals and outcomes (your CFO likely doesn’t care about impressions). It's possible to improve your reported marketing return on ad spend (or ROAS) without actually driving more sales. This is why, no matter how you measure your marketing, a clear focus on high level business results is imperative to keep you grounded.
Sure, attribution is great and all, but it’s not 100% reliable and it’s not necessarily measuring the real outcomes of your hard work. Implementing incrementality into your marketing measurement will help you ensure you’re driving real business results instead of padding an attribution report. This type of measurement is harder to execute, but it’s the only way that you can really know what value advertising is driving, and where to wisely invest your marketing dollars.
If you’re struggling to get a hold of your data and reporting, we can help. Check out our data & reporting page to learn how Thrive can improve (and provide clarity on) your ad spend effectiveness.