• About Us
    • New York
  • Work
  • Capabilities
  • Careers
  • Technology
  • Blog
  • Contact Us
  • About Us
    • New York
  • Work
  • Capabilities
  • Careers
  • Technology
  • Blog
  • Contact Us
April 04, 2016

Google’s Causal Impact: Part 1 – Intro

Posted by Preston Smith

Incrementality. It’s one of the toughest things to tackle in digital analytics. “How many incremental conversions did that branding campaign drive?” “How many additional clicks did we drive by implementing that new Adwords feature?”

The most common solution is a simple lift analysis: calculate the difference between the average conversions before and after the intervention. This method falls short of the mark because it assumes all differences between performance before and after the interaction are due strictly to that interaction. Seasonality is something that can throw a wrench into this plan. Even those that try to account for seasonality by performing the lift analysis using a forecast using the before data to the actual after data can fail to account for other business factors such as unforeseen press or promotions.

Google set out to help digital marketers with this problem. The result was the creation of the Causal Impact R package. While the inner workings are extremely complex, the overall idea is simple. You submit your response variable, conversions, clicks, etc., over time for a test and control group. (Note, this will require you to have a test group that was exposed to the interaction and a control group that wasn’t.) Causal Impact uses the control group to forecast where the test group would have ended up had the interaction not taken place. (This forecast is more accurate as the control group would have been exposed to any of the unforeseen business factors mentioned earlier.) It then calculates the cumulative difference between the forecasted and actual test group values to determine the incremental lift of the interaction.

To demonstrate, I’ll run through the simple example that Google put together and that every blog post on the package uses. We generate random dummy data and then introduce a substantial “interaction” at some point.

Default Causal Impact example. Shows actual test group against forecast, pointwise difference, and cumulative difference.

Default Causal Impact example. Shows actuals against forecast, pointwise difference, and cumulative difference.

The default plot Causal Impact spits out does a great job of showing the actual test values against the forecast, the pointwise difference between the two, and finally the cumulative difference, or the lift. This plot does a great job of visualizing what is happening in the analysis.

Causal Impact is extremely useful when trying to show incrementally. The logic behind the methodology is sound and the intuitive visualization gives analysts an easy way to explain/demonstrate the results. We have already used it for a couple of analyses and have created a Shiny app based around this package so our marketers can run this analysis whenever they want. Unfortunately, nothing is perfect. In part 2 we will take a look at one of the issues we have seen when using this tool in the real world.

analyticsdata visualizationstatistics
Previous
Next

Latest White Papers

  • Shifting Plans for 2020 & Beyond
  • Game On: How Brands Can Log Into A Diverse Multi-Billion Dollar Industry
  • What CCPA Means For Brands
  • How Google is Improving Consumer Data Privacy
  • Ways to Prepare for the Cookieless Future
  • See all White Papers

Featured Posts

  • Ad Age Names PMG #1 Best Place to Work in 2021
  • Hindsight 2020 & Looking Ahead to 2021
  • Preparing for Streaming’s Growth & The Future of TV Buying
  • MediaPost Names PMG Independent Agency of the Year
  • PMG Client Portfolio Trends During Amazon Prime Day 2020

Categories

  • Consumer Insights
  • Content
  • Creative Design
  • Data Analytics
  • Development
  • Digital TV & Video
  • Ecommerce
  • Industry News
  • Local
  • Mobile
  • Paid Search
  • PMG Culture
  • Programmatic & Display
  • SEO
  • Social Media
  • Structured Data
Fort Worth

2845 West 7th Street
Fort Worth, TX 76107

Dallas

3102 Oak Lawn Avenue
Suite 650
Dallas, TX 75219

Austin

823 Congress Avenue
Suite 800
Austin, TX 78701

London

33 Broadwick Street
London
W1F 0DQ

New York

120 East 23rd Street
New York, NY 10010

Get in touch

(817) 420 9970
info@pmg.com

Subscribe to the PMG Newsletter
© 2021 PMG Worldwide, LLC, All Rights Reserved
  • Contact
  • Privacy Policy
 Tweet
 Share
 Tweet
 Share
 Tweet
 Share
 LinkedIn
We and our partners use cookies to personalize content, analyze traffic, and deliver ads. By using our website, you agree to the use of cookies as described in our Cookie Policy.