Solving the digital advertising causality problem

Data-driven marketing professor and former JD business strategist science shares how an ad experimentation platform he built is helping with the conundrum of measuring digital advertising

data analytics
data analytics

One of the great benefits of digital advertising has been its inherent measurability. But while digital advertisers have a far easier time of understanding how many eyeballs are witnessing their messages, there is another conundrum that digital technology has yet to prove so adept at solving – causality.

A viewer might have seen an ad, and might have taken a subsequent action, but it doesn’t necessarily follow that one action definitely led to the other.

It’s a puzzle Harikesh Nair has devoted much of his professional life to solving, both as the Jonathan B. Lovelace Professor of Marketing at Stanford University’s Graduate School of Business, and more recently during his secondment as the chief business strategy scientist at China's second largest ecommerce company, JD.com.

Speaking ahead of his presentation at the Melbourne Business Analytics Conference, Nair described his role at JD.com where he used marketing science and applied econometrics to drive growth for the brand and its partner brands in China. It was work that saw him developing ecommerce marketing, pricing and advertising solutions for improved brand-building and monetisation.

The centrepiece, however, was his team’s work developing an external facing ad-experimentation platform, which facilitated scalable, self-serve experimentation for advertisers to evaluate and enhance their campaigns.

“There is huge frustration in the entire world of advertising and marketing that they don’t know what they are getting in return,” Nair says. “Digital advertising provides a vastly superior measurement and tracking and therefor that has been its source of success. But while measurability has improved quite dramatically compared to traditional media, there is still a huge problem in the confluence between correlation and causality.”

Nair’s first line of investigation was the randomised control trials and experiments used in drug testing. While these can be performed at scale in the digital world, he says they also present a significant opportunity cost, in terms of the lost revenue from those users who might be held in the control group.

“Experimentation can be actually costly, and to get exposure to users I have to bid and pay money,” Nair says.

Also, he says this form of experimentation could really only provide answers to behaviours based on whether the user had or had not seen the brand’s ad and could not take into account the behaviour had that same user seen a rival’s ad instead. The solution developed at JD.com was experimentation as-a-service, where JD.com used modern artificial intelligence-driven methods to minimise the cost of experimentation while learning the value of advertising.

“It is very hard to assess causality unless it is an experiment, and the experimentation has to be done by the platform,” Nair says. “If I put money into one platform as opposed to some other platform, what do I get? Can it show me that I am achieving my goals? So along with my team I built these external facing self-serve experimentation products, which are now available on JD.”

One example was JD Comparison Lift, which uses online experimentation to help advertisers discover a creative-target audience combination that provides the highest expected payoff. This is done via an algorithm that adaptively allocates traffic during the test so as to minimise the cost to the advertiser.

Building digital advertising momentum

Interestingly, while the results of these experiments have enabled some of China’s top advertisers to improve the effectiveness of their marketing effectiveness, Nair says JD has not seen any shaping of advertising spend. Instead, these capabilities have only served to increase the dollars flowing to digital platforms.

Nair says this visibility of effectiveness also increased advertisers’ acceptance of digital channels for brand building – something which until now has remained the domain of television.

“Delivery is a solved problem, and targeting is a well understood problem, so the next question is what am I getting out of this and how is it delivering on the various goals that I have, like building brands,” he says. “I think it is the next phase in the evolution of the digital advertising business.”

More on business and marketing analytics:

Follow CMO on Twitter: @CMOAustralia, take part in the CMO conversation on LinkedIn: CMO ANZ, follow our regular updates via CMO Australia's Linkedin company page, or join us on Facebook: https://www.facebook.com/CMOAustralia.    

Join the newsletter!

Or

Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.
Show Comments

Latest Videos

More Videos

Invest and earn with Coinbloc .us. Guaranteed Weekly ROI, early signals, fast withdrawals among others. I recommend Coinbloc .us as on...

Hans Jensen

Explainer: What marketers need to know about cryptocurrency

Read more

Investment decisions are a big deal, so why not get some guidance? You can day-trade cryptos, BUY and HOLD and evaluate the assets with f...

Dave Sigurd

Gartner: Digital isn't enough of a superpower for CMOs anymore

Read more

I normally don’t feel comfortable investing online but because the company I worked for downsized due to the pandemic and I was one of th...

Dave Sigurd

CMO's top 8 martech stories for the week - 9 June 2022

Read more

Investment decisions are a big deal, so why not get some guidance? You can day-trade cryptos, BUY and HOLD and evaluate the assets with f...

Dave Sigurd

Creating a marketplace for wellness

Read more

A solution for an retail industry data extraction. https://e-scraper.com/usefu...

"e-Scraper" Data Extracting

​Catchoftheday launches fee-based online shopping club

Read more

Blog Posts

2 hidden ingredients for leadership success CMOs need to know

Your success as a senior marketing professional has much in common with your success as a leader. Both marketing, and leadership activities, depend on building trust, encouraging action, and reliably fulfilling promises that have been made.

Gerard Penna

Leadership advisor, coach

How shifting economic trends are impacting digital media

Between further interest rate rises, inflation​, empty shelves, extortionate lettuce prices, supply chain issues and the barely believable events in Eastern Europe, the past six months there’s been a cacophony of environmental factors.

Kieran Reed

Senior digital manager, Alpha Digital

5 ways to turn imposter syndrome into confidence and conviction

Imposter syndrome. That feeling others will discover you are actually not as good as they expect, and at any point you will be exposed and ridiculed as a fraud. If you can relate to this, then you are not alone.

Rowena Millward

Author, consultant

Sign in