Why you should be embracing a test-and-learn culture

The concept of failing fast and often is inherent in Agile software methodologies, but can it also be applied in marketing? We investigate why CMOs need to start testing

test and learn
test and learn

Testing in digital advertising

The test-and-learn concept is embodied in the processes of many digital advertising technology and service providers. For instance, managing director for Australia at personalisation and retargeting specialists Criteo, Jeremy Crooks, says his company is responding to 15 million server requests each day, and reaching three out of four Australians every month.

“On the back of that, we are gathering a lot of information and feeding that directly back into the algorithms,” he says. “So hopefully the adverts we show the end user are fairly simplistic executions that are as relevant as possible. There is some degree of product recommendation in there as well which gives them a little bit of value extra ad as well.”

Online measurement company, Webtrends, has built a business model around offering test-and-learn services to clients that want to improve the performance of their websites.

“It is the fastest growing space for us,” says regional director, Mark Allison. “As a company we have been doing Web analytics for 20 years. The best way to use the data is to use it in real time to optimise the site.

“On average in Australia each test, across the board across all verticals, generates a 16.5 per cent lift in bottom line sales.”

Webtrends provides a test-and-learn optimisation service that can test multiple site iterations simultaneously, from small tweaks to entirely new functionality, by testing against a small sample of the overall site audience and comparing the results to a control group.

“It’s a bizarre thing, testing,” Allison says. “We might test five factors on a page, and things that we think will make a difference won’t, and things that we think won’t make much difference, do.”

Allison agrees test-and-learn is still a foreign concept for many Australian organisations – including some retailers – who prefer to launch massive redevelopments of their flagship sites with minimal user testing.

According to the head of strategy at advertising and digital media specialist Exponential, Tyler Greer, the unwillingness of some organisations to engage in test-and-learn activities may stem from an overall culture that shuns failure.

“We are in this landscape in which we have never had greater ability to understand our audience, their motivations, who they are consuming media, and yet we are very risk averse as well,” Greer says. “Social media has played a big role in that. There are two way conversations to be had. Yes there are the benefits of advocacy but then there is the risk of things going the other way.

“But risk as a concept is empowering to brands, because it builds a culture that is dynamic and nimble and intelligent and allows everyone to think about things and examine things.”

Follow CMO on Twitter: @CMOAustralia, take part in the CMO Australia conversation on LinkedIn: CMO Australia, or join us on Facebook: https://www.facebook.com/CMOAustralia

Join the newsletter!

Or

Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.
Show Comments

Latest Videos

More Videos

More Brand Posts

Blog Posts

Marketing prowess versus the enigma of the metaverse

Flash back to the classic film, Willy Wonka and the Chocolate Factory. Television-obsessed Mike insists on becoming the first person to be ‘sent by Wonkavision’, dematerialising on one end, pixel by pixel, and materialising in another space. His cinematic dreams are realised thanks to rash decisions as he is shrunken down to fit the digital universe, followed by a trip to the taffy puller to return to normal size.

Liz Miller

VP, Constellation Research

Why Excellent Leadership Begins with Vertical Growth

Why is it there is no shortage of leadership development materials, yet outstanding leadership is so rare? Despite having access to so many leadership principles, tools, systems and processes, why is it so hard to develop and improve as a leader?

Michael Bunting

Author, leadership expert

More than money talks in sports sponsorship

As a nation united by sport, brands are beginning to learn money alone won’t talk without aligned values and action. If recent events with major leagues and their players have shown us anything, it’s the next generation of athletes are standing by what they believe in – and they won’t let their values be superseded by money.

Simone Waugh

Managing Director, Publicis Queensland

Sign in