70 per cent of your marketing tests should fail, says head of Data@Ogilvy

Data leader says organisations need to embrace a test-and-learn culture if they're going to make commercial success out of their data strategies

Kuba Tymula
Kuba Tymula

Marketers that aren’t constantly testing and failing 70 per cent of the time aren’t pushing hard enough to make their data-driven approach to customer engagement successful, the chief of Data@Ogilvy claims.

Speaking at the Data Strategy Symposium in the Hunter Valley, the agency’s CEO and managing director, Kuba Tymula, said the best way to achieve the ‘3Rs’ of customer-led marketing – recognise, relate and retain – is by commercialising the data an organisation has.

In order to do this, organisations need to tackle four key layers of operational change: Omni-channel customer engagement, technology, analytics and a test-and-learn culture.

The first step is ensuring a single, targeted message is delivered to consumers regardless of channel, and that recognises where they are in the customer journey, Tymula said. He claimed the problem today is that many brands are sending out different messages to customers depending on channel, or the team responsible for managing it.

“Brands need to start acting across the customer journey and pick up all the crumbs of data around that, in order to take people across that journey,” Tymula said.

In addition, most brand interactions for people come after they’ve purchased products, he said.

“Once a person becomes a positive advocate for your brand, they shouldn’t go through the consideration and evaluation purchase cycle, but instead a loyalty loop stage and a bonding stage,” he said.

Tymula advocated pulling data into 360-degree customer view, combining transaction history, service, campaign response, channel behaviour, and third-party data sources. Key to then serving the right message at right time from this data pool is analytics. Tymula said the aim needs to be to structure and analyse data in a way that closes a feedback loop.

“Every interaction should improves the next interaction,” he said.

“Be pragmatic – don’t worry about creating a Rolls Royce. A 20-year-old Corolla is going to get you from point A to point B, way faster and more successfully than building 15 per cent of a Rolls Royce.” To make data and analytics work, marketers need to have the right technology in place, such as marketing clouds and automation, to deliver in real-time and at scale, Tymula said.

“You can have the most targeted message created in the database, but if you don’t deliver on time, it won’t matter a jot,” he said. “If your emails don’t reach people at 1pm, which is the window of time you need to reach them in, that’s a problem.”

Tymula admitted the wealth of technology available to marketing makes this complicated. Even if marketers may have worked out what platforms are important to them, the CEO or CFO who sign them off, haven’t.

“You have to be super pragmatic in explaining to people what it is you’re trying to do before they agree to do anything,” he advised. “Technology really is a jigsaw puzzle. You don’t have to have the best thing out there, it needs to just work and work quickly.”

The fourth and arguably most important layer of Tymula’s data-driven methodology is getting the organisational structure right. For him, the best way of achieving this is by embracing a test-and-learn culture.

“You can have the greatest technology in the world, the best data analysts, and the best designed customer engagement strategies, but it won’t matter a bit if you don’t have the organisation right,” he claimed.

“My acid test for an organisation is a single question: How many tests did you run last week? Unless 70 per cent of all your tests are failing, you’re not pushing hard enough.

“In my experience, if you push to a point where 70 per cent of tests fail, then 20 per cent will continue getting your status score ROI, but that extra 10 per cent will make you a rock star.”

Read more:Culture and change management key to digital delivery at AGL

One of the inhibitors to a test-and-learn culture is that the people needed to make these activities happen are not sitting in the same room or city, Tymula said. They’re also not working fast enough, he claimed.

“You want to have a highly performing team that’s super-energised,” he said. “Unless you prioritise ruthlessly and based on data, you’re not going to succeed.”

A lack of prioritisation initiatives and risk averse culture are other stumbling blocks.

“No one likes failing; no one wants to tell their boss that the test they ran didn’t do that well, or that only two of 10 succeeded,” Tymula said. “That’s one message. What you could say is: ‘Those tests failed but they only cost me $2000, but those two succeeded and make a shitload of money.’”

While admitting it can take up to six months to start to see an impact from making a cultural shift in your organisation, Tymula stressed that success with data comes down to small, behavioural changes.

To illustrate the point, Tymula pointed to the ‘marginal improvement’ approach taken in 2010 by the manager and performance director of Sky Team Pro Cycling, Dave Brailsford, to improve Great Britain’s chances of success on the track. The idea was to make a 1 per cent improvement to everything that it was possible to improve, from changing pillows for athletes to swapping massage gels and reducing the weight of tyres by 12 grams. By 2012, team members had begun winning.

“Why is this important? When you take a 1 per cent gain to power of N, you start getting a geometrical curve, and more meaningful results up the curve,” Tymula said.

“This isn’t rocket science, you just need a program to make it [data success] happen. Your data might be beautiful, but if people in your organisation aren’t using it, what use is it to you?”

Tymula’s top tips for becoming commercially successful through data

  • Ruthlessly test and learn: If you’re doing things right, 70 per cent of your tests will fail.

  • Increase the expectations of the pace of execution: As Tymula points out, “packing takes as much time as you leave to perform that task”. “But if you tell people to launch 20 tests today, people will make that happen. Or if you run a hackathon, people will build a minimal viable product in 14 hours because that’s how much time they had,” he said. “Organisations need to create a sense of urgency to move faster.”

  • Create ‘war rooms’: Tymula described the right operating structure as incorporating a ‘hacker’ (data analyst and/or programmer), who defines the testing opportunity, the ‘hustler’ (marketer – the last throat to choke), who will look at this and work out the budget, relevance and approach; and the ‘hipster’ (designer, copywriter), who ensures it’s all looped together.

  • Heavy use of analytics: Everything you do must be data-driven, and analytics allow you to ascertain what will offer the best ROI.

  • Visualise data management: Use dashboards to visualise data, making it easier for the rest of the organisation to understand effectiveness.

  • Regular meetups: Run daily morning huddles and check-ins help keep teams in line.

More from Data Strategy Symposium 2014

Nadia Cameron travelled to the Data Strategy Symposium as a guest of Ashton Media

Follow CMO on Twitter: @CMOAustralia, take part in the CMO Australia conversation on LinkedIn: CMO Australia, join us on Facebook: https://www.facebook.com/CMOAustralia, or check us out on Google+: google.com/+CmoAu

Signup to CMO’s email newsletter to receive your weekly dose of targeted content for the modern marketing chief.

Join the CMO newsletter!

Error: Please check your email address.
Show Comments

Supporting Association

Blog Posts

Marketers are driving our innovation ecosystem

The Government's newly released National Innovation and Science Agenda shows that for economic growth to continue within Australia, an 'innovation ecosystem' must be fostered, where new businesses with new ideas are encouraged to grow and flourish. With every company wanting to increase, retain or improve their customers’ experiences, this makes marketing vital to fuelling Australia's ideas boom.

Lee Tonitto

CEO, Australian Marketing Institute

Putting experience design and strategy in the spotlight

​A few years ago, there was lots of chatter about the elusive UX unicorn; a mythical person capable of delivering everything from research to design to development. It became an obsession for the industry, sparking debate about whether this was the metaphor for how unreasonable our expectations of designers had become, while some felt it was what all designers should be aspiring to.

Tracy Brown

Experience design strategy director, DT

Making sense of artificial intelligence

When new trends and technologies burst onto the marketing scene, there’s always a frantic effort to either keep up or provide guidance, especially when serious amounts of money are involved. It happened with social media, it happened with personalisation and big data, and it’s happening now with artificial intelligence.

Phil Whitehouse

Asia-Pacific innovation lead, DigitasLB

Martech will definitely make everything better especially when it comes to marketing and sales. Any business not comfortable with it shou...

TapAnalytics

Marketo’s CEO talks martech industry consolidation and his enterprise customer ambitions

Read more

You can also try this leads to revenue calculator tool (it's free): https://www.strategic-ic.co.uk...

Fes Askari

​The dangers of misaligning your marketing budget with business goals

Read more

“We wanted to provide was a way for a customer to have a seamless experience as they went across channels,” Marrocco added. “So if your c...

Sarah

​Telstra’s mission to match the offline experience with online customer service

Read more

You have the right to know what happened that made AI possible, after all these years.I discovered and patented statistics on unstructure...

Ilya Geller

Making sense artificial intelligence - Food for thought - CMO Australia

Read more

I hope this trickles down to job opportunities and more analytics based careers on the government.

Ale Xandra

Australian Open details data analytics improvements driving digital fan engagement

Read more

Latest Podcast

More podcasts

Sign in