Why you should be paying more attention to dark data

CMO of WP Engine reveals how dark data utilisation has lifted onsite engagement and can help brands improve elsewhere too


There is no shortage of marketplaces to satisfy the appetites of the most data-hungry organisations. But for some, their efforts might be better directed at utilising the data they already have right under their noses.

The 2016 Veritas Global Databerg Survey estimated as much as 85 per cent of the data generated in the world is actually ‘dark data’, which is not being utilised for deriving insights or decision-making. Other studies have suggested up to 90 per cent of data could be dark.

According to chief marketing officer at WordPress’ digital experience platform WP Engine, Mary Ellen Dugan, that means many marketers are failing to maximise the value of data assets they already own.

“With the right tools to analyse this information, you can get a far better understanding of client preferences, improve client relationships and increase revenue,” she tells CMO.

Dark data often comes in the form of logs and telemetry, and records information such as system activity or sensor input. Its uses are numerous, and in come cases are no longer uncommon, such as for analysing customer call records to better understand sentiment or preference, or understanding mobile geolocation data to serve up localised content.

Dugan says her own company is benefitting from more advanced uses cases, such as using browser usage information to engage in behavioural targeting, and performing comprehensive spend analysis by pulling data from financial and CRM systems to better understand key metrics like customer acquisition costs.

Dugan says data can become dark for many reasons, but primarily it occurs simply due to the volume of data organisations collect and the inefficiencies of technologies and systems for reading, filing and accessing it.

“It could be because the storage reservoir hasn’t marked the metadata labels appropriately, or because the data is in a format that the integrated tools can’t read and therefore cannot be retrieved by a query,” she says. “This kind of irretrievable data is commonly seen with imaging, audio and video files.

“What’s clear is as organisations’ ability to collect data exceeds their ability to analyse it, dark data will continue to explode.”

Dugan says the situation has been exacerbated by the need to often have humans manually extract and label metadata so it can be stored appropriately.

“This is an expensive, slow and unreliable process, but with the developing sophistication of deep learning technologies, dark data extraction can now be completed much faster and with a greater degree of accuracy,” she continues.

WP Engine has made use of dark data using the techniques described above to radically redesign its website, leading to an increase of 60 per cent year-on-year increase in traffic and a fourfold growth in its Agency Partner Program. The next step is seeing more of WP Engine’s clients take advantage of their hidden data assets, in line with the company’s value of being ‘customer inspired’.

Related: In depth: The art of dealing with Generation Z

“We are fundamentally interested in anything that can help businesses of all sizes to better understand their customers and grow their business online,” Dugan says. “I am a firm believer organisations can gain an immense value from learning who their customers really are, particularly for a marketing function, and any improvement in data analysis that shapes this understanding could be game-changing.”

And while harnessing dark data today might provide benefits to help propel a company beyond the performance of its peers, Dugan says in the future its utilisation may not be optional.

“As deep learning technologies advance, the ease and cost-effectiveness of analysing dark data will do so too,” she says. “At the moment, being able to harness this kind of untapped data resource stands as a competitive advantage, but it will quickly become the norm or companies will obsolesce.

“This is a data-hungry age, and it won’t be long before ignoring dark datasets will be a crippling competitive disadvantage.”

Follow CMO on Twitter: @CMOAustralia, take part in the CMO conversation on LinkedIn: CMO ANZ, join us on Facebook: https://www.facebook.com/CMOAustralia, or check us out on Google+:google.com/+CmoAu  

Join the newsletter!

Or

Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.
Show Comments

Blog Posts

How service heterogeneity is impacting engagement

Marketers have long known the importance of standardising products to assure quality and consistency. For services, however, standardisation is much more complex.

Dr Chris Baumann

Associate professor, Macquarie University

Kindness matters in business: why the nice guys finish first

A recent 1000-page Royal Commission report on misconduct in Australia’s financial sector revealed hair-raising stories of excessive commissions, rampant mis-selling and charges levied on the dead. So how do you stop a bank from misleading its customers?

Nick Liddell

Director of Consulting, The Clearing

Myer vs. David Jones: Do cyborgs win?

As two of Australia’s stalwart brands in Myer and David Jones continue their respective journeys through troubled waters, it heralds yet another sign of the shifting business environment and shift towards an experience economy.

Tom Uhlhorn

Founder and strategy director, Tiny CX

nice article

meripadhai

5 things marketers need to do to get better in buy in when presenting

Read more

International business is closely related to marketing or marketing activities carried out by the company. According to Gitman and McDani...

Eko Prasetyo Utomo X

Salesforce: The age of the marketing campaign is over

Read more

Back in 1968 Holden began an appeal to customers who have an interest in competition. It did this with the introduction of the HK GTS 32...

Ben Tate

Marketing professor: For Holden, brand nostalgia ain’t what it used to be

Read more

Your blog post is really good and informative. Thanks for taking time to provide us this useful information with us.Auto wrapping uaeADF ...

Yes Machinery

Image intelligence:10 must-see infographics for marketers

Read more

A debt of gratitude is in order for sharing this marvelous information.I have taken in numerous things from your post

digitech Classes

Lumen CMO strives to make the brand synonymous with anti-ageism

Read more

Latest Podcast

More podcasts

Sign in