Why this startup is helping marketers defend against the dark arts

Deep Labs chief explains how artificial intelligence is helping combat dark patterns and improving consumer judgment digitally

Since its invention, marketing has strived to influence people to do things they may not have otherwise done. Whether that is to encourage a person to buy a product they have never brought before, or switch from a preferred brand, or engage in any number of new behaviours, marketers have built a formidable skill set in changing the way people think, feel and behave.

As marketers have become more sophisticated, so too have the tools they use – most recently reflected in the use of artificial intelligence to analyse vast amounts of data and make nuanced and powerful recommendations to change behaviours.

Unfortunately, the tools available do not discriminate based on whether they are used for good or for ill, and the result has been consumers being influence into making decisions that might not be to their benefit.

For Scott Edington, CEO at San Francisco-based AI startup, Deep Labs, techniques used to steer people away from their better judgement are what he refers to as dark patterns. And they have become something he and his team are keen to protect people from.

“Ultimately what we are trying to do with our technology is, where appropriate, apply intelligent friction,” Edington tells CMO.

He defines intelligent friction as means to detect signals that might indicate a person is in danger of making a rash decision and then intercede on their behalf. Dark patterns, on the other hand, include scenarios such as when people are shamed into providing personal information they may not want to give, or where artificial scarcity is used to drive people towards a purchase sooner than they might prefer.

“What we are trying to do is figure out a way, using artificial intelligence and specifically machine learning, to try and decipher those signals, then truly understand what those signals are doing or could do to a consumer. From there, we figure out ways to mitigate their impact,” Edington says.

“What we are looking at is design features that effectively look at human psychology and figure out ways to exploit it and, in some cases, drive rash decisions or impulse buying.”

Where dark pattern combat is needed the most

Much of the company’s work has focused on protecting vulnerable people, which has seen Deep Labs focus on those who do not have mature financial or digital literacy. Another group it’s seeking to assist are people who have a high tendency towards depression, self-doubt or anxiety, and who again are highly likely to fall victim to dark patterns.

“If you understand how people can be influenced, then you can also help them and point them in a direction,” Edington says.

The techniques Deep Labs uses to steer consumers on to a better path include soft interventions such as implementing ‘cooling off’ periods, seeking additional confirmations of intentions, or distracting the user from that dark pattern.

Where Edington’s company has come to the fore has been through its ability to make inferences about consumers based on very weak digital signals and use these to match them to personas.

“Because of artificial intelligence, the ability to infer understanding of individuals is now available, so you don’t have to have to know about the last 15 years of someone’s transaction history to understand who someone is at the moment in time,” Edington says.

“By creating multidimensional profiles in effective real time, I can tell you with a high degree of predictive capability, at greater than 95 per cent, that an actor [person] at that time is most likely to want to do the following things. All of this is done using and discovering latent signals and stitching them together and being able to create a multidimensional profile.

“The challenge we all have right now is that due to the pandemic of the last two years, everything is an anomaly. The long-term profiles of who you believe ‘Scott Edington’ is has change dramatically. Even the short-term profile has shifted.”

While distracting consumers from unfortunate transactions might be anathema to some marketers, Edington says Deep Labs has found a willing customer base in the global payment ecosystem, where clients have been keen to reduce the level of chargebacks and other negative outcomes. Edington says this is achieved by identifying and reducing those interactions where consumers may believe they have been tricked into making a purchase, or do not believe they ever had made a purchase.

“Whether you are a payment network, merchant or a large bank, everyone has a vested interest in making sure you don’t have bad actors doing nefarious things. Because if you undermine the credibility of the payments ecosystem then consumers stop buying and no one wins,” Edington says.

“If you have these technologies and you understand how the bad actors and bad influencers are leveraging the technology, then you can create safety valves and mechanisms to combat them. And the good news is these techniques and methodologies, and the underlying technology, are being deployed at scale.

“Whether the consumers know it or not, I can assure that behind the scenes it is being deployed and they are making very good headway. We build solutions that help our customers be more mindful.”

Don’t miss out on the wealth of insight and content provided by CMO A/NZ and sign up to our weekly CMO Digest newsletters and information services here.  

You can also follow CMO on Twitter: @CMOAustralia, take part in the CMO conversation on LinkedIn: CMO ANZ, follow our regular updates via CMO Australia's Linkedin company page 





Join the newsletter!


Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.
Show Comments

Latest Videos

More Videos

Nice blog!Blog is really informative , valuable.keep updating us with such amazing blogs.influencer agency in Melbourne

Rajat Kumar

Why flipping Status Quo Bias is the key to B2B marketing success

Read more

good this information are very helpful for millions of peoples customer loyalty Consultant is an important part of every business.

Tom Devid

Report: 4 ways to generate customer loyalty

Read more

Great post, thanks for sharing such a informative content.

CodeWare Limited

APAC software company brings on first VP of growth

Read more

This article highlights Gartner’s latest digital experience platforms report and how they are influencing content operations ecosystems. ...

vikram Roy

Gartner 2022 Digital Experience Platforms reveals leading vendor players

Read more

What about this one FormDesigner.pro? I think it's a great platform providing a lot of options, you can collect different data and work w...

Salvador Lopez

Gartner highlights four content marketing platform players as leaders

Read more

Blog Posts

Marketing overseas? 4 ways to make your message stick

Companies encounter a variety of challenges when it comes to marketing overseas. Marketing departments often don’t know much about the business and cultural context of the international audiences they are trying to reach. Sometimes they are also unsure about what kind of marketing they should be doing.

Cynthia Dearin

Author, business strategist, advisor

From unconscious to reflective: What level of data user are you?

Using data is a hot topic right now. Leaders are realising data can no longer just be the responsibility of dedicated analysts or staff with ‘data’ in their title or role description.

Dr Selena Fisk

Data expert, author

Whose responsibility is it to set the ground rules for agency collaboration?

It’s not that your agencies don’t have your best interests at heart – most of them do. But the only way to ensure they’re 100 per cent focused on your business and not growing theirs by scope creep is by setting the guard rails for healthy agency collaboration.

Andrew Pascoe

Head of planning, Hatched

Sign in