Beware of AI inherent biases and take steps to correct them

Training data key to overcoming artificial intelligence biasm say Salesforce executives during Dreamforce conference

Artificial intelligence (AI) is only as good as the training data it is fed, and we must be aware of in-built bias as we move into a future where AI becomes increasingly relied on, said experts at the Dreamforce conference last week.

Salesforce architect, ethical AI practice leader, Kathy Baxter, and chief scientist, Richard Socher, led a discussion on the ethical implications of AI, and stressed education for those who use AI is key so that inbuilt societal biases are not magnified by technology.

Socher said AI has been a field of application and research for a long time, but only in the last 5-10 years has it crossed a threshold where accuracy is so high, with computer vision and natural language processing (NLP), that humanity can now use it in lots of applications.

“The things we can do in one year now were impossible for entire teams of people over years not that long ago,” he said. “However, now it’s working, we do need to think about the ethical implications of its use. We just had breakthrough research results a single model that solves 10 different NLP casting everything inside NLP, but generally for AI, the algorithms are all quite different.”

In June this year, Salesforce announced the Natural Language Decathlon (decaNLP), which makes it possible for a single model to tackle 10 different NLP tasks all at once and eliminates the need to build and train individual models for each problem. It spans question answering, machine translation, summarisation, natural language inference, sentiment analysis, semantic role labelling, relation extraction, goal-oriented dialogue, database query generation, and pronoun resolution. Until now, traditional approaches would require a hyper-customised architecture for each task.

But this is as close as humanity is to developing a generalised AI algorithm. What this means is different AI algorithms solve different issues, and there is not one generalised AI that does multiple tasks. In fact, unlike popular belief, scientists are not even at the stage to be able to predict the steps required to achieve on ‘overall’ AI, or Artificial General Intelligence, he said.

“Artificial general intelligence is a while off, and is a distraction to the actual ethical implications of what we do have,” he said.

Baxter believed technology should be in service of the human, not the other way around, and said it’s important to remember as we rush to implement AI in service and marketing that it is a dual-use technology, meaning it can have both good and bad use cases.

“AI can do so much good, but it can have the potential to unknowingly case harm and this occurs mostly in the training data it is fed. We can’t expect AI to erase the bias that is baked into our society and the data of the systems we use to make these predictions and recommendations,” she said.

“There are many proxies in the data that can be used to discriminate, such as gender or ethnicity. We need to identify the proxies that can be used for bias and then clean up the training data to create recommendations and predictions that represent the world as we want, not the world as it is.”

Socher went on to explain that within AI, there are supervised and unsupervised algorithms, and the majority of the breakthroughs we have seen are through supervised machine learning algorithms. 

“The training data maps a certain input to a certain output. When you train an AI to do this, it will use thousands of examples as it learns to do this on its own. If the data you use is biased, the AI will put up the bias and amplify it, or at least keep it going," he said. “We have to educate our clients that the AI is only as good as the training data you feed it.”

Baxter agreed, saying bias is error. "We want to ensure each person is given equal opportunity, and to do this we need to be scruitable to understand what is happening in the decision making process."

Both went on to discuss how AI in marketing will create more jobs, including different kinds of jobs, that we cannot even imagine 10 years from now.

“AI can help target people better and find the right opportunities so people don’t bothered by things they aren’t interested in. That can open up whole new kinds of jobs that don’t exist right now. It’s hard to predict the impacts technology like AI will have more than five years into the future,” Socher said.

Baxter said marketers should look at AI as a way not to decrease the workforce, but to make it more efficient, to create those moments of delight for customers.

“AI can turn people into super humans and maximise their potential and makes them feel more competent when they are dealing with customers," she said.

"But the quality of the training data really matters. At Salesforce, we help customer see and understand their data so they can identify bias and error and correct it for better outcomes for everybody.”  

Socher said when implementing AI, it is vital to keep a ‘beginner’s mind’ because the technology is not perfect, just like humans are not perfect.

“For example, voice generation and speech recognition uses more male voices, so we know the default will work less well for women. What that means is AI is not perfect, it is not 100 per cent, and sometime data is genuinely ambiguous. As you’re rolling out AI make sure you have feedback loops so you can improve the AI over time.

“It’s important to keep a beginners’ mind. Ensure you have those feedback loops in your AI systems, making sure there’s a person there to escalate service concerns from a bot. In general, as any organisation rolls out AI, they have to be aware of the implications it can have.”  

More of CMO's coverage of the power of AI:

-Vanessa Mitchell travelled to Dreamforce as a guest of Salesforce.

Follow CMO on Twitter: @CMOAustralia, take part in the CMO conversation on LinkedIn: CMO ANZ, join us on Facebook: https://www.facebook.com/CMOAustralia, or check us out on Google+:google.com/+CmoAu

 

 

Join the newsletter!

Or

Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.
Show Comments

Latest Videos

Conversations over a cuppa with CMO: Microsoft's Pip Arthur

​In this latest episode of our conversations over a cuppa with CMO, we catch up with the delightful Pip Arthur, Microsoft Australia's chief marketing officer and communications director, to talk about thinking differently, delivering on B2B connection in the crisis, brand purpose and marketing transformation.

More Videos

Hey there! Very interesting article, thank you for your input! I found particularly interesting the part where you mentioned that certain...

Martin Valovič

Companies don’t have policies to disrupt traditional business models: Forrester’s McQuivey

Read more

I too am regularly surprised at how little care a large swathe of consumers take over the sharing and use of their personal data. As a m...

Catherine Stenson

Have customers really changed? - Marketing edge - CMO Australia

Read more

The biggest concern is the lack of awareness among marketers and the most important thing is the transparency and consent.

Joe Hawks

Data privacy 2021: What should be front and centre for the CMO right now

Read more

Thanks for giving these awesome suggestions. It's very in-depth and informative!sell property online

Joe Hawks

The new rules of Millennial marketing in 2021

Read more

In these tough times finding an earning opportunity that can be weaved into your lifestyle is hard. Doordash fits the bill nicely until y...

Fred Lawrence

DoorDash launches in Australia

Read more

Blog Posts

Highlights of 2020 deliver necessity for Circular Economies

The lessons emerging from a year like 2020 are what make the highlights, not necessarily what we gained. One of these is renewed emphasis on sustainability, and by this, I mean complete circular sustainability.

Katja Forbes

Managing director of Designit, Australia and New Zealand

Have customers really changed?

The past 12 months have been a confronting time for marketers, with each week seemingly bringing a new challenge. Some of the more notable impacts have been customer-centric, driven by shifting priorities, new consumption habits and expectation transfer.

Emilie Tan

Marketing strategist, Alpha Digital

Cultivating engaging content in Account-based Marketing (ABM)

ABM has been the buzzword in digital marketing for a while now, but I feel many companies are yet to really harness its power. The most important elements of ABM are to: Identify the right accounts; listen to these tracked accounts; and hyper-personalise your content to these accounts to truly engage them. It’s this third step where most companies struggle.

Joana Inch

Co-founder and head of digital, Hat Media Australia

Sign in