Why 'explainability' around AI is gaining ground

Robotics expert, Dr Brian Ruttenberg, shares how the concept of explaining the way machine learning makes decisions is vital as industries adopt this emerging technology

The ability for artificially intelligent (AI) systems to generate recommendations quickly from vast amounts of data is seeing them applied in tasks ranging from customer scoring to detecting the presence of melanoma.

But the way in which these systems reach their decisions is not always clear – especially when they use machine learning techniques enabling to them to autonomously improve their accuracy over time.

The inability for humans to easily understand how a machine reaches a conclusion is in part a natural consequence of the reason why machines are asked to perform these calculations in the first place – that no human mind could practically complete the same task mathematically.

But when a human being is impacted by the decision of the AI, such as failing to be approved for credit, or being excluded from receiving certain offers, the desire to understand why is understandable. And the need to understand the processes behind the decisions becomes greater still when there is potential for the machine to be reaching conclusions based on faulty or biased data that will naturally disadvantage some groups within the community.

As the principal scientist at robotics company, NextDriod, Dr Brian Ruttenberg has dedicated his working life to this concept of ‘explainability’ in AI. Speaking ahead of his appearance at his appearance at the Institute of Analytics Professional Australia (IAPA) national conference, Ruttenberg says he was inspired to investigate the concept by the rapid adoption of AI in autonomous vehicles.

“With the advent of deep learning and more computational power available the AI systems are just becoming much more complex,” Ruttenberg tells CMO. “These AI decisions have social implications. Explainability is related to the notion of fairness and accountability and transparency.”

Ruttenberg’s interest in explainability has centred on autonomous vehicles, however, he says the adoption of AI in other fields is going to place pressure on those using it to better explain how they’re employing it and why they are confident of relying on its outcomes.

Ruttenberg says marketers have also become more interested in explainability due to the rise in use of AI in customer scoring, where an AI might make recommendations to a sales person that a person is a good target for a specific offer.

“So they can be told to go look at that person, but have no indication of what causes that person to be a good target so they can go back and improve whatever processes they have,” he says.

In the US, the desire for explainability has come into sharp focus in the financial services sector, where fair lending practices dictate that lenders cannot discriminate.

“If you come up with some fancy new algorithm to decide when to extend credit, you have to show that that is not biased or racist or something like that,” Ruttenberg says. “And if you do that and it is, you’ll get sued.”

But beyond the financial penalties, another substantial potential impact is reputational damage that can flow from the use of unexplainable AI systems demonstrating bias.

Google experienced this when it was realised the first generation of its visual recognition technology identified people of African descent as gorillas. Even now, results from an MIT Media Lab study by Joy Buolamwini show the accuracy of recognition of people of African descent is often poorer than for those of European descent.

Ruttenberg’s research is focused on the concept of causality, and is seeking to understand what actually causes a neural network to change its output when it receives changes to its input. His goal is to present a chain of usability from the input to the output int terms that people can understand.

“In a bunch of industries you need this capability for a variety of reasons, and if you don’t have there are going to be some serious problems of a legal and financial nature,” he says. “It is just becoming a requirement in a sense, and people who are developing complex AI systems need to be aware of it. You don’t want to have some newfangled AI system now that is not explainable.”

Follow CMO on Twitter: @CMOAustralia, take part in the CMO conversation on LinkedIn: CMO ANZ, join us on Facebook: https://www.facebook.com/CMOAustralia, or check us out on Google+: google.com/+CmoAu 

 

Join the newsletter!

Or

Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.
Show Comments

Latest Videos

Launch marketing council Episode 5: Retailer and supplier

In our fifth and final episode, we delve into the relationship between retailer and supplier and how it drives and influences launch marketing strategies and success. To do that, we’re joined by Campbell Davies, group general manager of Associated Retailers Limited, and Kristin Viccars, marketing director A/NZ, Apex Tool Group. Also featured are Five by Five Global managing director, Matt Lawton, and CMO’s Nadia Cameron.

More Videos

The best part: optimizing your site for SEO enables you to generate high traffic, and hence free B2B lead generation. This is done throug...

Sergiu Alexei

The top 6 content challenges facing B2B firms

Read more

Nowadays, when everything is being done online, it is good to know that someone is trying to make an improvement. As a company, you are o...

Marcus

10 lessons Telstra has learnt through its T22 transformation

Read more

Check out tiny twig for comfy and soft organic baby clothes.

Morgan mendoza

Binge and The Iconic launch Inactivewear clothing line

Read more

NetSuite started out as a cloud-based provider of Enterprise Resource Planning software or as NetSuite solution provider, which companies...

talalyousaf

NetSuite to acquire Bronto's digital marketing platform for US$200m

Read more

Thanks for sharing this post, its really good information I get through this blog.CDPO Online Exam Training

Infosectrain01

3 ways Booking.com is improving its B2B marketing game

Read more

Blog Posts

Getting privacy right in a first-party data world

With continued advances in marketing technology, data privacy continues to play catchup in terms of regulation, safety and use. The laws that do exist are open to interpretation and potential misuse and that has led to consumer mistrust and increasing calls for a stronger regulatory framework to protect personal information.

Furqan Wasif

Head of biddable media, Tug

​Beyond greenwashing: Why brands need to get their house in order first

Environmental, Social and (Corporate) Governance is a hot topic for brands right now. But before you start thinking about doing good, Craig Flanders says you best sort out the basics.

Craig Flanders

CEO, Spinach

​The value of collaboration: how to keep it together

Through the ages, from the fields to the factories to the office towers and now to our kitchen tables, collaboration has played a pivotal role in how we live and work. Together. We find partners, live as families, socialise in groups and work as teams. Ultimately, we rely on these collaborative structures to survive and thrive.

Rich Curtis

CEO, FutureBrand A/NZ

Sign in