How this AI startup is overcoming the challenges of cultural accents

New technology for help overcome challenges with understanding individual accents could have huge implications for marketers looking to improve customer service experiences

Andrés Pérez Soderi has a joke he likes to tell when asked to describe how his company came together.

“A Russian, a Chinese and a Venezuelan walked into a bar, and they end up making software so they can understand each other,” Soderi says.

Venezuelan-born Soderi is one of the three founders of US-based artificial intelligence startup, Sanas. Together with Chinese-born co-founders, Shawn Zhang, and Russian-born, Maxim Serebryakov, and their team, he has been working to unpick the nuances of accents to make communication easier for people from different backgrounds.

That could have huge implications for any marketer who wants to improve customer experience through voice channels by helping both customers and staff be better understood.

Soderi tells CMO the true inspiration for Sanas came from the experience of a mutual friend working in a contact centre in Guatemala, whose interactions with customers were constantly hampered by their inability to understand his accent.

“This guy was one of the smartest people we knew,” Soderi says. “The fact he wasn’t able to hold down a job in a customer service centre simply because of his accent, we didn’t think was fair. And accents aren’t something you can very easily change.”

Saanas’ solution uses custom algorithms to interpret incoming speech and provide a ‘translated’ output in near-real time. This audio output can be fed directly to the contact centre agent to improve their understanding of the incoming caller. The voice of the agent can also be translated into an accent that might be more easily understood by the caller.

“We don’t neutralise accents, we fully convert them or translate them,” Soderi says. “That means we can do German to Australian, or Spanish to Hindi - you can essentially do pretty much anything.

“If you were selling fancy watches from France, your customer support and sales team could have a French accent, just for fun. So it could really be used in a tonne of different scenarios and use cases.”

The technology can also be used in conjunction with popular collaboration tools such as Zoom or Hangouts.

Soderi says it currently takes a couple of weeks to create an AI model for each new accent. While the process of accent identification is still manual, the goal is to make this automated. The company’s mission will be assisted by an injection of US$5.5 million in seed funding from investors including Human Capital, General Catalyst, Quiet Capital and DN Capital.

Early tests have indicated up to a 40 per cent improvement in understanding when the technology is deployed between two speakers from different backgrounds. Sanas will be tested across seven BPO contact centres throughout the remainder of this year, and Soderi says the company has ambitions to see the technology incorporated in as many scenarios as possible.

“The end goal of the company is to help the world understand and be understood,” Soderi says. “We want to see this technology go into customer support but also healthcare, telemedicine, education or entertainment.

“In telemedicine, you quite often have limited time and every second is very valuable. Decreasing misunderstandings and increasing the clarity of conversation to increase understanding in high pressure scenarios is an area where we see a lot of value.”

Another opportunity exists in helping smart devices better understand a more diverse range of accents, with trials showing a 15 decrease in errors rates when Sanas is applied to industry-leading automatic speech recognition devices. Soderi says there is potential to incorporate the technology into IVR systems, too.

“We have had a tonne of interest in doing that, but it takes a little bit of figuring out, because of the phone audio signal,” he continues. “It involves training models to understand that type of data, but that is totally something we are planning on doing.

“The goal is to see this integrated into every digital communication app that’s out there. We believe that this is a product that should touch the lives of pretty much everyone that speaks in an individual communication format. We’d love to help people speak and understand each other on the same terms.”

Don’t miss out on the wealth of insight and content provided by CMO A/NZ and sign up to our weekly CMO Digest newsletters and information services here.  

You can also follow CMO on Twitter: @CMOAustralia, take part in the CMO conversation on LinkedIn: CMO ANZ, follow our regular updates via CMO Australia's Linkedin company page

 

 

Join the newsletter!

Or

Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.
Show Comments
cmo-xs-promo

Latest Videos

More Videos

Focus on your customer experience not your NPS score. Fix the fucking problems and the customer support requests will go away.I currently...

Chris B

Bringing community thinking to Optus' customer service team

Read more

Nice blog!Blog is really informative , valuable.keep updating us with such amazing blogs.influencer agency in Melbourne

Rajat Kumar

Why flipping Status Quo Bias is the key to B2B marketing success

Read more

good this information are very helpful for millions of peoples customer loyalty Consultant is an important part of every business.

Tom Devid

Report: 4 ways to generate customer loyalty

Read more

Great post, thanks for sharing such a informative content.

CodeWare Limited

APAC software company brings on first VP of growth

Read more

This article highlights Gartner’s latest digital experience platforms report and how they are influencing content operations ecosystems. ...

vikram Roy

Gartner 2022 Digital Experience Platforms reveals leading vendor players

Read more

Blog Posts

From unconscious to reflective: What level of data user are you?

Using data is a hot topic right now. Leaders are realising data can no longer just be the responsibility of dedicated analysts or staff with ‘data’ in their title or role description.

Dr Selena Fisk

Data expert, author

Whose responsibility is it to set the ground rules for agency collaboration?

It’s not that your agencies don’t have your best interests at heart – most of them do. But the only way to ensure they’re 100 per cent focused on your business and not growing theirs by scope creep is by setting the guard rails for healthy agency collaboration.

Andrew Pascoe

Head of planning, Hatched

AI Ethics Part 2: Mitigating bias in our algorithms

In first part of this article series, we explored the various forms of AI bias, ways to understand and identify them. This second part will cover various tangible measures that can be undertaken to control, mitigate or remove these biases.

Kshira Saagar

Chief data officer, Latitude Financial Services

Sign in