How this AI startup is overcoming the challenges of cultural accents

New technology for help overcome challenges with understanding individual accents could have huge implications for marketers looking to improve customer service experiences

Andrés Pérez Soderi has a joke he likes to tell when asked to describe how his company came together.

“A Russian, a Chinese and a Venezuelan walked into a bar, and they end up making software so they can understand each other,” Soderi says.

Venezuelan-born Soderi is one of the three founders of US-based artificial intelligence startup, Sanas. Together with Chinese-born co-founders, Shawn Zhang, and Russian-born, Maxim Serebryakov, and their team, he has been working to unpick the nuances of accents to make communication easier for people from different backgrounds.

That could have huge implications for any marketer who wants to improve customer experience through voice channels by helping both customers and staff be better understood.

Soderi tells CMO the true inspiration for Sanas came from the experience of a mutual friend working in a contact centre in Guatemala, whose interactions with customers were constantly hampered by their inability to understand his accent.

“This guy was one of the smartest people we knew,” Soderi says. “The fact he wasn’t able to hold down a job in a customer service centre simply because of his accent, we didn’t think was fair. And accents aren’t something you can very easily change.”

Saanas’ solution uses custom algorithms to interpret incoming speech and provide a ‘translated’ output in near-real time. This audio output can be fed directly to the contact centre agent to improve their understanding of the incoming caller. The voice of the agent can also be translated into an accent that might be more easily understood by the caller.

“We don’t neutralise accents, we fully convert them or translate them,” Soderi says. “That means we can do German to Australian, or Spanish to Hindi - you can essentially do pretty much anything.

“If you were selling fancy watches from France, your customer support and sales team could have a French accent, just for fun. So it could really be used in a tonne of different scenarios and use cases.”

The technology can also be used in conjunction with popular collaboration tools such as Zoom or Hangouts.

Soderi says it currently takes a couple of weeks to create an AI model for each new accent. While the process of accent identification is still manual, the goal is to make this automated. The company’s mission will be assisted by an injection of US$5.5 million in seed funding from investors including Human Capital, General Catalyst, Quiet Capital and DN Capital.

Early tests have indicated up to a 40 per cent improvement in understanding when the technology is deployed between two speakers from different backgrounds. Sanas will be tested across seven BPO contact centres throughout the remainder of this year, and Soderi says the company has ambitions to see the technology incorporated in as many scenarios as possible.

“The end goal of the company is to help the world understand and be understood,” Soderi says. “We want to see this technology go into customer support but also healthcare, telemedicine, education or entertainment.

“In telemedicine, you quite often have limited time and every second is very valuable. Decreasing misunderstandings and increasing the clarity of conversation to increase understanding in high pressure scenarios is an area where we see a lot of value.”

Another opportunity exists in helping smart devices better understand a more diverse range of accents, with trials showing a 15 decrease in errors rates when Sanas is applied to industry-leading automatic speech recognition devices. Soderi says there is potential to incorporate the technology into IVR systems, too.

“We have had a tonne of interest in doing that, but it takes a little bit of figuring out, because of the phone audio signal,” he continues. “It involves training models to understand that type of data, but that is totally something we are planning on doing.

“The goal is to see this integrated into every digital communication app that’s out there. We believe that this is a product that should touch the lives of pretty much everyone that speaks in an individual communication format. We’d love to help people speak and understand each other on the same terms.”

Don’t miss out on the wealth of insight and content provided by CMO A/NZ and sign up to our weekly CMO Digest newsletters and information services here.  

You can also follow CMO on Twitter: @CMOAustralia, take part in the CMO conversation on LinkedIn: CMO ANZ, follow our regular updates via CMO Australia's Linkedin company page

 

 

Join the newsletter!

Or

Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.
Show Comments

Latest Videos

More Videos

More Brand Posts

Blog Posts

Marketing prowess versus the enigma of the metaverse

Flash back to the classic film, Willy Wonka and the Chocolate Factory. Television-obsessed Mike insists on becoming the first person to be ‘sent by Wonkavision’, dematerialising on one end, pixel by pixel, and materialising in another space. His cinematic dreams are realised thanks to rash decisions as he is shrunken down to fit the digital universe, followed by a trip to the taffy puller to return to normal size.

Liz Miller

VP, Constellation Research

Why Excellent Leadership Begins with Vertical Growth

Why is it there is no shortage of leadership development materials, yet outstanding leadership is so rare? Despite having access to so many leadership principles, tools, systems and processes, why is it so hard to develop and improve as a leader?

Michael Bunting

Author, leadership expert

More than money talks in sports sponsorship

As a nation united by sport, brands are beginning to learn money alone won’t talk without aligned values and action. If recent events with major leagues and their players have shown us anything, it’s the next generation of athletes are standing by what they believe in – and they won’t let their values be superseded by money.

Simone Waugh

Managing Director, Publicis Queensland

Sign in