How AI led Carsales to unexpected customer experience gains
- 28 February, 2019 07:26
An AI project aimed at improving business processes by automatically recognising and tagging thousands of images used across its sites has resulted in a host of unexpected customer experience benefits for Carsales.
During the CMO-CIO Executive Connections event in Melbourne this week, Carsales CIO, Jason Blackman, told attendees machine learning was first presented as a possible solution to the problem of tagging images during a company hackathon back in 2016.
The 22-year old, digitally native ASX-listed group operates not only in Australia but across a number of South American and Asian markets, with 1300 staff worldwide. Alongside the core classifieds business, Carsales provides software-as-a-service tools into dealerships, insurance and finance companies.
“In the initial stages, our AI project didn’t have anything to do with marketing; it was image recognition we utilise in Carsales. But it come with a major side effect, which was an improvement to customer experience on our site,” Blackman said.
The problem related to Carsales’ team of photographers, who take photos of motor vehicles and catalogue these for an image library. These images are supplied to third parties as well as used on the classifieds site. This team was taking about 6000 images per day, then taking 30 minutes per day to classify and tag up those images.
While the team made it as easy as possible to tag images, 9000 hours of labour each year was clearly still a problem. Using AI to solve it came out of a company hackathon in 2016, where a team created a proof-of-concept in three days.
“In essence, that team was able to demonstrate this AI solution to the entire company and win the hackathon. As a consequence, the business decided to invest in this area. It went to the board and got investment,” Blackman said.
Importantly, the project was positioned as a research and development activity, giving the team permission to fail. “We didn’t know what was going to come out of it,” he continued.
“We were using new technology and there were limited assets available in the cloud, so the team had to do everything from the ground up, using open source libraries. And it was created as a microservice, so it could just be plugged into process and the front line.”
Building a Cyclops
The result was ‘Cyclops 1.0’. “Essentially, what we first wanted to do was the tagging of angles,” Blackman said. “When the photographers upload photos, we’d store them and tag as a photo of the boot, front-right passenger side, and so on.”
Helpfully, Carsales had stored every image ever uploaded to its site – millions of them – giving it 10 years’ worth of data to train the AI with. The problem was the training set took 40 weeks using existing equipment to learn and then do the work.
“We moved entirely to the cloud, brought that training down to three weeks, and we’ve progressed further with incremental training sets now,” Blackman said.
As a result, AI has removed those man hours and fulfilled its mandate. Importantly, however, was the customer side effect.
“Customers are uploading 100,000s of photos per week as well. We then used the exact model and apply to every photo uploaded to the carsales website, thereby improving the user experience,” he said.
“When you choose to sell your motor vehicle, you choose in which order to upload those photos and best market your vehicle. The problem is that when you come to compare cars as a buyer, I want those photos to be in a specific order, such that I can see the boots are aligned, steering wheels, and so on.
“Using AI gave us the ability to leave the seller in control while still allowing the buyer using parts of our site to maintain control too.”
The second customer benefit came from the learnings Carsales could provide car sellers about how to improve their chances of sales success.
“This enabled us to start coming into the sell process and say ‘hey, we know we need photos of the passenger seat, odometer and boot as they’re all things that help you buy and sell your vehicle. We’re able to identify because we are tagging the photos, and could advise the customers around that element of customisation,” Blackman said.
“They were missing things that could help them sell their vehicles. We can also go down to model specific needs – certain high-end cars require certain additional photos, for example.”
Initially, Carsales experienced major problems with accuracy, a result of poorer data sources as well as some misclassification. However today, accuracy is up to 98 per cent.
“We can also crowdsource the reinforcement learning, because we’re able to push out to customers and say we think it’s X, are we right? We can then get them to narrow it down further, enabling us to continuously evolve the model for us,” Blackman said.
Another win was that the AI simply integrated via APIs and therefore slotted straight into the sell funnel. “When we get the images, we fire off, get the answer back and display to the use. That gave us an ability to deliver immediate customer impact, and create huge savings for the business,” Blackman said.
But while the AI was simple to deploy, getting to the point where Carsales could use these capabilities is a much longer story. As Blackman pointed out, back in 2012, the company had monolithic applications, was lucky to do 150 technology deployments annually, lack a unified data centre approach and wasn’t using any cloud capability. There was also the absence of an innovation culture.
Work since then to transition to a single data centre and build a cloud native approach allowed the IT team to create a microservices-based architecture. This was what enabled it to deliver AI relatively easily while still ensuring it was integrated into core platforms.
Another key ingredient has been culture. In the last six years, Carsales has reoriented to a customer-centric structure, a move that created autonomous teams responsible for specific customer segments. Each team owns the products they deliver to customers end-to-end, for example, and are accountable via team-based business metrics. Importantly, this has seen marketing sitting with technologists, allowing for more frictionless customer experiences to evolve, Blackman said.
The next stage for Carsales is how to improve user experiences through the funnel. “When you go to sell your car, one of the biggest problems is identifying your car. I guarantee half the room here couldn’t guarantee what vehicle they drive, down to the exact specifics,” Blackman claimed.
“One thing we started doing was using that learned outcome from the imagery to accurately identify the vehicle based on photos that you’ve taken. We can take your photos upfront, then use AI to accurately identify which model of that car you’re trying to sell. This ensure you don’t end up with a bad experience further down the track where a buyer turns up, thinking it’s a 2018 model but you have the 2017.”
Carsales is also looking at enhanced vehicle identification. “We’ve got a HD camera sitting on our balcony at our building in Punt Road in Melbourne, which sees 30,000 cars per day and can recognise the number plate, model of car, and frequency it travels. We can then collate this with other data we have in the business and identify a whole lot more about that car and individual,” Blackman said.
The conundrum of AI
Which is leads to what Blackman called a “conundrum with regards to AI”: Ethics.
“Just because you can, doesn’t mean you should,” he cautioned. “One of our hackathons teams picked up on this and said we could scour Facebook for our 6.5 million members active each year in Australia, identify their gender, ethnic origins, age and things like that, just from the profile photos. We canned the project pretty quickly as it’s not something we want to get into, because our moral compass is pointing in the right direction.
“Those sorts of things are where this technology can take you, and it can be quite a dark path.”
For Blackman, what will help Carsales steer the right course is focusing on things that deliver consumers a benefit. One of these is fraud detection.
“When people are buying and selling cars, there is a lot of fraud. We pride ourselves at Carsales for getting on the front foot of that and ensures no one hands over their details to a sergeant major of an oil rig off the south coast of Nigeria,” he said.
Blackman also warned AI is not a unicorn, or the answer to everything.
“The technologists as usual, always try to put in a tack with a sledgehammer and often it’s the case you don’t need AI to solve a business problem, it proves a separate set of rules of processes you need,” he said. “But AI is certainly a fantastic tool we now have on our belt and we utilise on a daily basis.”
Blackman also stressed success comes down to people. “Having a culture of innovation in your business is important because not just one team does AI. The worst possible outcome for us is to have a team in one corner doing all the cool stuff and the rest of the organisation just watched from the sidelines,” he said.
“The other thing is you need to find data solutions first and if possible, see if there are cheaper options. For us, it was about automating that repetitive work.
“And finally, the key here is to give it a crack.”