How Australia Post is improving test-and-learn around customer products

Australia Post brings on Bugwolf real-world testing tool to help iron out customer issues with rapid product releases

In the race to get new products and services out to customers, compromise can be inevitable. But when those compromises impact usability and customer satisfaction, any advantage gained from rapid release can quickly be lost.

Australia Post believes it has found a way to operate a rapid release cycle while maintaining strong usability. Working in conjunction with Melbourne-based testing specialists, Bugwolf, the company has decreased its testing cycle times and improved usability by accessing a pool of vetted usability testers from around the world.

“Here at Post, we are very customer-centric and absolutely care about what the customer thinks of our products and services,” said Australia Post’s general manager for digital channels and innovation, Steve Maidment. “But in the development stage of a product it is really hard to get real-world testing.”

Bugwolf works by recruiting and vetting freelance usability testers globally, who are incentivised to use the services they are testing in real-world situations. While Maidment said Australia Post continues to use traditional lab-based scripted testing, Bugwold has enabled Post to pick up usability problems that might not other surface.

“With innovation or a new feature you are really trying to tease out the unknown, and the unknown can come in many forms,” Maidment said. “What’s great about Bugwolf is it allows us to actually do testing on the glass – so on a device – and allows us to get the testing done by real users in real situations.”

One example was uncovered in its testing of the Australia Post Apple Watch application, which has been designed so that users can open parcel lockers by having the locker scan a barcode on the Watch’s screen. Testing through Bugwolf, however, revealed that tilting the user’s wrist can turn off the display, rendering the barcode key ineffective.

“We were able to recruit people who had Watches on the day it was released, and test them in real world situations,” Maidment said. “That was one example. But there were a number of things that we picked up on. We would normally have to wait a few weeks for penetration to get out there before we got feedback, but with these guys we were able to get that feedback really quickly.

“Within 24 hours we had a number of things that were surfacing that were more an issue of behaviour rather than bugs that we hadn’t seen before.”

Read more: Apple Watch: A billboard for ads on the wrist?
Apple Watch: Must-have customer app or another gimmick?

Because Bugwolf’s testers are freelance and located across multiple timezones, they will work at night and across weekends, effectively compressing the testing timeframe and ensuring products and services come to market faster.

“We get a lot larger test coverage in a smaller amount of time that we would with traditional methods,” Maidment said.

Bugwolf founder, Ash Conway, said the idea for his company’s service is an evolution of crowdsourced software testing services. Currently, Bugwolf is operated as a managed service, but in the future customers will be able to use the company’s platform to access a vetted marketplace of testers directly to run their projects.

“The advantage of our model compared to others is the speed that at which we accelerate those test cycles,” Conway claimed. “So rather than taking weeks to get back to customers with their data, we are turning these things around within a couple of days, and there is a cost benefit.”

Gamification mechanics within the service also encourage testers to try out software and services in as many different situations and platform combinations as possible.

“We can get a lot more coverage over traditional models as well,” Conway said.

The company has been operating its current model for 18 months now, and has won several clients in the UK as well as Australia. Conway said the next stage is to expand Bugwolf’s presence in the UK and US markets, and is currently seeking capital.

Follow CMO on Twitter: @CMOAustralia, take part in the CMO Australia conversation on LinkedIn: CMO Australia, join us on Facebook: https://www.facebook.com/CMOAustralia, or check us out on Google+: google.com/+CmoAu

Join the newsletter!

Or

Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.
Show Comments

Blog Posts

Building a human-curated brand

If the FANG (Facebook, Amazon, Netflix, Google) sector and their measured worth are the final argument for the successful 21st Century model, then they are beyond reproach. Fine-tuning masses of algorithms to reduce human touchpoints and deliver wild returns to investors—all with workforces infinitesimally small compared to the giants of the 20th Century—has been proven out.

Will Smith

Co-founder and head of new markets, The Plum Guide

Sustainability trends brands can expect in 2020

​Marketers have made strides this year in sustainability with the number of brands rallying behind the Not Business As Usual alliance for action against climate change being a sign of the times. While sustainability efforts have gained momentum this year, 2020 is shaping up to be the year brands are really held accountable for their work in this area.

Ben King

CSR manager & sustainability expert, Finder

The trouble with Scotty from Marketing

As a Marketer, the ‘Scotty from Marketing’ meme troubles me.

Natalie Robinson

Director of marketing and communications, Melbourne Polytechnic

It's a pretty interesting article to read. I will learn more about this company later.

Dan Bullock

40 staff and 1000 contracts affected as foodora closes its Australian operations

Read more

If you think it can benefit both consumer and seller then it would be great

Simon Bird

Why Ford is counting on the Internet of Things to drive customer engagement

Read more

It's a good idea. Customers really should control their data. Now I understand why it's important.

Elvin Huntsberry

Salesforce CMO: Modern marketers have an obligation to give customers control of their data

Read more

Instagram changes algorithms every time you get used to them. It really pisses me off. What else pisses me off? The fact that Instagram d...

Nickwood

Instagram loses the like in Australia; industry reacts positively

Read more

I tried www.analisa.io to see my Instagram Insight

Dina Rahmawati

7 marketing technology predictions for 2016

Read more

Latest Podcast

More podcasts

Sign in