How Australia Post is improving test-and-learn around customer products

Australia Post brings on Bugwolf real-world testing tool to help iron out customer issues with rapid product releases

In the race to get new products and services out to customers, compromise can be inevitable. But when those compromises impact usability and customer satisfaction, any advantage gained from rapid release can quickly be lost.

Australia Post believes it has found a way to operate a rapid release cycle while maintaining strong usability. Working in conjunction with Melbourne-based testing specialists, Bugwolf, the company has decreased its testing cycle times and improved usability by accessing a pool of vetted usability testers from around the world.

“Here at Post, we are very customer-centric and absolutely care about what the customer thinks of our products and services,” said Australia Post’s general manager for digital channels and innovation, Steve Maidment. “But in the development stage of a product it is really hard to get real-world testing.”

Bugwolf works by recruiting and vetting freelance usability testers globally, who are incentivised to use the services they are testing in real-world situations. While Maidment said Australia Post continues to use traditional lab-based scripted testing, Bugwold has enabled Post to pick up usability problems that might not other surface.

“With innovation or a new feature you are really trying to tease out the unknown, and the unknown can come in many forms,” Maidment said. “What’s great about Bugwolf is it allows us to actually do testing on the glass – so on a device – and allows us to get the testing done by real users in real situations.”

One example was uncovered in its testing of the Australia Post Apple Watch application, which has been designed so that users can open parcel lockers by having the locker scan a barcode on the Watch’s screen. Testing through Bugwolf, however, revealed that tilting the user’s wrist can turn off the display, rendering the barcode key ineffective.

“We were able to recruit people who had Watches on the day it was released, and test them in real world situations,” Maidment said. “That was one example. But there were a number of things that we picked up on. We would normally have to wait a few weeks for penetration to get out there before we got feedback, but with these guys we were able to get that feedback really quickly.

“Within 24 hours we had a number of things that were surfacing that were more an issue of behaviour rather than bugs that we hadn’t seen before.”

Read more: Apple Watch: A billboard for ads on the wrist?
Apple Watch: Must-have customer app or another gimmick?

Because Bugwolf’s testers are freelance and located across multiple timezones, they will work at night and across weekends, effectively compressing the testing timeframe and ensuring products and services come to market faster.

“We get a lot larger test coverage in a smaller amount of time that we would with traditional methods,” Maidment said.

Bugwolf founder, Ash Conway, said the idea for his company’s service is an evolution of crowdsourced software testing services. Currently, Bugwolf is operated as a managed service, but in the future customers will be able to use the company’s platform to access a vetted marketplace of testers directly to run their projects.

“The advantage of our model compared to others is the speed that at which we accelerate those test cycles,” Conway claimed. “So rather than taking weeks to get back to customers with their data, we are turning these things around within a couple of days, and there is a cost benefit.”

Gamification mechanics within the service also encourage testers to try out software and services in as many different situations and platform combinations as possible.

“We can get a lot more coverage over traditional models as well,” Conway said.

The company has been operating its current model for 18 months now, and has won several clients in the UK as well as Australia. Conway said the next stage is to expand Bugwolf’s presence in the UK and US markets, and is currently seeking capital.

Follow CMO on Twitter: @CMOAustralia, take part in the CMO Australia conversation on LinkedIn: CMO Australia, join us on Facebook: https://www.facebook.com/CMOAustralia, or check us out on Google+: google.com/+CmoAu

Join the newsletter!

Or

Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.
Show Comments

Blog Posts

5 cornerstones of a strong digital culture

Creating a strong company culture may sound like a daunting task, but it’s actually pretty straightforward. In fact, company culture is created in exactly the same fashion as a religion or democracy. Behaviours created from the organisation’s inception are reinforced over time by leadership, attracting like-minded people and eventually reaching critical mass to become an accepted ‘truth’.

Anthony Stevens

Founder and CEO, Digital Asset Ventures

Should you rebuild your company’s tech stack in blockchain?

The question I get asked most regularly these days is: ‘Do I need to rebuild my company’s systems on Blockchain?’ And the answer, every time, is ‘No, you’re asking the wrong question’.

Michelle O'Keeffe

CEO, Engaging.io

Customer value proposition: Getting the brand promise to your customers right

Throughout my career, I have witnessed a litany of brand names that profess to have a unique customer value proposition (CVP). In reality, however, they’ve had little more than a ‘value proposition’: A simple list of benefits applied to a general audience.

Ric Navarro

Global director of marketing and communications, Norman, Disney & Young

RE: Sales and marketing SLAs, often the choke point isn't the teams but them getting the data into the tools they want to use with the da...

Ed Fry

Why sales and marketing alignment is more important than ever

Read more

Amazing article Mitchell. I really enjoyed the read. Chatbots will be critical in the future evolution of banking and financial services ...

Giridhar Prathap Reddy

7 businesses successfully implementing chatbots

Read more

Thank you for the good and very helpful information. It is very interesting. I love all the things you share and see your beautiful creat...

รัตนาวดี ภูมิวรรณ

Former eHarmony marketing chief joins telco startup

Read more

Colin Kaepernick, not Mike Kapernick.

thisisw

Zenith's innovation leader: Mid-digital age not benefitting media, brands or consumers

Read more

AGA KHAN HOSPITAL is in need of kidney donors for the sum of 2 crore, Contact us today if you want to sell your kidney for money, and thi...

Sebastian Friedrich

Mindshare gets behind blockchain advertising alliance

Read more

Latest Podcast

More podcasts

Sign in