How Australia Post is improving test-and-learn around customer products

Australia Post brings on Bugwolf real-world testing tool to help iron out customer issues with rapid product releases

In the race to get new products and services out to customers, compromise can be inevitable. But when those compromises impact usability and customer satisfaction, any advantage gained from rapid release can quickly be lost.

Australia Post believes it has found a way to operate a rapid release cycle while maintaining strong usability. Working in conjunction with Melbourne-based testing specialists, Bugwolf, the company has decreased its testing cycle times and improved usability by accessing a pool of vetted usability testers from around the world.

“Here at Post, we are very customer-centric and absolutely care about what the customer thinks of our products and services,” said Australia Post’s general manager for digital channels and innovation, Steve Maidment. “But in the development stage of a product it is really hard to get real-world testing.”

Bugwolf works by recruiting and vetting freelance usability testers globally, who are incentivised to use the services they are testing in real-world situations. While Maidment said Australia Post continues to use traditional lab-based scripted testing, Bugwold has enabled Post to pick up usability problems that might not other surface.

“With innovation or a new feature you are really trying to tease out the unknown, and the unknown can come in many forms,” Maidment said. “What’s great about Bugwolf is it allows us to actually do testing on the glass – so on a device – and allows us to get the testing done by real users in real situations.”

One example was uncovered in its testing of the Australia Post Apple Watch application, which has been designed so that users can open parcel lockers by having the locker scan a barcode on the Watch’s screen. Testing through Bugwolf, however, revealed that tilting the user’s wrist can turn off the display, rendering the barcode key ineffective.

“We were able to recruit people who had Watches on the day it was released, and test them in real world situations,” Maidment said. “That was one example. But there were a number of things that we picked up on. We would normally have to wait a few weeks for penetration to get out there before we got feedback, but with these guys we were able to get that feedback really quickly.

“Within 24 hours we had a number of things that were surfacing that were more an issue of behaviour rather than bugs that we hadn’t seen before.”

Read more: Apple Watch: A billboard for ads on the wrist?
Apple Watch: Must-have customer app or another gimmick?

Because Bugwolf’s testers are freelance and located across multiple timezones, they will work at night and across weekends, effectively compressing the testing timeframe and ensuring products and services come to market faster.

“We get a lot larger test coverage in a smaller amount of time that we would with traditional methods,” Maidment said.

Bugwolf founder, Ash Conway, said the idea for his company’s service is an evolution of crowdsourced software testing services. Currently, Bugwolf is operated as a managed service, but in the future customers will be able to use the company’s platform to access a vetted marketplace of testers directly to run their projects.

“The advantage of our model compared to others is the speed that at which we accelerate those test cycles,” Conway claimed. “So rather than taking weeks to get back to customers with their data, we are turning these things around within a couple of days, and there is a cost benefit.”

Gamification mechanics within the service also encourage testers to try out software and services in as many different situations and platform combinations as possible.

“We can get a lot more coverage over traditional models as well,” Conway said.

The company has been operating its current model for 18 months now, and has won several clients in the UK as well as Australia. Conway said the next stage is to expand Bugwolf’s presence in the UK and US markets, and is currently seeking capital.

Follow CMO on Twitter: @CMOAustralia, take part in the CMO Australia conversation on LinkedIn: CMO Australia, join us on Facebook:, or check us out on Google+:

Join the CMO newsletter!

Error: Please check your email address.
Show Comments

Supporting Association

Blog Posts

People in vegan houses shouldn't throw bacon

Picture this. You’re at a Gourmerican burger joint chomping a cheeseburger, when an outspoken vegan friend starts preaching that you’re killing the planet. Last week, that same vegan downed a pricey glass of pinot before their flight to a far-flung destination, armed with their strongest mossie repellant and first aid kit. Anything amiss?

Abbie Love

Strategist, Ikon Communications

The role of the CMO is evolving: Are you keeping up?

My (amazing) vacation in the Galapagos Islands earlier in the year got me thinking about Charles Darwin and his theory of evolution. What does this have to do with the role of today’s CMO, you ask? Plenty.

Sheryl Pattek

Vice-president, executive partner

Getting your business ready for the Entrepreneurial Consumer

We all know the digital revolution has completely transformed the way consumers are interacting with brands, and that a lot of businesses are finding it hard to catch up. One way to closing this brand gap is to understand consumer behaviour and build a brand experience that meets these new needs.

Pip Stocks

CEO and founder, BrandHook

Or just go to sites like www.shopsthatshiptoaustralia.c... and others and be sure that the stores will send to where you live :-)


Why online shopping is like dating – RedBalloon CEO

Read more

Personalisation is the key. Customers demand a very relatable and well defined CX where the sincerity and understanding of their disposit...

Hitesh Parekh

In pictures: Improving cutomer experiences through smart personalisation

Read more

Thanks for this. The key for me is the effective of governance where it dictates and sets the proactive policy when it comes to CX. Tech ...

Hitesh Parekh

6 lessons in modern marketing from a customer experience chief

Read more

Very well said “With today’s consumers more demanding of the brands and merchants they shop, it’s imperative for merchants to not just co...


CMO's top 10 martech stories for this week - 29 September

Read more

Very interesting article which touches on the importance of a feedback loop fuelled by customer and market insights. Ideally this scenari...

Andrew Reid

Building customer insights in the data and digital age

Read more

Latest Podcast

More podcasts

Sign in