Latest crowdsourced guide rates top A/B testing vendors for marketers

Trustradius buyer's guide to A/B testing rates the top marketing technology platforms in this space by company size and user ratings

A new crowdsourced guide from US-based Trustradius has ranked the most popular A/B testing software platforms with marketing teams based on user recommendations, company size and adoption.

The latest report, which is based on 200 in-depth reviews with users of A/B testing tools, found the leading vendor platforms for enterprises with more than 500 employees were pure-play offerings from Monetate and Maxymiser, with average user ratings of 4.6 and 4.4 out of five, respectively.

Alongside its user ratings, Trustradius tracked adoption of A/B testing platforms among the top 10,000 enterprise websites, top 100,00 mid-size websites and the whole Internet for small business websites using Buildwith.com’s public data to determine the most popular platforms in use.

Sixty-five per cent of the enterprise customer base was found to be using Monetate, compared with 83 per cent using Maxymiser. Other strong performers in the enterprise category in terms of user ratings and adoption included Qubit, SiteSpect, and AB Tasty.

In contrast, while Optimizely and Adobe Target were commonly used platforms within enterprise-size companies (22 per cent and 79 per cent respectively), both received lower-than-average user recommendation rankings in the TrustRadius report.

The report insights are displayed in a ‘TrustMap’, or visual depiction of the products for each of the three categories based on two dimensions: The likelihood to recommend ratings by users; and adoption in that segment.

In the mid-size segment (51 to 500 employees), Optimizely led as the preferred platform with a user rating of 4.5, and was being used by 53 per cent of the 100,000 websites rated by TrustRadius. Other strong performers in this space but with smaller install bases were Maxymiser, AB Tasty and Monetate.

At the small end of town (50 or fewer employees), Unbounce, which aims exclusively at small businesses, and Visual Website Optimizer were the leading platforms with users ratings of 4.7 and 4.4, respectively. They were also among the most widely used in this segment.

Across all three segments, Google Content Experiments, a free tool offered by Google Analytics, ranked beneath all other platforms.

The Trustradius guide defines A/B or split testing, as the process of dividing Web traffic among multiple versions of a webpage, email, app or other marketing channel, and evaluating which variation performs best against a business objective or outcome.

According to report author and Trustradius research manager, Megan Headley, the existence of low-cost and easy-to-use tools has increased the practice of testing among marketers. She also pointed out many companies were using more than one testing tool.

“In general, companies are moving from having one A/B testing champion, to a team dedicated to testing, to a testing-based culture, where different business units across the organisation are involved in testing,” she noted.

The report also found 44 per cent of A/B testing software users are spending more than $10,000 per year on A/B testing software.

The A/B Testing buyer’s guide is the third such peer-based review guide launched by Trustradius. Earlier this year, the company launched a guide looking into the top marketing automation platforms based on user views and industry segment.

That guide found Oracle’s Eloqua to be the top choice for enterprises, Marketo in the mid-tier and Hubspot at the smaller end of town.

Trustradius also recently produced a buyer’s guide on digital analytics platforms, finding Adobe Analytics as the most widely used and popular platform among enterprises and mid-size companies. Top performers in small business, meanwhile, opted for StatCounter, Piwik and Google Analytics (free).

Follow CMO on Twitter: @CMOAustralia, take part in the CMO Australia conversation on LinkedIn: CMO Australia, join us on Facebook: https://www.facebook.com/CMOAustralia, or check us out on Google+: google.com/+CmoAu

Signup to CMO’s email newsletter to receive your weekly dose of targeted content for the modern marketing chief.

Join the newsletter!

Or

Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.
Show Comments

Latest Videos

Conversations over a cuppa with CMO: Craig Davis

​Leadership resilience, startups scaling up, marketing best practices, customer insights - these are just a few of the topics we manage to explore in the latest episode of Conversations over a Cuppa with CMO featuring Craig Davis.

More Videos

This article gave me a better understanding about content creation. I learned a lot like this website https://a2designlab.com/ also offer...

Ryota Miyagi

How Remedy is using digital marketing and commerce to drive conversion

Read more

JP 54, D2, and D6 EN590,JET A1 AVAILABLE ON FOB DIP AND TEST IN SELLER TANKWe Can supply Aviation Kerosene,Jet fuel (JP 54-A1,5), Diesel ...

Collins Johnson

Oath to fully acquire Yahoo7 from Seven West Media

Read more

JP54,D2, D6, JetA1 EN590Dear Buyer/ Buyer mandateWe currently have Available FOB Rotterdam/Houston for JP54,D2, D6, JetA1 with good and w...

Collins Johnson

3-pronged marketing approach for property disruptor Brickx

Read more

With a response rate of 80-90%, a well optimized chatbot is a must-have for every business. Check out this link to explore how you can en...

Drishti Khurana

How NRMA’s Arlo the Koala chatbot won over customers

Read more

Hey, With a response rate of 80-90%, a well optimized chatbot is a must-have for every business. Check out this link to explore how you c...

Drishti Khurana

7 innovative brand chatbots

Read more

Blog Posts

Life beyond the cookie: 5 steps to mapping the future of marketing measurement

​There’s no denying there’s been a whirlwind of response to the imminent demise of the third-party cookie from all parts of the industry. But as we’ve collectively come to better understand the implications, it’s clear this change is giving the digital advertising industry the opportunity to re-think digital marketing to support core industry use cases, while balancing consumer privacy.

Natalie Stanbury

Director of research, IAB Australia

Ensuring post-crisis success

The COVID-19 pandemic has exposed brands’ CX shortcomings and a lack of customer understanding. Given ongoing disruption, customer needs, wants and expectations are continually changing, also causing customers to behave in different ways. Just look at hoarding toilet paper, staple and canned food, medicinal and cleaning products.

Riccardo Pasto

senior analyst, Forrester

A few behavioural economics lesson to get your brand on top of the travel list

Understanding the core principles of Behavioural Economics will give players in the travel industry a major competitive advantage when restrictions lift and travellers begin to book again. And there are a few insights in here for the rest of the marketing community, too.

Dan Monheit

Co-founder, Hardhat

Sign in