UPDATED: Facebook admits to further reporting errors, proposes metrics overhaul

Social networking giant announces plans to increase third-party verification, bring in a new measurement council and improve transparency as it strives to overcome challenges to its metrics

Facebook has revealed a host of new errors in its metrics and reporting for advertisers and says it’s overhauling metrics processes and stepping up transparency through third-party verification in order to combat concerns.

The social networking giant came under fire a couple of months ago after disclosing it had been vastly overestimating average viewing time for video ads on its platform for two years. The metric for average time users spent watching video had been inflated by up to 80 per cent because it was only factoring in video views of more than 3 seconds.

This week, the company disclosed a fresh list of errors discovered, which stretches back to August last year. One of these is a bug discovered in page insights that overestimates organic page reach by up to 55 per cent on 28-day reporting, and 33 per cent on 7-day summaries. The bug has been live since May and would be fixed in the next few weeks, Facebook stated.

Another of the more than four errors revealed is over-reporting on time spent in articles by consumers in the Instant Articles mobile content tool by 7-8 per cent, a mistake that’s been in place since August last year. Facebook said averages had been calculated across a histogram of time spent, instead of reflecting total time spent reading an article divided by total views.

Facebook also disclosed a miscalculation in referrals in its Analytics for Apps tool, a metric which evaluates all posts produced by people via an app or website. Overall, referrals have been overstated by 6 per cent on average.

“We meant to count clicks that went directly to an app or website; however, we’ve also counted other clicks on those posts via the app or website, including clicks to view photos or video,” the company stated. “Out of the referrals we currently report, on average about 30 per cent are actually clicks to consume content on Facebook.”

As a result of the errors, Facebook said it was working to overhaul metrics reporting via a number of initiatives. Among these are increased third-party verification, and the company said it’s launching the ability to verify display impression data through third-party viewability partners including Moat, Integral Ad Science and comScore.

For publishers, Facebook is partnering with Nielsen to include Facebook video and Facebook Live viewership in Nielsen’s Digital Content Ratings.

In addition, Facebook has created a new internal review process around metrics for its product offerings, and the company said it plans to communicate regularly with clients around changes. This will include in-product definitions, through client teams, and via a metrics FYI blog.

There’s also plenty of work being done on clarifying metrics, and Facebook said more descriptive names, clarified calculations, more consistent definitions and better categorisation are among the updates coming to clients. This will be supported by its global client council and a soon-to-be-formed measurement council.

“Today we’re updating our metrics to give our partners and the industry more clarity and confidence about the insights we provide,” Facebook stated. “We know that having access to reliable metrics is important to the millions of partners who use our services to grow their businesses. As our products evolve to meet the needs of the people and businesses that use them, our metrics will also evolve.”

Interactive Advertising Bureau (IAB) Australia CEO, Vijay Solanki, said the association supported Facebook’s move towards more transparent measurement and the further adoption of third-party measurement systems and metrics.

“The Australian market has supported independent audience measurement for many years and is one of the few markets with an industry endorsed currency,” he said. “The IAB continues to work with media buyers, sellers and measurement vendors to drive independent, robust and transparent systems for the digital ecosystem.”

In a statement, the AANA said that as the single largest marketing expense for a brand owners, marketers need to be able to make and defend these investments with confidence.

"For decades, advertisers have relied upon a standard of accepted practice for traditional media that requires independent reporting and verification of their audiences and their usage patterns, which have typically been supported by all competitors in a specific media category," the statement read.

"It is this third-party verification that Facebook is currently lacking. The latest revelations by Facebook cast a cloud of doubt over how reliable Facebook's data and self-reporting is."

"Equipping advertisers to achieve transparency in the media buying ecosystem has been high on the AANA’s agenda this year as it has been with our counterparts around the globe, like the Association of National Advertisers in the US."


The AANA called on the over-riding principles of comparability and accountability to govern all players in the media ecosystem and said it's in conversations with the Association of National Advertisers in the US, the ANA, to support its efforts to encourage Facebook to accept independent verification.

"The AANA sees no reason why Facebook should not abide by the standards of independent verification and auditing that more traditional media players have signed up to for decades in order to assure advertisers of their media investments," the statement continued.


"If Facebook and others don’t move voluntarily to an independent verification, it will require the major advertisers around the world to cooperate and crack this problem and achieve independent accountability in the digital space."

ThinkTV’s CEO, Kim Portrate, meanwhile, was quick to use the discrepancies in Facebook metrics to highlight the ongoing auditing and measurement processes supporting TV as an industry.

“When it comes to advertisers and their agencies deciding where to invest their budgets and having confidence they are reaching the audience they need, TV wins hands down,”she said in a statement. “Buyers of Australian TV ad spots can invest knowing that this industry’s audience metrics have been continuously audited, independently, for 16 years - and show a daily reach of 16 million Australians.


“OzTAM’s third-party measurement panel is not only the gold standard for independence, it will also increase by 50 per cent next year, making it the largest per capita people metered market in the world.”

Follow CMO on Twitter: @CMOAustralia, take part in the CMO conversation on LinkedIn: CMO ANZ, join us on Facebook: https://www.facebook.com/CMOAustralia, or check us out on Google+:google.com/+CmoAu

Join the CMO newsletter!

Error: Please check your email address.
Show Comments

Supporting Association

Blog Posts

Why 2017 will herald a resurgence of values-based marketing

It doesn’t take long for predictions to become predictable: The rise and rise of Facebook; advancements in analytics; the normalisation of chatbots; personalisation, programmatic, automation, authenticity… The prediction that’s missing from these lists is that in 2017 we will witness a resurgence of values-based marketing.

Jacqueline Burns

Founder, Market Expertise

Why customer experience driven growth is set to take off

Our overall brand perceptions are invariably shaped by our experiences. And loyal customer relationships can be severed in moments by a negative service interaction.

Consistency and conversation: How branding and advertising can work better together

Advertising and branding are two of the most visible outputs of marketing, which is why getting them right is so important. However, too often the line between branding and advertising becomes blurred. This means advertising activity can be out of sync with brand, resulting in poor results for both functions.

Dan Ratner

managing director, uberbrand

Someone needs a swift kick up the bum for such an idiotic idea.

random

​Why a degree is no longer enough to get you hired as a skilled marketer

Read more

The frequent flyer programs are the new profit machines for airlines all over the world, as they have morphed to be mass marketing machin...

Steve@iFLYflat

Velocity frequent flyers program strong performer in mixed half-year for Virgin

Read more

Hi Jennifer, thanks for sharing these info regarding the digital marketing trends.I've created a related video to this topic, would you m...

Fabio Carry

Predictions: 17 digital marketing trends for 2017

Read more

Great news. Marketing automation can be very useful for companies at various stages of development. With so many tools out there it's bet...

Ben

How HBF rolled out marketing automation in eight months

Read more

I read a report that the business sector in Australia as a whole have yet to fully harness and see the proactive change that predictive a...

Alex Martin

Report: Predictive analytics, IoT, machine learning battle it out for marketing dollars

Read more

Latest Podcast

More podcasts

Sign in