UPDATED: Facebook admits to further reporting errors, proposes metrics overhaul

Social networking giant announces plans to increase third-party verification, bring in a new measurement council and improve transparency as it strives to overcome challenges to its metrics

Facebook has revealed a host of new errors in its metrics and reporting for advertisers and says it’s overhauling metrics processes and stepping up transparency through third-party verification in order to combat concerns.

The social networking giant came under fire a couple of months ago after disclosing it had been vastly overestimating average viewing time for video ads on its platform for two years. The metric for average time users spent watching video had been inflated by up to 80 per cent because it was only factoring in video views of more than 3 seconds.

This week, the company disclosed a fresh list of errors discovered, which stretches back to August last year. One of these is a bug discovered in page insights that overestimates organic page reach by up to 55 per cent on 28-day reporting, and 33 per cent on 7-day summaries. The bug has been live since May and would be fixed in the next few weeks, Facebook stated.

Another of the more than four errors revealed is over-reporting on time spent in articles by consumers in the Instant Articles mobile content tool by 7-8 per cent, a mistake that’s been in place since August last year. Facebook said averages had been calculated across a histogram of time spent, instead of reflecting total time spent reading an article divided by total views.

Facebook also disclosed a miscalculation in referrals in its Analytics for Apps tool, a metric which evaluates all posts produced by people via an app or website. Overall, referrals have been overstated by 6 per cent on average.

“We meant to count clicks that went directly to an app or website; however, we’ve also counted other clicks on those posts via the app or website, including clicks to view photos or video,” the company stated. “Out of the referrals we currently report, on average about 30 per cent are actually clicks to consume content on Facebook.”

As a result of the errors, Facebook said it was working to overhaul metrics reporting via a number of initiatives. Among these are increased third-party verification, and the company said it’s launching the ability to verify display impression data through third-party viewability partners including Moat, Integral Ad Science and comScore.

For publishers, Facebook is partnering with Nielsen to include Facebook video and Facebook Live viewership in Nielsen’s Digital Content Ratings.

In addition, Facebook has created a new internal review process around metrics for its product offerings, and the company said it plans to communicate regularly with clients around changes. This will include in-product definitions, through client teams, and via a metrics FYI blog.

There’s also plenty of work being done on clarifying metrics, and Facebook said more descriptive names, clarified calculations, more consistent definitions and better categorisation are among the updates coming to clients. This will be supported by its global client council and a soon-to-be-formed measurement council.

“Today we’re updating our metrics to give our partners and the industry more clarity and confidence about the insights we provide,” Facebook stated. “We know that having access to reliable metrics is important to the millions of partners who use our services to grow their businesses. As our products evolve to meet the needs of the people and businesses that use them, our metrics will also evolve.”

Interactive Advertising Bureau (IAB) Australia CEO, Vijay Solanki, said the association supported Facebook’s move towards more transparent measurement and the further adoption of third-party measurement systems and metrics.

“The Australian market has supported independent audience measurement for many years and is one of the few markets with an industry endorsed currency,” he said. “The IAB continues to work with media buyers, sellers and measurement vendors to drive independent, robust and transparent systems for the digital ecosystem.”

In a statement, the AANA said that as the single largest marketing expense for a brand owners, marketers need to be able to make and defend these investments with confidence.

"For decades, advertisers have relied upon a standard of accepted practice for traditional media that requires independent reporting and verification of their audiences and their usage patterns, which have typically been supported by all competitors in a specific media category," the statement read.

"It is this third-party verification that Facebook is currently lacking. The latest revelations by Facebook cast a cloud of doubt over how reliable Facebook's data and self-reporting is."

"Equipping advertisers to achieve transparency in the media buying ecosystem has been high on the AANA’s agenda this year as it has been with our counterparts around the globe, like the Association of National Advertisers in the US."


The AANA called on the over-riding principles of comparability and accountability to govern all players in the media ecosystem and said it's in conversations with the Association of National Advertisers in the US, the ANA, to support its efforts to encourage Facebook to accept independent verification.

"The AANA sees no reason why Facebook should not abide by the standards of independent verification and auditing that more traditional media players have signed up to for decades in order to assure advertisers of their media investments," the statement continued.


"If Facebook and others don’t move voluntarily to an independent verification, it will require the major advertisers around the world to cooperate and crack this problem and achieve independent accountability in the digital space."

ThinkTV’s CEO, Kim Portrate, meanwhile, was quick to use the discrepancies in Facebook metrics to highlight the ongoing auditing and measurement processes supporting TV as an industry.

“When it comes to advertisers and their agencies deciding where to invest their budgets and having confidence they are reaching the audience they need, TV wins hands down,”she said in a statement. “Buyers of Australian TV ad spots can invest knowing that this industry’s audience metrics have been continuously audited, independently, for 16 years - and show a daily reach of 16 million Australians.


“OzTAM’s third-party measurement panel is not only the gold standard for independence, it will also increase by 50 per cent next year, making it the largest per capita people metered market in the world.”

Follow CMO on Twitter: @CMOAustralia, take part in the CMO conversation on LinkedIn: CMO ANZ, join us on Facebook: https://www.facebook.com/CMOAustralia, or check us out on Google+:google.com/+CmoAu

Join the newsletter!

Or

Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.
Show Comments

Blog Posts

Putting the ‘human element’ back in marketing

During the recent CMO Momentum conference, Paul Mitchell shared how marketing leaders can create cultures that deliver

Paul Mitchell

Managing director, The Human Enterprise

The rise and rise of voice search

In 1982, an AT&T employee by the name of Plotzke predicted the rise of voice: “In fact, it has been predicted that, by 1990, well over half the communications dollars spent by businesses will be for products and services that include voice technologies.

Michael Jenkins

Founder and director, Shout agency

Is design thinking the answer for the next generation of marketing?

The speed and pace of change will never be slower than we’re experiencing today. So in this era of unprecedented change, how can brands meet soaring consumer expectations, stay relevant and deliver differentiated and connected experiences?

Merryn Olifent

Senior consultant, G2 Innovation

Bullshit

John Winkler

Kmart turnaround chief to exit Wesfarmers, Target

Read more

End your financial worriesAre you a business man or woman? And you are in need of an urgent loan as to start up your own business? Or do ...

lance

Kmart turnaround chief to exit Wesfarmers, Target

Read more

https://uploads.disquscdn.c... [magic school bus] KID: where are we going today MS. FRIZZLE: the zoo KID: but last week we went to SPACE ...

Germain3161

Sephora Asia details its journey to data-driven decision making

Read more

DP Apparel bietet große Auswahl Audi Rennbekleidung in Deutschland zu den besten Angeboten. Das Geschäft bietet auch qualitativ hochwerti...

DP apparel

Audi Australia gets a new CMO

Read more

this is a really great news

Vincent Mouton

Mobile-first banking startup showcases fresh brand identity

Read more

Latest Podcast

More podcasts

Sign in