Ebay: Hadoop 'flexibility' favoured alongside Teradata for customer data analysis

Online retail giant has 'one of biggest Teradata implementations in the world'

Ebay is favouring the flexibility of NoSQL tools such as Hadoop alongside Teradata as its seeks to gain better insight into its customer data.

Speaking at the Financial Information Management (FIMA) event in London yesterday, Mark Uksusman, senior manager, data architecture at Ebay, claimed the online retailer has one of the largest implementations of Teradata in production. This includes two major Teradata clusters, one a normal data warehouse for its traditional reporting system, involving very structured data, and the other a bespoke platform, called Singularity, developed for deep analytics and data discovery.

However he said that open source data base software such as Hadoop, MongoDB and Cassandra offer more benefits for analysing data than its relational data bases.

"We are one of the biggest Teradata implementations in the world, we are processing 90PB of data," said Uksusman. "But are we optimised 100 percent? Maybe not, and maybe we need to think a bit about optimising our data warehouse and offload Teradata to Hadoop environments, which is more flexible and more developed for data discovery."

Uksusman explained that although tools such as Hadoop have clear benefits in areas such as real-time analytics, NoSQL databases are only considered for certain use cases, and would still tend towards relational databases where possible.

"I don't want to say that it is a 100 percent right solution [using non-relational data bases]. If you want to talk about secure transactions you have to ensure data governance and that your records are accurate, [for this} we are still using relational data base management system, Oracle, Teradata and so on.

"But if you are looking at something around data discovery, you would like to do some very quick processing and analyse information on the fly, and do some analysis of non-structural information, this is why NoSQL technology is there."

C-Suite gets behind digital customer engagement
Harnessing customers and content
Why customer data anlaytics is in vogue at the Specialty Fashion Group

The use of these tools is helping Ebay gain better insight into the masses of data that it generates and processes across its business. Uksusman said that, with the analysis of unstructured data such as social media feeds, this runs into many petabytes of data.

"We are not talking about terabytes any more at Ebay, not even hundreds of terabytes, we are talking about hundreds of petabytes that we are processing on different channels."

The information gained by Ebay's team of data scientists is being used to bring insights into customer behaviour, and enable predictive marketing.

This provides benefits as the company, which started trading purely as an auction site, moves into fixed price retail and attempts to tie in wider services such as its payments platform PayPal, and StubHub ticket trading.

"Right now we are doing more and more integration between the different companies. The challenge is huge because the companies already have some historic information, historic systems and data platforms, so integration is a humongous project for us."

"We would like to know if you go to StubHub or Paypal, and we would like to know if you are a customer of Ebay so we can offer you something on Ebay.com. Or, if you are a customer of Ebay, you can go to StubHub and buy tickets there."

He added: "To make sure we have a 360 degree view of our customer is very important, and big data is actually helping us to create this."

Join the newsletter!

Or

Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.
Show Comments

Latest Videos

Conversations over a cuppa with CMO: Microsoft's Pip Arthur

​In this latest episode of our conversations over a cuppa with CMO, we catch up with the delightful Pip Arthur, Microsoft Australia's chief marketing officer and communications director, to talk about thinking differently, delivering on B2B connection in the crisis, brand purpose and marketing transformation.

More Videos

Great content and well explained. Everything you need to know about Digital Design, this article has got you covered. You may also check ...

Ryota Miyagi

Why the art of human-centred design has become a vital CX tool

Read more

Interested in virtual events? If you are looking for an amazing virtual booth, this is definitely worth checking https://virtualbooth.ad...

Cecille Pabon

Report: Covid effect sees digital events on the rise long-term

Read more

Thank you so much for sharing such an informative article. It’s really impressive.Click Here & Create Status and share with family

Sanwataram

Predictions: 14 digital marketing predictions for 2021

Read more

Nice!https://www.live-radio-onli...

OmiljeniRadio RadioStanice Uzi

Google+ and Blogger cozy up with new comment system

Read more

Awesome and well written article. The examples and elements are good and valuable for all brand identity designs. Speaking of awesome, ch...

Ryota Miyagi

Why customer trust is more vital to brand survival than it's ever been

Read more

Blog Posts

A Brand for social justice

In 2020, brands did something they’d never done before: They spoke up about race.

Dipanjan Chatterjee and Xiaofeng Wang

VP and principal analyst and senior analyst, Forrester

Determining our Humanity

‘Business as unusual’ is a term my organisation has adopted to describe the professional aftermath of COVID-19 and the rest of the tragic events this year. Social distancing, perspex screens at counters and masks in all manner of situations have introduced us to a world we were never familiar with. But, as we keep being reminded, this is the new normal. This is the world we created. Yet we also have the opportunity to create something else.

Katja Forbes

Managing director of Designit, Australia and New Zealand

Should your business go back to the future?

In times of uncertainty, people gravitate towards the familiar. How can businesses capitalise on this to overcome the recessionary conditions brought on by COVID? Craig Flanders explains.

Craig Flanders

CEO, Spinach

Sign in