How many data scientists does the world really need?

For many smaller and mid-sized firms, the hype surrounding Big Data doesn't resonate, and probably won't translate into hiring

The tech media buzz surrounding Big Data suggests that organizations should invest huge sums into hiring and retaining highly skilled (and highly paid) data scientists. But you might not want to submit that graduate school application just yet.

In reality, most firms will address their Big Data challenges by leveraging data analytics technology and training employees they already have to turn big data into smart data.

Small Businesses, Big Data

For many smaller and mid-sized firms, the hype surrounding big data doesn't resonate, and probably won't translate into hiring, because the challenges those businesses face aren't truly related to Big Data, says Tim Herbert, director of research at CompTIA.

"A lot of companies don't actually have Big Data problems -- they have smaller challenges," Herbert says. Many of these data challenges crop up between IT and other departments such as marketing, finance, and business operations, as SMBs uncover their true business objectives and figure out how to make raw data into actionable intelligence, he says.

"While they need to find ways to take their business data and translate that into business intelligence, most of these SMBs are looking at data analytics and technologies like Hadoop and realizing they don't need anything as huge, powerful and scalable," Herbert says.

CompTIA's second annual "Big Data Insights and Opportunities"study, released last month, shows that many of these SMBs will instead invest in training and education for their existing employees rather than hire a formally trained data scientist.

"Hiring these costly, highly trained, highly educated data scientists just isn't practical for most businesses, so they'll put their money into what resources they already have," Herbert says.

In most cases, Herbert says, CompTIA's study found that most SMBs will rely on existing business analysts and financial analysts, though these folks will need additional technical training, he says.

In many businesses, this is already happening. According to the study, sales and research departments saw their participation in big data-related initiatives climb from 17 percent and 13 percent, respectively, to 27 percent and 25 percent.

Based on these numbers, it seems Big Data already is moving from its niche in the IT department and into many other business units and departments, Herbert says, but that's just the tip of the proverbial iceberg.

"Most companies may not realize that they have to first invest in making sure their data's in a format that can best be analyzed to derive value," Herbert says. "Finding the technology to do that is the easy part -- it's finding and nurturing the analytical talent and expertise that's hard, and that will take some more time," he says.

Large Enterprises, Larger Data Challenges

Initially, says Roger Gaskell, CTO of Kognitio, the demand for data scientists will be higher at larger enterprises as these organizations try and squeeze every last drop of value out of their data and their sophisticated business intelligence solutions.

Most large enterprises, looking for a competitive edge, will jump at the chance to hire folks who can use the data they've collected to try predicting the future of the markets, sales cycles and trends, and customer behavior rather than just react to what's happened, Gaskell says.

"If you want some predictive analytics, you're going to need to hire a few of these data scientists, but whole armies? That'll be too expensive," Gaskell says. Instead, enterprises will find ways to train business and financial analysts, as well as the 'average business user' to perform data analytics using automated tools.

"The feedback we're getting from customers is that they want just a handful -- maybe three, or five, or seven -- skilled and highly educated data scientists," says Michael Hiskey, Kognitio's vice president of business development and marketing.

Then, enterprises will surround those with business analysts, then surround those folks with a group of interns," Hiskey says. Kognitio itself has seen great success with such a hierarchy that it calls the Kognitio Analytics Center of Excellence (KACE), he says.

Big Data Reality vs. the Hype

For now, it seems, the rush to mint highly trained, highly educated data scientists can be chalked up hype and buzz, especially since the IT industry is still in beginning stages of big data usage and relevance, according to Ankur Gupta, head of global sales and marketing at MetaScale, a Hadoop solutions provider.

"Sure, enterprises are looking for folks with a statistical and predictive modeling background that can dig deep into data, understand trends and how to spot them, but they also have to have the patience to wait until trends and activity become clear," Gupta says.

"Right now, we see a trend toward companies wanting and needing that human touch, the expertise to parse data and use it to make decisions. But we're in the early stage of big data development, and as technology catches up, we believe that companies will offload these functions to machines, software, to technology. You don't need to hire ten data scientists to do the job," Gupta says.

Sharon Florentine covers IT careers and data center topics for CIO.com. Follow Sharon on Twitter @MyShar0na. Email her at sflorentine@cio.com. Follow everything from CIO.com on Twitter @CIOonline, Facebook, Google + and LinkedIn.

Read more about careers in CIO's Careers Drilldown.

Join the newsletter!

Or

Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.
Show Comments

Latest Videos

Conversations over a cuppa with CMO: ABC's Leisa Bacon

In this episode of Conversations over a Cuppa with CMO, ABC's director of audiences, Leisa Bacon, shares how she's navigated the COVID-19 crisis, the milestones and adaptability it's ushered in, and what sustained lessons there are for marketers as we start to recover.

More Videos

Very insightful. Executive leaders can let middle managers decide on the best course of action for the business and once these plans are ...

Abi TCA

CMOs: Let middle managers lead radical innovation

Read more

One failing brand tying up with another failing brand!

Realist

Binge and The Iconic launch Inactivewear clothing line

Read more

I am 56 years old and was diagnosed with Parkinson's disease after four years of decreasing mobility to the point of having family dress ...

Nancy Tunick

The personal digital approach that's helping Vision RT ride out the crisis

Read more

I am 57 and diagnosed in June 2009. I had a very long list of symptoms, some of which were. Keeping right arm close to my side while walk...

Nancy Tunick

Gartner survey: CMO spending hit by COVID-19

Read more

Audible did such a great job on their marketing and at the same time, there are no false promises. The support, quality, variety all good...

Vitaliy Lano

Audible's brand plan to build the value of audiobooks

Read more

Blog Posts

MYOD Dataset: Building a DAM

In my first article in this MYOD [Make Your Organisation Data-Driven] series, I articulated a one-line approach to successfully injecting data into your organisation’s DNA: Using a Dataset -> Skillset -> Mindset framework. This will take your people and processes on a journey to data actualisation.

Kshira Saagar

Group director of data science, Global Fashion Group

Business quiet? Now is the time to review your owned assets

For businesses and advertiser categories currently experiencing a slowdown in consumer activity, now is the optimal time to get started on projects that have been of high importance, but low urgency.

Olia Krivtchoun

CX discipline leader, Spark Foundry

Bottoms up: Lockdown lessons for an inverted marketing world

The effects of the coronavirus slammed the brakes on retail sales in pubs, clubs and restaurants. Fever-Tree’s Australia GM Andy Gaunt explains what they have learnt from some tricky months of trading

Andy Gaunt

General manager, Fever-Tree Australia and New Zealand

Sign in