Why machine learning is the new BI

Get ready for artificial intelligence and automation that helps you make business decisions rather than just understanding what happened in the past.

Business intelligence has gone from static reports that tell you what happened, to interactive dashboards where you can drill into information to try and understand why it happened.

New big data sources, including Internet of Things (IoT) devices, are pushing businesses from those reactive analytics – whether you look back once a month to spot trends or once a day to check for problems – to proactive analytics that give you alerts and real-time dashboards. That makes better use of operational data, which is more useful while it’s still current, before conditions change.

“There’s a demand for real-time dashboards,” says Herain Oberoi from Microsoft’s Cortana Analytics team. “A lot of businesses want to get the pulse of their business. But dashboards show things that have already happened.”

That’s why fastest growing area is predictive and other advanced analytics, according to Gartner. Its latest Magic Quadrant for advanced analytics predicts that by 2018 more than half of all large organizations around the world will use advanced analytics (and algorithms built on them) to compete.

Advanced, predictive analytics are about calculating trends and future possibilities, predicting potential outcomes and making recommendations. That goes beyond the queries and reports in familiar BI tools like SQL Server Reporting Services, Business Objects and Tableau, to more sophisticated methods like statistics, descriptive and predictive data mining, machine learning, simulation and optimization that look for trends and patterns in the data, which is often a mix of structured and unstructured.

They’re the kind of tools that are currently used by marketing or risk analysis teams for understanding churn, customer lifetimes, cross-selling opportunities, likelihood of buying, credit scoring and fraud detection. Those users aren’t going away. “Many telcos want to get from being reactive to being proactive,” says Oberoi. “They want a system where they can say ‘tell me which of these customers, based on their customer profile and calling pattern, is going to churn’.”

But Gartner says almost every business unit is going to be interested in these tools and he agrees that matches the customers for Cortana Analytics. “The people we’re talking to are changing. I’m having a lot more dialog with line of business decision makers. We see a lot of budget moving to line of business teams.” He recently spoke with customers at Microsoft’s Convergence conference in Europe. “Of the five customers I met, at least three were line of business and two of those had a charter for driving digital transformation and their company’s innovation agenda.”

Getting things done

Predictive maintenance has got a lot of attention but there are other key uses like predicting demand and finding problems in service or product quality using anomaly detection, as well as decision support systems. Those are questions like “what might happen” and “what should I do?” says Oberoi.

“The fundamental customer challenge hasn't changed; how do I go from the data that I have, to getting some insights, to actually enabling some an action or driving something forward?” What the tools in Cortana Analytics can do is reduce the number of manual steps you have to take to get to those actions.

“The basic way to go from data to decisions is a static report that says what happened. If I'm in sales and I want to look at what my sales look like by region for the last quarter, that's my static report, and then there's some manual steps I take before I go make a decision,” he explains.

“The next piece of it is not just something happened but why it happened. My sales went down last quarter, but did they go down because my top three deals didn't go through or because my average deal size went down? How do I slice and dice the data [to find out]? So I have a dashboard with reports I can interact with to understand why something happens, and that typically reduces the numbers of manual steps before I can make a decision and take some actions. Then we get into prediction; not just after-the-fact ‘my sales went down and I know why’ but tell me beforehand, based on my forecast, that I might not make my target for the month so I can respond.”

Business automation would mean the fewest possible manual steps. Oberoi explains what that might look like.

“The final piece of it is recommendation and decision automation. Ultimately, you want to get to a place where the system is proactively informing you, not just what might happen but what you can do about it. ‘It looks like you're going to miss your forecast next week. Based on that, you have two promotions lined up and those are hooked up to your CRM system; do you want to pull those promotions forward by a week, yes or no?’ You say yes, and you have the business process and the workflow set up, fully automated, and it helps you pull that forward by a week.”

That kind of advice will often come from an intelligent assistant; in Microsoft’s case, that’s Cortana, who can already take reminders and suggest when it’s time to leave for a meeting, as well as answering questions. Oberoi thinks that’s just as useful for business tasks where a reminder could tell employees they need to send in their expense report and those questions can be about your business; “what were the biggest deals we closed last quarter?” or “which of our customers are most likely to churn in the next quarter?” or “alert me if this customer ever has a 90 percent chance of churn in the next 30 days.”

“The system knows you're going to miss your forecast next week; it also knows that one of the things that might help you hit the forecast is pulling forward the marketing promotion that's being sent out. There's no reason why Cortana wouldn't proactively reach out to you and say ‘hey George, it looks like you're going to miss your forecast for sales next week and you've got these promotions lined up. Would you like to pull them forward, or talk to the team that owns those promotions to get them to pull them forward? It's a more proactive way for the system to interact with you and a more natural way to do it.”

Intelligent advice

Whether it’s IoT, big data or analytics, companies have a lot more data to base their decisions on, and data-driven decision making sounds obvious. And the next step beyond data-driven decisions is decision support systems and even automation. Are we ready for intelligent assistants with business advice?

While a recent study of 50,000 American manufacturing organizations found that the use of data-driven decisions had almost tripled between 2005 and 2010, that was still only 30 percent of plants. And when telecom provider Colt surveyed senior IT leaders in Europe in 2015, 71 percent of them said intuition and personal experience works better for making decisions than using data (even though 76 percent of them say their intuition doesn’t always match the data they get).

More positively, Avanade’s new study of smart technologies says business leaders globally expect to be using digital assistants and automated intelligence for problem solving, analysing data, collaborating and making decisions – and they also expect them to increase revenues by more than a third. With those kinds of expectations, attitudes are also more positive; 54 percent said they’d be happy working with those systems.

Certainly, early adopters that Accenture has spoken to who are using machine learning to improve the way they manage customer service, financial resources and risk and compliance, in sales and marketing and in developing new areas of business found “significant, even exponential, business gains” in costs, revenue and customer performance, by using a mix of what Oberoi calls “perceptual intelligence” using natural language and voice biometrics, advanced analytics and business decision support .

Those gains included cutting costs up to 70 percent, increasing revenue up to 20 times by tracking buyer behaviour more quickly and getting happier customers by handling call routing more quickly and accurately, and those results might help overcome reluctance.

Getting business users involved in building these systems should also increase adoption. The demand for data scientists is larger than supply, which means companies without their own deep expertise will look to cloud services and marketplaces for analytical solutions and algorithms like the Cortana Analytics gallery, which includes tutorials and experiments as well as APIs and templates you can use to get started and then customize, plus pre-configured services for recommendations and forecasting.

“The way to best succeed in this space in to experiment fast,” says Oberoi; “to go through the search space of ideas and find things that are really interesting.” Marketplaces are a great way to get started on those experiments.

Power users (who Gartner calls “citizen data scientists”) will also pick up these tools to create their own advanced analytics, which means you’ll want a strategy for addressing analytics. You can think of them as far more sophisticated versions of the Excel macros that many business departments rely on, that are going to demand more data literacy and careful thought about the ethics of automated decisions, because of the significant impact this new, more intelligent business intelligence is going to have on your organization.

Join the newsletter!


Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.
Show Comments

Latest Videos

Launch marketing council Episode 5: Retailer and supplier

In our fifth and final episode, we delve into the relationship between retailer and supplier and how it drives and influences launch marketing strategies and success. To do that, we’re joined by Campbell Davies, group general manager of Associated Retailers Limited, and Kristin Viccars, marketing director A/NZ, Apex Tool Group. Also featured are Five by Five Global managing director, Matt Lawton, and CMO’s Nadia Cameron.

More Videos

Hi,When online retailers establish their multi channel strategy and they are using or will to use live chatbot to support their customers...

Alice Labs Pte. Ltd.

CMO's top 8 martech stories for the week - 6 May 2021

Read more

Thanks for nice information regarding Account-based Marketing. PRO IT MELBOURNE is best SEO Agency in Melbourne have a team of profession...


Cultivating engaging content in Account-based Marketing (ABM)

Read more

The best part: optimizing your site for SEO enables you to generate high traffic, and hence free B2B lead generation. This is done throug...

Sergiu Alexei

The top 6 content challenges facing B2B firms

Read more

Nowadays, when everything is being done online, it is good to know that someone is trying to make an improvement. As a company, you are o...


10 lessons Telstra has learnt through its T22 transformation

Read more

Check out tiny twig for comfy and soft organic baby clothes.

Morgan mendoza

Binge and The Iconic launch Inactivewear clothing line

Read more

Blog Posts

Getting privacy right in a first-party data world

With continued advances in marketing technology, data privacy continues to play catchup in terms of regulation, safety and use. The laws that do exist are open to interpretation and potential misuse and that has led to consumer mistrust and increasing calls for a stronger regulatory framework to protect personal information.

Furqan Wasif

Head of biddable media, Tug

​Beyond greenwashing: Why brands need to get their house in order first

Environmental, Social and (Corporate) Governance is a hot topic for brands right now. But before you start thinking about doing good, Craig Flanders says you best sort out the basics.

Craig Flanders

CEO, Spinach

​The value of collaboration: how to keep it together

Through the ages, from the fields to the factories to the office towers and now to our kitchen tables, collaboration has played a pivotal role in how we live and work. Together. We find partners, live as families, socialise in groups and work as teams. Ultimately, we rely on these collaborative structures to survive and thrive.

Rich Curtis

CEO, FutureBrand A/NZ

Sign in