Consider this…eBay’s “Singularity” Teradata warehouse exceeds 40 petabytes. According to eBay, the company’s data volumes are 50+ terabytes per day in new incremental data, processing 50+ petabytes
and tens of millions of queries per day, with 99.98% availability and more than 50 petabytes of online storage.
Data is valuable. Data is plentiful. Data is complex. Data is in flux. Data is fast moving. Capturing and managing data is challenging.
So, if you are a senior leader in a Fortune 2000 company. How do you structure your group to deliver effective BI, Analytics or Big Data projects? Do you have the right structure, toolset, dataset, skillset and mindset for analytics and Big Data?
Organizing for effective BI, Analytics and Big Data is becoming a hot topic in corporations. In 2012, business users are exerting significant influence over BI, Analytics and Big Data decisions, often choosing analytics and visualization platforms and products in addition to/as alternatives to traditional BI platform (reporting and visualization tools).
Interested in slicing, dicing, measuring, and analyzing data for customer and business insights?
According to a recent survey by Bloomberg, 97% of companies with revenues of more than $100 million are using some form of business analytics, up from 90% just two years ago.
While businesses have embraced the idea of fact-based decision-making, a steep learning curve remains. Only one in four organizations believes its use of business analytics has been “very effective” in helping to make decisions. Data is not just ignored but often discarded in many organizations as the business users can’t figure out how to extract signal from data noise.
Next best offer, next best action, interaction optimization, and experience optimization typically have similar architecture. Machine learning and multivariate statistical analysis are at the heart of these cutting edge Behavioral Analytics strategies. Typically firms use statistical tools for segmentation models, behavioral propensity modeling, and market basket analysis.
The bleeding edge in next best offer is increasingly around:
- Applying machine learning to find connections between product tastes and different affinity statements
- Developing low-latency algorithms that help show the right product at the right time to a customer
- Developing rich customer affinity profiles through a variety of feedback loops as well as third-party data source (e.g. Facebook user demos and taste graph)
Targeted Offer Solutions
Procurement organizations tend to swim in data. One of the most important strategies for any best-in class procurement organization is spend analytics. In conjunction with sourcing, category, contract management and purchasing, spend analytics provides a window into spend behavior to drive cost reduction and cost avoidance efforts.
As a result, we are seeing a lot of interest around Spend BI and Analytics projects. Chief Procurement Officers and other Sourcing/Procurement leaders of Global, large and even mid-market firms are increasingly focusing on spend data analytics as part of a new wave of spend rationalization projects. Read more
The core business problem that every retailer including Target is attempting to solve:
“Your loyalty cards and web application logs have captured all the activity in your stores, your Website and Mobile application. This data is priceless; for example, it not only contains the fact that a purchase has been made but also captures the thought process that went into making that purchasing decision. This session describes how you you can capitalize on this raw data to gain better insights into your customers, enhance their user experience, and make targeted recommendations.”
To provide insight into an approach…I am reposting this well written Best-in-Class Behavioral Analytics Case Study by Charles Duhigg on how Target is targeting customers using Predictive Analytics to anticipate shopper behavior.
Target was founded in 1902 and is headquartered in Minneapolis, Minnesota. Target operates over 1,750 stores in 49 states under Target and SuperTarget names. It offers general merchandise products through its Website, Target.com. The company distributes its merchandise through a network of distribution centers, as well as third parties and direct shipping. Additionally, it offers credit to guests through its branded proprietary credit cards.
Data Analytics and Influencing Pregnant Shoppers
Andrew Pole had just started working as a statistician for Target in 2002, when two colleagues from the marketing department stopped by his desk to ask an odd question: “If we wanted to figure out if a customer is pregnant, even if she didn’t want us to know, can you do that? ”
As the marketers explained to Pole new parents are a retailer’s holy grail. Most shoppers don’t buy everything they need at one store. Instead, they buy groceries at the grocery store and toys at the toy store, and they visit Target only when they need certain items they associate with Target — cleaning supplies, say, or new socks or a six-month supply of toilet paper. But Target sells everything from milk to stuffed animals to lawn furniture to electronics, so one of the company’s primary goals is convincing customers that the only store they need is Target. But it’s a tough message to get across, even with the most ingenious ad campaigns, because once consumers’ shopping habits are ingrained, it’s incredibly difficult to change them. Read more
Data-driven DNA is about having the right toolset, mindset, skillset and dataset to evolve a major brand and seize today’s omni-channel opportunities. Whether it’s retooling and retraining for the multiscreen attention economy, or introducing digital innovations that transform both retail and healthcare, P&G is bringing data into every part of its core strategies to fight for the customer.
Striving for market leadership in consumer products is a non-stop managerial quest. In the struggle for survival, the fittest win out at the expense of their rivals because they succeed in adapting themselves best to their environment.
CMOs and CIOs everywhere agree that analytics is essential to sales & marketing and that its primary purpose is to gain access to customer insight and intelligence along the market funnel – awareness, consideration, preference, purchase and loyalty.
In this posting we illustrate a best-in-class “run-the-business” with Data/Analytics Case Study at P&G. The case study demonstrates four key characteristics of data market leaders:
- A shared belief that data is a core asset that can be used to enhance operations, customer service, marketing and strategy
- More effective leverage of more data – corporate, product, channel, and customer – for faster results
Technology is only a tool, it is not the answer..!
- Support for analytics by senior managers who embrace new ideas and are willing to shift power and resources to those who make data-driven decisions
This case study of a novel construct called Business Cockpit (also called LaunchTower in the Biotech and Pharmaceutical Industry) illustrates the way Business Analytics is becoming more central in retail and CPG decision making.
Here is a quick summary of P&G Analytics program:
- Primary focus on improving management decisions at scale – did the analysis to identify time gap between information and application to decision making
- “Information and Decision Solutions” (IT) embeds over 300 analysts in leadership teams
- Over 50 “Business Suites” for executive information viewing and decision-making
- “Decision cockpits” on 50,000 desktops
- 35% of marketing budget on digital
- Real-time social media sentiment analysis for “Consumer Pulse”
- Focused on how to best apply and visualize information instead of discussion/debate about validity of data
MULTI-CHANNEL is simply having multiple channels through which you buy, market, sell, and fulfill.
CROSS-CHANNEL has the ability to see all of a customer’s information across all channels enables more personalized offers based on their brand relationship.
OMNICHANNEL weaves all the touchpoints of the products and services of the brand into a seamless fabric of all phases of the customer’s brand experience.
Which one are you?
Let’s face it – The old uni-channel retail model is dying in some cases and changing in others. E-commerce is driving nearly all retail growth. Digital customers want simple, consistent, and relevant experiences across all channels, touchpoints, mobile screens, smart watches and other devices.
Our AMEX credit card was recently compromised. Someone got hold of the card information and Petro Canada charges started to rack up. Amex spotted this suspicious pattern and immediately initiated a fraud alert thru multiple touch points.
What does your credit card company know about you? A lot…maybe more than your spouse. A study of how customers of Canadian Tire were using the company’s credit cards found that 2200 of 100,000 cardholders who used their card at drinking places missed four payments within the next 12 months. By contrast, only 530 of the cardholders who used their card at the dentist missed four payments within the next 12 months. So drinking is a predictor of credit risk.
Predictive analytics is not a fad. It’s not a trend. In a real-time world, Analytics is a core business requirement/capability. However, many organizations flounder in their efforts not because they lack analytics capability but because they lack clear objectives. So the first question is, What do you want to achieve?
Analytics so far has largely been a departmental ad hoc activity. Even at the most sophisticated corporations, data analytics is a cumbersome affair. Information accumulates in “data warehouses,” and if a user had a question about some trend, they request “data priests/analysts” to tease the answers out of their costly, fragile systems. This resulted in a situation where the analytics are done looking in the rearview mirror, hypothesis testing to find out what happened six months ago.
Today it’s possible to gather huge volumes of data and analyze it in near real-time speed. A retailer such as Macy’s that once pored over last season’s sales information could shift to looking instantly at how an e-mail coupon impacts sales in different regions. Moving to a realtime model and also building an enterprise level “shared services” model is going to be the next big wave of activity.
“Running a company is an endless quest to find out things you don’t know“
– Jeff Immelt, CEO GE
What will 2012 bring? Recently, I attended the CIO Executive Leadership Summit in Greenwich, Connecticut. I was particularly intrigued by the presentation by the new CIO of IBM, Jeanette Horan where she presented the projects she was tackling and how IBM is thinking about business analytics.
IBM is making a bet that “true leaders” will develop the capabilities required for making good and timely decisions in unpredictable and stressful environments.
IBM is adapting to this new data analytics reality by a rapid-fire acquisition strategy: Cognos, Netezza, SPSS, ILog, CoreMetrics, Algorithmics, OpenPages, Clarity Systems, Emptoris, DemandTec (for retail). IBM also has other information management assets like Watson, DB2 etc. They are building a formidable capability around the value chain: “Raw Data -> Aggregate Data -> Intelligence ->Insight -> Decisions” . They see this as a $20Bln opportunity. Read more