- Data-as-a-Service: Data Provisioning, Management, Lineage, Quality
- Reporting-as-a-Service: Dashboards, KPIs, Drilldowns/Aggregates…. Descriptive
- Analytics-as-a-Service: Predictive Modeling and BI… Prescriptive analytics
- Information-as-a-Service: Threshold based Alerts, Exceptions, Mobile Prompts
- Insights-as-a-Service: ML/AI based…automated learning – ambient intelligence, Next best Offer/Action
Which strategy are you implementing?
Data is valuable. Data is plentiful. Data is complex. Data is in flux. Data is fast moving. Capturing and managing data is challenging.
So, if you are a senior leader in a Fortune 2000 company. How do you structure your group to deliver effective BI, Analytics or Big Data projects? Do you have the right structure, toolset, dataset, skillset and mindset for analytics and Big Data?
Organizing for effective BI, Analytics and Big Data is becoming a hot topic in corporations. In 2012, business users are exerting significant influence over BI, Analytics and Big Data decisions, often choosing analytics and visualization platforms and products in addition to/as alternatives to traditional BI platform (reporting and visualization tools).
The goal of these appliances (engineered systems) is to help IT groups further shrink data center costs, increase system utilization and enable better application integration. All goals that CIOs everywhere continue to struggle with. CIOs now face an interesting decision matrix: Exalytics/Logic/Data systems versus traditional build from components versus hosted.
With ExaSystems, Oracle has a tremendous market advantage. Oracle owns most of the software that enterprises need today. Via acquisitions, Oracle owns the whole stack! Web tier, Middleware, Database software, Database tier, Storage tier. With Sun Microsystems it’s ideally positioned to maximize the platform capabilities. It’s easy for Oracle make its own software play nice on the Exalytics, Exalogic and Exadata platforms.
Everyone is beginning to look beyond the status quo in BI, analytics, Big Data, Cloud Computing etc to fundamentally change how they discover fresh insights, how they can make smarter decisions, profit from customer intelligence and social media, and optimize performance management.
The headache for corporations is not the technology aspects but the leadership side. Who is going to lead this effort, corral the vendors and formalize and execute a more structured program.
Who is going to lead the effort to create the right toolset, dataset, skillset and mindset necessary for success?
As BI and Analytics moves from “experiment and test” lab projects to commercial deployments, companies are going to need more leadership and program management capabilities. They need leadership that can provide strategic, expert guidance for using powerful new technologies to find patterns and correlations in data transactions, event streams, and social media.
Some firms are making moves. In insurance, AIG – Chartis Inc. unit appointed Murli Buluswar to the new post of chief science officer. This aims to enhance Chartis’ focus on analytics… he “will be responsible for establishing a world-class R&D function to help improve Chartis’ global commercial and consumer business strategies and to deliver more value for customers.” This focus on analytics involves “asking the right questions and making science-driven decisions about strategies—whether it’s related to underwriting decisions, product innovation, pricing, distribution, marketing, claims or customer experience—with the end result of improving the scope of what Chartis delivers for customers”.
As a result of where we are in the maturity cycle and to support the business units better, we are seeing a new emerging role “CIO – BI” that is dotted lined to the global CIO or a shared services leader. Let’s look at a representative job posting from GE Capital, which always seems to be a step ahead of most companies. Read more
The financial crisis of 2007–2011 is driving widespread changes in the U.S regulatory system. Dodd-Frank Act addresses “too big to fail” problem by tightening capital requirements and supervision of large financial firms and hedge funds. It also creates an “orderly liquidation authority” so the government can wind down a failing institution without market chaos.
Financial institutions will be spending billions to strengthen, streamline and automate their recordkeeping, risk management KPIs and dashboard systems. The implications on Data Retention and Archiving, Disaster Recovery and Continuity Planning have been well covered. But leveraging Business Analytics to proactively and reactively manage/monitor risk and compliance is an emerging frontier.
We believe that Business Analytics and real-time data management are poised to play a huge role in regulating the next generation of risk and compliance management in Financial Services industry (FSI). in this posting, we are going to examine the strategic and structural challenges, the dashboards and KPIs of interest that provide feedback, and what an effective execution roadmap needs to be for every organization.
Data growth curve: Terabytes -> Petabytes -> Exabytes -> Zettabytes -> Yottabytes -> Brontobytes -> Geopbytes. It is getting more interesting.
Analytical Infrastructure curve: Databases -> Datamarts -> Operational Data Stores (ODS) -> Enterprise Data Warehouses -> Data Appliances -> In-Memory Appliances -> NoSQL Databases -> Hadoop Clusters
In most enterprises, whether it’s a public or private enterprise, there is typically a mountain of data, structured and unstructured data, that contains potential insights about how to serve their customers better, how to engage with customers better and make the processes run more efficiently. Consider this:
- Online firms–including Facebook, Visa, Zynga–use Big Data technologies like Hadoop to analyze massive amounts of business transactions, machine generated and application data.
- Wall street investment banks, hedge funds, algorithmic and low latency traders are leveraging data appliances such as EMC Greenplum hardware with Hadoop software to do advanced analytics in a “massively scalable” architecture
- Retailers use HP Vertica or Cloudera analyze massive amounts of data simply, quickly and reliably, resulting in “just-in-time” business intelligence.
- New public and private “data cloud” software startups capable of handling petascale problems are emerging to create a new category – Cloudera, Hortonworks, Northscale, Splunk, Palantir, Factual, Datameer, Aster Data, TellApart.
Data is seen as a resource that can be extracted and refined and turned into something powerful. It takes a certain amount of computing power to analyze the data and pull out and use those insights. That where the new tools like Hadoop, NoSQL, In-memory analytics and other enablers come in.
What business problems are being targeted?
Why are some companies in retail, insurance, financial services and healthcare racing to position themselves in Big Data, in-memory data clouds while others don’t seem to care?
World-class companies are targeting a new set of business problems that were hard to solve before – Modeling true risk, customer churn analysis, flexible supply chains, loyalty pricing, recommendation engines, ad targeting, precision targeting, PoS transaction analysis, threat analysis, trade surveillance, search quality fine tuning, and mashups such as location + ad targeting.
To address these petascale problems an elastic/adaptive infrastructure for data warehousing and analytics capable of three things is converging:
- ability to analyze transactional, structured and unstructured data on a single platform
- low-latency in-memory or Solid State Devices (SSD) for super high volume web and real-time apps
- Scale out with low cost commodity hardware; distribute processing and workloads
As a result, a new BI and Analytics framework is emerging to support public and private cloud deployments.
The “Raw Data -> Aggregated Data -> Intelligence -> Insights -> Decisions” is a differentiating causal chain in business today. To service this “data->decision” chain a very large industry is emerging.
The Business Intelligence, Performance Management and Data Analytics is a large confusing software category with multiple sub-categories — mega-vendors (full stack, niche vendors, data discovery, visualization, data appliances, Open Source, Cloud – SaaS, Data Integration, Data Quality, Mobile BI, Services and Custom Analytics).
But the interest in BI and analytics is surging. Arnab Gupta, CEO of Opera states why analytics are taking center stage, “We live in a world where computers, not people, are in the driver’s seat. In banking, virtually 100% of the credit decisions are made by machines. In marketing, advanced algorithms determine messages, sales channels, and products for each consumer. Online, more and more volume is spurred by sophisticated recommender engines. At Amazon.com, 40% of business comes from its “other people like you bought…” program.” (Businessweek, September 29, 2009).
Here is a list of vendors who participate in this marketspace: