Welcome!

@DXWorldExpo Authors: Liz McMillan, Pat Romanski, Elizabeth White, William Schmarzo, Kevin Benedict

Related Topics: @DXWorldExpo, @CloudExpo, Cloud Security

@DXWorldExpo: Article

Analytics Strategies | @CloudExpo #BigData #Analytics #IoT #M2M #CIO

New approaches and technologies deliver the ease-of-use and agility that business users want

Three "Housekeeping" Trends Impacting Big Data and Analytics Strategies

As the Big Data marketplace moves closer to a point of mass-maturity, business leaders have begun to take new approaches to implementation and utilization. Advanced analytics solutions have made their way into a range of industries and regions, and companies that successfully align these investments with core goals and requirements will enjoy more progressive improvements to operational sustainability, intelligence and general performance.

However, there is some housekeeping that must be addressed as organizations embark on Big Data and analytics initiatives. Data preparation, information governance and security are three fundamental elements of effective analytics strategies, yet, ironically, each has been largely ignored by many organizations in the rush to realize the promise of Big Data.

1. Data Preparation
Business intelligence and Big Data analytics tools have fundamentally transformed the way organizations operate. Business leaders across industries now use Big Data analytics technology for a wide range of processes, objectives and management needs. But while the technology is there, studies have shown that return on investment has been elusive at best for the vast majority of adopters. In fact, business analysts claim that 80 percent1 of their time is spent preparing data for analysis, and they still never seem to have the information they need.

Self-service data preparation is a critical, yet often overlooked, factor in the analytics process. Anyone can easily connect to relational data, CSV and other standard, structured data. But often the data that provides the most analytical value is locked away in multi-structured or unstructured documents, and it seems impossible to use this information without rekeying the data, or asking IT for help. And with the volumes of data being created each day in various locations and formats, business users and data analysts don't have time to wait for a specialist to create and run a report, or to grapple with IT to gain only limited access to data repositories.

Business users (AKA non-IT experts) must be able to quickly and easily access all types of data - including information from multi-structured and unstructured sources, such as PDFs, text reports and Web pages, as well as real-time streaming data - across a variety of internal and external sources. Self-service data preparation technology can play a pivotal role in this endeavor by enabling users to extract, cleanse, prepare and blend this otherwise unworkable data, transforming it into high-value information for solving business problems. Data experts are liberated to spend the majority of their time on analysis instead of data preparation.

2. Information Governance
Many organizations today are also struggling to reconcile information governance with strong analytics performance. One of the biggest benefits of self-service analytics lies in the ability to rapidly combine and analyze data from a variety of sources. However, this can sometimes introduce serious governance challenges, given that half of this data typically comes from sources that aren't managed by IT.

While most organizations have well-defined strategies for governing data that lives in managed systems, like enterprise applications or data warehouses, analysts often need to pull data from non-managed sources, like CSV or text extracts from transactional systems, personal spreadsheets, third-party reports or semi-structured content. Without proper governance, this can create big headaches around version control, data breaches, reconciliation, auditing, etc.

As Big Data becomes a more central aspect of corporate strategy, organizations must take important steps toward optimal information governance, and then tailor their initiatives, policies and strategies to adapt to the world of advanced analytics. When governance comes off the rails due to an advanced analytics project or any other reason, the chances of maintaining tight control over information and privacy while simultaneously enjoying high returns on Big Data investments will be inherently lower.

3. Security
For all of the benefits Big Data provides, many professionals - especially in IT - remain fearful about the security issues it poses. And you can't blame them. IT departments are on the front lines, tasked with a never-ending battle to mitigate risks introduced by Big Data's volume, velocity and variety. Additionally, advanced analytics tools and responsibilities are still somewhat new in the context of modern business intelligence solutions, causing many firms to struggle when searching for the right balance between protection, privacy, transparency and return on investment.

Introducing data masking approaches as part of the data preparation process is a great first step in protecting sensitive information. However, more work needs to be done to ensure that the deployment of wide-reaching Big Data programs is both profitable and positive, rather than representative of much greater risks to information integrity and security. The goal is to get more out of analytics investments without bolstering risk levels.

A New Era in Big Data and Analytics
The importance of security and information governance on Big Data and analytics implementations is clear, so why have many organizations failed to give them the attention they deserve? The answer is simple: they have historically impeded business processes and prevented business users and data analysts from doing their jobs effectively. But self-service data preparation has changed this, and made data discovery and advanced analytics winning propositions for both end users and IT.

The age of self-service analytics dawned years ago, after data and sources became so locked down by IT that users lost their ability to access a wide breadth of data for visualization and analysis. To get immediate results, analysts began resorting to the sources that were generally available to them, namely Excel. And once they started showcasing the insights that could be developed from such a small amount of valuable data, the self-service analytics movement took off. So much so, that the desire to leverage Excel data for immediate business value became far more important than taking the time to track what data sources were available, who was accessing them, and how information was being repurposed and changed to support analytics processes. It was the "Wild West" of the data world. No one knew where data was coming from or who was managing it. Information was floating around without auditing or classification. And security and governance were neglected because they slowed down analysts' ability to do their jobs.

Today, there's a new sheriff in town - self-service data preparation, which is now being recognized as the answer to the Big Data security and governance challenge, and a necessary component of any data discovery or advanced analytics implementation. Self-service data preparation not only drastically reduces the time and effort analysts spend on prep work, but it enables them to leverage the widest variety of sources while keeping these corporate assets protected.

In today's Big Data and analytics landscape, business users can now be autonomous without causing disorder, and companies can best leverage their intelligence investments while proactively mitigating threats. New approaches and technologies deliver the ease-of-use and agility that business users want as well as the scalability, automation and control IT demands. It's time to address security, governance and data preparation head on. Companies can no longer afford to sweep these three housekeeping items under the rug.

1. Forrester Blog, 3 Ways Data Preparation Tools Help You Get Ahead Of Big Data, February 2015: http://ibm.biz/Bd4DJm

More Stories By Dan Potter

Dan Potter is chief marketing officer at Datawatch Corporation. Prior to Datawatch, he held senior roles at IBM, Oracle, Progress and Attunity where he was responsible for identifying and launching solutions across a variety of markets including data analytics, cloud computing, real-time data streaming, federated data and e-commerce.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@BigDataExpo Stories
Continuous Delivery makes it possible to exploit findings of cognitive psychology and neuroscience to increase the productivity and happiness of our teams. In his session at 22nd Cloud Expo | DXWorld Expo, Daniel Jones, CTO of EngineerBetter, will answer: How can we improve willpower and decrease technical debt? Is the present bias real? How can we turn it to our advantage? Can you increase a team’s effective IQ? How do DevOps & Product Teams increase empathy, and what impact does empath...
SYS-CON Events announced today that Evatronix will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Evatronix SA offers comprehensive solutions in the design and implementation of electronic systems, in CAD / CAM deployment, and also is a designer and manufacturer of advanced 3D scanners for professional applications.
SYS-CON Events announced today that Synametrics Technologies will exhibit at SYS-CON's 22nd International Cloud Expo®, which will take place on June 5-7, 2018, at the Javits Center in New York, NY. Synametrics Technologies is a privately held company based in Plainsboro, New Jersey that has been providing solutions for the developer community since 1997. Based on the success of its initial product offerings such as WinSQL, Xeams, SynaMan and Syncrify, Synametrics continues to create and hone inn...
As many know, the first generation of Cloud Management Platform (CMP) solutions were designed for managing virtual infrastructure (IaaS) and traditional applications. But that's no longer enough to satisfy evolving and complex business requirements. In his session at 21st Cloud Expo, Scott Davis, Embotics CTO, explored how next-generation CMPs ensure organizations can manage cloud-native and microservice-based application architectures, while also facilitating agile DevOps methodology. He expla...
To get the most out of their data, successful companies are not focusing on queries and data lakes, they are actively integrating analytics into their operations with a data-first application development approach. Real-time adjustments to improve revenues, reduce costs, or mitigate risk rely on applications that minimize latency on a variety of data sources. In his session at @BigDataExpo, Jack Norris, Senior Vice President, Data and Applications at MapR Technologies, reviewed best practices to ...
DevOps promotes continuous improvement through a culture of collaboration. But in real terms, how do you: Integrate activities across diverse teams and services? Make objective decisions with system-wide visibility? Use feedback loops to enable learning and improvement? With technology insights and real-world examples, in his general session at @DevOpsSummit, at 21st Cloud Expo, Andi Mann, Chief Technology Advocate at Splunk, explored how leading organizations use data-driven DevOps to close th...
Sanjeev Sharma Joins June 5-7, 2018 @DevOpsSummit at @Cloud Expo New York Faculty. Sanjeev Sharma is an internationally known DevOps and Cloud Transformation thought leader, technology executive, and author. Sanjeev's industry experience includes tenures as CTO, Technical Sales leader, and Cloud Architect leader. As an IBM Distinguished Engineer, Sanjeev is recognized at the highest levels of IBM's core of technical leaders.
In his general session at 21st Cloud Expo, Greg Dumas, Calligo’s Vice President and G.M. of US operations, discussed the new Global Data Protection Regulation and how Calligo can help business stay compliant in digitally globalized world. Greg Dumas is Calligo's Vice President and G.M. of US operations. Calligo is an established service provider that provides an innovative platform for trusted cloud solutions. Calligo’s customers are typically most concerned about GDPR compliance, application p...
The 22nd International Cloud Expo | 1st DXWorld Expo has announced that its Call for Papers is open. Cloud Expo | DXWorld Expo, to be held June 5-7, 2018, at the Javits Center in New York, NY, brings together Cloud Computing, Digital Transformation, Big Data, Internet of Things, DevOps, Machine Learning and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding busin...
Smart cities have the potential to change our lives at so many levels for citizens: less pollution, reduced parking obstacles, better health, education and more energy savings. Real-time data streaming and the Internet of Things (IoT) possess the power to turn this vision into a reality. However, most organizations today are building their data infrastructure to focus solely on addressing immediate business needs vs. a platform capable of quickly adapting emerging technologies to address future ...
No hype cycles or predictions of a gazillion things here. IoT is here. You get it. You know your business and have great ideas for a business transformation strategy. What comes next? Time to make it happen. In his session at @ThingsExpo, Jay Mason, an Associate Partner of Analytics, IoT & Cybersecurity at M&S Consulting, presented a step-by-step plan to develop your technology implementation strategy. He also discussed the evaluation of communication standards and IoT messaging protocols, data...
A strange thing is happening along the way to the Internet of Things, namely far too many devices to work with and manage. It has become clear that we'll need much higher efficiency user experiences that can allow us to more easily and scalably work with the thousands of devices that will soon be in each of our lives. Enter the conversational interface revolution, combining bots we can literally talk with, gesture to, and even direct with our thoughts, with embedded artificial intelligence, whic...
Cloud Expo | DXWorld Expo have announced the conference tracks for Cloud Expo 2018. Cloud Expo will be held June 5-7, 2018, at the Javits Center in New York City, and November 6-8, 2018, at the Santa Clara Convention Center, Santa Clara, CA. Digital Transformation (DX) is a major focus with the introduction of DX Expo within the program. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive ov...
"Evatronix provides design services to companies that need to integrate the IoT technology in their products but they don't necessarily have the expertise, knowledge and design team to do so," explained Adam Morawiec, VP of Business Development at Evatronix, in this SYS-CON.tv interview at @ThingsExpo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
Recently, REAN Cloud built a digital concierge for a North Carolina hospital that had observed that most patient call button questions were repetitive. In addition, the paper-based process used to measure patient health metrics was laborious, not in real-time and sometimes error-prone. In their session at 21st Cloud Expo, Sean Finnerty, Executive Director, Practice Lead, Health Care & Life Science at REAN Cloud, and Dr. S.P.T. Krishnan, Principal Architect at REAN Cloud, discussed how they built...
In a recent survey, Sumo Logic surveyed 1,500 customers who employ cloud services such as Amazon Web Services (AWS), Microsoft Azure, and Google Cloud Platform (GCP). According to the survey, a quarter of the respondents have already deployed Docker containers and nearly as many (23 percent) are employing the AWS Lambda serverless computing framework. It’s clear: serverless is here to stay. The adoption does come with some needed changes, within both application development and operations. Tha...
Digital Transformation (DX) is not a "one-size-fits all" strategy. Each organization needs to develop its own unique, long-term DX plan. It must do so by realizing that we now live in a data-driven age, and that technologies such as Cloud Computing, Big Data, the IoT, Cognitive Computing, and Blockchain are only tools. In her general session at 21st Cloud Expo, Rebecca Wanta explained how the strategy must focus on DX and include a commitment from top management to create great IT jobs, monitor ...
"Digital transformation - what we knew about it in the past has been redefined. Automation is going to play such a huge role in that because the culture, the technology, and the business operations are being shifted now," stated Brian Boeggeman, VP of Alliances & Partnerships at Ayehu, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
Digital transformation is about embracing digital technologies into a company's culture to better connect with its customers, automate processes, create better tools, enter new markets, etc. Such a transformation requires continuous orchestration across teams and an environment based on open collaboration and daily experiments. In his session at 21st Cloud Expo, Alex Casalboni, Technical (Cloud) Evangelist at Cloud Academy, explored and discussed the most urgent unsolved challenges to achieve f...
In his Opening Keynote at 21st Cloud Expo, John Considine, General Manager of IBM Cloud Infrastructure, led attendees through the exciting evolution of the cloud. He looked at this major disruption from the perspective of technology, business models, and what this means for enterprises of all sizes. John Considine is General Manager of Cloud Infrastructure Services at IBM. In that role he is responsible for leading IBM’s public cloud infrastructure including strategy, development, and offering m...