Welcome!

@BigDataExpo Authors: Elizabeth White, Liz McMillan, John Esposito, Stefan Dietrich, John Basso

Related Topics: Microservices Expo, Java IoT, Industrial IoT, IoT User Interface, @CloudExpo, @BigDataExpo

Microservices Expo: Article

Big Data Is Not Just About Marketing: Don’t Forget the IT Department’s Needs

Advances in machine intelligence bring new excitement and value

Few, if any, information technology subjects have garnered more attention over the past two years than Big Data. It's a savior. It's evil. It's the killer app of killer apps. And now, according to Gartner analyst Svetlana Sicular, "Big Data Is Falling into the Trough of Disillusionment."

This disillusionment is giving me a little bit of Big Data fatigue - at least in the sense that so much buzz is focused on what Big Data can do for marketing and business intelligence departments. Lost amid all the hype and hoopla is the story of how predictive analytics can help IT teams better understand and support the business applications that are the very lifeblood of their enterprise. After all, predicting the right service to offer your online customer won't help if the customer experiences sluggish application performance.

And Big Data is not going away. Big Data begets Very Big Data, and so on. Analysts are projecting that astronomical amounts of money will be spent on analyzing and using information. This includes projections that millions of data scientists are going to be hired to make sense of all this. You and I know that few if any of those data scientists will be monitoring application or infrastructure performance.

Application performance monitoring is a critical job that can substantially impact a company's brand and bottom line. The fact is that this is an incredibly tough assignment because of all the variables that can negatively impact performance. It is like telling an Ops pro, "You don't have to find a needle in a haystack; you have to find an unspecified number of needles in an unspecified number of haystacks." As databases and other apps get bigger and more distributed, this is almost impossible to do with human intelligence and traditional tools.

The good news is that predictive analytics for IT solutions are far simpler and increasingly more affordable than their Big Data counterparts. It is important for all of us to bang the drum louder about the business value that predictive analytics can provide for IT, not just for application performance, but for people performance too. The industry needs to discuss the risks of fielding powerful and complex applications without arming IT Ops and Support with similarly powerful tools to ensure their availability and performance.

Why Predictive Analytics for IT Is So Cool - and Worth Talking About
Most currently available analytical tools that can forecast human behavior give users exactly what they ask for - and that is part of the problem. The more variables you have in an equation, the more relationships exist. It's getting more difficult all the time to know what questions to ask.

The cutting edge of predictive analytics for IT uses advanced machine intelligence to scan data patterns to detect anomalies and other relationships that human analysts cannot see, at least not see quickly or without the help of data scientists. Using machine intelligence as part of IT performance management is like having your own personal R2D2, or an android like Star Trek's Lieutenant Commander Data. In fact, pairing machine intelligence with human intelligence is the future of problem solving and prediction - you can see it working today to identify root causes of performance failures and limit unplanned downtime. It is quite cool. There is hope for the disillusioned.

Additionally, the list of use cases for predictive analytics in IT is growing. We see organizations using it all the time to predict and prevent service disruptions. If something does go wrong, users can often find the source of the disruption much faster than they can with just human analysis. I have found that in some cases, machine intelligence can identify root causes of performance failures up to 90 percent faster than human intelligence alone can.

We can already see innovations on the near horizon that will make predictive analytics powered by advanced machine intelligence even better equipped to serve IT Ops' needs. Integrating performance management with security threat management is a good example. All of this is good news for IT Ops pros because their jobs are increasingly vital to an organization's success in this era of widely distributed infrastructures.

This is why companies have to emphasize the business value of predictive analytics for IT in conversations about application and infrastructure management. If you forget about IT Ops' needs when contemplating the deployment of data-heavy business applications, you put your network and your organization as a whole at risk.

Predictive analytics in IT is a breath of fresh air in the Big Data conversation. It gets me excited - far from being disillusioned.

More Stories By Mark Jaffe

Mark Jaffe is CEO of Prelert, the first company to provide 100% self-learning predictive analytics solutions to dramatically improve IT operations. He is a serial software entrepreneur who has been instrumental in the success of numerous software companies. Over his 23 years high tech experience, Jaffe has held leadership roles in product marketing, software sales and executive management.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@BigDataExpo Stories
Increasing IoT connectivity is forcing enterprises to find elegant solutions to organize and visualize all incoming data from these connected devices with re-configurable dashboard widgets to effectively allow rapid decision-making for everything from immediate actions in tactical situations to strategic analysis and reporting. In his session at 18th Cloud Expo, Shikhir Singh, Senior Developer Relations Manager at Sencha, will discuss how to create HTML5 dashboards that interact with IoT devic...
Up until last year, enterprises that were looking into cloud services usually undertook a long-term pilot with one of the large cloud providers, running test and dev workloads in the cloud. With cloud’s transition to mainstream adoption in 2015, and with enterprises migrating more and more workloads into the cloud and in between public and private environments, the single-provider approach must be revisited. In his session at 18th Cloud Expo, Yoav Mor, multi-cloud solution evangelist at Cloudy...
In his session at @ThingsExpo, Chris Klein, CEO and Co-founder of Rachio, will discuss next generation communities that are using IoT to create more sustainable, intelligent communities. One example is Sterling Ranch, a 10,000 home development that – with the help of Siemens – will integrate IoT technology into the community to provide residents with energy and water savings as well as intelligent security. Everything from stop lights to sprinkler systems to building infrastructures will run ef...
In his session at 18th Cloud Expo, Sagi Brody, Chief Technology Officer at Webair Internet Development Inc., will focus on real world deployments of DDoS mitigation strategies in every layer of the network. He will give an overview of methods to prevent these attacks and best practices on how to provide protection in complex cloud platforms. He will also outline what we have found in our experience managing and running thousands of Linux and Unix managed service platforms and what specifically c...
Artificial Intelligence has the potential to massively disrupt IoT. In his session at 18th Cloud Expo, AJ Abdallat, CEO of Beyond AI, will discuss what the five main drivers are in Artificial Intelligence that could shape the future of the Internet of Things. AJ Abdallat is CEO of Beyond AI. He has over 20 years of management experience in the fields of artificial intelligence, sensors, instruments, devices and software for telecommunications, life sciences, environmental monitoring, process...
We’ve worked with dozens of early adopters across numerous industries and will debunk common misperceptions, which starts with understanding that many of the connected products we’ll use over the next 5 years are already products, they’re just not yet connected. With an IoT product, time-in-market provides much more essential feedback than ever before. Innovation comes from what you do with the data that the connected product provides in order to enhance the customer experience and optimize busi...
Unless you don’t use the internet, don’t live in California, or haven’t been paying attention to the recent news… you should be aware that self-driving cars are on their way to becoming a reality. I have seen them – they are real. If you believe in the future reality of self-driving cars, then continue reading on. If you don’t believe in the future possibilities, then I am not sure what to do to convince you other than discuss the very real changes that will roll out with the consumer producti...
A critical component of any IoT project is the back-end systems that capture data from remote IoT devices and structure it in a way to answer useful questions. Traditional data warehouse and analytical systems are mature technologies that can be used to handle large data sets, but they are not well suited to many IoT-scale products and the need for real-time insights. At Fuze, we have developed a backend platform as part of our mobility-oriented cloud service that uses Big Data-based approache...
The increasing popularity of the Internet of Things necessitates that our physical and cognitive relationship with wearable technology will change rapidly in the near future. This advent means logging has become a thing of the past. Before, it was on us to track our own data, but now that data is automatically available. What does this mean for mHealth and the "connected" body? In her session at @ThingsExpo, Lisa Calkins, CEO and co-founder of Amadeus Consulting, will discuss the impact of wea...
Many private cloud projects were built to deliver self-service access to development and test resources. While those clouds delivered faster access to resources, they lacked visibility, control and security needed for production deployments. In their session at 18th Cloud Expo, Steve Anderson, Product Manager at BMC Software, and Rick Lefort, Principal Technical Marketing Consultant at BMC Software, will discuss how a cloud designed for production operations not only helps accelerate developer...
SYS-CON Events announced today that Enzu, a leading provider of cloud hosting solutions, will exhibit at SYS-CON's 18th International Cloud Expo®, which will take place on June 7-9, 2016, at the Javits Center in New York City, NY. Enzu’s mission is to be the leading provider of enterprise cloud solutions worldwide. Enzu enables online businesses to use its IT infrastructure to their competitive advantage. By offering a suite of proven hosting and management services, Enzu wants companies to foc...
SYS-CON Events announced today that Ericsson has been named “Gold Sponsor” of SYS-CON's @ThingsExpo, which will take place on June 7-9, 2016, at the Javits Center in New York, New York. Ericsson is a world leader in the rapidly changing environment of communications technology – providing equipment, software and services to enable transformation through mobility. Some 40 percent of global mobile traffic runs through networks we have supplied. More than 1 billion subscribers around the world re...
SYS-CON Events announced today that Peak 10, Inc., a national IT infrastructure and cloud services provider, will exhibit at SYS-CON's 18th International Cloud Expo®, which will take place on June 7-9, 2016, at the Javits Center in New York City, NY. Peak 10 provides reliable, tailored data center and network services, cloud and managed services. Its solutions are designed to scale and adapt to customers’ changing business needs, enabling them to lower costs, improve performance and focus inter...
The IoTs will challenge the status quo of how IT and development organizations operate. Or will it? Certainly the fog layer of IoT requires special insights about data ontology, security and transactional integrity. But the developmental challenges are the same: People, Process and Platform. In his session at @ThingsExpo, Craig Sproule, CEO of Metavine, will demonstrate how to move beyond today's coding paradigm and share the must-have mindsets for removing complexity from the development proc...
SYS-CON Events announced today that SoftLayer, an IBM Company, has been named “Gold Sponsor” of SYS-CON's 18th Cloud Expo, which will take place on June 7-9, 2016, at the Javits Center in New York, New York. SoftLayer, an IBM Company, provides cloud infrastructure as a service from a growing number of data centers and network points of presence around the world. SoftLayer’s customers range from Web startups to global enterprises.
There is an ever-growing explosion of new devices that are connected to the Internet using “cloud” solutions. This rapid growth is creating a massive new demand for efficient access to data. And it’s not just about connecting to that data anymore. This new demand is bringing new issues and challenges and it is important for companies to scale for the coming growth. And with that scaling comes the need for greater security, gathering and data analysis, storage, connectivity and, of course, the...
So, you bought into the current machine learning craze and went on to collect millions/billions of records from this promising new data source. Now, what do you do with them? Too often, the abundance of data quickly turns into an abundance of problems. How do you extract that "magic essence" from your data without falling into the common pitfalls? In her session at @ThingsExpo, Natalia Ponomareva, Software Engineer at Google, will provide tips on how to be successful in large scale machine lear...
The IETF draft standard for M2M certificates is a security solution specifically designed for the demanding needs of IoT/M2M applications. In his session at @ThingsExpo, Brian Romansky, VP of Strategic Technology at TrustPoint Innovation, will explain how M2M certificates can efficiently enable confidentiality, integrity, and authenticity on highly constrained devices.
You think you know what’s in your data. But do you? Most organizations are now aware of the business intelligence represented by their data. Data science stands to take this to a level you never thought of – literally. The techniques of data science, when used with the capabilities of Big Data technologies, can make connections you had not yet imagined, helping you discover new insights and ask new questions of your data. In his session at @ThingsExpo, Sarbjit Sarkaria, data science team lead ...
Manufacturers are embracing the Industrial Internet the same way consumers are leveraging Fitbits – to improve overall health and wellness. Both can provide consistent measurement, visibility, and suggest performance improvements customized to help reach goals. Fitbit users can view real-time data and make adjustments to increase their activity. In his session at @ThingsExpo, Mark Bernardo Professional Services Leader, Americas, at GE Digital, will discuss how leveraging the Industrial Interne...