Welcome!

@DXWorldExpo Authors: Automic Blog, Liz McMillan, Pat Romanski, Yeshim Deniz, Nate Vickery

Related Topics: @ThingsExpo, @CloudExpo, @DXWorldExpo

@ThingsExpo: Blog Feed Post

Understanding Chaos Theory | @ThingsExpo #DX #BI #IoT #M2M #Analytics

Chaos Theory is the branch of mathematics that deals with complex systems whose behavior is highly sensitive to slight changes

Why Understanding Chaos Theory Is Important to Your Business

“Chaos: When the present determines the future, but the approximate present does not approximately determine the future.”

– Edward Lorenz

We all probably remember the movie (“Jurassic Park”), even if we don’t remember this exact scene: Dr. Malcolm, played by Jeff Goldblum is explaining Chaos Theory to Dr. Ellie Sattler, played by Laura Dern.

Dr. Malcolm is explaining how random, seemingly negligible events can disrupt even the most carefully laid out plans.

Dr. Ian Malcolm: [after the T-Rex failed to appear for the tour group]. “You see a Tyrannosaur doesn’t follow a set pattern or park schedules, the essence of chaos.”

And then later in the movie…

Dr. Ian Malcolm: “Oh, yeah. Oooh, ahhh, that’s how it always starts. Then later there’s running and um, screaming.”

Yes, running and screaming. That’s what happens when even the most carefully developed plans eventually succumb to the compounding of all these “random, seemingly negligible” events. And understanding the ramifications of Chaos Theory is becoming even more relevant as we look to machines to take over increasingly complex tasks.

What Is Chaos Theory?
Chaos Theory
is the branch of mathematics that deals with complex systems whose behavior is highly sensitive to slight changes in conditions, so that small alterations can give rise to unintended consequences. Chaos Theory is the science of surprises, and not always pleasant surprises. While traditional science deals with predictable phenomena like gravity, electricity, or chemical reactions, Chaos Theory deals with nonlinear things that are mostly impossible to predict, calculate, or control, like turbulence, a bar brawl, the stock market futures, debris flying out of the bed of a truck, or a child darting onto the street[1].

There are several underlying principles of Chaos Theory, including:

  • Butterfly Effect: This is probably the most common principle; that a butterfly flapping its wings in one part of the world can eventually cause a hurricane in another part of the world. Here is a more realistic way to describe the Butterfly Effect: small changes in the initial conditions can lead to drastic changes in the results. Our lives are an ongoing demonstration of this principle.
  • Unpredictability: Because we can never know all the initial conditions of a complex system in sufficient detail, we cannot hope to predict the ultimate fate of a complex system. Even slight errors in measuring the initial state of a system could be amplified dramatically, rendering any prediction useless or even wrong.
  • Mixing: Turbulence describes how two adjacent points in a complex system could eventually end up in very different positions after time has elapsed. Examples: Two neighboring water molecules may end up in different parts of the ocean or even in different oceans. Or a group of helium balloons that launch together eventually landing in drastically different locations.
  • Feedback: Systems often become chaotic when there is feedback. A good example is the behavior of the stock market. As the value of a stock rises or falls, people are inclined to buy or sell that stock. This in turn further affects the price of the stock, causing chaotic, unpredictable stock price movements.

Chaos Theory Meets the Autonomous Car
Complex systems
(sometimes called complexity theory) are systems whose behavior is intrinsically difficult to model due to the dependencies, relationships, or interactions between their parts and its environment. Complex systems are impacted by factors such as non-linearity, emergence, spontaneous order, adaptation, and feedback loops. And while an autonomous car may not be the most complex system in the world, it is certainly more complex than playing checkers, chess or Grand Theft Auto.

So what happens when Complex Systems run into the world of Chaos Theory?

Complex or dynamical systems – that is, systems whose state evolves over time –display dynamics that are highly sensitive to initial conditions (butterfly effect). These sensitivities manifest themselves as an exponential growth of perturbations in the initial conditions over time. As a result, the behavior of these complex systems grows more and more random (unpredictable). This happens even though these systems are deterministic, meaning that their future dynamics are fully defined by their initial conditions[2].

Summary
So while we can’t avoid the impact of Chaos Theory, especially as we employ Machine Learning and Artificial Intelligence to a growing body of complex systems and environments, here’s what we can do to mitigate the impact of Chaos Theory:

  • Build a plan for the continuous testing and refinement of the analytics. The performance of analytic models decay over time; they have a half-life because the world changes such as public sentiments driven by widening wealth gaps, corporate acts of malfeasance, government scandals, rising burden of student debt, growing ranks of the under-employed, wage stagnation, mounting populace divide on social media, legalization of marijuana, rising media sensationalism, climate change, terrorism, Cubs win the World Series, etc.

Figure 1: Half-life Calculation

Even apparently stable analytic models constantly need to be evaluated and fine-tuned.  Think of it as the “Data Scientist Life-time Employment Act!”  See the blog “2016 Presidential Election: Did Big Data Just Get Lazy” for more details on the analytics half-life effect.

  • Create a dashboard to monitor the performance of your analytic models. A dashboard is the perfect monitoring device to ensure that business managers and the data science team are proactively monitoring the performance and state of the analytic models.  Heck, maybe even integrate some data science into the dashboard to predict when a model is starting to fail (i.e., predictive maintenance).  See the blog “Big Data Dashboards” for some ideas about how to transform your “monitoring” dashboard into a “predictive” dashboard.
  • Understand the costs and liabilities associated with Type I and Type II errors and use those costs and liabilities to prioritize your investments in data acquisition, data quality, metadata enhancements and model tuning. See the blog “Understanding Type I and Type II Errors” for an approach for quantifying the costs and liabilities associated with Type I and Type II errors.

To borrow again from the movie “Jurassic Park”, don’t get caught with your pants down with respect to the potential ramifications of Chaos Theory on your complex analytic projects.

  1. http://fractalfoundation.org/resources/what-is-chaos-theory/
  2. https://en.wikipedia.org/wiki/Dynamical_systems_theory#Chaos_theory

The post Why Understanding Chaos Theory Is Important To Your Business appeared first on InFocus Blog | Dell EMC Services.

Read the original blog entry...

More Stories By William Schmarzo

Bill Schmarzo, author of “Big Data: Understanding How Data Powers Big Business”, is responsible for setting the strategy and defining the Big Data service line offerings and capabilities for the EMC Global Services organization. As part of Bill’s CTO charter, he is responsible for working with organizations to help them identify where and how to start their big data journeys. He’s written several white papers, avid blogger and is a frequent speaker on the use of Big Data and advanced analytics to power organization’s key business initiatives. He also teaches the “Big Data MBA” at the University of San Francisco School of Management.

Bill has nearly three decades of experience in data warehousing, BI and analytics. Bill authored EMC’s Vision Workshop methodology that links an organization’s strategic business initiatives with their supporting data and analytic requirements, and co-authored with Ralph Kimball a series of articles on analytic applications. Bill has served on The Data Warehouse Institute’s faculty as the head of the analytic applications curriculum.

Previously, Bill was the Vice President of Advertiser Analytics at Yahoo and the Vice President of Analytic Applications at Business Objects.

@BigDataExpo Stories
"Evatronix provides design services to companies that need to integrate the IoT technology in their products but they don't necessarily have the expertise, knowledge and design team to do so," explained Adam Morawiec, VP of Business Development at Evatronix, in this SYS-CON.tv interview at @ThingsExpo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
Smart cities have the potential to change our lives at so many levels for citizens: less pollution, reduced parking obstacles, better health, education and more energy savings. Real-time data streaming and the Internet of Things (IoT) possess the power to turn this vision into a reality. However, most organizations today are building their data infrastructure to focus solely on addressing immediate business needs vs. a platform capable of quickly adapting emerging technologies to address future ...
In his Opening Keynote at 21st Cloud Expo, John Considine, General Manager of IBM Cloud Infrastructure, led attendees through the exciting evolution of the cloud. He looked at this major disruption from the perspective of technology, business models, and what this means for enterprises of all sizes. John Considine is General Manager of Cloud Infrastructure Services at IBM. In that role he is responsible for leading IBM’s public cloud infrastructure including strategy, development, and offering m...
Sanjeev Sharma Joins June 5-7, 2018 @DevOpsSummit at @Cloud Expo New York Faculty. Sanjeev Sharma is an internationally known DevOps and Cloud Transformation thought leader, technology executive, and author. Sanjeev's industry experience includes tenures as CTO, Technical Sales leader, and Cloud Architect leader. As an IBM Distinguished Engineer, Sanjeev is recognized at the highest levels of IBM's core of technical leaders.
The 22nd International Cloud Expo | 1st DXWorld Expo has announced that its Call for Papers is open. Cloud Expo | DXWorld Expo, to be held June 5-7, 2018, at the Javits Center in New York, NY, brings together Cloud Computing, Digital Transformation, Big Data, Internet of Things, DevOps, Machine Learning and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding busin...
Digital transformation is about embracing digital technologies into a company's culture to better connect with its customers, automate processes, create better tools, enter new markets, etc. Such a transformation requires continuous orchestration across teams and an environment based on open collaboration and daily experiments. In his session at 21st Cloud Expo, Alex Casalboni, Technical (Cloud) Evangelist at Cloud Academy, explored and discussed the most urgent unsolved challenges to achieve f...
SYS-CON Events announced today that Synametrics Technologies will exhibit at SYS-CON's 22nd International Cloud Expo®, which will take place on June 5-7, 2018, at the Javits Center in New York, NY. Synametrics Technologies is a privately held company based in Plainsboro, New Jersey that has been providing solutions for the developer community since 1997. Based on the success of its initial product offerings such as WinSQL, Xeams, SynaMan and Syncrify, Synametrics continues to create and hone inn...
Digital Transformation (DX) is not a "one-size-fits all" strategy. Each organization needs to develop its own unique, long-term DX plan. It must do so by realizing that we now live in a data-driven age, and that technologies such as Cloud Computing, Big Data, the IoT, Cognitive Computing, and Blockchain are only tools. In her general session at 21st Cloud Expo, Rebecca Wanta explained how the strategy must focus on DX and include a commitment from top management to create great IT jobs, monitor ...
In a recent survey, Sumo Logic surveyed 1,500 customers who employ cloud services such as Amazon Web Services (AWS), Microsoft Azure, and Google Cloud Platform (GCP). According to the survey, a quarter of the respondents have already deployed Docker containers and nearly as many (23 percent) are employing the AWS Lambda serverless computing framework. It’s clear: serverless is here to stay. The adoption does come with some needed changes, within both application development and operations. Tha...
Cloud Expo | DXWorld Expo have announced the conference tracks for Cloud Expo 2018. Cloud Expo will be held June 5-7, 2018, at the Javits Center in New York City, and November 6-8, 2018, at the Santa Clara Convention Center, Santa Clara, CA. Digital Transformation (DX) is a major focus with the introduction of DX Expo within the program. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive ov...
A strange thing is happening along the way to the Internet of Things, namely far too many devices to work with and manage. It has become clear that we'll need much higher efficiency user experiences that can allow us to more easily and scalably work with the thousands of devices that will soon be in each of our lives. Enter the conversational interface revolution, combining bots we can literally talk with, gesture to, and even direct with our thoughts, with embedded artificial intelligence, whic...
Recently, REAN Cloud built a digital concierge for a North Carolina hospital that had observed that most patient call button questions were repetitive. In addition, the paper-based process used to measure patient health metrics was laborious, not in real-time and sometimes error-prone. In their session at 21st Cloud Expo, Sean Finnerty, Executive Director, Practice Lead, Health Care & Life Science at REAN Cloud, and Dr. S.P.T. Krishnan, Principal Architect at REAN Cloud, discussed how they built...
In his general session at 21st Cloud Expo, Greg Dumas, Calligo’s Vice President and G.M. of US operations, discussed the new Global Data Protection Regulation and how Calligo can help business stay compliant in digitally globalized world. Greg Dumas is Calligo's Vice President and G.M. of US operations. Calligo is an established service provider that provides an innovative platform for trusted cloud solutions. Calligo’s customers are typically most concerned about GDPR compliance, application p...
Continuous Delivery makes it possible to exploit findings of cognitive psychology and neuroscience to increase the productivity and happiness of our teams. In his session at 22nd Cloud Expo | DXWorld Expo, Daniel Jones, CTO of EngineerBetter, will answer: How can we improve willpower and decrease technical debt? Is the present bias real? How can we turn it to our advantage? Can you increase a team’s effective IQ? How do DevOps & Product Teams increase empathy, and what impact does empath...
SYS-CON Events announced today that Evatronix will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Evatronix SA offers comprehensive solutions in the design and implementation of electronic systems, in CAD / CAM deployment, and also is a designer and manufacturer of advanced 3D scanners for professional applications.
As many know, the first generation of Cloud Management Platform (CMP) solutions were designed for managing virtual infrastructure (IaaS) and traditional applications. But that's no longer enough to satisfy evolving and complex business requirements. In his session at 21st Cloud Expo, Scott Davis, Embotics CTO, explored how next-generation CMPs ensure organizations can manage cloud-native and microservice-based application architectures, while also facilitating agile DevOps methodology. He expla...
To get the most out of their data, successful companies are not focusing on queries and data lakes, they are actively integrating analytics into their operations with a data-first application development approach. Real-time adjustments to improve revenues, reduce costs, or mitigate risk rely on applications that minimize latency on a variety of data sources. In his session at @BigDataExpo, Jack Norris, Senior Vice President, Data and Applications at MapR Technologies, reviewed best practices to ...
DevOps promotes continuous improvement through a culture of collaboration. But in real terms, how do you: Integrate activities across diverse teams and services? Make objective decisions with system-wide visibility? Use feedback loops to enable learning and improvement? With technology insights and real-world examples, in his general session at @DevOpsSummit, at 21st Cloud Expo, Andi Mann, Chief Technology Advocate at Splunk, explored how leading organizations use data-driven DevOps to close th...
No hype cycles or predictions of a gazillion things here. IoT is here. You get it. You know your business and have great ideas for a business transformation strategy. What comes next? Time to make it happen. In his session at @ThingsExpo, Jay Mason, an Associate Partner of Analytics, IoT & Cybersecurity at M&S Consulting, presented a step-by-step plan to develop your technology implementation strategy. He also discussed the evaluation of communication standards and IoT messaging protocols, data...
"Digital transformation - what we knew about it in the past has been redefined. Automation is going to play such a huge role in that because the culture, the technology, and the business operations are being shifted now," stated Brian Boeggeman, VP of Alliances & Partnerships at Ayehu, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.