Welcome!

@BigDataExpo Authors: Elizabeth White, Liz McMillan, Pat Romanski, Harry Trott, William Schmarzo

Related Topics: Recurring Revenue, Java IoT, Linux Containers, Containers Expo Blog, Agile Computing, @CloudExpo, @BigDataExpo, @ThingsExpo

Recurring Revenue: Article

Big Data's Many Dimensions (IoT)

Urgency, Importance, Frequency, Consequences, Remedy & Cost

It occurred to me, as I'm sure it's occurred to most of you, that driving a car is a classic example of the IoT in action. In this case, my brain is the CPU, and all of my car's gauges are the things. 

I was making a routine 30-minute drive to raid a local vegetable stand. As I processed all the information coming in, I realized there were several dimensions to it. The same principle is at work with IoT projects, no matter what their scale.

One of the classic charts/concepts widely used in information management is determining urgency vs. importance. Urgent & important things are represented in the upper-right quadrant of a square, urgent but not important in the lower right, important but not urgent in the upper left, and that phone call from your old college friend asking for money in the not urgent and not important lower left.

Riding Along in My Automobile
In my car, my speedometer sends me a reading that is urgent and important. My gas gauge reading is not urgent but important, and becomes urgent and important once I start running low. My gearshift is important but not urgent. 

My car has a tachometer but also an automatic transmission, so the tach reading is not urgent and not important. I can go down through the checklist of everything from the odometer, water temp, battery, and oil pressure, to the heating/AC settings, the radio; to the stream of other info and alerts kept by the car's computer.

It's Not That Simple
But this simple classification misses a lot of important stuff. For one thing, as I note above, much of the information changes its nature depending on conditions. Not only am I in trouble if I run out of gas, I'm in big trouble if any of the water, battery, or oil gauges changes. They seldom do, but if they do, they become red-flag urgent and important.


So an IoT monitoring & analytical architecture must take into account the changing, sometimes fluid nature of the dataflows. 

Many Dimensions
It must also take into account frequency, consequences, remedies, and cost. Returning to the gas gauge, I need to look at it infrequently, the consequence is embarrassing but usually not life threatening, the remedy is generally easy, and the cost is not high. The speedometer, on the other hand, must be monitored in real time, whether I ignore it or not.

Should the engine throw a belt and cut my power while driving at night, the consequence is more severe, the remedy more difficult, and the cost higher. Should I ignore a low oil pressure warning, then I'm potentially getting into a dangerous, difficult, very costly situation.

I've had air conditioning systems conk out on me, something for which there is neither a gauge nor an alert. This problem is not urgent or important (as uncomfortable as driving without AC in the heat can be), has little consequence (unless you need to drive people somewhere who may be less tolerant of the heat than you), but can be very difficult and expensive to fix. 

I've also had wheels fall of my car--twice. The first time was when I was 19 years old, driving a decrepit used car, and speeding down the road in the manner of many teenagers who think they're going to live forever. I missed slamming into a bridge by inches, but ended up merely on the side of the road with nobody hurt. I also slowed my driving down forever. 

The second time I was going 5 miles per hour, and thought I had a flat tire. Even at this slow speed, the incident could have had very bad consequences. Losing control of the car is a terrifying thing. This car was not particularly old, but had these supremely annoying aluminum wheels that raise all sorts of Cain with tires and linkages. Again, no gauge here to help me out, but both times I was put in a potentially fatal situation. 

"Gaugeless IoT"
The "gaugeless IoT" of AC & wheel failures exists in many other aspects of driving my car. For example, even though a thermometer courteously tells me how hot or cold it is outside--something I had already nailed down as I was walking out to my car--it doesn't have an anemometer. I have to know and gauge the effect of wind myself. It doesn't let me know about traffic jams ahead, flooding, or perhaps a tornado coming my way. It doesn't warn me of kids on bicycles or dogs or deer darting out in front of me, or big trucks suddenly crowding me. It doesn't predict any of the other thousands of examples of atrocious driving I've encountered with my fellow Americans.

But wait a minute, that's why I have eyes and ears. And memory, my own organic expert system. 

So, So Early
This brings me to my overall point: Even as the IoT will generate trillions of dollars within the global economy very soon, we're still in the very early days. I'm tempted to say that we're only now in Act I of the Information Age. All previous progress has been mere prologue.

There's been a golden quest for decades to smarten computers up by attaching sensors to them. Sure, our wondrous machines have been able to crunch numbers better than us forever, and can perform all manner of brute-force tasks. Today they can even play a nice song or movie at a very high quality. 

But the IoT will bring sensory to our systems in a big way for the first time. They will need to measure all the new incoming data in several dimensions, with built-in decision points that assess remedies and consequences. Even so, it will be decades before IoT applications can "see" and "hear" with anywhere near the ability of people. As always, let's not get too arrogant about the power of our machines, and remember that human beings are sometimes the weak link but sometimes the salvation of the systems we build.

Contact Me on Twitter

More Stories By Roger Strukhoff

Roger Strukhoff (@IoT2040) is Executive Director of the Tau Institute for Global ICT Research, with offices in Illinois and Manila. He is Conference Chair of @CloudExpo & @ThingsExpo, and Editor of SYS-CON Media's CloudComputing BigData & IoT Journals. He holds a BA from Knox College & conducted MBA studies at CSU-East Bay.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@BigDataExpo Stories
SYS-CON Events announced today that Golden Gate University will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Since 1901, non-profit Golden Gate University (GGU) has been helping adults achieve their professional goals by providing high quality, practice-based undergraduate and graduate educational programs in law, taxation, business and related professions. Many of its courses are taug...
DevOps at Cloud Expo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 21st Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to w...
SYS-CON Events announced today that Grape Up will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct. 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Grape Up is a software company specializing in cloud native application development and professional services related to Cloud Foundry PaaS. With five expert teams that operate in various sectors of the market across the U.S. and Europe, Grape Up works with a variety of customers from emergi...
SYS-CON Events announced today that DXWorldExpo has been named “Global Sponsor” of SYS-CON's 21st International Cloud Expo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Digital Transformation is the key issue driving the global enterprise IT business. Digital Transformation is most prominent among Global 2000 enterprises and government institutions.
With Cloud Foundry you can easily deploy and use apps utilizing websocket technology, but not everybody realizes that scaling them out is not that trivial. In his session at 21st Cloud Expo, Roman Swoszowski, CTO and VP, Cloud Foundry Services, at Grape Up, will show you an example of how to deal with this issue. He will demonstrate a cloud-native Spring Boot app running in Cloud Foundry and communicating with clients over websocket protocol that can be easily scaled horizontally and coordinate...
21st International Cloud Expo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy. Me...
Any startup has to have a clear go –to-market strategy from the beginning. Similarly, any data science project has to have a go to production strategy from its first days, so it could go beyond proof-of-concept. Machine learning and artificial intelligence in production would result in hundreds of training pipelines and machine learning models that are continuously revised by teams of data scientists and seamlessly connected with web applications for tenants and users.
IT organizations are moving to the cloud in hopes to approve efficiency, increase agility and save money. Migrating workloads might seem like a simple task, but what many businesses don’t realize is that application migration criteria differs across organizations, making it difficult for architects to arrive at an accurate TCO number. In his session at 21st Cloud Expo, Joe Kinsella, CTO of CloudHealth Technologies, will offer a systematic approach to understanding the TCO of a cloud application...
Connecting to major cloud service providers is becoming central to doing business. But your cloud provider’s performance is only as good as your connectivity solution. Massive Networks will place you in the driver's seat by exposing how you can extend your LAN from any location to include any cloud platform through an advanced high-performance connection that is secure and dedicated to your business-critical data. In his session at 21st Cloud Expo, Paul Mako, CEO & CIO of Massive Networks, wil...
When shopping for a new data processing platform for IoT solutions, many development teams want to be able to test-drive options before making a choice. Yet when evaluating an IoT solution, it’s simply not feasible to do so at scale with physical devices. Building a sensor simulator is the next best choice; however, generating a realistic simulation at very high TPS with ease of configurability is a formidable challenge. When dealing with multiple application or transport protocols, you would be...
SYS-CON Events announced today that Secure Channels, a cybersecurity firm, will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Secure Channels, Inc. offers several products and solutions to its many clients, helping them protect critical data from being compromised and access to computer networks from the unauthorized. The company develops comprehensive data encryption security strategie...
"With Digital Experience Monitoring what used to be a simple visit to a web page has exploded into app on phones, data from social media feeds, competitive benchmarking - these are all components that are only available because of some type of digital asset," explained Leo Vasiliou, Director of Web Performance Engineering at Catchpoint Systems, in this SYS-CON.tv interview at DevOps Summit at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
An increasing number of companies are creating products that combine data with analytical capabilities. Running interactive queries on Big Data requires complex architectures to store and query data effectively, typically involving data streams, an choosing efficient file format/database and multiple independent systems that are tied together through custom-engineered pipelines. In his session at @BigDataExpo at @ThingsExpo, Tomer Levi, a senior software engineer at Intel’s Advanced Analytics ...
Cloud adoption is often driven by a desire to increase efficiency, boost agility and save money. All too often, however, the reality involves unpredictable cost spikes and lack of oversight due to resource limitations. In his session at 20th Cloud Expo, Joe Kinsella, CTO and Founder of CloudHealth Technologies, tackled the question: “How do you build a fully optimized cloud?” He will examine: Why TCO is critical to achieving cloud success – and why attendees should be thinking holistically ab...
As businesses adopt functionalities in cloud computing, it’s imperative that IT operations consistently ensure cloud systems work correctly – all of the time, and to their best capabilities. In his session at @BigDataExpo, Bernd Harzog, CEO and founder of OpsDataStore, presented an industry answer to the common question, “Are you running IT operations as efficiently and as cost effectively as you need to?” He then expounded on the industry issues he frequently came up against as an analyst, and ...
SYS-CON Events announced today that App2Cloud will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct. 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. App2Cloud is an online Platform, specializing in migrating legacy applications to any Cloud Providers (AWS, Azure, Google Cloud).
Cloud resources, although available in abundance, are inherently volatile. For transactional computing, like ERP and most enterprise software, this is a challenge as transactional integrity and data fidelity is paramount – making it a challenge to create cloud native applications while relying on RDBMS. In his session at 21st Cloud Expo, Claus Jepsen, Chief Architect and Head of Innovation Labs at Unit4, will explore that in order to create distributed and scalable solutions ensuring high availa...
Internet-of-Things discussions can end up either going down the consumer gadget rabbit hole or focused on the sort of data logging that industrial manufacturers have been doing forever. However, in fact, companies today are already using IoT data both to optimize their operational technology and to improve the experience of customer interactions in novel ways. In his session at @ThingsExpo, Gordon Haff, Red Hat Technology Evangelist, shared examples from a wide range of industries – including en...
Detecting internal user threats in the Big Data eco-system is challenging and cumbersome. Many organizations monitor internal usage of the Big Data eco-system using a set of alerts. This is not a scalable process given the increase in the number of alerts with the accelerating growth in data volume and user base. Organizations are increasingly leveraging machine learning to monitor only those data elements that are sensitive and critical, autonomously establish monitoring policies, and to detect...
To get the most out of their data, successful companies are not focusing on queries and data lakes, they are actively integrating analytics into their operations with a data-first application development approach. Real-time adjustments to improve revenues, reduce costs, or mitigate risk rely on applications that minimize latency on a variety of data sources. Jack Norris reviews best practices to show how companies develop, deploy, and dynamically update these applications and how this data-first...