Welcome!

@BigDataExpo Authors: Pat Romanski, Elizabeth White, Liz McMillan, Dana Gardner, John Basso

Related Topics: @ThingsExpo, Java IoT, Microservices Expo, Linux Containers, Containers Expo Blog, Agile Computing, @CloudExpo, @BigDataExpo

@ThingsExpo: Article

Plumbing and the Internet of Things

It's Been a Long Odyssey For Us to Get Where We Are. Now What?

A couple of days ago, I noted the fundamental enterprise IT change driven over the past generation by user impatience - nobody likes waiting in line.

We can point to Moore's Law, Metcalf's Law, and a general business trend toward disintermediation and decentralization as well, taking note of the millions of hard-working people all over the world who've been making things faster, better, cheaper, and more effective for several decades.

All of this effort has led to the big change in IT during my career-the invention of plumbing.

Going to the Well
The bad, old way of MIS meant you went to the well to get your water. You visited the wellmaster, er, MIS manager, and hoped your ration, er, report, was ready. Sometimes MIS would bring the water to you, but only if you didn't bug them for it very much.

The minicomputers came, and with them, plumbing. Information flowed in two directions, and more or less when users wanted it. It had moved from the well into several silos, and you needed a different terminal to get at the stuff in each separate silo.

So soon enough, user impatience re-appeared. They wanted several types of information, and they wanted it to be available on their desks, in one place, all the time. In came PCs, approved or not, and forced IS to get better plumbing, usually a miraculous local network called Ethernet.

What Did They Ever Do For Us?
But users are wont to grumble and complain, and as with Monty Python's Biblical revolutionaries asking what the Romans had ever done for them, modern-day computer users didn't appreciate all the plumbing that IS had so graciously provided.

Once the world at large discovered the Internet, then the Worldwide Web, the old ways were doomed. There's been a constant back-and-forth battle for control between IT and users since that time, but modern-day information plumbing-much of it wireless-continues to be this nihilistic force that trumps the most rigorous IT efforts to control the flow.

With the great plumbing afforded by the Internet and Web came the battle to destroy those silos that had replaced the original well. This battle will no doubt continue for many more decades, as each new type of information flow creates new silos.

Constant Battle
Data types are data types, archives are archives, and an enterprise's information-one of its most valuable assets-just can't be tossed around willy nilly, like the records, books, newspapers, magazines, and laundry in my old college dorm room. It must be organized somehow.

Yet user demands for access to any information, anytime, anywhere, on any device are an inexorable force. The nearly 20-year odyssey of today's @CloudExpo @ThingsExpo and everything that goes with the event started with application service providers and web services.

The idea of deconstructing (or decoupling) what applications do from their silos was a profound, radical thought. It was also easier said than done.

Once developers and users started to think of software as a service rather than a product, though, they also started to think about how to measure it. An application is bought in a package or a download; a service is something that comes streaming in as you need it.

Following that thought, why not, then, combine specific services with one another to create a new service? Set theory and a facility for high-level mathematical proofs started to influence the thinking of how best to develop and deliver services.

SOA, Then Cloud
Web services extended into Service-Oriented Architecture (SOA), and a further decoupling at the hardware level (promulgated by software) brought us into the modern age of cloud computing.

The Internet of Things and Big Data are now possible with cloud computing, now that compute resources can appear infinite and highly flexible.

I wrote a piece once about how this sort of deconstruction was similar to revolutions in 20th century music, art, literature, and philosophy. A friend of mine said at least six people in the world would be interested in my piece-I can now say that, in fact, almost 5,000 people have read it over a time period of only five years. Here it is if you need some sleep.

Whither Plumbing?
Modern-day distributed computing can also be said to be simply a result of a human desire to improve things. It's commonly accepted wisdom that we shouldn't try to re-invent the wheel, but that's exactly what people do.

The ironic consequence of all this is now people have questions about the plumbing. Can the Internet withstand the onslaught of the coming zettabytes? What protocols, specifications, and techniques will be required to keep local information flows as local as possible, so as not to burden the bigger pipes?

We all know that the late Sen. Ted Stevens was right. The Internet is a series of tubes (or pipes), if structured with a little more subtlety and complexity than he articulated.

Now that the plumbing has addressed user impatience and improved user experiences for decades, will it become the bottleneck itself? And will a great concentrations of information among a small number of cloud services providers some day bring us back to having to depend on the well and its keepers for our cyber-survival?

Contact Me on Twitter

More Stories By Roger Strukhoff

Roger Strukhoff (@IoT2040) is Executive Director of the Tau Institute for Global ICT Research, with offices in Illinois and Manila. He is Conference Chair of @CloudExpo & @ThingsExpo, and Editor of SYS-CON Media's CloudComputing BigData & IoT Journals. He holds a BA from Knox College & conducted MBA studies at CSU-East Bay.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@BigDataExpo Stories
SYS-CON Events announced today that Peak 10, Inc., a national IT infrastructure and cloud services provider, will exhibit at SYS-CON's 18th International Cloud Expo®, which will take place on June 7-9, 2016, at the Javits Center in New York City, NY. Peak 10 provides reliable, tailored data center and network services, cloud and managed services. Its solutions are designed to scale and adapt to customers’ changing business needs, enabling them to lower costs, improve performance and focus inter...
In his session at @ThingsExpo, Chris Klein, CEO and Co-founder of Rachio, will discuss next generation communities that are using IoT to create more sustainable, intelligent communities. One example is Sterling Ranch, a 10,000 home development that – with the help of Siemens – will integrate IoT technology into the community to provide residents with energy and water savings as well as intelligent security. Everything from stop lights to sprinkler systems to building infrastructures will run ef...
The IoTs will challenge the status quo of how IT and development organizations operate. Or will it? Certainly the fog layer of IoT requires special insights about data ontology, security and transactional integrity. But the developmental challenges are the same: People, Process and Platform. In his session at @ThingsExpo, Craig Sproule, CEO of Metavine, will demonstrate how to move beyond today's coding paradigm and share the must-have mindsets for removing complexity from the development proc...
SYS-CON Events announced today that Ericsson has been named “Gold Sponsor” of SYS-CON's @ThingsExpo, which will take place on June 7-9, 2016, at the Javits Center in New York, New York. Ericsson is a world leader in the rapidly changing environment of communications technology – providing equipment, software and services to enable transformation through mobility. Some 40 percent of global mobile traffic runs through networks we have supplied. More than 1 billion subscribers around the world re...
A critical component of any IoT project is the back-end systems that capture data from remote IoT devices and structure it in a way to answer useful questions. Traditional data warehouse and analytical systems are mature technologies that can be used to handle large data sets, but they are not well suited to many IoT-scale products and the need for real-time insights. At Fuze, we have developed a backend platform as part of our mobility-oriented cloud service that uses Big Data-based approache...
Artificial Intelligence has the potential to massively disrupt IoT. In his session at 18th Cloud Expo, AJ Abdallat, CEO of Beyond AI, will discuss what the five main drivers are in Artificial Intelligence that could shape the future of the Internet of Things. AJ Abdallat is CEO of Beyond AI. He has over 20 years of management experience in the fields of artificial intelligence, sensors, instruments, devices and software for telecommunications, life sciences, environmental monitoring, process...
The increasing popularity of the Internet of Things necessitates that our physical and cognitive relationship with wearable technology will change rapidly in the near future. This advent means logging has become a thing of the past. Before, it was on us to track our own data, but now that data is automatically available. What does this mean for mHealth and the "connected" body? In her session at @ThingsExpo, Lisa Calkins, CEO and co-founder of Amadeus Consulting, will discuss the impact of wea...
SYS-CON Events announced today that SoftLayer, an IBM Company, has been named “Gold Sponsor” of SYS-CON's 18th Cloud Expo, which will take place on June 7-9, 2016, at the Javits Center in New York, New York. SoftLayer, an IBM Company, provides cloud infrastructure as a service from a growing number of data centers and network points of presence around the world. SoftLayer’s customers range from Web startups to global enterprises.
There is an ever-growing explosion of new devices that are connected to the Internet using “cloud” solutions. This rapid growth is creating a massive new demand for efficient access to data. And it’s not just about connecting to that data anymore. This new demand is bringing new issues and challenges and it is important for companies to scale for the coming growth. And with that scaling comes the need for greater security, gathering and data analysis, storage, connectivity and, of course, the...
We’ve worked with dozens of early adopters across numerous industries and will debunk common misperceptions, which starts with understanding that many of the connected products we’ll use over the next 5 years are already products, they’re just not yet connected. With an IoT product, time-in-market provides much more essential feedback than ever before. Innovation comes from what you do with the data that the connected product provides in order to enhance the customer experience and optimize busi...
Increasing IoT connectivity is forcing enterprises to find elegant solutions to organize and visualize all incoming data from these connected devices with re-configurable dashboard widgets to effectively allow rapid decision-making for everything from immediate actions in tactical situations to strategic analysis and reporting. In his session at 18th Cloud Expo, Shikhir Singh, Senior Developer Relations Manager at Sencha, will discuss how to create HTML5 dashboards that interact with IoT devic...
So, you bought into the current machine learning craze and went on to collect millions/billions of records from this promising new data source. Now, what do you do with them? Too often, the abundance of data quickly turns into an abundance of problems. How do you extract that "magic essence" from your data without falling into the common pitfalls? In her session at @ThingsExpo, Natalia Ponomareva, Software Engineer at Google, will provide tips on how to be successful in large scale machine lear...
The IETF draft standard for M2M certificates is a security solution specifically designed for the demanding needs of IoT/M2M applications. In his session at @ThingsExpo, Brian Romansky, VP of Strategic Technology at TrustPoint Innovation, will explain how M2M certificates can efficiently enable confidentiality, integrity, and authenticity on highly constrained devices.
You think you know what’s in your data. But do you? Most organizations are now aware of the business intelligence represented by their data. Data science stands to take this to a level you never thought of – literally. The techniques of data science, when used with the capabilities of Big Data technologies, can make connections you had not yet imagined, helping you discover new insights and ask new questions of your data. In his session at @ThingsExpo, Sarbjit Sarkaria, data science team lead ...
In his session at 18th Cloud Expo, Sagi Brody, Chief Technology Officer at Webair Internet Development Inc., will focus on real world deployments of DDoS mitigation strategies in every layer of the network. He will give an overview of methods to prevent these attacks and best practices on how to provide protection in complex cloud platforms. He will also outline what we have found in our experience managing and running thousands of Linux and Unix managed service platforms and what specifically c...
Many private cloud projects were built to deliver self-service access to development and test resources. While those clouds delivered faster access to resources, they lacked visibility, control and security needed for production deployments. In their session at 18th Cloud Expo, Steve Anderson, Product Manager at BMC Software, and Rick Lefort, Principal Technical Marketing Consultant at BMC Software, will discuss how a cloud designed for production operations not only helps accelerate developer...
Manufacturers are embracing the Industrial Internet the same way consumers are leveraging Fitbits – to improve overall health and wellness. Both can provide consistent measurement, visibility, and suggest performance improvements customized to help reach goals. Fitbit users can view real-time data and make adjustments to increase their activity. In his session at @ThingsExpo, Mark Bernardo Professional Services Leader, Americas, at GE Digital, will discuss how leveraging the Industrial Interne...
Up until last year, enterprises that were looking into cloud services usually undertook a long-term pilot with one of the large cloud providers, running test and dev workloads in the cloud. With cloud’s transition to mainstream adoption in 2015, and with enterprises migrating more and more workloads into the cloud and in between public and private environments, the single-provider approach must be revisited. In his session at 18th Cloud Expo, Yoav Mor, multi-cloud solution evangelist at Cloudy...
You deployed your app with the Bluemix PaaS and it's gaining some serious traction, so it's time to make some tweaks. Did you design your application in a way that it can scale in the cloud? Were you even thinking about the cloud when you built the app? If not, chances are your app is going to break. Check out this webcast to learn various techniques for designing applications that will scale successfully in Bluemix, for the confidence you need to take your apps to the next level and beyond.
Unless you don’t use the internet, don’t live in California, or haven’t been paying attention to the recent news… you should be aware that self-driving cars are on their way to becoming a reality. I have seen them – they are real. If you believe in the future reality of self-driving cars, then continue reading on. If you don’t believe in the future possibilities, then I am not sure what to do to convince you other than discuss the very real changes that will roll out with the consumer producti...