Click here to close now.

Welcome!

Big Data Journal Authors: Elizabeth White, Roger Strukhoff, Liz McMillan, Plutora Blog, Gregor Petri

Related Topics: @ThingsExpo, Java, SOA & WOA, Linux, Virtualization, Web 2.0, Cloud Expo, Big Data Journal

@ThingsExpo: Article

Plumbing and the Internet of Things

It's Been a Long Odyssey For Us to Get Where We Are. Now What?

A couple of days ago, I noted the fundamental enterprise IT change driven over the past generation by user impatience - nobody likes waiting in line.

We can point to Moore's Law, Metcalf's Law, and a general business trend toward disintermediation and decentralization as well, taking note of the millions of hard-working people all over the world who've been making things faster, better, cheaper, and more effective for several decades.

All of this effort has led to the big change in IT during my career-the invention of plumbing.

Going to the Well
The bad, old way of MIS meant you went to the well to get your water. You visited the wellmaster, er, MIS manager, and hoped your ration, er, report, was ready. Sometimes MIS would bring the water to you, but only if you didn't bug them for it very much.

The minicomputers came, and with them, plumbing. Information flowed in two directions, and more or less when users wanted it. It had moved from the well into several silos, and you needed a different terminal to get at the stuff in each separate silo.

So soon enough, user impatience re-appeared. They wanted several types of information, and they wanted it to be available on their desks, in one place, all the time. In came PCs, approved or not, and forced IS to get better plumbing, usually a miraculous local network called Ethernet.

What Did They Ever Do For Us?
But users are wont to grumble and complain, and as with Monty Python's Biblical revolutionaries asking what the Romans had ever done for them, modern-day computer users didn't appreciate all the plumbing that IS had so graciously provided.

Once the world at large discovered the Internet, then the Worldwide Web, the old ways were doomed. There's been a constant back-and-forth battle for control between IT and users since that time, but modern-day information plumbing-much of it wireless-continues to be this nihilistic force that trumps the most rigorous IT efforts to control the flow.

With the great plumbing afforded by the Internet and Web came the battle to destroy those silos that had replaced the original well. This battle will no doubt continue for many more decades, as each new type of information flow creates new silos.

Constant Battle
Data types are data types, archives are archives, and an enterprise's information-one of its most valuable assets-just can't be tossed around willy nilly, like the records, books, newspapers, magazines, and laundry in my old college dorm room. It must be organized somehow.

Yet user demands for access to any information, anytime, anywhere, on any device are an inexorable force. The nearly 20-year odyssey of today's @CloudExpo @ThingsExpo and everything that goes with the event started with application service providers and web services.

The idea of deconstructing (or decoupling) what applications do from their silos was a profound, radical thought. It was also easier said than done.

Once developers and users started to think of software as a service rather than a product, though, they also started to think about how to measure it. An application is bought in a package or a download; a service is something that comes streaming in as you need it.

Following that thought, why not, then, combine specific services with one another to create a new service? Set theory and a facility for high-level mathematical proofs started to influence the thinking of how best to develop and deliver services.

SOA, Then Cloud
Web services extended into Service-Oriented Architecture (SOA), and a further decoupling at the hardware level (promulgated by software) brought us into the modern age of cloud computing.

The Internet of Things and Big Data are now possible with cloud computing, now that compute resources can appear infinite and highly flexible.

I wrote a piece once about how this sort of deconstruction was similar to revolutions in 20th century music, art, literature, and philosophy. A friend of mine said at least six people in the world would be interested in my piece-I can now say that, in fact, almost 5,000 people have read it over a time period of only five years. Here it is if you need some sleep.

Whither Plumbing?
Modern-day distributed computing can also be said to be simply a result of a human desire to improve things. It's commonly accepted wisdom that we shouldn't try to re-invent the wheel, but that's exactly what people do.

The ironic consequence of all this is now people have questions about the plumbing. Can the Internet withstand the onslaught of the coming zettabytes? What protocols, specifications, and techniques will be required to keep local information flows as local as possible, so as not to burden the bigger pipes?

We all know that the late Sen. Ted Stevens was right. The Internet is a series of tubes (or pipes), if structured with a little more subtlety and complexity than he articulated.

Now that the plumbing has addressed user impatience and improved user experiences for decades, will it become the bottleneck itself? And will a great concentrations of information among a small number of cloud services providers some day bring us back to having to depend on the well and its keepers for our cyber-survival?

Contact Me on Twitter

More Stories By Roger Strukhoff

Roger Strukhoff (@IoT2040) is Executive Director of the Tau Institute for Global ICT Research, with offices in Illinois and Manila. He is Conference Chair of @CloudExpo & @ThingsExpo, and Editor of SYS-CON Media's CloudComputing BigData & IoT Journals. He holds a BA from Knox College & conducted MBA studies at CSU-East Bay.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@BigDataExpo Stories
SYS-CON Events announced today that Vitria Technology, Inc. will exhibit at SYS-CON’s @ThingsExpo, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. Vitria will showcase the company’s new IoT Analytics Platform through live demonstrations at booth #330. Vitria’s IoT Analytics Platform, fully integrated and powered by an operational intelligence engine, enables customers to rapidly build and operationalize advanced analytics to deliver timely business outcomes ...
SYS-CON Events announced today that Dyn, the worldwide leader in Internet Performance, will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. Dyn is a cloud-based Internet Performance company. Dyn helps companies monitor, control, and optimize online infrastructure for an exceptional end-user experience. Through a world-class network and unrivaled, objective intelligence into Internet conditions, Dyn ensures...
Containers and microservices have become topics of intense interest throughout the cloud developer and enterprise IT communities. Accordingly, attendees at the upcoming 16th Cloud Expo at the Javits Center in New York June 9-11 will find fresh new content in a new track called PaaS | Containers & Microservices Containers are not being considered for the first time by the cloud community, but a current era of re-consideration has pushed them to the top of the cloud agenda. With the launch ...
CommVault has announced that top industry technology visionaries have joined its leadership team. The addition of leaders from companies such as Oracle, SAP, Microsoft, Cisco, PwC and EMC signals the continuation of CommVault Next, the company's business transformation for sales, go-to-market strategies, pricing and packaging and technology innovation. The company also announced that it had realigned its structure to create business units to more directly match how customers evaluate, deploy, op...
In their session at @ThingsExpo, Shyam Varan Nath, Principal Architect at GE, and Ibrahim Gokcen, who leads GE's advanced IoT analytics, focused on the Internet of Things / Industrial Internet and how to make it operational for business end-users. Learn about the challenges posed by machine and sensor data and how to marry it with enterprise data. They also discussed the tips and tricks to provide the Industrial Internet as an end-user consumable service using Big Data Analytics and Industrial C...
Cryptography has become one of the most underappreciated, misunderstood components of technology. It’s too easy for salespeople to dismiss concerns with three letters that nobody wants to question. ‘Yes, of course, we use AES.’ But what exactly are you trusting to be the ultimate guardian of your data? Let’s face it – you probably don’t know. An organic, grass-fed Kobe steak is a far cry from a Big Mac, but they’re both beef, right? Not exactly. Crypto is the same way. The US government require...
Software Defined Storage provides many benefits for customers including agility, flexibility, faster adoption of new technology and cost effectiveness. However, for IT organizations it can be challenging and complex to build your Enterprise Grade Storage from software. In his session at Cloud Expo, Paul Turner, CMO at Cloudian, looked at the new Original Design Manufacturer (ODM) market and how it is changing the storage world. Now Software Defined Storage companies can build Enterprise grade ...
Thanks to Docker, it becomes very easy to leverage containers to build, ship, and run any Linux application on any kind of infrastructure. Docker is particularly helpful for microservice architectures because their successful implementation relies on a fast, efficient deployment mechanism – which is precisely one of the features of Docker. Microservice architectures are therefore becoming more popular, and are increasingly seen as an interesting option even for smaller projects, instead of bein...
Performance is the intersection of power, agility, control, and choice. If you value performance, and more specifically consistent performance, you need to look beyond simple virtualized compute. Many factors need to be considered to create a truly performant environment. In his General Session at 15th Cloud Expo, Harold Hannon, Sr. Software Architect at SoftLayer, discussed how to take advantage of a multitude of compute options and platform features to make cloud the cornerstone of your onlin...
The explosion of connected devices / sensors is creating an ever-expanding set of new and valuable data. In parallel the emerging capability of Big Data technologies to store, access, analyze, and react to this data is producing changes in business models under the umbrella of the Internet of Things (IoT). In particular within the Insurance industry, IoT appears positioned to enable deep changes by altering relationships between insurers, distributors, and the insured. In his session at @Things...
Even as cloud and managed services grow increasingly central to business strategy and performance, challenges remain. The biggest sticking point for companies seeking to capitalize on the cloud is data security. Keeping data safe is an issue in any computing environment, and it has been a focus since the earliest days of the cloud revolution. Understandably so: a lot can go wrong when you allow valuable information to live outside the firewall. Recent revelations about government snooping, along...
SYS-CON Media announced that IBM, which offers the world’s deepest portfolio of technologies and expertise that are transforming the future of work, has launched ad campaigns on SYS-CON’s numerous online magazines such as Cloud Computing Journal, Virtualization Journal, SOA World Magazine, and IoT Journal. IBM’s campaigns focus on vendors in the technology marketplace, the future of testing, Big Data and analytics, and mobile platforms.
In his session at DevOps Summit, Tapabrata Pal, Director of Enterprise Architecture at Capital One, will tell a story about how Capital One has embraced Agile and DevOps Security practices across the Enterprise – driven by Enterprise Architecture; bringing in Development, Operations and Information Security organizations together. Capital Ones DevOpsSec practice is based upon three "pillars" – Shift-Left, Automate Everything, Dashboard Everything. Within about three years, from 100% waterfall, C...
The explosion of connected devices / sensors is creating an ever-expanding set of new and valuable data. In parallel the emerging capability of Big Data technologies to store, access, analyze, and react to this data is producing changes in business models under the umbrella of the Internet of Things (IoT). In particular within the Insurance industry, IoT appears positioned to enable deep changes by altering relationships between insurers, distributors, and the insured. In his session at @Things...
The Internet of Things (IoT) is rapidly in the process of breaking from its heretofore relatively obscure enterprise applications (such as plant floor control and supply chain management) and going mainstream into the consumer space. More and more creative folks are interconnecting everyday products such as household items, mobile devices, appliances and cars, and unleashing new and imaginative scenarios. We are seeing a lot of excitement around applications in home automation, personal fitness,...
Data-intensive companies that strive to gain insights from data using Big Data analytics tools can gain tremendous competitive advantage by deploying data-centric storage. Organizations generate large volumes of data, the vast majority of which is unstructured. As the volume and velocity of this unstructured data increases, the costs, risks and usability challenges associated with managing the unstructured data (regardless of file type, size or device) increases simultaneously, including end-to-...
The excitement around the possibilities enabled by Big Data is being tempered by the daunting task of feeding the analytics engines with high quality data on a continuous basis. As the once distinct fields of data integration and data management increasingly converge, cloud-based data solutions providers have emerged that can buffer your organization from the complexities of this continuous data cleansing and management so that you’re free to focus on the end goal: actionable insight.
When it comes to the Internet of Things, hooking up will get you only so far. If you want customers to commit, you need to go beyond simply connecting products. You need to use the devices themselves to transform how you engage with every customer and how you manage the entire product lifecycle. In his session at @ThingsExpo, Sean Lorenz, Technical Product Manager for Xively at LogMeIn, will show how “product relationship management” can help you leverage your connected devices and the data th...
The Internet of Things (IoT) is causing data centers to become radically decentralized and atomized within a new paradigm known as “fog computing.” To support IoT applications, such as connected cars and smart grids, data centers' core functions will be decentralized out to the network's edges and endpoints (aka “fogs”). As this trend takes hold, Big Data analytics platforms will focus on high-volume log analysis (aka “logs”) and rely heavily on cognitive-computing algorithms (aka “cogs”) to mak...
With several hundred implementations of IoT-enabled solutions in the past 12 months alone, this session will focus on experience over the art of the possible. Many can only imagine the most advanced telematics platform ever deployed, supporting millions of customers, producing tens of thousands events or GBs per trip, and hundreds of TBs per month. With the ability to support a billion sensor events per second, over 30PB of warm data for analytics, and hundreds of PBs for an data analytics arc...