Welcome!

@BigDataExpo Authors: Elizabeth White, Scott Allen, Pat Romanski, Dana Gardner, Liz McMillan

Related Topics: @BigDataExpo, Microservices Expo, Open Source Cloud, Containers Expo Blog, Server Monitoring, @CloudExpo

@BigDataExpo: Blog Post

Evolution and Innovation in Middleware

Undoubtedly, the future holds a number of surprises for the enterprise IT industry

2013 middleware predictions by Red Hat's Craig Muzilla. This post originally appeared on Dec. 18, 2012.

Last year, I offered my thoughts on trends and developments that the market would see in 2012. At that time, I felt that we were looking at a continued emphasis on cloud, while mobile and backend integration technologies would rise in prominence within enterprise IT. I think the industry made progress in all three areas: analysts indicate huge adoption of mobile technologies as a substitute for what would have typically been a laptop or desktop computer; at Red Hat we saw an uptick in interest around some of our backend integration tools like rules-based processing and business process management (BPM); and the industry as a whole saw a solidification around cloud visions and roadmaps from vendors.

One area that turned out to be much bigger than I had anticipated was the explosion and interest in big data. Moving forward, I think applications will be much more data-driven, using information generated by the millions of mobile devices I mentioned earlier.

To-date, the primary use of big data has been related to the analysis of large volumes of information that could not be analyzed using traditional data warehouses. I think this will continue; however, I anticipate a rise in applications wanting to participate in either big data or NoSQL solutions. I expect technologies such as Hive, which allows users to do traditional SQL queries in a big data setting, are going to become very important and popular in the coming year.

Transactional or production-related applications will need to interface with these big data solutions beyond simple analysis to take on some action or activity. Where I predict the market will likely see the most activity is around technologies like middleware that have been on the sidelines but may now begin to develop interfaces for things like MapReduce queries, Hive, or even traditional SQL queries. In this way I expect to see the more traditional application servers and tools like ESBs participate in the big data movement.

Another significant development that I anticipate for next year is the explosion of private cloud. There has been a lot of discussion lately about cloud in general, but public cloud has largely been the focus. Infrastructure-as-a-Service (IaaS) and Platform-as-a-Service (PaaS) technologies have both made a lot of progress from a public cloud standpoint, where they have primarily been used for development, testing and experimentation. I predict that PaaS will come out of this paradigm for production purposes. While very few applications are in production right now in public clouds, I think we'll see a lot of companies begin to take applications into production via private clouds.

A word of caution, though. Organizations need to shift their ways of thinking about governance models. Developers have much more responsibility and power than they did in the on-premises world. There was always a development process, and then an application went into operations, and operations took it into production. Today, we have the idea of DevOps, which is designed to empower the developer to not only work in the development phase, but then take the finished application into production and even manage it there. This model redefines governance because companies will need to think about what kind of responsibility and authority they give to staff members that may have not had those roles before. Ultimately, I think there will be a lot more flexibility, productivity and freedom, but companies will need to rethink their governance model to avoid running into problems.

In the near term, I predict the primary themes will remain the top priorities moving forward: cloud computing and PaaS, especially on-premises, will be important; OpenStack will play a big role in terms of basic cloud infrastructure for IaaS; and the industry will see continued movement in the mobile area. Today, most enterprise mobile activity has been around the client application with little backend service considerations, but I think we'll see a huge movement in iPhone or Android development, even natively, but requiring backend services such as security, transactions, enterprise integration, and persistence. As a result, I expect to see a lot of technology being developed that allows these mobile applications to fully participate in backend services and applications, and that will be a breakthrough for the industry.

In terms of big data, I hope to see a surge of technologies that seek to allow a broad set of applications, both analytical applications and transactional applications, become more involved. Whether this is using data in-memory, such as NoSQL solutions, or data management solutions like Hadoop with virtualized storage, I predict that it will ultimately lead to more data-driven applications. The foundation for this is already in place with MapReduce and Hadoop, and NoSQL solutions like Mongo and our own Red Hat JBoss Data Grid, but I think the interfaces required for participation from a broad set of applications still need to be built out over the next few years. Companies will look to NoSQL and big data solutions as a replacement for traditional relational databases or to reduce the dependency on them, and they will use them for a variety of transaction and analytical apps. I expect middleware to evolve to support this.

Long term, I think the nature of an enterprise application will change, especially as it relates to creating higher levels of abstraction, allowing non-technologists and business users to participate in the creation of those applications and mobile applications. Over the next two to five years, business users, consumers and partners will use tools like BPM and rules management that offer this level of abstraction to develop and adjust applications based on needs. There is some discussion regarding intelligent BPM (iBPM) now, but it still seems to be largely under the radar. The industry will likely hear much more discussion about these sophisticated and end user-friendly technologies, both in the cloud and in traditional uses, in the years to come.

Undoubtedly, the future holds a number of surprises for the enterprise IT industry. While my thoughts and observations here are based on some existing trends, all of these things are driving innovation. What's more, cloud, mobile and big data are all driving the need for innovation. Small pieces of innovation are happening every day in communities at the developer level. It's exciting to see and be a part of these innovations as they emerge, take hold in the enterprise and make their mark on the world.

More Stories By Daniel Thompson

I curate the content on this page, but the credit goes to my talented colleagues for the posts that you see here. Much of what you read on this page is the work of friends at How to JBoss, and I encourage you to drop by the site at http://www.howtojboss.com for some of the best JBoss technical and non-technical content for developers, architects and technology executives on the Web.

@BigDataExpo Stories
With the proliferation of both SQL and NoSQL databases, organizations can now target specific fit-for-purpose database tools for their different application needs regarding scalability, ease of use, ACID support, etc. Platform as a Service offerings make this even easier now, enabling developers to roll out their own database infrastructure in minutes with minimal management overhead. However, this same amount of flexibility also comes with the challenges of picking the right tool, on the right ...
DevOps at Cloud Expo – being held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA – announces that its Call for Papers is open. Born out of proven success in agile development, cloud computing, and process automation, DevOps is a macro trend you cannot afford to miss. From showcase success stories from early adopters and web-scale businesses, DevOps is expanding to organizations of all sizes, including the world's largest enterprises – and delivering real results. Am...
"This week we're really focusing on scalability, asset preservation and how do you back up to the cloud and in the cloud with object storage, which is really a new way of attacking dealing with your file, your blocked data, where you put it and how you access it," stated Jeff Greenwald, Senior Director of Market Development at HGST, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
The 19th International Cloud Expo has announced that its Call for Papers is open. Cloud Expo, to be held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, brings together Cloud Computing, Big Data, Internet of Things, DevOps, Digital Transformation, Microservices and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding business opportuni...
Large scale deployments present unique planning challenges, system commissioning hurdles between IT and OT and demand careful system hand-off orchestration. In his session at @ThingsExpo, Jeff Smith, Senior Director and a founding member of Incenergy, will discuss some of the key tactics to ensure delivery success based on his experience of the last two years deploying Industrial IoT systems across four continents.
The Internet of Things will challenge the status quo of how IT and development organizations operate. Or will it? Certainly the fog layer of IoT requires special insights about data ontology, security and transactional integrity. But the developmental challenges are the same: People, Process and Platform. In his session at @ThingsExpo, Craig Sproule, CEO of Metavine, demonstrated how to move beyond today's coding paradigm and shared the must-have mindsets for removing complexity from the develo...
“We're a global managed hosting provider. Our core customer set is a U.S.-based customer that is looking to go global,” explained Adam Rogers, Managing Director at ANEXIA, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
SYS-CON Events announced today that MangoApps will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. MangoApps provides modern company intranets and team collaboration software, allowing workers to stay connected and productive from anywhere in the world and from any device.
IoT is rapidly changing the way enterprises are using data to improve business decision-making. In order to derive business value, organizations must unlock insights from the data gathered and then act on these. In their session at @ThingsExpo, Eric Hoffman, Vice President at EastBanc Technologies, and Peter Shashkin, Head of Development Department at EastBanc Technologies, discussed how one organization leveraged IoT, cloud technology and data analysis to improve customer experiences and effi...
The IETF draft standard for M2M certificates is a security solution specifically designed for the demanding needs of IoT/M2M applications. In his session at @ThingsExpo, Brian Romansky, VP of Strategic Technology at TrustPoint Innovation, explained how M2M certificates can efficiently enable confidentiality, integrity, and authenticity on highly constrained devices.
"We've discovered that after shows 80% if leads that people get, 80% of the conversations end up on the show floor, meaning people forget about it, people forget who they talk to, people forget that there are actual business opportunities to be had here so we try to help out and keep the conversations going," explained Jeff Mesnik, Founder and President of ContentMX, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
Let’s face it, embracing new storage technologies, capabilities and upgrading to new hardware often adds complexity and increases costs. In his session at 18th Cloud Expo, Seth Oxenhorn, Vice President of Business Development & Alliances at FalconStor, discussed how a truly heterogeneous software-defined storage approach can add value to legacy platforms and heterogeneous environments. The result reduces complexity, significantly lowers cost, and provides IT organizations with improved efficienc...
"When you think about the data center today, there's constant evolution, The evolution of the data center and the needs of the consumer of technology change, and they change constantly," stated Matt Kalmenson, VP of Sales, Service and Cloud Providers at Veeam Software, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
Internet of @ThingsExpo, taking place November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with the 19th International Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world and ThingsExpo Silicon Valley Call for Papers is now open.
The IoT is changing the way enterprises conduct business. In his session at @ThingsExpo, Eric Hoffman, Vice President at EastBanc Technologies, discussed how businesses can gain an edge over competitors by empowering consumers to take control through IoT. He cited examples such as a Washington, D.C.-based sports club that leveraged IoT and the cloud to develop a comprehensive booking system. He also highlighted how IoT can revitalize and restore outdated business models, making them profitable ...
In his session at @DevOpsSummit at 19th Cloud Expo, Yoseph Reuveni, Director of Software Engineering at Jet.com, will discuss Jet.com's journey into containerizing Microsoft-based technologies like C# and F# into Docker. He will talk about lessons learned and challenges faced, the Mono framework tryout and how they deployed everything into Azure cloud. Yoseph Reuveni is a technology leader with unique experience developing and running high throughput (over 1M tps) distributed systems with extre...
We all know the latest numbers: Gartner, Inc. forecasts that 6.4 billion connected things will be in use worldwide in 2016, up 30 percent from last year, and will reach 20.8 billion by 2020. We're rapidly approaching a data production of 40 zettabytes a day – more than we can every physically store, and exabytes and yottabytes are just around the corner. For many that’s a good sign, as data has been proven to equal money – IF it’s ingested, integrated, and analyzed fast enough. Without real-ti...
"There's a growing demand from users for things to be faster. When you think about all the transactions or interactions users will have with your product and everything that is between those transactions and interactions - what drives us at Catchpoint Systems is the idea to measure that and to analyze it," explained Leo Vasiliou, Director of Web Performance Engineering at Catchpoint Systems, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York Ci...
As companies gain momentum, the need to maintain high quality products can outstrip their development team’s bandwidth for QA. Building out a large QA team (whether in-house or outsourced) can slow down development and significantly increases costs. This eBook takes QA profiles from 5 companies who successfully scaled up production without building a large QA team and includes: What to consider when choosing CI/CD tools How culture and communication can make or break implementation
Actian Corporation has announced the latest version of the Actian Vector in Hadoop (VectorH) database, generally available at the end of July. VectorH is based on the same query engine that powers Actian Vector, which recently doubled the TPC-H benchmark record for non-clustered systems at the 3000GB scale factor (see tpc.org/3323). The ability to easily ingest information from different data sources and rapidly develop queries to make better business decisions is becoming increasingly importan...