Welcome!

@BigDataExpo Authors: Liz McMillan, Pat Romanski, Elizabeth White, Yeshim Deniz, William Schmarzo

Related Topics: @BigDataExpo, Mobile IoT, Cloud Security

@BigDataExpo: Blog Post

A Mature In-Memory Data Fabric By @GridGain | @CloudExpo [#BigData]

The growing demands of Big Data, SaaS, & mobile computing have led to a surge in new apps that access & process data in memory

Why the Fast Data World Needs a Proven and Mature In-Memory Data Fabric

Much of what human beings experience as commonplace today - social networking, online gaming, mobile and wearable computing -- was impossible a decade ago. One thing is certain: we're going to see even more impressive advances in the next few years. However, this will be the result of a fundamental change in computing, as current methods have reached their limit in terms of speed and volume. Traditional disk-based storage infrastructure is far too slow to meet today's data demands for speed at volume, which are growing exponentially. In-memory computing (IMC) offers the only practical way to scale to today's computing demands. Although IMC may once have been the domain of only the most well-funded organizations, the falling cost of RAM means that it can now be accomplished by any organization on commodity hardware.

As Mike Matchett, Senior Analyst, The Taneja Group said: "Clearly the big data ecosystem is evolving, tackling more kinds of analytics and addressing a wider variety of applications, including enterprise operational intelligence (EOI) apps that require faster interactive latencies, predictive machine learning, split-second decision-making, and high-volume processing. In-memory computing is key to profiting from new competitively differentiating big data solutions like these."

Spinning disks will certainly be around for years to come, but the growing demands of Big Data, SaaS, mobile computing and Internet scale, coupled with dramatic improvements in RAM economics and availability, have led to a surge in new applications that access and process data in memory. As a result, IMC is quickly moving from esoteric concept to mainstream adoption. Like any game-changing technology, developers need to be able to learn it, experiment with it and test its limits in order to fulfill its promise.

As you may know, GridGain has been at the cutting edge of developing a comprehensive in-memory data processing framework for real-time transactional and analytical use cases for many years. Hundreds of organizations around the globe now use its proven open source technology under the Apache 2.0 license. This work has culminated in the recent release of its application- and data-agnostic GridGain In-Memory Data Fabric. GridGain's in-memory data fabric code base shares the goals of easy accessibility and free redistribution with other memory-centric, open source data exchange frameworks that have emerged -- most notably the Apache Spark project in the Hadoop world.

Today we are thrilled to announce that the GridGain In-Memory Data Fabric has been accepted into the Apache Incubator program under the name "Apache Ignite." Our decision to contribute our pride and joy to the Apache Software Foundation (ASF) will ensure that this robust and battle-tested software not only remains broadly available, but will continue gaining community support to become the standard upon which in-memory computing's promise will be realized. While GridGain will continue to be a strong contributor to the Ignite code base and offer new and innovative enterprise-grade features to its commercial product, the platform's core code will be managed by the non-profit ASF, home of the world's most successful open source projects.

Mike Matchett, The Taneja Group, continues: "GridGain has now put their key IP out for the world to use as Apache Ignite. We predict an enthusiastic adoption curve since GridGain's approach leverages current developer skills and accelerates existing Hadoop apps without modification, providing an easy transition into in-memory computing."

In order to explain why now is the right time to trust our code base to the ASF, it is first necessary to explain why we went to an open source model less than a year ago--and for that matter, why we spent years developing this software in the first place.

Earlier this year, we took an important step in order to make the transformation to IMC truly accessible by shifting to an open source model through an Apache 2.0 license. Our motivation was simple: remove all barriers to IMC adoption and accelerate the innovation that's poised to occur through this technology. We wanted to introduce IMC to the mass market in a way that would give developers maximum freedom to experiment with it and discover the amazing things it allows you to  do - for example, accelerating drug discovery for diseases such as cancer. The first step was to make our mature and tested IMC platform open source, so that the technology would be as widely available and easily adoptable as possible. So we put the IMC code up on places like GitHub, which resulted in a more than 2000 percent increase in downloads in just a few months, clearly validating the huge interest from the community in the software.

The second step -- turning over the keys to the Apache Software Foundation -- will drive true community-building beyond just open source consumption, and of course will ensure the in-memory data fabric's viability for the long term. By doing this, we hope to continue to fast-track both the adoption and adaptation of this technology.

Ilya Sterin, Sr. Director of Engineering, Chronotrack Systems, summed up the advantages of this strategy: "GridGain's In-Memory Data Fabric enables us to solve our data and compute scale challenges, which become increasingly complex as our systems grow to support more events and athletes. With its track record behind open source projects, the Apache Software Foundation's backing of GridGain's open source platform gives us confidence that we can rely on it for the long term, and that we can expect to see ongoing innovation as this project is opened to thousands of contributors."

Ultimately, community-driven adoption of open source in-memory data fabric technology will enable a new class of transactional, analytical and hybrid real-time applications that will allow even the smallest organizations to gain a competitive advantage from fast, data-driven decisions and operations. We believe Apache Ignite has all the right ingredients to become for the Fast Data world of the future what Hadoop is for Big Data today.

Let the innovation begin!

More Stories By Nikita Ivanov

Nikita Ivanov is founder and CEO of GridGain Systems, started in 2007 and funded by RTP Ventures and Almaz Capital. Nikita has led GridGain to develop advanced and distributed in-memory data processing technologies – the top Java in-memory computing platform starting every 10 seconds around the world today.

Nikita has over 20 years of experience in software application development, building HPC and middleware platforms, contributing to the efforts of other startups and notable companies including Adaptec, Visa and BEA Systems. Nikita was one of the pioneers in using Java technology for server side middleware development while working for one of Europe’s largest system integrators in 1996.

He is an active member of Java middleware community, contributor to the Java specification, and holds a Master’s degree in Electro Mechanics from Baltic State Technical University, Saint Petersburg, Russia.

@BigDataExpo Stories
SYS-CON Events announced today that Cedexis will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Cedexis is the leader in data-driven enterprise global traffic management. Whether optimizing traffic through datacenters, clouds, CDNs, or any combination, Cedexis solutions drive quality and cost-effectiveness.
SYS-CON Events announced today that Enroute Lab will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Enroute Lab is an industrial design, research and development company of unmanned robotic vehicle system. For more information, please visit http://elab.co.jp/.
SYS-CON Events announced today that Mobile Create USA will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Mobile Create USA Inc. is an MVNO-based business model that uses portable communication devices and cellular-based infrastructure in the development, sales, operation and mobile communications systems incorporating GPS capabi...
SYS-CON Events announced today that Suzuki Inc. will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Suzuki Inc. is a semiconductor-related business, including sales of consuming parts, parts repair, and maintenance for semiconductor manufacturing machines, etc. It is also a health care business providing experimental research for...
Cloud-based disaster recovery is critical to any production environment and is a high priority for many enterprise organizations today. Nearly 40% of organizations have had to execute their BCDR plan due to a service disruption in the past two years. Zerto on IBM Cloud offer VMware and Microsoft customers simple, automated recovery of on-premise VMware and Microsoft workloads to IBM Cloud data centers.
Real IoT production deployments running at scale are collecting sensor data from hundreds / thousands / millions of devices. The goal is to take business-critical actions on the real-time data and find insights from stored datasets. In his session at @ThingsExpo, John Walicki, Watson IoT Developer Advocate at IBM Cloud, will provide a fast-paced developer journey that follows the IoT sensor data from generation, to edge gateway, to edge analytics, to encryption, to the IBM Bluemix cloud, to Wa...
SYS-CON Events announced today that Massive Networks, that helps your business operate seamlessly with fast, reliable, and secure internet and network solutions, has been named "Exhibitor" of SYS-CON's 21st International Cloud Expo ®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. As a premier telecommunications provider, Massive Networks is headquartered out of Louisville, Colorado. With years of experience under their belt, their team of...
SYS-CON Events announced today that Nihon Micron will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Nihon Micron Co., Ltd. strives for technological innovation to establish high-density, high-precision processing technology for providing printed circuit board and metal mount RFID tags used for communication devices. For more inf...
SYS-CON Events announced today that mruby Forum will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. mruby is the lightweight implementation of the Ruby language. We introduce mruby and the mruby IoT framework that enhances development productivity. For more information, visit http://forum.mruby.org/.
SYS-CON Events announced today that Ryobi Systems will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Ryobi Systems Co., Ltd., as an information service company, specialized in business support for local governments and medical industry. We are challenging to achive the precision farming with AI. For more information, visit http:...
SYS-CON Events announced today that SIGMA Corporation will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. uLaser flow inspection device from the Japanese top share to Global Standard! Then, make the best use of data to flip to next page. For more information, visit http://www.sigma-k.co.jp/en/.
Today traditional IT approaches leverage well-architected compute/networking domains to control what applications can access what data, and how. DevOps includes rapid application development/deployment leveraging concepts like containerization, third-party sourced applications and databases. Such applications need access to production data for its test and iteration cycles. Data Security? That sounds like a roadblock to DevOps vs. protecting the crown jewels to those in IT.
SYS-CON Events announced today that Daiya Industry will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Daiya Industry specializes in orthotic support systems and assistive devices with pneumatic artificial muscles in order to contribute to an extended healthy life expectancy. For more information, please visit https://www.daiyak...
SYS-CON Events announced today that B2Cloud will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. B2Cloud specializes in IoT devices for preventive and predictive maintenance in any kind of equipment retrieving data like Energy consumption, working time, temperature, humidity, pressure, etc.
Automation is enabling enterprises to design, deploy, and manage more complex, hybrid cloud environments. Yet the people who manage these environments must be trained in and understanding these environments better than ever before. A new era of analytics and cognitive computing is adding intelligence, but also more complexity, to these cloud environments. How smart is your cloud? How smart should it be? In this power panel at 20th Cloud Expo, moderated by Conference Chair Roger Strukhoff, paneli...
SYS-CON Events announced today that NetApp has been named “Bronze Sponsor” of SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. NetApp is the data authority for hybrid cloud. NetApp provides a full range of hybrid cloud data services that simplify management of applications and data across cloud and on-premises environments to accelerate digital transformation. Together with their partners, NetApp em...
What is the best strategy for selecting the right offshore company for your business? In his session at 21st Cloud Expo, Alan Winters, U.S. Head of Business Development at MobiDev, will discuss the things to look for - positive and negative - in evaluating your options. He will also discuss how to maximize productivity with your offshore developers. Before you start your search, clearly understand your business needs and how that impacts software choices.
SYS-CON Events announced today that Interface Corporation will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Interface Corporation is a company developing, manufacturing and marketing high quality and wide variety of industrial computers and interface modules such as PCIs and PCI express. For more information, visit http://www.i...
SYS-CON Events announced today that Keisoku Research Consultant Co. will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Keisoku Research Consultant, Co. offers research and consulting in a wide range of civil engineering-related fields from information construction to preservation of cultural properties. For more information, vi...
SYS-CON Events announced today that MIRAI Inc. will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. MIRAI Inc. are IT consultants from the public sector whose mission is to solve social issues by technology and innovation and to create a meaningful future for people.