@BigDataExpo Authors: Elizabeth White, Pat Romanski, Sematext Blog, Ed Featherston, Roger Strukhoff

Related Topics: @CloudExpo, Java IoT, Linux Containers, Containers Expo Blog, @BigDataExpo, SDN Journal

@CloudExpo: Article

Bringing New Intelligence to Cloud Orchestration with Cloudify 3.0

Full product rewrite delivers software-defined orchestration for applications on the cloud

GigaSpaces Technologies on Monday announced it has completely re-architected its Cloudify offering to provide Intelligent Orchestration of applications on the cloud. With this product rewrite, the new Cloudify orchestration platform simplifies the application deployment, management and scaling experience on OpenStack, VMware vSphere and other clouds and environments.

"To deliver this next generation, intelligent orchestration, we needed to rethink Cloudify's design," said Yaron Parasol, VP of Product at GigaSpaces. "With a new language of code, adoption of industry standards and development of scalable and custom workflows, we created something that few are doing today - orchestration of the entire app lifecycle that encompasses both pre-deployment and post-deployment management with a single platform."

In current orchestration models, most tools focus primarily on application installation, while much of application management occurs after deployment. As a result, vast custom tool chains are often used to manually manage post-deployment processes such as monitoring and logging, leading to significant overhead, complexity and inconsistency across systems.

Cloudify's redesign provides a simple solution for managing the full application lifecycle. The new intelligent orchestration model introduces a feedback loop that automates fixes and updates without manual intervention, all with a single platform that integrates with any tool chain. Cloudify 3.0 reduces the complexity of cloud application management and ensures that managed applications meet their desired SLA.

Cloudify 3.0 Highlights:
New intelligence in orchestration:
Cloudify 3.0 eliminates the boundaries between orchestration and monitoring, providing a mechanism that automatically reacts to monitored events with appropriate corrective measures. Version 3.0 includes these building blocks of custom workflows, a workflow engine and a modeling language that enables the automation of any process and any stack. The subsequent release (due in Q4 2014) will introduce monitoring and custom policies for automated triggering of such corrective measures to provide auto-healing and auto-scaling capabilities.

Integrating the entire automation and monitoring tool chain: Cloudify 3.0 brings together a variety of tools that are used throughout the various stages of the application lifecycle. In doing so, Cloudify promotes common industry best practices, making it easy to integrate and use best-of-breed tools to manage the environment. Cloudify has a new plug-in architecture that enables easy integration of a wide range of tools for monitoring, configuration management and cloud infrastructure. Examples of such integration include Chef, Puppet, Fabric and Docker for configuration management, OpenStack Heat for infrastructure orchestration, logstash and Elasticsearch for logging and monitoring, and Reimann.IO for real-time analytics.

Native integration with OpenStack: As OpenStack is fast becoming the de facto standard for private clouds, Cloudify 3.0 offers even tighter integration with OpenStack technology and core services, including KeyStone, Neutron, Nova and Heat. The underlying design of Cloudify was re-architected to match the design principles of OpenStack services, including the rewriting of the core services in Python and leveraging common infrastructure building blocks such as RabbitMQ.

Support for VMware, CloudStack, SoftLayer and other clouds: Cloudify 3.0 contains built-in plug-ins for VMware vSphere and Apache CloudStack, and will soon have plug-ins for vCloud and SoftLayer. It comes with open plug-in architecture to support other clouds, including Amazon AWS, GCE and Linux containers such as Docker (plug-ins for all of which will be released in the coming few weeks). With Cloudify 3.0, users can span the same application across multiple cloud environments without creating a new Cloudify setup per environment. This is useful for users who are transitioning from their existing environment into a cloud environment and also for allowing bursting and hybrid deployments between OpenStack, VMware, Amazon and other clouds.

New topology-driven monitoring: Cloudify 3.0 introduces a new concept of topology-driven monitoring in which the entire application management and tracking system is centralized around the application topology, rather than the infrastructure. This makes it possible at any given moment to track not only the state of the application, but also the status of deployment, updates and scaling processes through a single view. As the monitoring system is integrated with the orchestration engine, the two systems are always in sync and up to date, eliminating the need to rely on external discover services.

Support for the TOSCA specification: TOSCA (Topology and Orchestration Specification for Cloud Applications) allows users to describe any set of automation processes on cloud applications with an extendable set of hooks and component types. Cloudify 3.0 uses a YAML-based orchestration template driven by the TOSCA specification. The next release of Cloudify will include full syntax compatibility with the TOSCA specification as soon as it becomes officially supported.

Multiple applications that can span thousands of nodes: Cloudify 3.0 allows for management and monitoring of large scale applications using a message broker to manage the communication with its managed instances and a logging and analysis engine for Big Data scale.

More Stories By Pat Romanski

News Desk compiles and publishes breaking news stories, press releases and latest news articles as they happen.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.

@BigDataExpo Stories
SYS-CON Events announced today that Niagara Networks will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Niagara Networks offers the highest port-density systems, and the most complete Next-Generation Network Visibility systems including Network Packet Brokers, Bypass Switches, and Network TAPs.
In an era of historic innovation fueled by unprecedented access to data and technology, the low cost and risk of entering new markets has leveled the playing field for business. Today, any ambitious innovator can easily introduce a new application or product that can reinvent business models and transform the client experience. In their Day 2 Keynote at 19th Cloud Expo, Mercer Rowe, IBM Vice President of Strategic Alliances, and Raejeanne Skillern, Intel Vice President of Data Center Group and ...
Data is the fuel that drives the machine learning algorithmic engines and ultimately provides the business value. In his session at Cloud Expo, Ed Featherston, a director and senior enterprise architect at Collaborative Consulting, will discuss the key considerations around quality, volume, timeliness, and pedigree that must be dealt with in order to properly fuel that engine.
SYS-CON Events announced today that Cemware will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Use MATLAB functions by just visiting website mathfreeon.com. MATLAB compatible, freely usable, online platform services. As of October 2016, 80,000 users from 180 countries are enjoying our platform service.
Traditional on-premises data centers have long been the domain of modern data platforms like Apache Hadoop, meaning companies who build their business on public cloud were challenged to run Big Data processing and analytics at scale. But recent advancements in Hadoop performance, security, and most importantly cloud-native integrations, are giving organizations the ability to truly gain value from all their data. In his session at 19th Cloud Expo, David Tishgart, Director of Product Marketing ...
Virgil consists of an open-source encryption library, which implements Cryptographic Message Syntax (CMS) and Elliptic Curve Integrated Encryption Scheme (ECIES) (including RSA schema), a Key Management API, and a cloud-based Key Management Service (Virgil Keys). The Virgil Keys Service consists of a public key service and a private key escrow service. 

The best way to leverage your Cloud Expo presence as a sponsor and exhibitor is to plan your news announcements around our events. The press covering Cloud Expo and @ThingsExpo will have access to these releases and will amplify your news announcements. More than two dozen Cloud companies either set deals at our shows or have announced their mergers and acquisitions at Cloud Expo. Product announcements during our show provide your company with the most reach through our targeted audiences.
SYS-CON Events announced today that Embotics, the cloud automation company, will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Embotics is the cloud automation company for IT organizations and service providers that need to improve provisioning or enable self-service capabilities. With a relentless focus on delivering a premier user experience and unmatched customer support, Embotics is the fas...
The Internet of Things (IoT), in all its myriad manifestations, has great potential. Much of that potential comes from the evolving data management and analytic (DMA) technologies and processes that allow us to gain insight from all of the IoT data that can be generated and gathered. This potential may never be met as those data sets are tied to specific industry verticals and single markets, with no clear way to use IoT data and sensor analytics to fulfill the hype being given the IoT today.
DevOps is speeding towards the IT world like a freight train and the hype around it is deafening. There is no reason to be afraid of this change as it is the natural reaction to the agile movement that revolutionized development just a few years ago. By definition, DevOps is the natural alignment of IT performance to business profitability. The relevance of this has yet to be quantified but it has been suggested that the route to the CEO’s chair will come from the IT leaders that successfully ma...
More and more brands have jumped on the IoT bandwagon. We have an excess of wearables – activity trackers, smartwatches, smart glasses and sneakers, and more that track seemingly endless datapoints. However, most consumers have no idea what “IoT” means. Creating more wearables that track data shouldn't be the aim of brands; delivering meaningful, tangible relevance to their users should be. We're in a period in which the IoT pendulum is still swinging. Initially, it swung toward "smart for smar...
@ThingsExpo has been named the Top 5 Most Influential M2M Brand by Onalytica in the ‘Machine to Machine: Top 100 Influencers and Brands.' Onalytica analyzed the online debate on M2M by looking at over 85,000 tweets to provide the most influential individuals and brands that drive the discussion. According to Onalytica the "analysis showed a very engaged community with a lot of interactive tweets. The M2M discussion seems to be more fragmented and driven by some of the major brands present in the...
The Quantified Economy represents the total global addressable market (TAM) for IoT that, according to a recent IDC report, will grow to an unprecedented $1.3 trillion by 2019. With this the third wave of the Internet-global proliferation of connected devices, appliances and sensors is poised to take off in 2016. In his session at @ThingsExpo, David McLauchlan, CEO and co-founder of Buddy Platform, discussed how the ability to access and analyze the massive volume of streaming data from millio...
SYS-CON Events announced today that Pulzze Systems will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Pulzze Systems, Inc. provides infrastructure products for the Internet of Things to enable any connected device and system to carry out matched operations without programming. For more information, visit http://www.pulzzesystems.com.
Successful digital transformation requires new organizational competencies and capabilities. Research tells us that the biggest impediment to successful transformation is human; consequently, the biggest enabler is a properly skilled and empowered workforce. In the digital age, new individual and collective competencies are required. In his session at 19th Cloud Expo, Bob Newhouse, CEO and founder of Agilitiv, will draw together recent research and lessons learned from emerging and established ...
Enterprise IT has been in the era of Hybrid Cloud for some time now. But it seems most conversations about Hybrid are focused on integrating AWS, Microsoft Azure, or Google ECM into existing on-premises systems. Where is all the Private Cloud? What do technology providers need to do to make their offerings more compelling? How should enterprise IT executives and buyers define their focus, needs, and roadmap, and communicate that clearly to the providers?
One of biggest questions about Big Data is “How do we harness all that information for business use quickly and effectively?” Geographic Information Systems (GIS) or spatial technology is about more than making maps, but adding critical context and meaning to data of all types, coming from all different channels – even sensors. In his session at @ThingsExpo, William (Bill) Meehan, director of utility solutions for Esri, will take a closer look at the current state of spatial technology and ar...
You have great SaaS business app ideas. You want to turn your idea quickly into a functional and engaging proof of concept. You need to be able to modify it to meet customers' needs, and you need to deliver a complete and secure SaaS application. How could you achieve all the above and yet avoid unforeseen IT requirements that add unnecessary cost and complexity? You also want your app to be responsive in any device at any time. In his session at 19th Cloud Expo, Mark Allen, General Manager of...
SYS-CON Events announced today that Streamlyzer will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Streamlyzer is a powerful analytics for video streaming service that enables video streaming providers to monitor and analyze QoE (Quality-of-Experience) from end-user devices in real time.
Cloud based infrastructure deployment is becoming more and more appealing to customers, from Fortune 500 companies to SMEs due to its pay-as-you-go model. Enterprise storage vendors are able to reach out to these customers by integrating in cloud based deployments; this needs adaptability and interoperability of the products confirming to cloud standards such as OpenStack, CloudStack, or Azure. As compared to off the shelf commodity storage, enterprise storages by its reliability, high-availabil...