Big Data Journal Authors: Elizabeth White, Liz McMillan, Kevin Benedict, Pat Romanski, Andreas Grabner

News Feed Item

WSO2 Launches Latest Releases of WSO2 Complex Event Processor and WSO2 Business Activity Monitor, Providing Industry First With Simultaneous Analysis of Massive Data Streams in Real-Time and Batch

Sensors, the Web, cloud and mobile computing are driving unprecedented volumes of information. In response, enterprises are adopting big data strategies to transform that information into insights about their business. WSO2 supports this demand with the latest releases of two products: WSO2 Complex Event Processor (WSO2 CEP) 3.0 and WSO2 Business Activity Monitor (WSO2 BAM) 2.4.

WSO2 CEP 3.0 and WSO2 BAM 2.4 complement database management systems in addressing the big data challenge. Working together, the integrated WSO2 products provide the industry’s first solution for enabling data streams to be analyzed simultaneously in real-time (with WSO2 CEP 3.0) and via batch processing (with WSO2 BAM 2.4). As a result, enterprises have unprecedented flexibility for analyzing the vast streams of events coming into the organization to gain valuable insights into their business.

With today’s launch:

WSO2 CEP 3.0, which is designed for real-time complex event processing, has been significantly re-architected. It also offers several new features within the WSO2 Siddhi CEP engine that increase performance up to 50%, expands event management functionality, and adds dashboard integration via WSO2 User Engagement Server for real-time event analysis and visualization.

WSO2 BAM 2.4, which supports batch analysis, adds Apache Cassandra indexing support to facilitate searches. It also offers a new activity dashboard for viewing events in real-time, and incremental processing and timestamp data type support through Apache Cassandra and Apache Hive.

WSO2 CEP 3.0 and WSO2 BAM 2.4 inherit new capabilities from Version 4.2 of the WSO2 Carbon core framework on which both products are built, including support for Hazelcast, multi-profile deployment, and synchronous deployment of artifacts.

As with all WSO2 Carbon middleware products, WSO2 CEP 3.0 and WSO2 BAM 2.4 are fully multitenant and cloud-ready. This means IT professionals can write an application once and deploy it on the same middleware on-premises, in the cloud, or in a hybrid environment.

The Bigger Picture Around Big Data

“Big data investments in 2013 continue to rise, with 64% of organizations investing or planning to invest in big data technology compared with 58% last year. Investments are led by media and communications, banking and services. Planned investments the next two years are highest for transportation, healthcare and insurance. Fewer than 8% of respondents have deployed,” observes Gartner in the report, Survey Analysis: Big Data Adoption in 2013 Shows Substance Behind the Hype1, which was published September 12, 2013. The report further notes, “Companies either are or will be looking at a variety of technologies to extract value from their big data projects, basing choices on the types of data processed, responsiveness and timeliness requirements, and analytical workload.”

“IT leaders and business teams who separate business signals from transaction noise can transform their business operations into a proactive, collaborative model that increases customer-centric interaction, streamlines partner coordination, and enhances revenue growth,” said Dr. Sanjiva Weerawarana, WSO2 founder and CEO. “Together, our WSO2 CEP 3.0 and WSO2 BAM 2.4 products uniquely complement transactional databases by providing the only solution to simultaneously analyze business activity across multiple data formats and message channels in real-time for timely operational management and via batch for effective business planning.”

WSO2 Complex Event Processor 3.0

WSO2 CEP provides complex event processing and event stream processing to enable solutions that require analysis over time, such as fraud detection, algorithmic trading analysis, sales, shipping or order status, and other business events. Using WSO2 CEP, developers and architects can easily create queries and analysis of real-time event streams to drive real-time business decisions based on time-based events.

WSO2 CEP 3.0 builds on the performance capabilities introduced in 2012 with version 2.0, which included a new WSO2 Siddhi CEP engine that increased performance by up to 10x and support for the high-performance Apache Thrift transport. The newest version has been rewritten to reduce the tight coupling between product components and enable their use in other WSO2 middleware products. Other major enhancements have been made to the CEP engine and WSO2 CEP’s event management functionality.

New CEP Engine Capabilities

Version 3.0 of WSO2 CEP adds several new capabilities to WSO2 Siddhi, which have increased performance by up to 50% over the previous release. The CEP engine now supports dynamic query partitioning based on incoming events, which increases performance. It also lets users store, retrieve and process events in a database table-like structure, with the option to use “in-memory table” or “relational table” style event tables. A new event adaptor manager in WSO2 Siddhi for broker manager-related configurations makes it easier to create event adaptors and write custom event adaptors quickly. Other enhancements to the CEP engine, include:

  • Output rating limiting, which empowers users to decide when WSO2 CEP needs to trigger events out.
  • Three new built-in functions: Coalesce, to coalesce attributes and get the value from an attribute that has the available data; Convert, to convert an event attribute from one data type to another; and IsMatch, to compare an event attribute to a regular expression and see if there is a match.
  • An external time window, which enables the CEP engine to consider timestamps from and external source, not just the host machine clock, for time-related processing.
  • Support for WSO2 Siddhi stats calculation, so users can monitor event statistics (incoming count, processed count etc.) within the CEP engine, itself.
  • Support for event tracing at multiple stages of an event flow by providing information on how events get changed in each and every component.
  • Default timestamp and attribute-type converters, which let users convert an event attribute data type to another without having to write an extension.
  • Ability to retrieve resources/properties from the registry, allowing users to set the resource location in WSO2 Siddhi queries, so the CEP engine can get the resource from the registry dynamically at runtime.

Enhanced Event Management

WSO2 CEP 3.0 also offers several enhancements to event management. A new event builder for mapping incoming events and a new event formatter for mapping outgoing events both allow users to change the event format as required to other formats, such as XML, JSON, TXT or MAP, as well as filter attributes of the event. Additionally, the event formatter has been integrated with the registry, so users can define the mapping templates in the registry and can use/reuse them dynamically in different execution plans. Support for multiple input event adaptors and output event adaptors gives users the option to select the best approach for each use case. Finally, with WSO2 CEP 3.0, statistics about events can be taken for the whole server, for an execution plan or per a deployment artifact (e.g., input adaptors, event builders, execution plans, event formatters, and output adaptors).

Other new features in WSO2 CEP 3.0 include:

  • A sample framework for WSO2 CEP, which allows users to start the product with the necessary configurations—without having to configure the software manually.
  • Support for Java Message Service (JMS) Queue in addition to the previously supported JMS Topic to help support durable subscriptions.
  • Support for the popular JSON format, particularly for mobile applications, enabling XML/JSON input child elements to be processed as separate input messages.
  • Dashboard integration with WSO2 User Engagement Server, which enables users to rapidly create visually appealing and engaging Web components for presenting data, such as dashboards, microsites and gadgets, to facilitate real-time event analysis and visualization.

Business Activity Monitor 2.4

WSO2 Business Activity Monitor 2.4 provides just-in-time visibility into distributed complex systems and gives enterprises a powerful framework for tracking and analyzing big data related to such areas as click-streams, API usage, fraud detection, and software log analysis in a cloud environment, to name a few.

WSO2 BAM utilizes Apache Cassandra to offer scalable event storage using column families for each event type. Additionally, through Apache Hadoop, it provides SQL-like flexibility for writing analysis algorithms via Apache Hive. Analysis results can be stored flexibly in Apache Cassandra, a relational database, or file system. Meanwhile load balancing offers horizontal scaling, and a low-latency API enables WSO2 BAM 2.0 to receive large volumes events over various transports, including Apache Thrift and REST/HTTP.

With Version 2.4, WSO2 BAM adds several new capabilities, including:

  • Ability to set up a message tracer filter to a Web application, so a user can intercept messages from any Web application and send them to WSO2 BAM to be analyzed later.
  • Apache Cassandra data indexing support, enabling users to make searches more efficient by creating either Cassandra secondary indexes or WSO2’s own custom indexes for defined indexed properties and data.
  • Support for searching on defined indexed properties enables an event search capability to be built on top of the data indexing feature.
  • A new activity monitoring dashboard works with the indexed event search, so results can be now viewed in real time, without additional batch operations.
  • The Hive Timestamp data type support has been added to the Cassandra data handler when accessing Cassandra data stores.
  • Incremental analysis with Cassandra and Hive allows for only new data to be analyzed, improving resource efficiency.

New Capabilities Inherited With WSO2 Carbon 4.2

WSO2 CEP 3.0 and WSO2 BAM 2.4 are part of WSO2 Carbon, the industry’s first fully componentized middleware platform for creating, running and managing composite applications and Web services within a service-oriented architecture (SOA) and cloud environment. Built on the OSGi specification, WSO2 Carbon lets developers easily deploy and customize any WSO2 Carbon-based middleware products, and the 175-plus components on which they are comprised, providing greater flexibility and agility to meet changing enterprise demands.

The cloud-enabled, fully multitenant WSO2 Carbon core framework provides all WSO2 middleware products with a consistent set of enterprise-class management, security, clustering, logging, statistics, tracing, and other capabilities. As a result, WSO2 CEP 3.0 and WSO2 BAM 2.4 inherit the capabilities that were launched with version 4.2 of the WSO2 Carbon core in October 2013. These include:

  • Hazelcast Support – featuring new distributed caching and clustering implementations that are based on Hazelcast, the open source in-memory data grid that provides a clustering and highly scalable data distribution platform for Java.
  • Multi-profile Deployment Support – helping IT organizations improve their resource utilization by selecting a “preferred profile,” which runs only the features specific to that profile.
  • Synchronous Deployment of Artifacts – ensuring that if a Carbon Application (CApp) is deployed successfully, the relevant artifacts are guaranteed to have deployed successfully as well.

For more detail, on the WSO2 Carbon 4.2 release, visit http://wso2.com/about/news/wso2-carbon-wso2-api-manager-and-wso2-governance-registry-increase-speed-scalability-and-high-availability-through-hazelcast.

Availability and Support

WSO2 Complex Event Processor 3.0 and WSO2 Business Activity Monitor 2.4 are in production today. They are available as software downloads that can run directly on servers or as WSO2 Cloud Virtual Machines running on the Amazon Elastic Computing Cloud (EC2), Linux Kernel Virtual Machine (KVM), and VMware ESX. They can operate as part of a private platform as a service (PaaS) by plugging into WSO2 Private PaaS software, and they are available as hosted services on the WSO2 Cloud public PaaS. As fully open source solutions released under the Apache License 2.0, they do not carry any licensing fees.

WSO2 CEP 3.0 and WSO2 BAM 2.4 are backed by a world-class technical team in which the experts that helped create the software provide support, leading to direct and immediate access to the people with in-depth knowledge of the middleware. In addition to production support, WSO2 service and support options include evaluation support, development support, and special QuickStartSM consulting programs.

About WSO2

WSO2 is the only company that provides a completely integrated enterprise application platform for enabling a business to build and connect APIs, applications, Web services, iPaaS, PaaS, software as a service and legacy connections without having to write code; using big data and mobile; and fostering reuse through a social enterprise store. Only with WSO2 can enterprises use a family of governed secure solutions built on the same code base to extend their ecosystems across the cloud and on mobile devices to employees, customers and partners in anyway they like. Hundreds of leading enterprise customers across every sector—health, financial, retail, logistics, manufacturing, travel, technology, telecom and more—in every region of the world rely on WSO2’s award-winning, 100% open source platform for their mission-critical applications. To learn more, visit http://wso2.com, or check out the WSO2 community on the WSO2 Blog, Twitter, LinkedIn, and Facebook.

Trademarks and registered trademarks are the properties of their respective owners.

1Gartner, “Survey Analysis: Big Data Adoption in 2013 Shows Substance Behind the Hype,” by Lisa Kart, Nick Heudecker, and Frank Buytendijk, September 12, 2013.

More Stories By Business Wire

Copyright © 2009 Business Wire. All rights reserved. Republication or redistribution of Business Wire content is expressly prohibited without the prior written consent of Business Wire. Business Wire shall not be liable for any errors or delays in the content, or for any actions taken in reliance thereon.

Cloud Expo Breaking News
Next-Gen Cloud. Whatever you call it, there’s a higher calling for cloud computing that requires providers to change their spots and move from a commodity mindset to a premium one. Businesses can no longer maintain the status quo that today’s service providers offer. Yes, the continuity, speed, mobility, data access and connectivity are staples of the cloud and always will be. But cloud providers that plan to not only exist tomorrow – but to lead – know that security must be the top priority for the cloud and are delivering it now. In his session at 14th Cloud Expo, Kurt Hagerman, Chief Information Security Officer at FireHost, will detail why and how you can have both infrastructure performance and enterprise-grade security – and what tomorrow's cloud provider will look like.
The social media expansion has shown just how people are eager to share their experiences with the rest of the world. Cloud technology is the perfect platform to satisfy this need given its great flexibility and readiness. At Cynny, we aim to revolutionize how people share and organize their digital life through a brand new cloud service, starting from infrastructure to the users’ interface. A revolution that began from inventing and designing our very own infrastructure: we have created the first server network powered solely by ARM CPU. The microservers have “organism-like” features, differentiating them from any of the current technologies. Benefits include low consumption of energy, making Cynny the ecologically friendly alternative for storage as well as cheaper infrastructure, lower running costs, etc.
Cloud backup and recovery services are critical to safeguarding an organization’s data and ensuring business continuity when technical failures and outages occur. With so many choices, how do you find the right provider for your specific needs? In his session at 14th Cloud Expo, Daniel Jacobson, Technology Manager at BUMI, will outline the key factors including backup configurations, proactive monitoring, data restoration, disaster recovery drills, security, compliance and data center resources. Aside from the technical considerations, the secret sauce in identifying the best vendor is the level of focus, expertise and specialization of their engineering team and support group, and how they monitor your day-to-day backups, provide recommendations, and guide you through restores when necessary.
Web conferencing in a public cloud has the same risks as any other cloud service. If you have ever had concerns over the types of data being shared in your employees’ web conferences, such as IP, financials or customer data, then it’s time to look at web conferencing in a private cloud. In her session at 14th Cloud Expo, Courtney Behrens, Senior Marketing Manager at Brother International, will discuss how issues that had previously been out of your control, like performance, advanced administration and compliance, can now be put back behind your firewall.
Cloud scalability and performance should be at the heart of every successful Internet venture. The infrastructure needs to be resilient, flexible, and fast – it’s best not to get caught thinking about architecture until the middle of an emergency, when it's too late. In his interactive, no-holds-barred session at 14th Cloud Expo, Phil Jackson, Development Community Advocate for SoftLayer, will dive into how to design and build-out the right cloud infrastructure.
The revolution that happened in the server universe over the past 15 years has resulted in an eco-system that is more open, more democratically innovative and produced better results in technically challenging dimensions like scale. The underpinnings of the revolution were common hardware, standards based APIs (ex. POSIX) and a strict adherence to layering and isolation between applications, daemons and kernel drivers/modules which allowed multiple types of development happen in parallel without hindering others. Put simply, today's server model is built on a consistent x86 platform with few surprises in its core components. A kernel abstracts away the platform, so that applications and daemons are decoupled from the hardware. In contrast, networking equipment is still stuck in the mainframe era. Today, networking equipment is a single appliance, including hardware, OS, applications and user interface come as a monolithic entity from a single vendor. Switching between different vendor'...
More and more enterprises today are doing business by opening up their data and applications through APIs. Though forward-thinking and strategic, exposing APIs also increases the surface area for potential attack by hackers. To benefit from APIs while staying secure, enterprises and security architects need to continue to develop a deep understanding about API security and how it differs from traditional web application security or mobile application security. In his session at 14th Cloud Expo, Sachin Agarwal, VP of Product Marketing and Strategy at SOA Software, will walk you through the various aspects of how an API could be potentially exploited. He will discuss the necessary best practices to secure your data and enterprise applications while continue continuing to support your business’s digital initiatives.
You use an agile process; your goal is to make your organization more agile. What about your data infrastructure? The truth is, today’s databases are anything but agile – they are effectively static repositories that are cumbersome to work with, difficult to change, and cannot keep pace with application demands. Performance suffers as a result, and it takes far longer than it should to deliver on new features and capabilities needed to make your organization competitive. As your application and business needs change, data repositories and structures get outmoded rapidly, resulting in increased work for application developers and slow performance for end users. Further, as data sizes grow into the Big Data realm, this problem is exacerbated and becomes even more difficult to address. A seemingly simple schema change can take hours (or more) to perform, and as requirements evolve the disconnect between existing data structures and actual needs diverge.
SYS-CON Events announced today that SherWeb, a long-time leading provider of cloud services and Microsoft's 2013 World Hosting Partner of the Year, will exhibit at SYS-CON's 14th International Cloud Expo®, which will take place on June 10–12, 2014, at the Javits Center in New York City, New York. A worldwide hosted services leader ranking in the prestigious North American Deloitte Technology Fast 500TM, and Microsoft's 2013 World Hosting Partner of the Year, SherWeb provides competitive cloud solutions to businesses and partners around the world. Founded in 1998, SherWeb is a privately owned company headquartered in Quebec, Canada. Its service portfolio includes Microsoft Exchange, SharePoint, Lync, Dynamics CRM and more.
The world of cloud and application development is not just for the hardened developer these days. In their session at 14th Cloud Expo, Phil Jackson, Development Community Advocate for SoftLayer, and Harold Hannon, Sr. Software Architect at SoftLayer, will pull back the curtain of the architecture of a fun demo application purpose-built for the cloud. They will focus on demonstrating how they leveraged compute, storage, messaging, and other cloud elements hosted at SoftLayer to lower the effort and difficulty of putting together a useful application. This will be an active demonstration and review of simple command-line tools and resources, so don’t be afraid if you are not a seasoned developer.
SYS-CON Events announced today that BUMI, a premium managed service provider specializing in data backup and recovery, will exhibit at SYS-CON's 14th International Cloud Expo®, which will take place on June 10–12, 2014, at the Javits Center in New York City, New York. Manhattan-based BUMI (Backup My Info!) is a premium managed service provider specializing in data backup and recovery. Founded in 2002, the company’s Here, There and Everywhere data backup and recovery solutions are utilized by more than 500 businesses. BUMI clients include professional service organizations such as banking, financial, insurance, accounting, hedge funds and law firms. The company is known for its relentless passion for customer service and support, and has won numerous awards, including Customer Service Provider of the Year and 10 Best Companies to Work For.
Chief Security Officers (CSO), CIOs and IT Directors are all concerned with providing a secure environment from which their business can innovate and customers can safely consume without the fear of Distributed Denial of Service attacks. To be successful in today's hyper-connected world, the enterprise needs to leverage the capabilities of the web and be ready to innovate without fear of DDoS attacks, concerns about application security and other threats. Organizations face great risk from increasingly frequent and sophisticated attempts to render web properties unavailable, and steal intellectual property or personally identifiable information. Layered security best practices extend security beyond the data center, delivering DDoS protection and maintaining site performance in the face of fast-changing threats.
From data center to cloud to the network. In his session at 3rd SDDC Expo, Raul Martynek, CEO of Net Access, will identify the challenges facing both data center providers and enterprise IT as they relate to cross-platform automation. He will then provide insight into designing, building, securing and managing the technology as an integrated service offering. Topics covered include: High-density data center design Network (and SDN) integration and automation Cloud (and hosting) infrastructure considerations Monitoring and security Management approaches Self-service and automation
In his session at 14th Cloud Expo, David Holmes, Vice President at OutSystems, will demonstrate the immense power that lives at the intersection of mobile apps and cloud application platforms. Attendees will participate in a live demonstration – an enterprise mobile app will be built and changed before their eyes – on their own devices. David Holmes brings over 20 years of high-tech marketing leadership to OutSystems. Prior to joining OutSystems, he was VP of Global Marketing for Damballa, a leading provider of network security solutions. Previously, he was SVP of Global Marketing for Jacada where his branding and positioning expertise helped drive the company from start-up days to a $55 million initial public offering on Nasdaq.
Performance is the intersection of power, agility, control, and choice. If you value performance, and more specifically consistent performance, you need to look beyond simple virtualized compute. Many factors need to be considered to create a truly performant environment. In his General Session at 14th Cloud Expo, Marc Jones, Vice President of Product Innovation for SoftLayer, will explain how to take advantage of a multitude of compute options and platform features to make cloud the cornerstone of your online presence.