Welcome!

Big Data Journal Authors: Roger Strukhoff, Elizabeth White, Liz McMillan, Pat Romanski, Yeshim Deniz

Related Topics: Cloud Expo, Java, SOA & WOA, Virtualization, Big Data Journal, SDN Journal

Cloud Expo: Article

Reining in Enterprise IT Management Costs

Reducing support costs is a key goal of CIOs

Simplifying IT administration is a goal for CIOs to reduce manual intervention while running day-to-day operations with the primary goal of reducing the percentage of their IT budgets spent on maintenance. The IT management costs of web companies like Google and Facebook (which cater to tens of millions of users) are extremely low when compared to the size of their infrastructures. A huge advantage they and other super-efficient companies share is gained by 1) a mostly virtualized compute workloads 2) very little legacy infrastructure and 3) most applications written to follow common patterns optimized to take full advantage of virtualized resources. Having learned from managing compute infrastructures, these companies have extended this best practice to managing storage and network resources, too.

A number of enterprises are adopting cloud infrastructures with the aim of replicating similar efficiencies in their own IT departments. The challenge these organizations face is that they are hobbled by supporting legacy systems that must co-exist with new cloud architectures. Traditional approaches to IT management require IT operators and administrators to navigate among multiple systems and agents to collect and analyze information necessary to maintain high availability and performance. Most of the IT management products enterprises use do not offer integrated capabilities to manage these new environments.

Consider as an example the enterprise challenge that has arisen from recent major changes to retail businesses. Using a multi-channel approach by combining online properties, stores and mobile devices is crucial to improving customer experience while also increasing revenues. This approach requires use of composite applications combining various components of an IT environment, including supply chain, web-to-store integration and order management. Managing this environment that combines traditional IT with virtualized and cloud infrastructure brings up new challenges to IT operations.

For an integrated enterprise IT environment, IT management tools should provide optimal detection, management and fix of problems as follows:

  1. Detection: Before end-users even observe problems, IT management tools should generate alerts. These alerts could include applications that cross a warning threshold for response times or transactions speeds that drop below a limit. Notified of anomalies, IT operations personnel can take steps to manage the process of fixing the components causing these problems.
  1. Management: After getting alerts, IT Operations have enough information to review traditional IT, virtualized and cloud resources together. They can leverage a consolidated IT Management tool to view the entire infrastructure through a "single pane of glass." Operational analysts are able to drill down into various components of the entire IT infrastructure, including tracking transactions, application servers, ERP applications and end-user experiences. This allows them to look into the health of traditional IT and cloud applications to identify components that need to be fixed.
  1. Fix: Once the components causing the problem are identified, the revised parameters should be recorded on the Change and Configuration Management Database (CCMDB) through the same interface. A provisioning tool should be leveraged to create patterns of composite applications targeted to be deployed to virtualized hardware and supported hypervisors. The updated parameters are then recorded and stored in CCMDB, forming the basis of future deployments.

Similar detect/manage/fix activities could be followed for network and storage resources. Particularly critical to the success of these strategies are the insight into end user experience and the capability to automatically respond with capacity, availability and performance management.

As businesses change to adopt cloud computing solutions, enterprise IT support operations are increasingly challenged to handle more complex environments. Managing an integrated IT environment requires a single solution with visibility into application performance. The combination of technologies demands that solutions work across multiple environments to pull together diverse applications and data. This kind of insight enables management of cloud, virtualized and hybrid environments that run side by side with traditional IT environments. It is important to take the right approach so that business change is not hobbled by an inflexible IT infrastructure. Matching appropriate technology solutions to increasingly complex business challenges allows an optimum business outcome.

Several products exist in this space to assist enterprise customers including: CA, Compuware, HP and IBM. I have reviewed several from IBM including SmartCloud Application Performance Management, SmartCloud Monitoring, SmartCloud Control Desk, SmartCloud Provisioning, IBM Netcool Network Management and SmartCloud Virtual Storage Center. While each has unique strengths, the integration of these products is what really allows IBM to offer customers highly differentiated solutions for effectively managing new IT environments.

While enterprise customers have several goals for 2013, managing integrated environments should be high on the priority list. Choosing the appropriate vendor with an appropriate integrated portfolio is important to meet enterprise goals of managing infrastructures with the efficiencies of Google or Facebook. One vendor whose solutions are well worth considering in this regard is IBM.

Disclaimer:  IBM is one of my customers.

This post was first published on Robustcloud.com. Republished with permission.

More Stories By Larry Carvalho

Larry Carvalho runs Robust Cloud LLC, an advisory services company helping various ecosystem players develop a strategy to take advantage of cloud computing. As the 2010-12 Instructor of Cloud Expo's popular Cloud Computing Bootcamp, he has already led the bootcamp in New York, Silicon Valley, and Prague, receiving strong positive feedback from attendees about the value gained at these events. Carvalho has facilitated all-day sessions at customer locations to set a clear roadmap and gain consensus among attendees on strategy and product direction. He has participated in multiple discussion panels focused on cloud computing trends at information technology events, and he has delivered all-day cloud computing training to customers in conjunction with CloudCamps. To date, his role has taken him to clients in three continents.

Latest Stories from Big Data Journal
BlueData aims to “democratize Big Data” with its launch of EPIC Enterprise, which it calls “the industry’s first Big Data software to enable enterprises to create a self-service cloud experience on premise.” This self-service private cloud allows enterprises to create 100-node Hadoop and Spark clusters in less than 10 minutes. The company is also offering a Community Edition via free download. We had a few questions for BlueData CEO Kumar Sreekanti about all this, and here's what he had to s...
Cisco on Wedesday announced its intent to acquire privately held Metacloud. Based in Pasadena, Calif., Metacloud deploys and operates private clouds for global organizations with a unique OpenStack-as-a-Service model that delivers and remotely operates production-ready private clouds in a customer's data center. Metacloud's OpenStack-based cloud platform will accelerate Cisco's strategy to build the world's largest global Intercloud, a network of clouds, together with key partners to address cu...
The cloud provides an easy onramp to building and deploying Big Data solutions. Transitioning from initial deployment to large-scale, highly performant operations may not be as easy. In his session at 15th Cloud Expo, Harold Hannon, Sr. Software Architect at SoftLayer, will discuss the benefits, weaknesses, and performance characteristics of public and bare metal cloud deployments that can help you make the right decisions.
Technology is enabling a new approach to collecting and using data. This approach, commonly referred to as the “Internet of Things” (IoT), enables businesses to use real-time data from all sorts of things including machines, devices and sensors to make better decisions, improve customer service, and lower the risk in the creation of new revenue opportunities. In his session at Internet of @ThingsExpo, Dave Wagstaff, Vice President and Chief Architect at BSQUARE Corporation, will discuss the real...
IoT is still a vague buzzword for many people. In his session at Internet of @ThingsExpo, Mike Kavis, Vice President & Principal Cloud Architect at Cloud Technology Partners, will discuss the business value of IoT that goes far beyond the general public's perception that IoT is all about wearables and home consumer services. The presentation will also discuss how IoT is perceived by investors and how venture capitalist access this space. Other topics to discuss are barriers to success, what is n...
Where historically app development would require developers to manage device functionality, application environment and application logic, today new platforms are emerging that are IoT focused and arm developers with cloud based connectivity and communications, development, monitoring, management and analytics tools. In her session at Internet of @ThingsExpo, Seema Jethani, Director of Product Management at Basho Technologies, will explore how to rapidly prototype using IoT cloud platforms and c...
Amazon, Google and Facebook are household names in part because of their mastery of Big Data. But what about organizations without billions of dollars to spend on Big Data tools - how can they extract value from their data? Ion Stoica is co-founder and CEO of Databricks, a company working to revolutionize Big Data analysis through the Apache Spark platform. He also serves as a professor of computer science at the University of California, Berkeley. Ion previously co-founded Conviva to commercial...
Due of the rise of Hadoop, many enterprises are now deploying their first small clusters of 10 to 20 servers. At this small scale, the complexity of operating the cluster looks and feels like general data center servers. It is not until the clusters scale, as they inevitably do, when the pain caused by the exponential complexity becomes apparent. We've seen this problem occur time and time again.
Labor market analytics firm Wanted Analytics recently assessed the market for technology professionals and found that demand for people with proficient levels of Hadoop expertise had skyrocketed by around 33% since last year – it is true, Hadoop is hard technology to master and the labor market is not exactly flooded with an over-abundance of skilled practitioners. Hadoop has been called a foundational technology, rather than ‘just’ a database by some commentators – this almost pushes it towards...
When one expects instantaneous response from video generated on the internet, lots of invisible problems have to be overcome. In his session at 6th Big Data Expo®, Tom Paquin, EVP and Chief Technology Officer at OnLive, to discuss how to overcome these problems. A Silicon Valley veteran, Tom Paquin provides vision, expertise and leadership to the technology research and development effort at OnLive as EVP and Chief Technology Officer. With more than 20 years of management experience at lead...