Welcome!

Big Data Journal Authors: Maureen O'Gara, Pat Romanski, Jim Williams, Liz McMillan, David Smith

Related Topics: SDN Journal, SOA & WOA, .NET, Virtualization, Web 2.0, Cloud Expo, Big Data Journal

SDN Journal: Article

Future Proofing the Data Center

How to become agile in a rapidly changing storage world

More and more of our lives are lived online. Our music collections, bookshelves, vacation memories and more are increasingly digitized and uploaded into the cloud, the vast network of server farms that provide the bulk of online storage today. Research firm Gartner projects that by 2016, 36 percent of consumer content will be stored on the cloud, up from a mere seven percent in 2011.

Service providers, watching these trends with a wary eye, will be required to accommodate ever-increasing demands for storage as consumer appetites for cloud content storage continues to grow. To adapt, many service providers are exploring new options in data center architecture that will permit greater flexibility and control over hardware costs.

One such option is software-defined storage. By taking features typically found in hardware and moving them to the software layer, a software-defined approach to data center architecture eliminates the dependency on server "appliances" with software inextricably baked in.

Software-Defined Storage: A Primer
Although the term "software-defined" may seem like a recent buzzword, many everyday electronic devices - such as personal computers - have been "software-defined" for years. In the example of a PC, software can be installed on any hardware platform, allowing the user to custom-tailor both the hardware and the software according to his or her needs. For example, the average PC can use Linux as an operating system if the owner so chooses. This gives the user greater freedom to allocate his or her budget precisely as needed for the task at hand - whether towards a high-powered graphic design setup, for example, or a lightweight web browser.

Despite these clear benefits in flexibility, data centers are one of the last frontiers for software-defined technologies. The reluctance to embrace the trend can be traced - as it so often is - to the initial expenditures required to make the switch. Given the sheer level of infrastructure in service providers' data centers - giant warehouses in multiple locations across the globe - the outlays required to switch systems represents a very high investment indeed. Yet there is no denying the consumer trend toward ever-higher rates of online content storage.

The Status Quo
Existing data center architecture is comprised mainly of appliances. In industry parlance, an appliance is server hardware with proprietary, mandatory software baked in. The software is designed for the hardware and vice versa, and come tightly wedded together as a package. This can be a benefit for data centers without staff who specialize in server technology and therefore lack the tools necessary to configure a custom server deployment in-house. Yet since hardware inevitably fails (at a number of points within the machine), traditional appliances typically include multiple copies of expensive components to anticipate and prevent failure. These extra layers of identical hardware extract higher costs in energy usage, and add layers of complication to a single appliance. Because the actual cost per appliance is quite high compared with commodity servers, cost estimates often skyrocket when companies begin examining how to scale out their data centers.

It's due in large part to problems with appliances that data center administrators are beginning to consider software-defined storage approaches. "Software-defined" is far from a new concept. To the data center ecosystem, however - accustomed to appliances with mandatory, pre-set software - a software-defined approach was almost revolutionary.

Data center administrators interested in learning more about software-defined solutions are typically attracted initially to one or more of the following benefits:

1. Cost Reduction
As with many solutions, convenience comes with a price. Traditional appliances offer convenience in the form of a baked-in, standardized package, but the added costs associated with several layers of complicated, mandatory software coupled with high-powered hardware can lead to significant cost outlays for a data center that needs to scale rapidly.

Conversely, software-defined storage liberates the software from the hardware, allowing administrators to choose inexpensive commodity servers. When coupled with lightweight, efficient software solutions, the use of commodity servers can result in substantial cost savings for online service providers seeking ways to accommodate their users' growing demand for storage.

2. Flexibility
Not every data center is created equal. A telco servicing one particular area will have different storage needs than a major bank with branches in several countries, and a cloud services host provider will have different needs still. While appliances might be good enough for most of these needs, the benefits realized by fully uncoupling the software from the hardware can extract substantial gains in economy of scale.

Software-defined storage gives administrators the freedom to examine the needs of their business and to hand-select the specific components and software that best support their growth goals. While this approach does require more technically trained staff, the flexibility afforded by software-defined storage delivers a simpler, stronger and more tailored data center for the company's needs.

3. Future Proofing
Budgets, network environments and corporate priorities all change in response to market demands. Having an expansive, rigid network environment locked into configurations determined by an outside vendor severely curtails the ability of the organization to react nimbly to market demands, much less anticipate them in a proactive manner.

The future in storage is here. There are clear trends pointing to ever-increasing demands for cheap storage, and if companies continue to rely on expensive, inflexible appliances in their data centers, they will be forced to outlay significant funds to develop the storage capacity they need to meet customer demand.

Software-defined solutions offer an attractive alternative to companies looking to "future proof" their data centers. Since the hardware and the software are separate investments, either may be switched out to a better, more appropriate option as the market dictates, at minimal cost.

Software-Defined Storage and Globalization
Software-defined storage can also benefit companies with data centers all over the globe in novel - sometimes unexpected - ways.

Since cloud services need to be accessed from locations all over the world, service providers must be able to offer data centers located across the globe to minimize load time. With global availability, however, come a number of challenges. Load is active in the data center in a company's region. This creates a problem, since all data stored in all locations must be in sync. Also, companies often are required to restrict global data storage from either leaving certain countries (such as Germany), or being stored in others (such as Iran). In addition, global data centers must be resilient to localized disaster - such as a power outage - that puts a local server farm offline. Finally, if a local data center or server goes down, global data centers must reroute data quickly to available servers to minimize downtime.

While there are certainly solutions today that solve these problems, they do so at the application layer. Attempting to solve these issues that high up in the hierarchy of data center infrastructure - instead of solving them at the storage level - presents significant cost and complexity disadvantages. Solving these issues directly at the storage level can reap dividends in efficiency, time and cost savings.

Conclusion
These abilities represent just the beginning. Perceiving the potential of software-defined storage approaches, many organizations are beginning to explore the next phase of data center implementation. For data center administrators facing these types of challenges, a software-defined approach to storage is worth a serious look.

More Stories By Stefan Bernbo

Stefan Bernbo is the founder and CEO of Compuverde. For 20 years, he has designed and built numerous enterprise scale data storage solutions designed to be cost-effective for storing huge data sets. From 2004 to 2010 Stefan worked within this field for Storegate, the wide-reaching Internet based storage solution for consumer and business markets, with the highest possible availability and scalability requirements. Previously, he worked with system and software architecture on several projects with Swedish giant Ericsson, the world-leading provider of telecommunications equipment and services to mobile and fixed network operators.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


Cloud Expo Breaking News
The new open source cloud orchestration platform called OpenStack is the promise of flexible network virtualization, and network overlays are looking closer than ever. The vision of this platform is to enable the on-demand creation of many distinct networks on top of one underlying physical infrastructure in the cloud environment. The platform will support automated provisioning and management of large groups of virtual machines or compute resources, including extensive monitoring in the cloud.
Everyone is virtualizing, but are they realizing any of the promised savings? This overview of IBM's new virtualization optimization solutions will show you how integrated Cloud Solutions like SmartCloud Provisioning and SmartCloud Monitoring can deliver the savings virtualization promises. Organizations are using intelligent management and analytics to provide the insight needed to optimize their virtualized infrastructure and dramatically improve availability, reduce data storage footprint...
One of the most compelling promises of the cloud is that you can pull out a credit card and be working in minutes. No purchase orders to fill out, no equipment to wait for on the loading dock. Just instant access to the resources you need, when you need them. But accessibility comes at a price, and an unintentional consequence may be that you create yet another orphaned identity silo. Enterprise IT has spent years consolidating its mishmash of directories, only to discover that cloud now threate...
Cloud computing is transforming the way businesses think about and leverage technology. As a result, the general understanding of cloud computing has come a long way in a short time. However, there are still many misconceptions about what cloud computing is and what it can do for businesses that adopt this game-changing computing model. In his General Session at the 12th International Cloud Expo, Gene Eun, Senior Director, Oracle Cloud at Oracle, will discuss and dispel some of the common myth...
OpenStack Cells is one of the most anticipated features in Grizzly, the seventh release of the open source software that offers more block storage options and scalability. It has been running in production at Rackspace for more than a year. In his session at the 12th International Cloud Expo, Wayne Walls, OpenStack Developer Advocate at Rackspace Hosting, will discuss nova cells and how it is changing the way you design your cloud applications and infrastructure. He will explain how OpenStack ...
"Since Cloud Expo is running the week of June 10, we thought it'd be a great idea to schedule our Meetup this week. That way, if you have colleagues, friends, or family in town that week for the Expo, you can invite them to join you!" With those words, the OpenStack New York Meetup Group's organizer's launched a landing page this week where anyone interested can register for the June 12 evening event.
“Cloud has everything to do with what has happened with Big Data,” explained Jason Deck, Director of Strategic Alliances at Logicworks, in this exclusive Q&A with Cloud Expo Conference Chair Jeremy Geelan. “Big Data doesn’t exist in its easily accessible way without cloud. From reduced startup costs, to cheap storage, to fast processing, to adequate security, to the easy incorporation of third-party analytics tools, cloud made Big Data accessible to customers of all sizes, with all different bud...
“Open source has always provided a number of benefits, including easing adoption costs, propagating a better understanding of the technology, and allowing for faster evolution and commercialization of products and services based on it,” noted Terry Woloszyn, Founder & CEO, Leeward Security Ltd., in this exclusive Q&A with Cloud Expo Conference Chair Jeremy Geelan. “This is clearly evident with the OpenStack and CloudStack,” Woloszyn continued, “and others that have been quickly commercialized as...
SYS-CON Events announced today that OpenStack will exhibit at SYS-CON's 12th International Cloud Expo, which will take place on June 10–13, 2013, at the Javits Center in New York City, New York. OpenStack software controls large pools of compute, storage, and networking resources throughout a datacenter, all managed by a dashboard that gives administrators control while empowering their users to provision resources through a web interface. OpenStack powers some of the most widely-used SaaS app...
SYS-CON Events announced today that BUMI (Backup My Info!), the premium provider of managed online backup and recovery solutions for small to mid-sized businesses, will exhibit at SYS-CON's 12th International Cloud Expo, which will take place on June 10–13, 2013, at the Javits Center in New York City, New York. Manhattan-based BUMI (Backup My Info!) is a premium managed service provider specializing in online data backup and recovery. Founded in 2002, the company's data backup and recovery serv...