Welcome!

Big Data Journal Authors: Liz McMillan, Elizabeth White, Jnan Dash, Esmeralda Swartz, Pat Romanski

Blog Feed Post

Effective Storage for Growing Data Volumes

By Ian Kilpatrick, chairman Wick Hill Group

Dealing with vast amounts of data used to be a problem faced purely by large enterprises. However, in today's world of rapidly increasing data, it's now an issue for companies of all sizes.

Data is increasing for all sorts of reasons, which include the use of social media and the increased use of mobile devices such as smartphones and tablets, which have dramatically increased the amount of data being backed up on the network.

Symantec's recent State of Information Survey conducted over 38 countries worldwide found that SMEs expected their storage to increase by 178% over the next year.

The large amount of data companies now produce, which can be in the terabytes and petabytes, needs to be backed up and stored so it can be accessed easily and quickly. It needs to be archived in case it is needed in the future and also for compliance reasons; and it needs to be replicated, so it's available for use in the case of a disaster. All this needs to be done cost-effectively and securely.

Storage is a notoriously boring subject for many people, and it tends to get pushed down the list of priorities. While enterprises have the resources to manage their back-up and storage issues, many organisations consider it a necessary evil and don't review its financial effectiveness or its fitness for future purpose.

This is a shame, as in all matters IT, times have moved on from things such as old-style tape systems. Modern solutions are bigger, better, easier and lower cost, often with features previously only available on enterprise systems.

Increases in data volume now make storage a key business issue for companies. Performance issues, which result from companies being overwhelmed by data or by backing up, could impact on profitability. The inability to access data quickly, in the event of a disaster, could put a company out of business.

Some recent statistics indicate that 43% of businesses that close after a natural disaster never re-open and a further 29% close within two years. One of the key reasons for this is the failure of their disaster-recovery planning. Back-ups and back-up plans need to be tested regularly to ensure that they are relevant or actually working. Finding that your back-ups are corrupted, when you absolutely need them, is too late.

Which route forward?
The question is how to choose a storage solution that will cope with current storage needs as well as taking you forward into a future of unpredictable, and mushrooming, data growth?

Storage solutions for companies outside the Top 500 range from traditional tape to the cloud, with other options and permutations in between. For some organisations, cloud may be the answer. For others, particularly if they have been using tape in the past, the leap to the cloud is just too great and they want something more tangible, such as disc-based storage.

For some, the solution may be a hybrid one which gives local back up with background cloud back-up. This option provides speed of access with the security of offsite cloud.

Companies still using traditional tape for back-up and archiving will be finding it increasingly inadequate for their needs, that is if they've checked recently. Tape also has inherent disadvantages.

It's cumbersome, expensive, has a finite life and is easily damaged. It takes longer and longer, the more you are backing up. And it can be very difficult to find things quickly on tape when you need them.

The cloud, while it may seem like a great option to many, isn't for everyone. One disadvantage of the cloud, which many aren't aware of, is that the data is probably going to be stored on traditional tape.

Another issue to be aware of is how long it takes to seed and download data over limited capacity internet connections. Seeding a terabyte of data in the cloud on a 10mbps connection with nothing else going on will take 300 hours (12.5 days).

This means that accessing it and downloading it could take days. If you have a serious disaster recovery situation, this may possibly be acceptable, but it's a serious hindrance if you need to access stored data quickly during the normal day-to-day running of a business.

Solutions
One solution for more conservative SMEs is to use RDX removable hard disc cartridges for storage. They combine the best of hard disc and tape storage. They scale with a business, but, unlike tape, are very rugged and reliable. It's a step forward, for those who have been using tape, which isn't too different from what went before.

RDX cartridges back-up and restore data very quickly (much quicker than tape) and are very secure. They are typically available in sizes from 160 gigabytes to 1.5 terabytes. You just add extra cartridges as your storage needs expand.

Imation, for example, which has a specialist division for SME storage, provides an RDX solution, the A8, which can accommodate up to 12 terabytes of data.

The A8 helps SMEs conduct high-performance back-up, data protection, archiving, restoration and cloud-enabling. It can mix RDX cartridges of different sizes, so users can start with lower capacity cartridges and add higher capacity ones as needs dictate.

A solution like this allows organisations to quickly back up and instantly access their crucial data. It gives them more operational flexibility and the ability to cost-effectively and quickly recover their data in the event of a disaster. Users get the benefits of RDX cartridge storage, but also keep cloud options open.

Imation also provides another product which gives companies a comprehensive set of storage and back-up options.

DataGuard is a network attached storage (NAS) backup appliance which uses hard disk drives, removable RDX® disk cartridges, replication, and cloud storage to provide up to four layers of data protection. It shortens back-up windows and allows for fast recovery.

DataGuard is capable of making multiple copies of content as local online copies, replicated copies, optional offline RDX copies and remote online (cloud) copies.

It means companies can have all bases covered. They don't have to go with the cloud straight away, but the facility is there to do it when and if they are ready.

Another company which provides a solution which gives the best of both worlds, both local and cloud storage, is Barracuda with its Barracuda Backup Service.

This provides full local data back-up and is combined with a storage subscription, to replicate data to the cloud at two offsite locations. So organisations get onsite back-ups for fast restore times and secure, offsite storage for disaster recovery.

The Barracuda system uses a technology called deduplication, which reduces traditional back-up storage requirements by 20 to 50 times, while also reducing back-up windows and bandwidth requirements.

Deduplication works by eliminating redundant data. Only one unique instance of the data is actually retained. The redundant data is replaced with a pointer to the original copy.

Conclusion
One constant is guaranteed. Storage and data access requirements will (as they always have done) continue to grow, in fact the pace appears to be accelerating. Alongside the change in data volumes, new options have become available which provide enterprise-level solutions at affordable prices.

A range of such options is available from RDX cartridges to cloud services, plus a variety of combinations in between. Such solutions allow organisations to effectively back-up and store data, so it doesn't cause serious performance problems on the network; they allow the data to be quickly available for both the running of the business and for compliance purposes; and they offer a disaster recovery option.

Bio of author
Ian Kilpatrick is chairman of international value added distributor Wick Hill Group plc, specialists in market development for secure IP infrastructure solutions and convergence. Kilpatrick has been involved with the Group for more than 35 years. Wick Hill supplies organisations from enterprises to SMEs, through an extensive value-added network of accredited VARs.

Kilpatrick has an in-depth experience of IT and unified communications (UC) with a strong vision of the future. He looks at these areas from a business point-of-view and his approach reflects his philosophy that business benefits, ease-of-use and cost of ownership are key factors, rather than just technology. He has authored numerous articles and publications, as well as being a regular speaker at conferences, exhibitions and seminars. For more information about Wick Hill, please visit http://www.wickhill.com or www.twitter.com/wickhill.

ENDS

For further press information, please contact Annabelle Brown on 01326 318212, email [email protected]. For reader queries, contact Wick Hill on 01483 227600. Web http://www.wickhill.com. For pic of Ian Kilpatrick, please contact Annabelle Brown or download from www.wickhill.com/company/press/pictures

Read the original blog entry...

More Stories By RealWire News Distribution

RealWire is a global news release distribution service specialising in the online media. The RealWire approach focuses on delivering relevant content to the receivers of our client's news releases. As we know that it is only through delivering relevance, that influence can ever be achieved.

@BigDataExpo Stories
“We help people build clusters, in the classical sense of the cluster. We help people put a full stack on top of every single one of those machines. We do the full bare metal install," explained Greg Bruno, Vice President of Engineering and co-founder of StackIQ, in this SYS-CON.tv interview at 15th Cloud Expo, held Nov 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA.
In this demo at 15th Cloud Expo, John Meza, Product Engineer at Esri, showed how Esri products hook into Hadoop cluster to allow you to do spatial analysis on the spatial data within your cluster, and he demonstrated rendering from a data center with ArcGIS Pro, a new product that has a brand new rendering engine.
"People are a lot more knowledgeable about APIs now. There are two types of people who work with APIs - IT people who want to use APIs for something internal and the product managers who want to do something outside APIs for people to connect to them," explained Roberto Medrano, Executive Vice President at SOA Software, in this SYS-CON.tv interview at Cloud Expo, held Nov 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA.
The Software Defined Data Center (SDDC), which enables organizations to seamlessly run in a hybrid cloud model (public + private cloud), is here to stay. IDC estimates that the software-defined networking market will be valued at $3.7 billion by 2016. Security is a key component and benefit of the SDDC, and offers an opportunity to build security 'from the ground up' and weave it into the environment from day one. In his session at 16th Cloud Expo, Reuven Harrison, CTO and Co-Founder of Tufin,...
Performance is the intersection of power, agility, control, and choice. If you value performance, and more specifically consistent performance, you need to look beyond simple virtualized compute. Many factors need to be considered to create a truly performant environment. In his General Session at 15th Cloud Expo, Harold Hannon, Sr. Software Architect at SoftLayer, discussed how to take advantage of a multitude of compute options and platform features to make cloud the cornerstone of your onlin...
Hardware will never be more valuable than on the day it hits your loading dock. Each day new servers are not deployed to production the business is losing money. While Moore's Law is typically cited to explain the exponential density growth of chips, a critical consequence of this is rapid depreciation of servers. The hardware for clustered systems (e.g., Hadoop, OpenStack) tends to be significant capital expenses. In his session at Big Data Expo, Mason Katz, CTO and co-founder of StackIQ, disc...
Software Defined Storage provides many benefits for customers including agility, flexibility, faster adoption of new technology and cost effectiveness. However, for IT organizations it can be challenging and complex to build your Enterprise Grade Storage from software. In his session at Cloud Expo, Paul Turner, CMO at Cloudian, looked at the new Original Design Manufacturer (ODM) market and how it is changing the storage world. Now Software Defined Storage companies can build Enterprise grade ...
Can the spatial component of your Big Data be harnessed and visualized, adding another dimension of power and analytics to your data? In his session at Big Data Expo®, John Meza, Product Engineer and Performance Engineering Team Lead at Esri, discussed the spatial queries that can be used within the Hadoop ecosystem and their integration with GeoSpatial applications. The GIS Tools for Hadoop project was also discussed and its implementation to discover location-based patterns and relationships...
In this Women in Technology Power Panel at 15th Cloud Expo, moderated by Anne Plese, Senior Consultant, Cloud Product Marketing at Verizon Enterprise, Esmeralda Swartz, CMO at MetraTech; Evelyn de Souza, Data Privacy and Compliance Strategy Leader at Cisco Systems; Seema Jethani, Director of Product Management at Basho Technologies; Victoria Livschitz, CEO of Qubell Inc.; Anne Hungate, Senior Director of Software Quality at DIRECTV, discussed what path they took to find their spot within the tec...
DevOps Summit 2015 New York, co-located with the 16th International Cloud Expo - to be held June 9-11, 2015, at the Javits Center in New York City, NY - announces that it is now accepting Keynote Proposals. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to wait for long development cycles that produce software that is obsolete...
Software AG and Wipro Ltd. have announced a joint solution platform for streaming analytics that provides real-time actionable intelligence for the Internet of Things (IoT) market. “The key to successfully addressing the IoT market is the ability to rapidly build and evolve apps that tap into, analyze and make smart decisions on fast, big data”, said John Bates, Global Head of Industry Solutions and CMO, Software AG. To address the huge market potential created by streaming analytics in conj...
Amazon, Google and Facebook are household names in part because of their mastery of Big Data. But what about organizations without billions of dollars to spend on Big Data tools - how can they extract value from their data? In his session at 6th Big Data Expo®, Ali Ghodsi, Co-Founder and Head of Engineering at Databricks, discussed how the zero management cost and scalability of the cloud is addressing the challenges and pain points that data engineers face when working with Big Data. He also s...
We’re no longer looking to the future for the IoT wave. It’s no longer a distant dream but a reality that has arrived. It’s now time to make sure the industry is in alignment to meet the IoT growing pains – cooperate and collaborate as well as innovate. In his session at @ThingsExpo, Jim Hunter, Chief Scientist & Technology Evangelist at Greenwave Systems, will examine the key ingredients to IoT success and identify solutions to challenges the industry is facing. The deep industry expertise be...
DevOps means different things to different people. Qubell defines DevOps as the ability for the developer teams to do what they need to do to have this level of self-service. At DevOps Summit, Stan Klimoff, CTO of Qubell, demos the enterprise DevOps platform.
SYS-CON Events announced today that that Innodisk, the service-driven provider of industrial embedded flash and DRAM storage products and technologies, will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. Innodisk is a service-driven provider of industrial embedded flash and DRAM storage products and technologies. With satisfied customers across the embedded, aerospace and defense, cloud storage markets an...
The 3rd International Internet of @ThingsExpo, co-located with the 16th International Cloud Expo - to be held June 9-11, 2015, at the Javits Center in New York City, NY - announces that its Call for Papers is now open. The Internet of Things (IoT) is the biggest idea since the creation of the Worldwide Web more than 20 years ago.
The Internet of Things will greatly expand the opportunities for data collection and new business models driven off of that data. In her session at @ThingsExpo, Esmeralda Swartz, CMO of MetraTech, discussed how for this to be effective you not only need to have infrastructure and operational models capable of utilizing this new phenomenon, but increasingly service providers will need to convince a skeptical public to participate. Get ready to show them the money!
Eighty-five percent of companies store information in some sort of unstructured manner. In this demo at 15th Cloud Expo, Mark Fronczak, Product Manager at Solgenia, discussed their enterprise content management solution, which was created to help companies organize and take control of their digital assets.

ARMONK, N.Y., Nov. 20, 2014 /PRNewswire/ --  IBM (NYSE: IBM) today announced that it is bringing a greater level of control, security and flexibility to cloud-based application development and delivery with a single-tenant version of Bluemix, IBM's

Midway through the decade, the experts from Veeva Systems – a leader in cloud-based software for the global life sciences industry – look at what’s on the horizon over the next five years. Their forecasts are informed by a vision for what’s next in technology and insight gleaned from Veeva’s 200+ life sciences customers worldwide. Overall, these predictions reflect how new innovations will enable faster time to market, evolving commercial models, and new ways to support physicians and patients. ...