Welcome!

Big Data Journal Authors: Roger Strukhoff, Elizabeth White, Jnan Dash, Jason Bloomberg, Kevin Benedict

Blog Feed Post

Effective Storage for Growing Data Volumes

By Ian Kilpatrick, chairman Wick Hill Group

Dealing with vast amounts of data used to be a problem faced purely by large enterprises. However, in today's world of rapidly increasing data, it's now an issue for companies of all sizes.

Data is increasing for all sorts of reasons, which include the use of social media and the increased use of mobile devices such as smartphones and tablets, which have dramatically increased the amount of data being backed up on the network.

Symantec's recent State of Information Survey conducted over 38 countries worldwide found that SMEs expected their storage to increase by 178% over the next year.

The large amount of data companies now produce, which can be in the terabytes and petabytes, needs to be backed up and stored so it can be accessed easily and quickly. It needs to be archived in case it is needed in the future and also for compliance reasons; and it needs to be replicated, so it's available for use in the case of a disaster. All this needs to be done cost-effectively and securely.

Storage is a notoriously boring subject for many people, and it tends to get pushed down the list of priorities. While enterprises have the resources to manage their back-up and storage issues, many organisations consider it a necessary evil and don't review its financial effectiveness or its fitness for future purpose.

This is a shame, as in all matters IT, times have moved on from things such as old-style tape systems. Modern solutions are bigger, better, easier and lower cost, often with features previously only available on enterprise systems.

Increases in data volume now make storage a key business issue for companies. Performance issues, which result from companies being overwhelmed by data or by backing up, could impact on profitability. The inability to access data quickly, in the event of a disaster, could put a company out of business.

Some recent statistics indicate that 43% of businesses that close after a natural disaster never re-open and a further 29% close within two years. One of the key reasons for this is the failure of their disaster-recovery planning. Back-ups and back-up plans need to be tested regularly to ensure that they are relevant or actually working. Finding that your back-ups are corrupted, when you absolutely need them, is too late.

Which route forward?
The question is how to choose a storage solution that will cope with current storage needs as well as taking you forward into a future of unpredictable, and mushrooming, data growth?

Storage solutions for companies outside the Top 500 range from traditional tape to the cloud, with other options and permutations in between. For some organisations, cloud may be the answer. For others, particularly if they have been using tape in the past, the leap to the cloud is just too great and they want something more tangible, such as disc-based storage.

For some, the solution may be a hybrid one which gives local back up with background cloud back-up. This option provides speed of access with the security of offsite cloud.

Companies still using traditional tape for back-up and archiving will be finding it increasingly inadequate for their needs, that is if they've checked recently. Tape also has inherent disadvantages.

It's cumbersome, expensive, has a finite life and is easily damaged. It takes longer and longer, the more you are backing up. And it can be very difficult to find things quickly on tape when you need them.

The cloud, while it may seem like a great option to many, isn't for everyone. One disadvantage of the cloud, which many aren't aware of, is that the data is probably going to be stored on traditional tape.

Another issue to be aware of is how long it takes to seed and download data over limited capacity internet connections. Seeding a terabyte of data in the cloud on a 10mbps connection with nothing else going on will take 300 hours (12.5 days).

This means that accessing it and downloading it could take days. If you have a serious disaster recovery situation, this may possibly be acceptable, but it's a serious hindrance if you need to access stored data quickly during the normal day-to-day running of a business.

Solutions
One solution for more conservative SMEs is to use RDX removable hard disc cartridges for storage. They combine the best of hard disc and tape storage. They scale with a business, but, unlike tape, are very rugged and reliable. It's a step forward, for those who have been using tape, which isn't too different from what went before.

RDX cartridges back-up and restore data very quickly (much quicker than tape) and are very secure. They are typically available in sizes from 160 gigabytes to 1.5 terabytes. You just add extra cartridges as your storage needs expand.

Imation, for example, which has a specialist division for SME storage, provides an RDX solution, the A8, which can accommodate up to 12 terabytes of data.

The A8 helps SMEs conduct high-performance back-up, data protection, archiving, restoration and cloud-enabling. It can mix RDX cartridges of different sizes, so users can start with lower capacity cartridges and add higher capacity ones as needs dictate.

A solution like this allows organisations to quickly back up and instantly access their crucial data. It gives them more operational flexibility and the ability to cost-effectively and quickly recover their data in the event of a disaster. Users get the benefits of RDX cartridge storage, but also keep cloud options open.

Imation also provides another product which gives companies a comprehensive set of storage and back-up options.

DataGuard is a network attached storage (NAS) backup appliance which uses hard disk drives, removable RDX® disk cartridges, replication, and cloud storage to provide up to four layers of data protection. It shortens back-up windows and allows for fast recovery.

DataGuard is capable of making multiple copies of content as local online copies, replicated copies, optional offline RDX copies and remote online (cloud) copies.

It means companies can have all bases covered. They don't have to go with the cloud straight away, but the facility is there to do it when and if they are ready.

Another company which provides a solution which gives the best of both worlds, both local and cloud storage, is Barracuda with its Barracuda Backup Service.

This provides full local data back-up and is combined with a storage subscription, to replicate data to the cloud at two offsite locations. So organisations get onsite back-ups for fast restore times and secure, offsite storage for disaster recovery.

The Barracuda system uses a technology called deduplication, which reduces traditional back-up storage requirements by 20 to 50 times, while also reducing back-up windows and bandwidth requirements.

Deduplication works by eliminating redundant data. Only one unique instance of the data is actually retained. The redundant data is replaced with a pointer to the original copy.

Conclusion
One constant is guaranteed. Storage and data access requirements will (as they always have done) continue to grow, in fact the pace appears to be accelerating. Alongside the change in data volumes, new options have become available which provide enterprise-level solutions at affordable prices.

A range of such options is available from RDX cartridges to cloud services, plus a variety of combinations in between. Such solutions allow organisations to effectively back-up and store data, so it doesn't cause serious performance problems on the network; they allow the data to be quickly available for both the running of the business and for compliance purposes; and they offer a disaster recovery option.

Bio of author
Ian Kilpatrick is chairman of international value added distributor Wick Hill Group plc, specialists in market development for secure IP infrastructure solutions and convergence. Kilpatrick has been involved with the Group for more than 35 years. Wick Hill supplies organisations from enterprises to SMEs, through an extensive value-added network of accredited VARs.

Kilpatrick has an in-depth experience of IT and unified communications (UC) with a strong vision of the future. He looks at these areas from a business point-of-view and his approach reflects his philosophy that business benefits, ease-of-use and cost of ownership are key factors, rather than just technology. He has authored numerous articles and publications, as well as being a regular speaker at conferences, exhibitions and seminars. For more information about Wick Hill, please visit http://www.wickhill.com or www.twitter.com/wickhill.

ENDS

For further press information, please contact Annabelle Brown on 01326 318212, email [email protected]. For reader queries, contact Wick Hill on 01483 227600. Web http://www.wickhill.com. For pic of Ian Kilpatrick, please contact Annabelle Brown or download from www.wickhill.com/company/press/pictures

Read the original blog entry...

More Stories By RealWire News Distribution

RealWire is a global news release distribution service specialising in the online media. The RealWire approach focuses on delivering relevant content to the receivers of our client's news releases. As we know that it is only through delivering relevance, that influence can ever be achieved.

Cloud Expo Breaking News
Scott Jenson leads a project called The Physical Web within the Chrome team at Google. Project members are working to take the scalability and openness of the web and use it to talk to the exponentially exploding range of smart devices. Nearly every company today working on the IoT comes up with the same basic solution: use my server and you'll be fine. But if we really believe there will be trillions of these devices, that just can't scale. We need a system that is open a scalable and by using the URL as a basic building block, we open this up and get the same resilience that the web enjoys.
Cloud Computing is evolving into a Big Three of Amazon Web Services, Google Cloud, and Microsoft Azure. Cloud 360: Multi-Cloud Bootcamp, being held Nov 4–5, 2014, in conjunction with 15th Cloud Expo in Santa Clara, CA, delivers a real-world demonstration of how to deploy and configure a scalable and available web application on all three platforms. The Cloud 360 Bootcamp, led by Janakiram MSV, an analyst with Gigaom Research, is the first bootcamp that introduces the core concepts of Infrastructure as a Service (IaaS) based on the workings of the Big Three platforms – Amazon EC2, Google Compute Engine, and Azure VMs. Bootcamp attendees will get to see the big picture and also receive the knowledge needed to make the best cloud decisions for their business applications and entire enterprise IT organization.
The Internet of Things is a natural complement to the cloud and related technologies such as Big Data, analytics, and mobility. In his session at Internet of @ThingsExpo, Joe Weinman will lay out four generic strategies – digital disciplines – to exploit emerging digital technologies for strategic advantage. Joe Weinman has held executive leadership positions at Bell Labs, AT&T, Hewlett-Packard, and Telx, in areas such as corporate strategy, business development, product management, operations, and R&D.
SYS-CON Events announced today that DevOps.com has been named “Media Sponsor” of SYS-CON's “DevOps Summit at Cloud Expo,” which will take place on June 10–12, 2014, at the Javits Center in New York City, New York. DevOps.com is where the world meets DevOps. It is the largest collection of original content relating to DevOps on the web today Featuring up-to-the-minute news, feature stories, blogs, bylined articles and more, DevOps.com is where the thought leaders of the DevOps movement make their ideas known.
There are 182 billion emails sent every day, generating a lot of data about how recipients and ISPs respond. Many marketers take a more-is-better approach to stats, preferring to have the ability to slice and dice their email lists based numerous arbitrary stats. However, fundamentally what really matters is whether or not sending an email to a particular recipient will generate value. Data Scientists can design high-level insights such as engagement prediction models and content clusters that allow marketers to cut through the noise and design their campaigns around strong, predictive signals, rather than arbitrary statistics. SendGrid sends up to half a billion emails a day for customers such as Pinterest and GitHub. All this email adds up to more text than produced in the entire twitterverse. We track events like clicks, opens and deliveries to help improve deliverability for our customers – adding up to over 50 billion useful events every month. While SendGrid data covers only abo...
SYS-CON Events announced today that the Web Host Industry Review has been named “Media Sponsor” of SYS-CON's 15th International Cloud Expo®, which will take place on November 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA. Since 2000, The Web Host Industry Review has made a name for itself as the foremost authority of the Web hosting industry providing reliable, insightful and comprehensive news, reviews and resources to the hosting community. TheWHIR Blogs provides a community of expert industry perspectives. The Web Host Industry Review Magazine also offers a business-minded, issue-driven perspective of interest to executives and decision-makers. WHIR TV offers on demand web hosting video interviews and web hosting video features of the key persons and events of the web hosting industry. WHIR Events brings together like-minded hosting industry professionals and decision-makers in local communities. TheWHIR is an iNET Interactive property.
SYS-CON Events announced today that O'Reilly Media has been named “Media Sponsor” of SYS-CON's 15th International Cloud Expo®, which will take place on November 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA. O'Reilly Media spreads the knowledge of innovators through its books, online services, magazines, and conferences. Since 1978, O'Reilly Media has been a chronicler and catalyst of cutting-edge development, homing in on the technology trends that really matter and spurring their adoption by amplifying "faint signals" from the alpha geeks who are creating the future. An active participant in the technology community, the company has a long history of advocacy, meme-making, and evangelism.
SYS-CON Events announced today that Verizon has been named “Gold Sponsor” of SYS-CON's 15th International Cloud Expo®, which will take place on November 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA. Verizon Enterprise Solutions creates global connections that generate growth, drive business innovation and move society forward. With industry-specific solutions and a full range of global wholesale offerings provided over the company's secure mobility, cloud, strategic networking and advanced communications platforms, Verizon Enterprise Solutions helps open new opportunities around the world for innovation, investment and business transformation. Visit verizonenterprise.com to learn more.
SYS-CON Events announced today that TMCnet has been named “Media Sponsor” of SYS-CON's 15th International Cloud Expo®, which will take place on November 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA. Technology Marketing Corporation (TMC) is the world's leading business to business and integrated marketing media company, servicing niche markets within the communications and technology industries.
"In my session I spoke about enterprise cloud analytics and how we can leverage analytics as a service," explained Ajay Budhraja, CTO at the Department of Justice, in this SYS-CON.tv interview at the 14th International Cloud Expo®, held June 10-12, 2014, at the Javits Center in New York City. Cloud Expo® 2014 Silicon Valley, November 4–6, at the Santa Clara Convention Center in Santa Clara, CA, will feature technical sessions from a rock star conference faculty and the leading Cloud industry players in the world.
“We are starting to see people move beyond the commodity cloud and enterprises need to start focusing on additional value added services in order to really drive their adoption," explained Jason Mondanaro, Director of Product Management at MetraTech, in this SYS-CON.tv interview at the 14th International Cloud Expo®, held June 10-12, 2014, at the Javits Center in New York City. Cloud Expo® 2014 Silicon Valley, November 4–6, at the Santa Clara Convention Center in Santa Clara, CA, will feature technical sessions from a rock star conference faculty and the leading Cloud industry players in the world.
"We are automated capacity control software, which basically looks at all the supply and demand and running a virtual cloud environment and does a deep analysis of that and says where should things go," explained Andrew Hillier, Co-founder & CTO of CiRBA, in this SYS-CON.tv interview at the 14th International Cloud Expo®, held June 10-12, 2014, at the Javits Center in New York City. Cloud Expo® 2014 Silicon Valley, November 4–6, at the Santa Clara Convention Center in Santa Clara, CA, will feature technical sessions from a rock star conference faculty and the leading Cloud industry players in the world.
Almost everyone sees the potential of Internet of Things but how can businesses truly unlock that potential. The key will be in the ability to discover business insight in the midst of an ocean of Big Data generated from billions of embedded devices via Systems of Discover. Businesses will also need to ensure that they can sustain that insight by leveraging the cloud for global reach, scale and elasticity. In his session at Internet of @ThingsExpo, Mac Devine, Distinguished Engineer at IBM, will discuss bringing these three elements together via Systems of Discover.
The Internet of Things promises to transform businesses (and lives), but navigating the business and technical path to success can be difficult to understand. In his session at 15th Internet of @ThingsExpo, Chad Jones, Vice President, Product Strategy of LogMeIn's Xively IoT Platform, will show you how to approach creating broadly successful connected customer solutions using real world business transformation studies including New England BioLabs and more.
All too many discussions about DevOps conclude that the solution is an all-purpose player: developer and operations guru, complete with pager for round-the-clock duty. For most organizations that is not the way forward. In his session at DevOps Summit, Bernard Golden, Vice President of Strategy at ActiveState, will discuss how to achieve the agility and speed of end-to-end automation without requiring an organization stocked with Supermen and Superwomen.