@DXWorldExpo Authors: Elizabeth White, Yeshim Deniz, Liz McMillan, Pat Romanski, Zakia Bouachraoui

Related Topics: @DXWorldExpo, @CloudExpo

@DXWorldExpo: Blog Feed Post

The Structure in Next Generation Object Storage

The fun moment of the conference was when Chris Mellor, absent for good reasons, challenged us all through a video message

It’s about time to revive this blog: it has been almost 6 months since I joined DDN and it has been a roller coaster ride (I love roller coasters). I’ve learned a lot about how to build a better object storage platform and I hope I’ve helped a lot of people here how to better explain the benefits, opportunities and use cases of object storage to customers. Talking about customers, it’s been exciting to visit our major WOS accounts and see object storage in action at massive scale.

That said, last week (actually, almost 2 weeks back now) it was demonstrated again that we’re only halfway there. It was the time of the year for GigaOm Structure and the guys from the Next Generation Object Storage Summit (in)conveniently scheduled their object storage get-together the same week (avoid the overlap guys). At NGOSS, a surprisingly large amount of the conference was spent on the “what is object storage” debate. At Structure, my workshop about how the right type of object storage can resolve the scalability, efficiency and performance challenges of large scale web applications was very well attended, even though a lot of it was a basic object storage 101.

I had avoided the NGOSS event previously as I didn’t see the point of just presenting to my competitors (half joking), but this event turned out to be very enlightening. It was good to learn more about Intel’s initiatives (adding Erasure Coding to Swift and their CosBench “object storage benchmarking” project) and there were a few very interesting presentations and panels. As a matter of fact I think a next event should have us spend some time on discussing performance for object storage in general. Performance has been the missing piece in many object storage conversations but yet it is oh so important. In times of whistleblowers, the Yottastor use case got a great deal of attention and the discussion around government use of object storage was very exciting. Based on the number of questions Reuven Cohen of Forbes had for Bob Carlson at Yottastor, we should hope for some coverage on the solution in his blog some time soon. If not, I’ll dedicate a post to the Yottastor solution on this blog so stay tuned.

The fun moment of the conference was when Chris Mellor, absent for good reasons, challenged us all through a video message: “show me where the file system fails and where object storage saves the day”. Chris, I would suggest you consider the question differently and not suggest that file systems will ultimately die: just like tape will never die, the file system will continue to play a strong role in an integrated solution stack where object storage becomes one element of a larger data center framework. There will always be use cases for file storage and some file systems will scale massively (and probably never break… DDN certainly has a number of high scale use cases to talk to). But it’s about avoiding the file system complexity and overhead. It’s about storing large volumes of mostly immutable data more efficiently etc. etc. etc. We invite you to talk with University College London (a train ride away…) and learn what they’re using object storage for, their ambitions to go to and beyond 100PB, the value of a scalable, efficient and portable platform….

Back to the essence: believe it or not, but I thought the “what makes a storage platform an object storage platform” discussion still the most interesting one. Is a REST API enough (no)? Does it need to be pure object, without POSIX on the disk level (to be efficient and scale… of course). Isn’t it defined by the benefits the platform provides (yes, that as well). Industry analyst Ben Woo offered to take the lead in composing a check list to help buyers decide whether a proposed object storage solution will do the job for them, and Deni Connor pointed out a lot of the debate is also covered in their recent object storage survey report.

Coincidentally (or not), most of what’s been discussed at the NGOSS are topics that my readers have been reading about for some time. As these conferences confirm there is still a lot of education to do, let me dedicate the next few posts to the essence of object storage. By the time the summer is over (if it ever gets started here in Belgium), it will all be crystal clear (kind of).

Read the original blog entry...

More Stories By Tom Leyden

Tom Leyden is VP Product Marketing at Scality. Scality was founded in 2009 by a team of entrepreneurs and technologists. The idea wasn’t storage, per se. When the Scality team talked to the initial base of potential customers, the customers wanted a system that could “route” data to and from individual users in the most scalable, efficient way possible. And so began a non-traditional approach to building a storage system that no one had imagined before. No one thought an object store could have enough performance for all the files and attachments of millions of users. No one thought a system could remain up and running through software upgrades, hardware failures, capacity expansions, and even multiple hardware generations coexisting. And no one believed you could do all this and scale to petabytes of content and billions of objects in pure software.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.

DXWorldEXPO Digital Transformation Stories
Most DevOps journeys involve several phases of maturity. Research shows that the inflection point where organizations begin to see maximum value is when they implement tight integration deploying their code to their infrastructure. Success at this level is the last barrier to at-will deployment. Storage, for instance, is more capable than where we read and write data. In his session at @DevOpsSummit at 20th Cloud Expo, Josh Atwell, a Developer Advocate for NetApp, will discuss the role and value...
Nicolas Fierro is CEO of MIMIR Blockchain Solutions. He is a programmer, technologist, and operations dev who has worked with Ethereum and blockchain since 2014. His knowledge in blockchain dates to when he performed dev ops services to the Ethereum Foundation as one the privileged few developers to work with the original core team in Switzerland.
"When you think about the data center today, there's constant evolution, The evolution of the data center and the needs of the consumer of technology change, and they change constantly," stated Matt Kalmenson, VP of Sales, Service and Cloud Providers at Veeam Software, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
Cloud-enabled transformation has evolved from cost saving measure to business innovation strategy -- one that combines the cloud with cognitive capabilities to drive market disruption. Learn how you can achieve the insight and agility you need to gain a competitive advantage. Industry-acclaimed CTO and cloud expert, Shankar Kalyana presents. Only the most exceptional IBMers are appointed with the rare distinction of IBM Fellow, the highest technical honor in the company. Shankar has also receive...
Today, we have more data to manage than ever. We also have better algorithms that help us access our data faster. Cloud is the driving force behind many of the data warehouse advancements we have enjoyed in recent years. But what are the best practices for storing data in the cloud for machine learning and data science applications?
Andi Mann, Chief Technology Advocate at Splunk, is an accomplished digital business executive with extensive global expertise as a strategist, technologist, innovator, marketer, and communicator. For over 30 years across five continents, he has built success with Fortune 500 corporations, vendors, governments, and as a leading research analyst and consultant.
Bill Schmarzo, author of "Big Data: Understanding How Data Powers Big Business" and "Big Data MBA: Driving Business Strategies with Data Science" is responsible for guiding the technology strategy within Hitachi Vantara for IoT and Analytics. Bill brings a balanced business-technology approach that focuses on business outcomes to drive data, analytics and technology decisions that underpin an organization's digital transformation strategy.
DevOpsSummit New York 2018, colocated with CloudEXPO | DXWorldEXPO New York 2018 will be held November 11-13, 2018, in New York City. Digital Transformation (DX) is a major focus with the introduction of DXWorldEXPO within the program. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive over the long term.
Headquartered in Plainsboro, NJ, Synametrics Technologies has provided IT professionals and computer systems developers since 1997. Based on the success of their initial product offerings (WinSQL and DeltaCopy), the company continues to create and hone innovative products that help its customers get more from their computer applications, databases and infrastructure. To date, over one million users around the world have chosen Synametrics solutions to help power their accelerated business or per...
DXWorldEXPO LLC announced today that ICOHOLDER named "Media Sponsor" of Miami Blockchain Event by FinTechEXPO. ICOHOLDER gives detailed information and help the community to invest in the trusty projects. Miami Blockchain Event by FinTechEXPO has opened its Call for Papers. The two-day event will present 20 top Blockchain experts. All speaking inquiries which covers the following information can be submitted by email to [email protected] Miami Blockchain Event by FinTechEXPOalso offers sp...