Welcome!

@BigDataExpo Authors: Elizabeth White, Liz McMillan, Yeshim Deniz, Matt Brickey, Christoph Schell

Related Topics: @BigDataExpo, @CloudExpo

@BigDataExpo: Blog Feed Post

The Structure in Next Generation Object Storage

The fun moment of the conference was when Chris Mellor, absent for good reasons, challenged us all through a video message

It’s about time to revive this blog: it has been almost 6 months since I joined DDN and it has been a roller coaster ride (I love roller coasters). I’ve learned a lot about how to build a better object storage platform and I hope I’ve helped a lot of people here how to better explain the benefits, opportunities and use cases of object storage to customers. Talking about customers, it’s been exciting to visit our major WOS accounts and see object storage in action at massive scale.

That said, last week (actually, almost 2 weeks back now) it was demonstrated again that we’re only halfway there. It was the time of the year for GigaOm Structure and the guys from the Next Generation Object Storage Summit (in)conveniently scheduled their object storage get-together the same week (avoid the overlap guys). At NGOSS, a surprisingly large amount of the conference was spent on the “what is object storage” debate. At Structure, my workshop about how the right type of object storage can resolve the scalability, efficiency and performance challenges of large scale web applications was very well attended, even though a lot of it was a basic object storage 101.

I had avoided the NGOSS event previously as I didn’t see the point of just presenting to my competitors (half joking), but this event turned out to be very enlightening. It was good to learn more about Intel’s initiatives (adding Erasure Coding to Swift and their CosBench “object storage benchmarking” project) and there were a few very interesting presentations and panels. As a matter of fact I think a next event should have us spend some time on discussing performance for object storage in general. Performance has been the missing piece in many object storage conversations but yet it is oh so important. In times of whistleblowers, the Yottastor use case got a great deal of attention and the discussion around government use of object storage was very exciting. Based on the number of questions Reuven Cohen of Forbes had for Bob Carlson at Yottastor, we should hope for some coverage on the solution in his blog some time soon. If not, I’ll dedicate a post to the Yottastor solution on this blog so stay tuned.

The fun moment of the conference was when Chris Mellor, absent for good reasons, challenged us all through a video message: “show me where the file system fails and where object storage saves the day”. Chris, I would suggest you consider the question differently and not suggest that file systems will ultimately die: just like tape will never die, the file system will continue to play a strong role in an integrated solution stack where object storage becomes one element of a larger data center framework. There will always be use cases for file storage and some file systems will scale massively (and probably never break… DDN certainly has a number of high scale use cases to talk to). But it’s about avoiding the file system complexity and overhead. It’s about storing large volumes of mostly immutable data more efficiently etc. etc. etc. We invite you to talk with University College London (a train ride away…) and learn what they’re using object storage for, their ambitions to go to and beyond 100PB, the value of a scalable, efficient and portable platform….

Back to the essence: believe it or not, but I thought the “what makes a storage platform an object storage platform” discussion still the most interesting one. Is a REST API enough (no)? Does it need to be pure object, without POSIX on the disk level (to be efficient and scale… of course). Isn’t it defined by the benefits the platform provides (yes, that as well). Industry analyst Ben Woo offered to take the lead in composing a check list to help buyers decide whether a proposed object storage solution will do the job for them, and Deni Connor pointed out a lot of the debate is also covered in their recent object storage survey report.

Coincidentally (or not), most of what’s been discussed at the NGOSS are topics that my readers have been reading about for some time. As these conferences confirm there is still a lot of education to do, let me dedicate the next few posts to the essence of object storage. By the time the summer is over (if it ever gets started here in Belgium), it will all be crystal clear (kind of).

Read the original blog entry...

More Stories By Tom Leyden

Tom Leyden is VP Product Marketing at Scality. Scality was founded in 2009 by a team of entrepreneurs and technologists. The idea wasn’t storage, per se. When the Scality team talked to the initial base of potential customers, the customers wanted a system that could “route” data to and from individual users in the most scalable, efficient way possible. And so began a non-traditional approach to building a storage system that no one had imagined before. No one thought an object store could have enough performance for all the files and attachments of millions of users. No one thought a system could remain up and running through software upgrades, hardware failures, capacity expansions, and even multiple hardware generations coexisting. And no one believed you could do all this and scale to petabytes of content and billions of objects in pure software.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@BigDataExpo Stories
"With Digital Experience Monitoring what used to be a simple visit to a web page has exploded into app on phones, data from social media feeds, competitive benchmarking - these are all components that are only available because of some type of digital asset," explained Leo Vasiliou, Director of Web Performance Engineering at Catchpoint Systems, in this SYS-CON.tv interview at DevOps Summit at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
21st International Cloud Expo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy. Me...
SYS-CON Events announced today that DXWorldExpo has been named “Global Sponsor” of SYS-CON's 21st International Cloud Expo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Digital Transformation is the key issue driving the global enterprise IT business. Digital Transformation is most prominent among Global 2000 enterprises and government institutions.
SYS-CON Events announced today that Datera, that offers a radically new data management architecture, has been named "Exhibitor" of SYS-CON's 21st International Cloud Expo ®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Datera is transforming the traditional datacenter model through modern cloud simplicity. The technology industry is at another major inflection point. The rise of mobile, the Internet of Things, data storage and Big...
"Outscale was founded in 2010, is based in France, is a strategic partner to Dassault Systémes and has done quite a bit of work with divisions of Dassault," explained Jackie Funk, Digital Marketing exec at Outscale, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
"We focus on SAP workloads because they are among the most powerful but somewhat challenging workloads out there to take into public cloud," explained Swen Conrad, CEO of Ocean9, Inc., in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
"We provide IoT solutions. We provide the most compatible solutions for many applications. Our solutions are industry agnostic and also protocol agnostic," explained Richard Han, Head of Sales and Marketing and Engineering at Systena America, in this SYS-CON.tv interview at @ThingsExpo, held June 6-8, 2017, at the Javits Center in New York City, NY.
"We are still a relatively small software house and we are focusing on certain industries like FinTech, med tech, energy and utilities. We help our customers with their digital transformation," noted Piotr Stawinski, Founder and CEO of EARP Integration, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
"We've been engaging with a lot of customers including Panasonic, we've been involved with Cisco and now we're working with the U.S. government - the Department of Homeland Security," explained Peter Jung, Chief Product Officer at Pulzze Systems, in this SYS-CON.tv interview at @ThingsExpo, held June 6-8, 2017, at the Javits Center in New York City, NY.
"We were founded in 2003 and the way we were founded was about good backup and good disaster recovery for our clients, and for the last 20 years we've been pretty consistent with that," noted Marc Malafronte, Territory Manager at StorageCraft, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
"We want to show that our solution is far less expensive with a much better total cost of ownership so we announced several key features. One is called geo-distributed erasure coding, another is support for KVM and we introduced a new capability called Multi-Part," explained Tim Desai, Senior Product Marketing Manager at Hitachi Data Systems, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
SYS-CON Events announced today that Calligo, an innovative cloud service provider offering mid-sized companies the highest levels of data privacy and security, has been named "Bronze Sponsor" of SYS-CON's 21st International Cloud Expo ®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Calligo offers unparalleled application performance guarantees, commercial flexibility and a personalised support service from its globally located cloud plat...
Internet of @ThingsExpo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 21st Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The Internet of Things (IoT) is the most profound change in personal and enterprise IT since the creation of the Worldwide Web more than 20 years ago. All major researchers estimate there will be tens of billions devic...
"The Striim platform is a full end-to-end streaming integration and analytics platform that is middleware that covers a lot of different use cases," explained Steve Wilkes, Founder and CTO at Striim, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
"Peak 10 is a hybrid infrastructure provider across the nation. We are in the thick of things when it comes to hybrid IT," explained Michael Fuhrman, Chief Technology Officer at Peak 10, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
"We are focused on SAP running in the clouds, to make this super easy because we believe in the tremendous value of those powerful worlds - SAP and the cloud," explained Frank Stienhans, CTO of Ocean9, Inc., in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
DX World EXPO, LLC., a Lighthouse Point, Florida-based startup trade show producer and the creator of "DXWorldEXPO® - Digital Transformation Conference & Expo" has announced its executive management team. The team is headed by Levent Selamoglu, who has been named CEO. "Now is the time for a truly global DX event, to bring together the leading minds from the technology world in a conversation about Digital Transformation," he said in making the announcement.
"MobiDev is a Ukraine-based software development company. We do mobile development, and we're specialists in that. But we do full stack software development for entrepreneurs, for emerging companies, and for enterprise ventures," explained Alan Winters, U.S. Head of Business Development at MobiDev, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
"Cloud computing is certainly changing how people consume storage, how they use it, and what they use it for. It's also making people rethink how they architect their environment," stated Brad Winett, Senior Technologist for DDN Storage, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
While the focus and objectives of IoT initiatives are many and diverse, they all share a few common attributes, and one of those is the network. Commonly, that network includes the Internet, over which there isn't any real control for performance and availability. Or is there? The current state of the art for Big Data analytics, as applied to network telemetry, offers new opportunities for improving and assuring operational integrity. In his session at @ThingsExpo, Jim Frey, Vice President of S...