Why Object Stores Are the Future of Archiving

Bob Ganley, Senior Solutions Consultant | 4/9/2012 | 8 comments

Bob Ganley
When it comes to long-term archiving of digital information, there are several media choices, including tape, optical media, NAS, SAN, and object storage.

Tape: Old standby
Tape is a traditional solution for backup and archiving needs and has been in use for many years. For long-term storage, it can seem at first blush to be a cost-effective solution when compared with disk-based storage.

However, once you look at the logistics surrounding growing tape libraries and the long-term costs of those environments, the advantage isn't so clear. In terms of reliability, IT managers say that a disturbingly high percentage of tape restores fail. Of course, the disadvantages of sequential access to information on tape means that recovery times can be long and rapid direct access to specific information is impossible.

Optical: Failure rate debate
Optical media has the portability of tape, but it doesn't have the same capacity. One clear advantage of optical is direct access for quicker restores, but because of the nature of removable media, it doesn't provide online access.

The management and handling challenges of growing optical backup libraries are not that different from tape, and with comparatively higher media cost, TCO of optical systems is similar. Failure rates for optical media have been the subject of a lot of debate and study. Higher capacity Blu-ray media may be more susceptible to environmental stress.

NAS and SAN: Access and protection
When it comes to performance for information access, network attached storage solutions NAS and SAN are great. Archived files can be quickly searched, and specific information can be restored without having to wait for a tape to spin.

Importantly, NAS and SAN solutions bring data protection to the table like RAID protection to prevent physical media issues from causing data loss. The reality is that storage solutions are designed for primary storage and can be expensive.

Automated tiering solutions can definitely lower the $/MB. Traditional NAS system namespaces are limited, preventing growth past preset limits. Archiving solutions for some applications, such as banking and healthcare, need to prove the integrity of their archives and require data immutability assurance that may not be available in SAN and NAS systems.

Object storage: Think efficient
For digital archiving, object storage systems are a great solution. They don't have the transactional performance of SAN or NAS, but they have the online data accessibility of primary storage systems.

They are designed to be easy to manage and provide data protection not afforded in tape solutions. By their nature, object stores don't have the namespace limitations of NAS storage, and so can scale to very large capacities.

For some applications, immutability must be assured and write-once/read-many (WORM) capabilities are a feature of many object storage systems. Storage of rich metadata on stored objects enables the application of management policies to govern the features of the storage, which is great for archival applications. For example, object storage systems can use metadata to automatically administer per-object data management policies, like number of replicas or destruction date. Redundant Array of Independent Nodes (RAIN) is the name of the technique of replicating data to other nodes within the object storage system to enhance reliability.

The right implementation of object storage offers a space and energy-efficient dense storage solution. A scale-out architecture using commodity hardware allows for a cost-effective solution that can start small can grow over time as needed.

The intelligence built into the software running the object storage system allows for a less-complex-to-manage system. This approach provides a measureable boost in enterprise efficiency and can be truly seen as the next phase in archiving solutions.

View Comments: Newest First | Oldest First | Threaded View
Bob Ganley   Why Object Stores Are the Future of Archiving   4/24/2012 3:30:10 PM
Re: Attaining Storage Nirvana
So true @LuFu and what would we do for a living otherwise :-)

I definitely see a couple of trends converging here. 1) Increasing data growth leading to increasing urgency of the need to control primary storage capacity, along with realization that storage tiering (including an archive tier) can reduce storage costs. 2) desire to have archive data near-line - I mean by that retrievable quickly as in hundreds of milliseconds. 3) The rising importance of storing meta-data with an archived object as a way to enable the automation of policy implementation. 4) The increasing adoption of object storage giving legitimacy to the segment.

Thanks for the comment!

Bob
User Ranking: Blogger
LuFu   Why Object Stores Are the Future of Archiving   4/24/2012 1:34:18 PM
Attaining Storage Nirvana
@Bob - Good layout of the storage landscape for archiving. As depicted, there isn't a single be-all, end-all solution for archiving data at the enterprise level. Current solutions with tape, optical, NAS/SAN, and Object Storage each have their own niche and purpose. And while it may be true that Object Storage will be the mode of the future I've been around long enough to hear the same discussions regarding tape, optical, and NAS/SAN...and they are still hanging around in the present. No doubt we will still be practicing storage meditation for years to come.
Bob Ganley   Why Object Stores Are the Future of Archiving   4/23/2012 7:17:00 AM
RE: Why Object Stores Are the Future of Archiving
Thanks for the comment @singlemud. I like your handle, any chance you ride a single speed mtb? :-)
User Ranking: Blogger
singlemud   Why Object Stores Are the Future of Archiving   4/20/2012 4:51:12 PM
RE: Why Object Stores Are the Future of Archiving
Very good post, I will keep my eye open and subscribe to object storage.
mastachand   Why Object Stores Are the Future of Archiving   4/18/2012 10:52:00 AM
Re: More than just for Archive
Hey Bob,

Too bad we missed each other at SNW, but i'm glad you were able to spend some time with Philippe ;)

I know 400 words is very limiting when talking about such an innovation-filled arena, which is why the comments are great ;) No words limitations there and it creates a discussion, which is great.

Let us know if we can help in anyway for your follow-up posts about object storage and storage efficiency. We're always happy to discuss this (rather) objectively :-D

Best

-Marc

@mastachand
Bob Ganley   Why Object Stores Are the Future of Archiving   4/18/2012 7:28:46 AM
Re: More than just for Archive
Thanks for the post @mastachand . I'm excited that you are contributing to the discussion and appreciate the additional detail.  I'm going to write more about object storage and will include some of your points in future posts.

FYI, I tried to find you at SNW and ended up meeting Philippe and having a great conversation. One thing I'm excited about is erasure encoding. It is a great topic for a future post focused on storage efficiency. Fact of the matter is that it is hard to do justice to ANY subject in 400 words, so I usually look at a specific angle for any given post.
User Ranking: Blogger
mastachand   Why Object Stores Are the Future of Archiving   4/17/2012 6:35:02 PM
More than just for Archive
Hey Bob,

[Disclaimer: i work for Scality]

Thanks for your post. Great sum up on why there's a need for object storage for large (and ever-growing) unstructured data stores. But even though unstructured data is indeed the fastest growing type of data out there, not all of that is archive. It also includes Emails, or data sets/objects (mostly media) for web 2.0 applications. Medical imagery, EMR & EHR storage are, again, not archive/backup use cases.

Also, I think object storage, when designed correctly, can help solve the management nightmare of legacy storage solutions when one reaches a PB. At that scale, SANs and NAS become overly complex and expensive for many organizations. Bringing in a software stack that is not tied to any specific hardware but incorporates all the intelligence needed to take advantage of any type of hardware (leveraging fast storage HW for hot, heavily accessed files, and slower storage for backup, archival and otherwise long-term storage) in a totally transparent fashion from the application storing data is something object storage can offer. a truly hardware-agnostic solution also gets rid of migrations every 3/5 years for hardware replacement.

Basicaly, it makes managing 1 PB, 10 PB and more not only simpler but actually achievable. It is not the case with legacy storage systems, whether you think in financially sustainable or purely operational terms. Moving 10PB to another system after 3 years is not a solution.

Some Object Storage vendors really focus on the archive/long-term storage market where performance is not key. At Scality, we are focusing on bringing the economies of scale of the public cloud giants (amazon, rackspace, google) to PB-scale storage systems for Telcos, Service Providers and Enterprises. Scalable performance (IOPS, throughput and latency), durability and cost-efficiency for large email platforms, web 2.0 applications and of course for archival, public cloud storage...

Object storage is meant for more than only archive and backups. We're only in its infancy stage in a transforming industry (which is a good place to be as a startup :)).

Thanks again for your article.

-Marc Villemade

@mastachand

http://www.scality.com
Technocrat   Why Object Stores Are the Future of Archiving   4/14/2012 8:02:14 PM
Optical Storage: The Next Frontier of Storage

Bob Thank you for speaking on the benefits of Optical Storage, didn't know much about it until I read your piece. I am just a little confused as to where the  optical image is written to ?  I also was not aware that there were namespace limitations in the current NAS configurations -  Very interesting stuff Thanks Bob !



The blogs and comments posted on EnterpriseEfficiency.com do not reflect the views of TechWeb, EnterpriseEfficiency.com, or its sponsors. EnterpriseEfficiency.com, TechWeb, and its sponsors do not assume responsibility for any comments, claims, or opinions made by authors and bloggers. They are no substitute for your own research and should not be relied upon for trading or any other purpose.

More Enterprise Delliberation
Bob Ganley   6/1/2012   0 comments
Yes, RAID is important; it helps protect from data loss in the event of a disk failure. The problem is that RAID configuration in the traditional sense of the concept is very inefficient. ...
Bob Ganley   5/18/2012   3 comments
If you are planning a deployment of Exchange 2010, choosing the right storage architecture can be a confusing task.
Bob Ganley   5/2/2012   4 comments
Now hold on a minute. You have heard about Virtual Desktop Infrastructure, and it is very intriguing. After all, managing lots of desktop PCs is one of the more labor intensive, error ...
Bob Ganley   4/13/2012   22 comments
Data growth is a reality. IDC's Worldwide File-Based Storage 2010-2014 Forecast predicts that the amount of storage used in the next two years will exceed that from the past five years!
Latest Archived Broadcast
In this episode, you'll learn how to stretch the limits of your private cloud -- and how to recognize the limits that can't be exceeded.
On-demand Video with Chat
IT has to deploy Server 2012 in a way that fits the architecture of its application delivery system.
E2 IT Migration Zones
IT Migration Zone - UK
Why PowerShell Is Important
Reduce the Windows 8 Footprint for VDI
Rethinking Storage Management
IT Migration Zone - FR
SQL Server : 240 To de mémoire flash pour votre data warehouse
Quand Office vient booster les revenus Cloud et Android de Microsoft
Windows Phone : Nokia veut davantage d'applications (et les utilisateurs aussi)
IT Migration Zone - DE
Cloud Computing: Warum Unternehmen trotz NSA auf die „private“ Wolke setzen sollten
Cloud Computing bleibt Wachstumsmarkt – Windows Azure ist Vorreiter
Like Us on Facebook
Twitter Feed
Enterprise Efficiency Twitter Feed
Site Moderators Wanted
Enterprise Efficiency is looking for engaged readers to moderate the message boards on this site. Engage in high-IQ conversations with IT industry leaders; earn kudos and perks. Interested? E-mail:
moderators@enterpriseefficiency.com
Informed CIO: Dollars & Sense: Virtual Desktop Infrastructure
Cut through the VDI hype and get the full picture -- including ROI and the impact on your Data Center -- to make an informed decision about your virtual desktop infrastructure deployments.

Read the full report
Virtualization Management: Time To Get Serious
Welcome to the backside of the virtualization wave. Discover the state of virtualization management and where analysts are predicting it is heading

Read the full report
PUBLIC SECTOR RESOURCES
WHITE PAPERS
A Video Case Study – Translational Genomics Research Institute
e2 Storage Video


On the Case
TGen IT: Where We're Going Next

7|11|12   |   08:12   |   10 comments


Now that TGen has broken new ground in genomic research by using Dell's storage, cloud, and high-performance computing solutions, the company discusses what will come next for it and for personalized medicine.
On the Case
Better Care Through Better Communications

6|6|12   |   02:24   |   12 comments


The achievements of the TGen/Dell project could improve how all people receive healthcare, because they are creating ways to improve end-to-end communication of medical data.
On the Case
TGen IT: Where We Are Now

5|15|12   |   06:58   |   5 comments


TGen is breaking new ground in genomic research by using Dell's storage, cloud, and high-performance computing solutions.
On the Case
TGen IT: Where We Were

4|27|12   |   06:45   |   10 comments


The Translational Genomics Research Institute wanted to save lives, but its efforts were hobbled by immense computing challenges related to collecting, processing, sharing, and storing enormous amounts of data.
On the Case
1,200% Faster

4|18|12   |   02:27   |   12 comments


Through their partnership, Dell and TGen have increased the speed of TGen’s medical research by 1,200 percent.
On the Case
IT May Improve Children's Chances of Survival

4|17|12   |   02:12   |   8 comments


IT is helping medical researchers reach breakthroughs in a way and pace never seen before.
On the Case
Medical Advances in the Cloud

4|10|12   |   1:25   |   5 comments


TGen and Dell are pushing the boundaries of computing, and harnessing the power of the cloud to improve healthcare.
On the Case
TGen: Living the Mission

4|9|12   |   2:25   |   3 comments


TGen's CIO puts the organizational mission at the heart of everything the IT staff does.
On the Case
TGen Speeding Up Biomedical Research to Save More Lives

4|5|12   |   1:59   |   8 comments


The Translational Genomics Research Institute is revamping its computing to improve speed, storage, and collaboration – and, most importantly, to save lives.
On the Case
Computing Power Helping to Save Children's Lives

3|28|12   |   2:13   |   3 comments


The Translational Genomics Institute’s partnership with Dell is enabling them to treat kids with neuroblastoma more quickly and save more lives.
Tom Nolle
How Deep Is My Storage Hierarchy?

7|3|12   |   2:13   |   5 comments


At the GigaOM Structure conference, a startup announced a cloud and virtualization storage optimizing approach that shows there's still a lot of thinking to be done on the way storage joins the virtual world.
E2 Interview
What Other Industries Can Learn From Financial Services

6|13|12   |   02:08   |   3 comments


We asked CIO Steve Rubinow what CIOs in other industries can learn from the financial services industry about datacenter efficiency, security, and green computing.
E2 Interview
Removing Big-Data Flow Bottlenecks

6|12|12   |   02:55   |   No comments


We ask CIO Steve Rubinow what pieces of financial services infrastructure need to perform better to get traders info faster.
E2 Interview
Getting Traders the Data They Need

6|11|12   |   02:04   |   1 comment


We ask CIO Steve Rubinow: What do stock market traders need to know, how fast do they need it, and how can CIOs get it to them?
E2 Interview
Can IT Help Fix the Global Economy?

6|8|12   |   02:32   |   2 comments


We ask CIO Steve Rubinow whether today's IT can help repair the global economy (and if IT played any role in the economy's collapse).
E2 Interview
More Competitive Business via Datacenter Strategy

5|4|12   |   2:46   |   1 comment


Businesses need to be competitive, yet efficient, and both goals affect datacenter design.
E2 Interview
The Recipe for Greater Efficiency

5|3|12   |   3:14   |   2 comments


Intel supplies the best ingredients to drive greater datacenter efficiency and support new compute, storage, and networking needs.
E2 Interview
Datacenters Enabling Business Transformation

5|1|12   |   06:37   |   1 comment


Dell’s Gaurav Chand says that for the first time ever datacenter technology is truly enabling all kinds of organizations to transform their business and achieve new objectives.
Tom Nolle
Cloud Data: Big AND Persistent!

3|28|12   |   2:11   |   10 comments


We always hear about "Big" data, but a real issue in cloud storage is not just bigness but also persistence. A large data model is less complicated than a big application repository that somehow needs to be accessed. The Hadoop send-program-to-data model may be the answer.
Tom Nolle
Project Lightning Streamlines Storage

2|16|12   |   2:09   |   2 comments


EMC's Project Lightning has matured into a product set, and it's important, less because it has new features or capabilities in storage technology and management, than because it may package the state of the art in a way more businesses can deploy.
Tom Nolle
Big Data Appliance Is Big News

1|12|12   |   2:18   |   No comments


Oracle's release of a Hadoop appliance for Big Data may be a signal that we're shifting to database appliances.
Tom Nolle
Myopia Can Hurt Storage Policy

12|22|11   |   2:08   |   No comments


We're at the beginning of a cloud-driven revolution in storage, but Oracle's quarter shows that enterprises are hunkering down on old concepts because they're afraid of the costs in the near term.
Sara Peters
An Untrained User & a Mobile Medical Device

12|19|11   |   2:43   |   11 comments


Untrained end users, clueless central IT staff, and expensive mobile devices are a worrisome combination for healthcare CIOs.
Tom Nolle
Too Many Labels on 'Big Data'?

12|9|11   |   2:12   |   3 comments


However you label it, structured and unstructured information are different and will likely always require different tools.
Sara Peters
E2 Debuts New Storage Section

12|8|11   |   1:51   |   1 comment


Need strategic guidance on everything from SSDs to 100 percent virtualized datacenters? Look no further.