The New Economics of Primary Storage in the Datacenter

Mike Vizard, Journalist | 6/13/2013 | 7 comments

Mike Vizard
With the rise of affordable Flash memory options in the datacenter, the fundamental economics of storage are rapidly transforming.

Rather than relying solely on hard disk drives that are challenging to manage, many IT organizations are making a rapid transition to solid state disk (SSD) technology. While still more expensive than hard disk drives, SSD has come down in price when combined with a raft of additional benefits, making SSDs too compelling to ignore.

The first major benefit is that IT organizations can use smaller, more energy-efficient processors in their servers because SSDs eliminate a lot of latency. This not only reduces the cost of the servers, it saves energy and reduces footprints. Just as importantly, fewer servers usually results in lower application licensing fees, because most software licensing schemes are based on the number of servers employed.

Add to that the fact that SSDs are less likely to have mechanical problems resulting in the need for fewer spares and lower maintenance costs, and they become a pretty compelling alternative to magnetics disks.

"Like most things in IT you need to follow the money," James Baker, senior contributing analyst with The Clipper Group, an IT consulting firm, told me. "You need to take a more holistic approach to assessing costs."

Beyond hardware issues, SSDs make life a lot easier for developers. Rather than trying to optimize the placement of data on magnetic spinning disks, developers can write applications without having to worry about any constraints relating to data latency. That might allow them to develop applications that were never before possible, and at the very least the environment becomes a lot more forgiving of the quality of the code being run.

While well-known providers of hard disk drives such as Seagate have been aggressively investing in Flash memory technologies, Scott Horn, vice president of marketing at Seagate, says it would be shortsighted to completely write off high performance disk drives any time soon.

Not only will hard disk drive pricing continue to fall, Horn says Flash memory pricing is about as low as it's going to go for the foreseeable future because the industry is starting to reach some capacity constraints.

Horn predicts that not only will we soon see shortages of Flash memory, the cost of hard disk shortage systems will fall given advances such as new 5 millimeter technology and the fact that storage system vendors have a lot of leeway in terms of the margins they have historically enjoyed.

"Flash memory pricing may even go up with Flash memory increasing goes on allocation," says Horn.

It's too early to say with absolute certainty that Flash memory will completely replace high performance magnetic systems in the enterprise. But it is clear that so-called "hot data" associated with mission-critical applications is moving that way. Cold data, meanwhile, will increasing wind up on inexpensive SAS drives. What's not clear is where all the "warm data" that resides between those two extremes will ultimately wind up, which is why storage vendors are introducing more sophisticated automated tiering systems.

Dell, for example, just introduced the Dell Compellent Flash Optimized Solution, which supports automated tiering across hard drives and two classes of SSDs.

According to Bob Fine, product director for Dell Storage, the Dell Compellent Flash Optimized Solution is the only system that not only tiers data across SSD and hard disk drives, it will tier data across different classes of SSDs. That means the system will automatically tier write data on single-level cell (SLC) class SSDs, while using less expensive multi-level cell (MLC) class SSDs for read-only data.

Fine says that when it comes to automated tiering of data, the Dell Compellent Flash Optimized Solution is the only instance of that kind of storage management tool that imposes no restrictions in terms of where data can be placed in the system.

"When it comes to putting the right data at the right place at the right time we excel," says Fine.

Of course, taking advantage of those kinds of systems will require IT organizations to acquire new storage systems. But when you think about all the time and effort administrators now go through to manually optimize the placement of data, it's a relatively small price to pay to free someone up to add more value elsewhere inside the IT organization.

View Comments: Newest First | Oldest First | Threaded View
MDMConsult   The New Economics of Primary Storage in the Datacenter   7/3/2013 9:09:11 AM
Re: Tiering by Dell
SSDs do have a reliability reputation. Today they are where disk drives were 15 years ago. The cost is lesser, and significant improvements are being made to the market. We should be on the lookout for reliability technologies that are new being brought to the market in the coming years to test these factors.
tekedge   The New Economics of Primary Storage in the Datacenter   6/17/2013 10:56:10 AM
The New Economics
Very informative . thanks.Heartenng to know we will have cheaper options for data storage , and technology is moving fast in this regard!
Technocrat   The New Economics of Primary Storage in the Datacenter   6/15/2013 11:08:25 PM
Re: SSD technology will go cheap in future
Really encouraging to learn Dell is making great strides in optimizing the potential of SSD's for storage.  Will be nice to see how this plays out.
rdv   The New Economics of Primary Storage in the Datacenter   6/15/2013 6:15:54 PM
SSD technology will go cheap in future
SSD technology will go cheap and more reliable (already reliable) in future.

With the usage of NAND based SSD and also the improving manufacturing technology of 3D stacking of the chips a lot of memory can be packed into a small die areas.  A term "memory cubes" is what used to these stacked dies of memory.  Since the memory are repeatitive when it comes to manufacturing, the price is likely go down in near future.

  On another note, a good comparison of the SLC and MLC SSD memory and their reliability is captured in this PDF.
rdv   The New Economics of Primary Storage in the Datacenter   6/15/2013 6:03:49 PM
Tiering by Dell
Mike: Thanks for the post.

"the Dell Compellent Flash Optimized Solution is the only system that not only tiers data across SSD and hard disk drives, it will tier data across different classes of SSDs."

   Does it not retard the bit-rate (killing the advantage of using the high-speed SSD) by have a interface when tiering the data on different storage device?

   Does the solution from dell put all the data related to a particular application on only one kind of storage, I mean there is no requirement like De-fragmentation of data between different storages?
rdv   The New Economics of Primary Storage in the Datacenter   6/15/2013 5:41:48 PM
Re: solid state disk (SSD) technology a viable storage alternative
Pedro:  "Of course, it may not completely replace hard disk storage,..."

  I agree you here, given the cost of the memory HDD is far more cheap than SSD.  Also the present configurations of Laptop have 256GB of SSD Vs. 1TB of HDD and that too at more than double the price.

  For the people who want lighter and slimmer devices, who want faster boot-up time and faster applications' loading time, they will have to shell-out money on SSD memory.
Pedro Gonzales   The New Economics of Primary Storage in the Datacenter   6/14/2013 11:26:55 AM
solid state disk (SSD) technology a viable storage alternative
great article.  I know from a user perspective, solid state disk (SSD) technologies have revolutionize personal storage, they are used for pretty much anything and their storage capacity keeps increasing. You point out many advantages in this  technology, advantages that could very well make a difference in improving efficiency for the enterprise.  Of course, it may not completely replace hard disk storage, may be its not suppose to, but its good to know that there are other choices available. 


The blogs and comments posted on EnterpriseEfficiency.com do not reflect the views of TechWeb, EnterpriseEfficiency.com, or its sponsors. EnterpriseEfficiency.com, TechWeb, and its sponsors do not assume responsibility for any comments, claims, or opinions made by authors and bloggers. They are no substitute for your own research and should not be relied upon for trading or any other purpose.

More Blogs from Michael Vizard
Mike Vizard   10/23/2013   14 comments
With congressional hearings scheduled this week to get to the bottom of the fiasco surrounding the HealthCare.gov launch, what will probably come to light is just how much a broken ...
Mike Vizard   10/15/2013   2 comments
Speaking at the recent McAfee Focus 2013 conference, Intel president Renee James says integrating security into hardware in a way that fundamentally lowers the cost of IT security is now ...
Mike Vizard   10/9/2013   18 comments
With so many big-data projects now underway across the enterprise, the next big challenge facing IT organizations is how to effectively manage that amount of data.
Mike Vizard   9/13/2013   27 comments
With massive investments now being made in customer experience management, the way organizations sell their wares is being transformed in the digital age; and with it is coming a profound ...
Mike Vizard   9/9/2013   20 comments
IT organizations of all sizes have never been confronted with as much diversity and complexity in terms of the devices they are being asked to support.
Latest Archived Broadcast
In this episode, you'll learn how to stretch the limits of your private cloud -- and how to recognize the limits that can't be exceeded.
On-demand Video with Chat
IT has to deploy Server 2012 in a way that fits the architecture of its application delivery system.
E2 IT Migration Zones
IT Migration Zone - UK
Why PowerShell Is Important
Reduce the Windows 8 Footprint for VDI
Rethinking Storage Management
IT Migration Zone - FR
SQL Server : 240 To de mémoire flash pour votre data warehouse
Quand Office vient booster les revenus Cloud et Android de Microsoft
Windows Phone : Nokia veut davantage d'applications (et les utilisateurs aussi)
IT Migration Zone - DE
Cloud Computing: Warum Unternehmen trotz NSA auf die „private“ Wolke setzen sollten
Cloud Computing bleibt Wachstumsmarkt – Windows Azure ist Vorreiter
Like Us on Facebook
Twitter Feed
Enterprise Efficiency Twitter Feed
Site Moderators Wanted
Enterprise Efficiency is looking for engaged readers to moderate the message boards on this site. Engage in high-IQ conversations with IT industry leaders; earn kudos and perks. Interested? E-mail:
moderators@enterpriseefficiency.com
Informed CIO: Dollars & Sense: Virtual Desktop Infrastructure
Cut through the VDI hype and get the full picture -- including ROI and the impact on your Data Center -- to make an informed decision about your virtual desktop infrastructure deployments.

Read the full report
Virtualization Management: Time To Get Serious
Welcome to the backside of the virtualization wave. Discover the state of virtualization management and where analysts are predicting it is heading

Read the full report
PUBLIC SECTOR RESOURCES
WHITE PAPERS
A Video Case Study – Translational Genomics Research Institute
e2 Storage Video


On the Case
TGen IT: Where We're Going Next

7|11|12   |   08:12   |   10 comments


Now that TGen has broken new ground in genomic research by using Dell's storage, cloud, and high-performance computing solutions, the company discusses what will come next for it and for personalized medicine.
On the Case
Better Care Through Better Communications

6|6|12   |   02:24   |   11 comments


The achievements of the TGen/Dell project could improve how all people receive healthcare, because they are creating ways to improve end-to-end communication of medical data.
On the Case
TGen IT: Where We Are Now

5|15|12   |   06:58   |   6 comments


TGen is breaking new ground in genomic research by using Dell's storage, cloud, and high-performance computing solutions.
On the Case
TGen IT: Where We Were

4|27|12   |   06:45   |   10 comments


The Translational Genomics Research Institute wanted to save lives, but its efforts were hobbled by immense computing challenges related to collecting, processing, sharing, and storing enormous amounts of data.
On the Case
1,200% Faster

4|18|12   |   02:27   |   12 comments


Through their partnership, Dell and TGen have increased the speed of TGen’s medical research by 1,200 percent.
On the Case
IT May Improve Children's Chances of Survival

4|17|12   |   02:12   |   8 comments


IT is helping medical researchers reach breakthroughs in a way and pace never seen before.
On the Case
Medical Advances in the Cloud

4|10|12   |   1:25   |   5 comments


TGen and Dell are pushing the boundaries of computing, and harnessing the power of the cloud to improve healthcare.
On the Case
TGen: Living the Mission

4|9|12   |   2:25   |   3 comments


TGen's CIO puts the organizational mission at the heart of everything the IT staff does.
On the Case
TGen Speeding Up Biomedical Research to Save More Lives

4|5|12   |   1:59   |   6 comments


The Translational Genomics Research Institute is revamping its computing to improve speed, storage, and collaboration – and, most importantly, to save lives.
On the Case
Computing Power Helping to Save Children's Lives

3|28|12   |   2:13   |   3 comments


The Translational Genomics Institute’s partnership with Dell is enabling them to treat kids with neuroblastoma more quickly and save more lives.
Tom Nolle
How Deep Is My Storage Hierarchy?

7|3|12   |   2:13   |   5 comments


At the GigaOM Structure conference, a startup announced a cloud and virtualization storage optimizing approach that shows there's still a lot of thinking to be done on the way storage joins the virtual world.
E2 Interview
What Other Industries Can Learn From Financial Services

6|13|12   |   02:08   |   3 comments


We asked CIO Steve Rubinow what CIOs in other industries can learn from the financial services industry about datacenter efficiency, security, and green computing.
E2 Interview
Removing Big-Data Flow Bottlenecks

6|12|12   |   02:55   |   No comments


We ask CIO Steve Rubinow what pieces of financial services infrastructure need to perform better to get traders info faster.
E2 Interview
Getting Traders the Data They Need

6|11|12   |   02:04   |   1 comment


We ask CIO Steve Rubinow: What do stock market traders need to know, how fast do they need it, and how can CIOs get it to them?
E2 Interview
Can IT Help Fix the Global Economy?

6|8|12   |   02:32   |   2 comments


We ask CIO Steve Rubinow whether today's IT can help repair the global economy (and if IT played any role in the economy's collapse).
E2 Interview
More Competitive Business via Datacenter Strategy

5|4|12   |   2:46   |   1 comment


Businesses need to be competitive, yet efficient, and both goals affect datacenter design.
E2 Interview
The Recipe for Greater Efficiency

5|3|12   |   3:14   |   2 comments


Intel supplies the best ingredients to drive greater datacenter efficiency and support new compute, storage, and networking needs.
E2 Interview
Datacenters Enabling Business Transformation

5|1|12   |   06:37   |   1 comment


Dell’s Gaurav Chand says that for the first time ever datacenter technology is truly enabling all kinds of organizations to transform their business and achieve new objectives.
Tom Nolle
Cloud Data: Big AND Persistent!

3|28|12   |   2:11   |   10 comments


We always hear about "Big" data, but a real issue in cloud storage is not just bigness but also persistence. A large data model is less complicated than a big application repository that somehow needs to be accessed. The Hadoop send-program-to-data model may be the answer.
Tom Nolle
Project Lightning Streamlines Storage

2|16|12   |   2:09   |   2 comments


EMC's Project Lightning has matured into a product set, and it's important, less because it has new features or capabilities in storage technology and management, than because it may package the state of the art in a way more businesses can deploy.
Tom Nolle
Big Data Appliance Is Big News

1|12|12   |   2:18   |   No comments


Oracle's release of a Hadoop appliance for Big Data may be a signal that we're shifting to database appliances.
Tom Nolle
Myopia Can Hurt Storage Policy

12|22|11   |   2:08   |   No comments


We're at the beginning of a cloud-driven revolution in storage, but Oracle's quarter shows that enterprises are hunkering down on old concepts because they're afraid of the costs in the near term.
Sara Peters
An Untrained User & a Mobile Medical Device

12|19|11   |   2:43   |   11 comments


Untrained end users, clueless central IT staff, and expensive mobile devices are a worrisome combination for healthcare CIOs.
Tom Nolle
Too Many Labels on 'Big Data'?

12|9|11   |   2:12   |   3 comments


However you label it, structured and unstructured information are different and will likely always require different tools.
Sara Peters
E2 Debuts New Storage Section

12|8|11   |   1:51   |   1 comment


Need strategic guidance on everything from SSDs to 100 percent virtualized datacenters? Look no further.