GPU Supercomputing Comes of Age

Andy Patrizio, Technology Journalist | 12/2/2010 | 2 comments

Andy Patrizio

Twice a year we get the Top 500 list of supercomputers in the world. By and large the list is pointless. The Number 1 machine 18 months ago is now Number 17 (which shows how fast this stuff changes), and the vast majority of machines are used by research institutions and governments; it's not exactly relevant to IT/business computing.

Back when I was a staffer with a news publication, this inevitably meant one thing: a string of self-congratulatory press releases from Intel Corp. (Nasdaq: INTC), Advanced Micro Devices Inc. (AMD) (NYSE: AMD), IBM Corp. (NYSE: IBM), and Hewlett-Packard Co. (NYSE: HPQ). Well, one more vendor has joined that list of vendors with well earned bragging rights: Nvidia Corp. (Nasdaq: NVDA). The company that powers our video games is now becoming a player in high-performance computing -- something it has pursued for a few years.

The GPU (graphics processing unit) is a logical choice for many supercomputing tasks. A GPU is nothing more than a glorified math co-processor. (Remember the good old days of 80387 processors to go with your 386 computer?) They do one thing: process floating-point math very, very fast. GPUs have hundreds of math processing cores, which is exactly what graphics processing requires.

Nvidia, looking for new growth markets, decided several years back to repurpose those massive calculators as high-performance computing processors under the Tesla brand name, complete with its own programming language, called CUDA, to make apps use the GPU instead of the CPU.

It was a slow road for awhile as CUDA matured. Nvidia couldn't get the big names in supercomputing hardware behind Tesla. IBM threw its weight behind the Cell processor it co-developed for the Sony PlayStation 3, while other firms stuck with x86 technology.

Slowly these firms have come around. As Nvidia has advanced the technology and improved CUDA, it’s found more universities to teach computer science students and increased the talent pool. It had to go with ODMs for the first few generations of Tesla, but now IBM, HP, and Dell Inc. are offering servers with integrated Tesla processors.

The result? Three of the top five computers on the Top 500 supercomputer list are using Nvidia's Tesla, and six overall on the list are using it. Only one is using AMD's Radeon GPUs, a German cluster. AMD has really been left behind in GPU computing, making virtually no effort in that area at all, despite the fact many people consider its Radeon video cards to be highly competitive with the Nvidia cards.

What I find bothersome is that the top Nvidia computers are all in Asia. Tianhe-1A, the top computer on the list with 2.566 petaflops of peak performance, is in China. It uses 14,336 six-core Intel Xeon X5670 CPUs and 7,168 Nvidia Tesla 2050 compute boards. Nebulae, a 1.271Pflop beast, is also in China, and Tsubame 2.0 (1.192PFlop) is in Japan.

China has a third Tesla system and Japan has a second, both further down the list. There is only one American machine, ranked No. 72, at the Lawrence Livermore Labs.

So, why is Asia getting GPU computing so right? Or to put it another way: Why are we not getting it right? Frozen budgets? Don't know where to start? You can always experiment with Inc. (Nasdaq: AMZN)'s new GPU-based EC2 service. The service will provide you with access to Tesla CPUs like the ones being used in Asia.

It may not give you petaflops of power, but it's pretty good. One guy used them to crack the SHA-1 encryption protocol. He was able to break it in less than two hours. I'm not sure that's what Amazon intended when it created this service, but it does show the power available for rent.

So hop to it, American IT. You're being left behind by the Chinese and Japanese. Again.

View Comments: Newest First | Oldest First | Threaded View
Technocrat   GPU Supercomputing Comes of Age   12/3/2010 3:50:29 AM
Re: And he throws down the gauntlet...
@ CMTucker   I agree wholeheartedly with your assessment. The technology is there and you can bet those in the know within the government know about the Chinese and Japanese developments. Why is the U.S. not pursuing supercomputers to the same extent? In my opinion, if the technology cannot be controlled then the Government definitely sees it as a potential threat – that doesn’t mean the Government doesn’t have them behind some locked door, but the economic realities of the last decade have slowed the developmental progress for sure.
CMTucker   GPU Supercomputing Comes of Age   12/2/2010 2:14:48 PM
And he throws down the gauntlet...
It has to be the money, because that's what makes everything go over here. We don't have a centralized authority that can dictate priorities; and we've suffered through 8 years of cuts to funding for research and innovation in the public sector. 

Granted, the last two years have seen some increase in funding, but I think the reason there was no funding prior to 2008 has to do with a recession (corporations cutting funding) and lack of public funding (due to political will). 

There is a possibility that we haven't considered, either, is that perhaps the US Government thinks that super computers are a serious enough threat to not encourage development of the technology. 

The blogs and comments posted on do not reflect the views of TechWeb,, or its sponsors., TechWeb, and its sponsors do not assume responsibility for any comments, claims, or opinions made by authors and bloggers. They are no substitute for your own research and should not be relied upon for trading or any other purpose.

More Blogs from Andy Patrizio
Andy Patrizio   10/31/2013   26 comments
A new survey from International Data Corporation (IDC) finds that the business departments of major firms are taking an increasing role in funding a company's IT spending. It's a trend ...
Andy Patrizio   6/26/2013   85 comments
It's long been known that employees are not always as security-conscious as they could be and that many breaches, especially data loss, occur from innocent mistakes. However, there is a ...
Andy Patrizio   3/13/2013   19 comments
The mushrooming datacenter industry in America is being painted as a villain in power consumption and pollution, but a study by Stanford computer science professor Jonathan Koomey found ...
Andy Patrizio   6/22/2012   49 comments
In the space of a week in early June, we learned about significant password breaches at LinkedIn,, and eHarmony. In the weeks preceding that, we had a few other biggies, like a ...
Andy Patrizio   6/13/2012   10 comments
This past May, Microsoft finally killed off the Windows Live brand, the umbrella term it used for its online apps that required and used an Internet connection, as well as the Azure brand ...
Latest Archived Broadcast
We talk with Bernard Golden about accelerating application delivery in the cloud.
On-demand Video with Chat
Register for this video discussion to learn how tablets can provide true business usability and productivity.
E2 IT Migration Zones
IT Migration Zone - UK
Why PowerShell Is Important
Reduce the Windows 8 Footprint for VDI
Rethinking Storage Management
IT Migration Zone - FR
SQL Server : 240 To de mémoire flash pour votre data warehouse
Quand Office vient booster les revenus Cloud et Android de Microsoft
Windows Phone : Nokia veut davantage d'applications (et les utilisateurs aussi)
IT Migration Zone - DE
Cloud Computing: Warum Unternehmen trotz NSA auf die „private“ Wolke setzen sollten
Cloud Computing bleibt Wachstumsmarkt – Windows Azure ist Vorreiter
Like Us on Facebook
Twitter Feed
Enterprise Efficiency Twitter Feed
Site Moderators Wanted
Enterprise Efficiency is looking for engaged readers to moderate the message boards on this site. Engage in high-IQ conversations with IT industry leaders; earn kudos and perks. Interested? E-mail:
Dell's Efficiency Modeling Tool
The major problem facing the CIO is how to measure the effectiveness of the IT department. Learn how Dell’s Efficiency Modeling Tool gives the CIO two clear, powerful numbers: Efficiency Quotient and Impact Quotient. These numbers can be transforma¬tive not only to the department, but to the entire enterprise.

Read the full report
The State of Enterprise Efficiency in the Virtual Era: Virtualization – Smart Approaches to Maximize Gains
Virtualization is a presence in nearly all enterprise data centers. But not all companies are using it to its best effect. Learn the common characteristics of success, what barriers companies face, and how to get the most from your efforts.

Read the full report
Informed CIO: Dollars & Sense: Virtual Desktop Infrastructure
Cut through the VDI hype and get the full picture -- including ROI and the impact on your Data Center -- to make an informed decision about your virtual desktop infrastructure deployments.

Read the full report
A Video Case Study – Translational Genomics Research Institute
e2 Video

On the Case
TGen IT: Where We're Going Next

7|11|12   |   08:12   |   10 comments

Now that TGen has broken new ground in genomic research by using Dell's storage, cloud, and high-performance computing solutions, the company discusses what will come next for it and for personalized medicine.
On the Case
Better Care Through Better Communications

6|6|12   |   02:24   |   11 comments

The achievements of the TGen/Dell project could improve how all people receive healthcare, because they are creating ways to improve end-to-end communication of medical data.
On the Case
TGen IT: Where We Are Now

5|15|12   |   06:58   |   6 comments

TGen is breaking new ground in genomic research by using Dell's storage, cloud, and high-performance computing solutions.
On the Case
TGen IT: Where We Were

4|27|12   |   06:45   |   10 comments

The Translational Genomics Research Institute wanted to save lives, but its efforts were hobbled by immense computing challenges related to collecting, processing, sharing, and storing enormous amounts of data.
On the Case
1,200% Faster

4|18|12   |   02:27   |   12 comments

Through their partnership, Dell and TGen have increased the speed of TGen’s medical research by 1,200 percent.
On the Case
IT May Improve Children's Chances of Survival

4|17|12   |   02:12   |   8 comments

IT is helping medical researchers reach breakthroughs in a way and pace never seen before.
On the Case
Medical Advances in the Cloud

4|10|12   |   1:25   |   5 comments

TGen and Dell are pushing the boundaries of computing, and harnessing the power of the cloud to improve healthcare.
On the Case
TGen: Living the Mission

4|9|12   |   2:25   |   3 comments

TGen's CIO puts the organizational mission at the heart of everything the IT staff does.
On the Case
TGen Speeding Up Biomedical Research to Save More Lives

4|5|12   |   1:59   |   6 comments

The Translational Genomics Research Institute is revamping its computing to improve speed, storage, and collaboration – and, most importantly, to save lives.
On the Case
Computing Power Helping to Save Children's Lives

3|28|12   |   2:13   |   3 comments

The Translational Genomics Institute’s partnership with Dell is enabling them to treat kids with neuroblastoma more quickly and save more lives.
Tom Nolle
The Big Reason to Use Office

3|18|14   |   02:24   |   46 comments

Office and personal productivity tools come in a first-class and coach flavor set, but what makes the difference is primarily little things that most users won't encounter. What's the big issue in using something other than Office, and can you get around it?
E2 Editors
SPONSORED: Mobile Security — A Use Case

3|4|14   |   04:27   |   16 comments

New mobile security solutions can accommodate a wide array of needs, including those of a complex university environment.
Tom Nolle
Killing Net Neutrality Might Save You Money

1|16|14   |   2:13   |   16 comments

The DC Court of Appeals voided most of the Neutrality Order, and whatever it might mean for the Internet overall, it might mean better and cheaper Internet VPNs for businesses.
Tom Nolle
The Internet of Everythinguseful

1|10|14   |   2:18   |   19 comments

We really don't want an "Internet of Everything" but even building an Internet of Everythinguseful means setting some ground rules to insure there's value in the process and that costs and risks are minimized.
Tom Nolle
Maturing Google Chrome

12|30|13   |   2.18   |   25 comments

Google's Chrome OS has a lot of potential value and a lot of recent press, but it still needs something to make it more than a thin client. It needs cloud integration, it needs extended APIs via web services, and it needs to suck it up and support a hard drive.
Sara Peters
No More Cookie-Cutter IT

12|23|13   |   03.58   |   21 comments

Creating the right combination of technology, people, and processes for your IT organization is a lot like baking Christmas cookies.
Sara Peters
Smart Wigs Not a Smart Idea

12|5|13   |   3:01   |   46 comments

Sony is seeking a patent for wigs that contain computing devices.
Tom Nolle
Cloud in the Wild

12|4|13   |   02:23   |   15 comments

On a recent African trip I saw examples of the value of the cloud in developing nations, for educational and community development programs. We could build on this, but not only in developing economies, because these same programs are often under-supported even in first-world countries.
E2 Editors
SPONSORED: Is Malware Evading Your IPS?

11|18|13   |   03:16   |   4 comments

Intrusion prevention software is supposed to detect and block malware intrusions, but clever malware authors can evade your IPS in these five main ways.
Sara Peters
Where Have All the Mentors Gone?

9|27|13   |   3:15   |   38 comments

A good professional mentor can change your life for the better... but where do you find one?
Tom Nolle
SDN Wars & You Could Win

9|17|13   |   2:10   |   5 comments

VMware's debate with Cisco on SDN might finally create a fusion between an SDN view that's all about software and another that's all about network equipment. That would be good for every enterprise considering the cloud and SDN.
Ivan Schneider
The Future of the Smart Watch

9|12|13   |   3:19   |   39 comments

Wearing a bulky, oversized watch is good training for the next phase in wristwatches: the Internet-enabled, connected watch. Why the smartphone-tethered connected watch makes sense, plus Ivan demos an entirely new concept for the "smart watch."
Tom Nolle
Cutting Your Cloud Storage Costs

9|4|13   |   2:06   |   3 comments

Cloud storage costs are determined primarily by the rate at which files are changed and the possibility of concurrent access/update. If you can structure your storage use to optimize these factors you can cut costs, perhaps to zero.
Sara Peters
Do CIOs Need an IT Background?

8|29|13   |   2:11   |   23 comments

Most of the CIOs interviewed in the How to Become a CIO series did not start their careers as IT professionals. So is an IT background essential?
Ivan Schneider
The Internet Loves Birthdays

8|27|13   |   3:25   |   69 comments

The Internet has evolved into a machine for drumming up a chorus of "Happy Birthday" messages, from family, friends, friends of friends who you added on Facebook, random people that you circled on G+, and increasingly, automated bots. Enough already.