Sandia Red Storm supercomputer exits world stage

A celebration at Sandia鈥檚 Computer Science Research Institute in mid-May wrote finis to Red Storm, the Sandia-designed and Cray Inc.-built supercomputer, one of the most influential machines of its era, with 124 descendants at 70 sites around the world.
Cray Inc. President and Chief Executive Officer Peter Ungaro did not stint in his praise. He told the assembled group, 鈥淲ithout Red Storm I wouldn鈥檛 be here in front of you today. Virtually everything we do at Cray 鈥 each of our three business units 鈥 comes from Red Storm. It spawned a company around it, a historic company struggling as to where we would go next. Literally, this program saved Cray.鈥
Red Storm鈥檚 design and its descendants have racked up more than a billion dollars in sales for the company, he said.
Among the machine鈥檚 advances was its use of off-the-shelf parts, which made it cheaper to build, repair and upgrade. Red Storm was air-cooled instead of water-cooled, so parts could be replaced and upgrades completed while the machine was running. The only custom component was the Interconnect chip that made it possible to pass information more directly from processor to processor while applications were running. High-memory bandwidth kept the processors from being starved for data.
And its architecture was upgradeable, from a theoretical peak at birth of 41.47 teraflops in 2005 to 124.42 teraflops in 2006 to 284.16 teraflops in 2008, because (among other reasons) the machine accommodated single-, dual- and quad-core processors that eventually reached 12,920 in number.
Among the machine鈥檚 technical achievements was the operation in 2008 known as Burnt Frost, in which Red Storm programmed a 152-inch rocket to shoot down an errant satellite traveling at 17,000 miles per hour, 153 miles above the earth.
For months, Red Storm calculated a large number of shoot-down scenarios, until Sandians were ready to brief then-President George W. Bush on his options.
The result: after the successful take-down with no collateral damage, a military commander exulted, 鈥淲e can hit a spot on a bullet with a bullet.鈥
Red Storm鈥檚 role, classified for several years, was made known when DoD released the information, followed by a Sandia impact video with a sound track that opened oracularly, 鈥淭his IS rocket science!鈥
Other, still classified, Red Storm operations were officially described as solving 鈥減ressing national security problems in cyber defense, vulnerability assessments, informatics (network discovery), space systems threats and image processing.鈥
One nonclassified use for the machine and its more powerful descendant Jaguar at Oak Ridge was to produce high-fidelity climate models that revealed, for the first time in simulations, swirls of water, or vortices, in the Indian Ocean.
Sandia Center Director Rob Leland, who hosted the celebration, was the responsible senior manager when Red Storm was designed and built. He recalled that in 2004, he was on the verge of re-locating his family to Seattle, Cray鈥檚 home base, to help out. 鈥淭hings were really tense. We couldn鈥檛 keep flying back and forth to be in immediate touch with Cray management and technicians,鈥 he said in an interview. 鈥淚magine going to a company whose defining idea is one thing [a custom vectorized, or linear, processor] and telling them it鈥檚 the wrong idea for the future and they needed to focus instead on building massively parallel systems out of commodity processors. It only worked because they were at risk of going out of business, so they were quite motivated to accommodate us. And it turned out really well for them. In four years, their market share of supercomputers jumped from 6 percent to 20 percent.鈥
鈥淩ed Storm is over, but its influence is not,鈥 agreed Bill Camp, the retired Sandia director who achieved support for the design first proposed by Sandia technical adept Jim Tomkins (retired).
Then-Sandia vice-president Frank Figueroa was wary to let Camp embark on the project because, Figueroa protested, 鈥淭he size of the project is bigger than the net worth of the company.鈥 To Camp, with Intel refusing to remain in the specialty supercomputer field and IBM already committed to another type of machine, Cray was, so to speak, the only U.S. game in town, but Cray wasn鈥檛 sure it wanted to play.
Sandia executives convinced Congress and DOE to fund the new effort, which eventually reached a cost of approximately $72 million, a large sum but far less than comparable supercomputers at the time, and for a far more all-purpose machine.
鈥淭he normal supercomputer development time for Cray was four to five years,鈥 said Leland. 鈥淲e had in mind about 18-22 months.鈥
鈥淚t was the fastest development cycle of any supercomputer,鈥 said Camp.
Things moved fast despite the perfectionism of the originator of the design, Jim Tomkins. 鈥淚 had this nickname at Cray, 鈥榯he devil incarnate,鈥 because I was something of a hard nose,鈥 he told the group. 鈥淚 believed if we didn鈥檛 pay attention to detail, we were going to fail. I wanted dotted i鈥檚 and crossed t鈥檚. But it was the best team I ever worked with. There was no internal friction, and it was a great adventure.鈥
Because of the speed with which Sandians pressed forward, when the machine arrived in Albuquerque, it had neither management software to boot the system nor working communication software between processors, so Sandia researchers wrote them. 鈥淭he communication software is still in use today,鈥 said Sandia manager Sue Kelly, credited with leading the effort to make the system usable once it was delivered.
One of the most often-heard compliments to the machine, one man said at the celebration, is that 鈥渨hen a program doesn鈥檛 work on another machine, they say, 鈥業t works on Red Storm.鈥欌
Horst Simon, deputy director at Lawrence Berkeley National Laboratory and a prominent computer scientist, emailed Camp, 鈥淚 just want you to know what a wonderful thing you and Jim [Tomkins] have done for supercomputing.鈥
鈥淛im Tomkins and me, we hung in there and made it happen,鈥 reminisced Camp.
About Camp, Leland said, 鈥淭here were a handful of people in the country with the leadership skills for this job and a handful with the technical skills for this job, but I don鈥檛 know anyone who had both, except for Bill.鈥
Among other people mentioned as having a positive impact on the project were Don Cook (now NNSA Deputy Administrator for Defense Programs), and Sandia California vice president Rick Stulen.
Provided by Sandia National Laboratories