US President-elect Barack Obama will soon outline an economic stimulus plan that will likely include billions of dollars for infrastructure projects, such as roads, bridges and new schools. Obama is also hearing calls for new funding to improve the information infrastructure and the virtual highways it runs on, and to broaden access to high-performance computing (HPC) systems.
So far, the use of supercomputers to increase the industrial might of the US has amounted to little more than an asterisk from a financial standpoint in both the federal budget and the economy as a whole. Market research firm IDC estimates that the public and private sectors spent a combined total of just over US$10 billion (NZ$18.6 billion) on HPC systems last year.
To provide some perspective, consider this: since September, the US government has spent US$150 billion to keep insurer American International Group afloat. Meanwhile, HPC resources are inaccessible to many companies that could benefit from using the technology.
On the surface, all looks well with HPC. Federal agencies continue to fund the development of massive systems, such as IBM's Roadrunner, which last spring became the first machine to break through the petaflop performance barrier. Cray's XT5 Jaguar, another system bought and paid for by the government, also topped the petaflop mark this month and was neck-and-neck with Roadrunner on the latest Top500 list of the world's fastest supercomputers.
Supercomputers provide something akin to a Second Life for engineers. Instead of building physical models of new products, HPC users can create them in virtual environments and then use the supercomputing horsepower to test how the products work and change design elements and materials as needed. That can cut weeks or even months off of the design and testing process, potentially giving a company a critical edge over its competitors.
But there's a problem in getting HPC capabilities into the hands of companies that create jobs. Thousands of businesses could conceivably make use of the systems, but many can't afford them -- leaving HPC's economic potential largely unrealised.
That has prompted some universities and academic institutions to launch programmes under which they provide companies with access to high-performance systems as well as technical help. One such approach is being tested by the Ohio Supercomputer Centre (OSC) in Columbus and the Edison Welding Institute (EWI), a nonprofit organisation that does research and consulting work on welding processes and technologies.
Last fall, the EWI, which is based in Columbus, began a beta program that makes a web-based user interface available to welding engineers at its client firms. The institute's software lets the engineers input a wide range of data related to the joining of various materials. The data is run on a supercomputer at the OSC, and the engineers can view simulations that show how certain welds will work. The program gives companies access to HPC resources via a browser, with no programming required.
The EWI is building modules to address specific industrial needs, but it has no interest in running its own HPC systems. "Our business is welding technology, not operating supercomputers," President and CEO Henry Cialone says, adding that the institute eventually will develop a revenue-sharing programme with the OSC.
Cialone says that in his view, US industries are just scratching the surface on the use of HPC-based simulation modeling technologies. "We can enhance the competitiveness of manufacturing in the US with tools like this," he says.
The state of Indiana is also trying to help boost HPC use. Last March, Indiana University and Purdue University, along with the state government, announced a project to make 20 teraflops of computing capacity on an IBM system available to Indiana businesses. So far, the companies that have taken advantage of the HPC programme are primarily in the pharmaceutical and automotive industries, which already know what high-performance systems can deliver to users.
Brad Wheeler, CIO and vice president of IT at Indiana University, thinks that offering supercomputing as a shared utility to companies makes a lot of sense because it can provide them with standardised software packages as well as the means to host their application code and help in parallelising it. The initial steps involve corporate legal counsels checking to ensure that proprietary research will be safe on a shared system. But once that bridge is crossed, "you start to see a lot more acceleration in its use," Wheeler says.
The role that HPC technology can play in developing new economic opportunities was illustrated in August, when Louisiana State University and the Louisiana government announced an agreement to open a quality assurance centre with Electronic Arts, a California-based developer of computer games and other interactive entertainment software. The announcement followed the development of a digital media academic programme that includes increased research in visualisation on HPC systems.
Stacey Simmons, associate director of economic development at LSU's Center for Computation & Technology, says the state wants to build a visual-media economy. "We really wanted something that was an economic engine," Simmons says. But first, it was important to develop a computing, software and networking environment that can support that kind of economic activity, she adds.
Cloud computing offers another way to gain access to HPC resources, and researchers at Rice University in Houston have used Amazon.com's Elastic Compute Cloud, or EC2, service. But access to computing capacity is only one aspect of the problem. Applications and codes have to be adapted to run in parallel environments, and there is a need for people with the skills to make that happen, said Charles Koelbel, a research scientist at Rice.
The university is trying to make training in parallel programming as affordable and accessible as possible. As part of that effort, Rice is developing books that can be downloaded online, partly through a competition that challenges people to write about various parallel computing topics. A number of companies are backing the contest, including Chevron, Sun Microsystems and Nvidia. "These firms really need to have good people to help them do scientific computing," Koelbel says.
Gerry McCartney, Purdue's CIO and vice president of IT, said that until recently, investment banks were hiring virtually all of the college graduates with computer modeling skills. But, he adds, communities of interest are now organising and collaborating in other areas as well. For instance, Purdue has a Web 2.0 site called Hubzero.org that can be used to create scientific research communities with access to technical resources, including research algorithms and interactive simulation tools.
"We need to remember what made this country successful in terms of technology," McCartney says. "It was aggressive adoption of technology."
Earl Joseph, an IDC analyst who spoke at the SC08 supercomputing conference in Austin last week, says competitive concerns are one of the reasons that HPC use is growing. Joseph warned attendees that manufacturers in Asia are using HPC systems to develop products, a move that he says is already is hurting some US companies.
IDC has been forecasting that the HPC market would grow at an average annual rate of 9% over the next four years, to more than US$15 billion in revenue. But the firm is revising that estimate based on the current economic conditions and their likely affect on IT spending.
HPC development may benefit from an Obama administration economic stimulus package, through the government's funding of national laboratories and university research centres.
"When the government got interested in climate modeling, we saw big advances in HPC," says Todd Thibodeaux, president and CEO of the Computing Technology Industry Association, an Illinois-based trade group known as CompTIA. Thibodeaux also hopes to see education funding that could help with IT training in the expected stimulus package.
The Council on Competitiveness, a Washington-based group with members that include many large companies and universities, has continued to cite increased HPC adoption as a major goal. In a report issued this month, the council urged the federal government to revitalise the Department of Defence's role as a developer of "dual use" breakthrough technologies and help "put the power of high-performance computing into the hands of all American producers, innovators and entrepreneurs."
Cynthia McIntyre, a senior vice president at the council, says the group sees HPC technology as one of the country's strategic assets.