Nvidia's 'supercomputer in a box' training AI faster
Nvidia is calling its new DGX-1 model an “AI supercomputer in a box”, teaming machine-learning software with eight of the company’s graphics processing units. The system can be used to train analytical models, making deep-learning algorithms more powerful. Costing $129,000, the DGX-1 has been bought by fewer than 100 companies, but early owners say that they are able to use the device for larger scale models at three to four times the processing speed. The DGX-1 has been used for health care data and medical research, as well as in the AI research community.

Data scientists have been leveraging GPUs to accelerate deep learning—an AI technique that mimics the way human brains process data—since 2012, but many say that current computing systems limit their work. Faster computers such as the DGX-1 promise to make deep-learning algorithms more powerful and let data scientists run deep-learning models that previously weren’t possible.

The DGX-1 isn’t a magical solution for every company. It costs $129,000, more than systems that companies could assemble themselves from individual components. It also comes with a fixed amount of system memory and GPU cards. But because the relevant parts and programs are preinstalled in a metal enclosure about the size of a medium suitcase, and since it pairs advanced hardware with fast connectivity, Nvidia claims the DGX-1 is easier to set up and quicker at analyzing data than previous GPU systems. Moreover, the positive reception the DGX-1 has attracted in its first few months of availability suggests that similar all-in-one deep-learning systems could help organizations run more AI experiments and refine them more rapidly. Though the DGX-1 is the only system of its kind today, Nvidia’s manufacturing partners will release new versions of the supercomputer in early 2017.

Fewer than 100 companies and organizations have bought DGX-1s since they started shipping in the fall, but early adopters say Nvidia’s claims about the system seem to hold up. Jackie Hunter, CEO of London-based BenevolentAI’s life sciences arm, BenevolentBio, says her data science team had models training on the DGX-1 the same day it was installed. She says the team was able to develop several large-scale models designed to identify suitable molecules for drugs within eight weeks. These models train three to four times faster on the DGX-1 than on the startup’s other GPU systems, according to Hunter. “We had multiple models that originally took weeks to train, but we can now do this in days and hours instead,” she adds.

Massachusetts General Hospital has a DGX-1 in one of its data centers and has one more on order. It says it needs GPU supercomputers such as the DGX-1 to crunch large volumes of dissimilar types of data. MGH’s Center for Clinical Data Science, which is coördinating access to the hospital’s DGX-1 across the Boston-area PartnersHealthCare system, says projects using the supercomputer will involve analyzing pathology and radiology images, electronic health records, and genomic information.

“If you’re incorporating not just x-rays, but a whole host of clinical information, billing information, and social media feeds as indicators of a patient’s health, you really do need large amounts of GPU computing power to crush that,” says center director Mark Michalski.

Several other organizations are deploying DGX-1s to make sense of huge quantities of data related to health care and medical research. Argonne and Oak Ridge national laboratories use theirs to study the origins of cancer and identify new therapies as part of Joe Biden’s Cancer Moonshot project.

DGX-1s are in active use in the AI research community as well. Nvidia donated the first DGX-1 it produced to the nonprofit AI research company OpenAI and gave nine other systems to universities with prominent deep-learning departments, including New York University, Stanford University, and the University of Toronto.

Multinational corporations are also snapping up the systems. SAP, which makes software to help businesses manage their operations and customer relations, has installed DGX-1s in two of its global innovation centers, one in Potsdam, Germany, and one in Ra’anana, Israel, and is running proof-of-concept projects on the systems to identify the best ways to make use of their scale and speed, says vice president Markus Noga. Fidelity Labs, the R&D arm of Fidelity Investments, also owns two DGX-1s and plans to use them to build neural networks or computer systems modeled on the human brain, says labs director Sean Belka.