NVIDIA Unveils DGX-2H Server with 450W Tesla V100 GPUs

Wednesday, November 21st, 2018 - Servers, Teknologi

NVIDIA Unveils DGX-2H Server with 450W Tesla V100 GPUs

NVIDIA has introduced a new version of its DGX-2 server that is outfitted with higher-performing CPUs and GPUs. The DGX-2H server is powered by 16 Tesla V100 GPUs that run at higher clocks and feature a 450 W TDP each. The whole system consumes up to 12 kW of power and delivers 2.1 PetaFLOPS of compute horsepower.


NVIDIA’s DGX-2H is an updated version of the DGX-2 machine the company introduced earlier this year. The new system is based on Intel’s two 24-core Intel Xeon Platinum 8174 processor accompanied by 1.5 TB of DDR4 memory, as well as 30 TB of NVMe storage. The key improvements of the new server versus the previous one are faster NVIDIA Tesla V100 GPUs featuring 512 GB of HBM2 memory in total. In addition, the new DGX-2H also has faster networking capabilities: it has dual 10/25/40/50/100 GbE instead of 10/25 GbE.

NVIDIA DGX Series (with Volta)
CPUs2 x Intel Xeon
Platinum 8174
2 x Intel Xeon
Platinum 8168
2 x Intel Xeon
E5-2600 v4
GPUs16 x NVIDIA Tesla V100
32GB HBM2 (450 W)
16 x NVIDIA Tesla V100
32GB HBM2 (350 W)
8 x NVIDIA Tesla V100
16 GB HBM2
System MemoryUp to 1.5 TB DDR4Up to 0.5 TB DDR4
GPU Memory512 GB HBM2
(16 x 32 GB)
256 GB HBM
(8 x 32 GB)
Storage30 TB NVMe
Up to 60 TB
4 x 1.92 TB NVMe
Networking8 x Infiniband/100 GbE
Dual 100 GbE
8 x Infiniband/100 GbE or
Dual 10/25 Gb
4 x IB +
2 x 10 GbE
Power12 kW10 kW3.5 kW
Size360 lbs340 lbs134 lbs
GPU ThroughputTensor: 2100 TFLOPs
FP16: ? TFLOPs
FP32: ? TFLOPs
FP64: ? TFLOPs
Tensor: 1920 TFLOPs
FP16: 480 TFLOPs
FP32: 240 TFLOPs
FP64: 0 TFLOPs
Tensor: 960 TFLOPs
FP16: 240 TFLOPs
FP32: 0 TFLOPs
FP64: 60 TFLOPs

Thanks to faster graphics processors with a 450 W TDP each, the system now can deliver 2.1 PFLOPS of compute performance, up from 2 PFLOPS before. Meanwhile, in a bid to increase power, it looks like NVIDIA had to switch to a new cooling method. ServeTheHome believes that NVIDIA also uses a new cooling subsystem as the DGX-2H weighs 20 pounds more than its predecessor (360 pounds vs. 340 pounds), though the company has not confirmed this. Along with performance improvements NVIDIA had to decrease maximum operating temperature of the DGX-2H from 35C to 25C.

NVIDIA has not disclosed pricing of the DGX-2H, though it is likely that it will cost more than $399,000, the price of the DGX-2. What remains to be seen is whether NVIDIA customers find the DGX-2H performance good enough for extra 2 kW of power consumption.

Related Reading:

Sources: NVIDIA, ServeTheHome

Source link : NVIDIA Unveils DGX-2H Server with 450W Tesla V100 GPUs


Pictures gallery of NVIDIA Unveils DGX-2H Server with 450W Tesla V100 GPUs

NVIDIA Unveils DGX-2H Server with 450W Tesla V100 GPUs | admin | 4.5