The NVIDIA DGX H100 system is a universal system designed for AI infrastructure and workloads. Here is a summary of the main hardware and component features of the system:
![main hardware and component features](https://www.fibermall.com/blog/wp-content/uploads/2023/12/main-hardware-and-component-features.png)
![component](https://www.fibermall.com/blog/wp-content/uploads/2023/12/component-1024x687.png)
The GPU Board Tray is the key component assembly area of the entire AI server. The core part is the GPU Board Tray, which mainly contains GPU components, module boards, and NVSwitches.
The CPU Motherboard Tray is the core component of the server (including both ordinary servers and AI servers), which contains the CPU motherboard, system memory, network card, PCIE Switch, and other components.
![overview](https://www.fibermall.com/blog/wp-content/uploads/2023/12/overview-1024x501.png)
![front](https://www.fibermall.com/blog/wp-content/uploads/2023/12/front.png)
![back](https://www.fibermall.com/blog/wp-content/uploads/2023/12/back.png)
- Graphics processor: 8 NVIDIA H100 GPUs, providing 640 GB of GPU memory.
- Central processor: 2 Intel Xeon 8480C PCIe Gen5 CPUs, each with 56 cores, clock speed ranging from 2.0 GHz to 3.8 GHz.
![hopper H100 tensor core cpu](https://www.fibermall.com/blog/wp-content/uploads/2023/12/hopper-H100-tensor-core-cpu-1024x541.png)
- NVLink: 4 fourth-generation NVLinks, providing 900 GB/s of GPU-to-GPU bandwidth.
- Storage:
Operating system storage: 2 1.92 TB NVMe M.2 SSDs (RAID 1 array).
Data cache storage: 8 3.84 TB NVMe U.2 SEDs (RAID 0 array).
- Network:
Cluster network: 4 OSFP ports, supporting InfiniBand (up to 400Gbps) and Ethernet (up to 400GbE).
Storage network: 2 NVIDIA ConnectX-7 dual-port Ethernet cards, supporting Ethernet (up to 400GbE) and InfiniBand (up to 400Gbps).
- System memory: Each 32 DIMMs provides 2 TB of memory.
- Out-of-band system management (BMC): Supports Redfish, IPMI, SNMP, KVM, and Web user interface.
- In-band system management: 3 dual-port 100GbE and 10GbE RJ45 interfaces. Mechanical & power specifications:
![In-band system management](https://www.fibermall.com/blog/wp-content/uploads/2023/12/In-band-system-management-1024x449.png)
![PCle card riser](https://www.fibermall.com/blog/wp-content/uploads/2023/12/PCle-card-riser.png)
- Dimensions: 8U rack-mounted, height 14 inches, maximum width 19 inches, maximum depth 35.3 inches.
- Weight: Maximum 287.6 pounds (130.45 kg).
- Input voltage: 200-240 volts AC.
- Specifications for each power supply: Maximum 10.2 kilowatts, 3300 watts @ 200-240 volts, 16 amps, 50-60 hertz.
- Supports high-speed network connections, including InfiniBand and Ethernet, with speeds up to 400Gbps.
![4th generation NVlink](https://www.fibermall.com/blog/wp-content/uploads/2023/12/4th-generation-NVlink.png)
![DGX H100 networking module](https://www.fibermall.com/blog/wp-content/uploads/2023/12/DGX-H100-networking-module-1024x516.png)
![connection to cpu](https://www.fibermall.com/blog/wp-content/uploads/2023/12/connection-to-cpu.png)
Related Products:
-
NVIDIA MMA4Z00-NS400 Compatible 400G OSFP SR4 Flat Top PAM4 850nm 30m on OM3/50m on OM4 MTP/MPO-12 Multimode FEC Optical Transceiver Module $900.00
-
NVIDIA MMA4Z00-NS-FLT Compatible 800Gb/s Twin-port OSFP 2x400G SR8 PAM4 850nm 100m DOM Dual MPO-12 MMF Optical Transceiver Module $850.00
-
NVIDIA MMA4Z00-NS Compatible 800Gb/s Twin-port OSFP 2x400G SR8 PAM4 850nm 100m DOM Dual MPO-12 MMF Optical Transceiver Module $750.00
-
NVIDIA MMS4X00-NM Compatible 800Gb/s Twin-port OSFP 2x400G PAM4 1310nm 500m DOM Dual MTP/MPO-12 SMF Optical Transceiver Module $1500.00
-
NVIDIA MMS4X00-NM-FLT Compatible 800G Twin-port OSFP 2x400G Flat Top PAM4 1310nm 500m DOM Dual MTP/MPO-12 SMF Optical Transceiver Module $1500.00
-
NVIDIA MMS4X00-NS400 Compatible 400G OSFP DR4 Flat Top PAM4 1310nm MTP/MPO-12 500m SMF FEC Optical Transceiver Module $1350.00
-
Mellanox MMA1T00-HS Compatible 200G Infiniband HDR QSFP56 SR4 850nm 100m MPO-12 APC OM3/OM4 FEC PAM4 Optical Transceiver Module $200.00
-
NVIDIA MFP7E10-N010 Compatible 10m (33ft) 8 Fibers Low Insertion Loss Female to Female MPO Trunk Cable Polarity B APC to APC LSZH Multimode OM3 50/125 $47.00
-
NVIDIA MCP7Y00-N003-FLT Compatible 3m (10ft) 800G Twin-port OSFP to 2x400G Flat Top OSFP InfiniBand NDR Breakout DAC $495.00
-
NVIDIA MCP7Y70-H002 Compatible 2m (7ft) 400G Twin-port 2x200G OSFP to 4x100G QSFP56 Passive Breakout Direct Attach Copper Cable $160.00
-
NVIDIA MCA4J80-N003-FTF Compatible 3m (10ft) 800G Twin-port 2x400G OSFP to 2x400G OSFP InfiniBand NDR Active Copper Cable, Flat top on one end and Finned top on other $600.00
-
NVIDIA MCP7Y10-N002 Compatible 2m (7ft) 800G InfiniBand NDR Twin-port OSFP to 2x400G QSFP112 Breakout DAC $215.00