Intelligence DisruptMining Disrupt Buy ticketsTickets

NVIDIA GPU power and cooling requirements

An H100 or H200 draws up to 700 W, a B200 up to 1,000 W and a B300 about 1,100 W. An eight-GPU server needs 10 to 15 kW and can still be air-cooled, but a GB200 or GB300 NVL72 rack draws 125 to 140 kW and must be liquid-cooled. This guide lists the power, memory and cooling needs of each platform, and shows how many GPUs a megawatt of data center capacity holds.

Published November 20, 2026. Figures are NVIDIA's and AMD's, or their partners' where the makers do not publish them, as listed in the sources.

Power and cooling by platform

PlatformGPU powerMemorySystem or rack powerCoolingAvailability
H100 SXMUp to 700 W80 GB HBM3DGX H100: 10.2 kW (8 GPUs)AirShipping
H200 SXMUp to 700 W141 GB HBM3eDGX H200: 10.2 kW (8 GPUs)AirShipping
B200 (HGX/DGX)Up to 1,000 W1,440 GB per 8 GPUsDGX B200: about 14.3 kWAirShipping
B300 (HGX/DGX)About 1,100 W (partners)288 GB HBM3eDGX B300: about 14 kWAir or liquidShipping
GB200 NVL72Not published per GPU13.4 TB per rackUp to 132 kW per rackLiquid onlyIn deployment
GB300 NVL72Not published per GPU20 TB per rack132–140 kW per rack (Supermicro)Liquid onlyAvailable
Vera Rubin NVL72Not published288 GB HBM4 per GPUNot publishedLiquid (45 °C warm water)Ships H2 2026
AMD MI355X1,400 W288 GB HBM3ENot publishedLiquidShipping since June 2025
AMD MI455X (Helios rack)Not publishedUp to 432 GB HBM4Not publishedLiquidIn production (AMD, July 2026)

NVIDIA publishes per-GPU power for its eight-GPU servers but only rack-level figures for NVL72 systems, and none yet for Vera Rubin; rack figures above come from Vertiv and Supermicro where NVIDIA does not publish them.

Why AI racks need liquid cooling

Uptime Institute's 2024 survey put the average data center rack at about 8 kW, with most racks at 4 to 6 kW and few above 30 kW. A GB200 or GB300 NVL72 rack draws 125 to 140 kW, about 15 to 17 times the average, in one cabinet. Air cannot carry that much heat out of a rack, so NVL72 systems are built for direct-to-chip liquid cooling, and Vera Rubin racks run on 45 °C warm-water loops. Eight-GPU servers at 10 to 15 kW can still be air-cooled, which is why many existing halls run HGX B200 and B300 rather than NVL72. Read more in our liquid cooling guide.

How many GPUs fit in a megawatt

Dividing 1 MW of IT load by each system's rated power gives the counts below. At the utility meter, cooling and other overhead take a share: at a PUE of 1.2, 1 MW at the meter leaves about 833 kW for IT, enough for six NVL72 racks, or 432 GPUs.

SystemPer MW of IT loadGPUs
DGX H100 (10.2 kW, 8 GPUs)98 servers784
DGX B200 (14.3 kW, 8 GPUs)69 servers552
GB200 NVL72 (132 kW, 72 GPUs)7 racks504
GB300 NVL72 (132–140 kW, 72 GPUs)7 racks504

What to plan for

  • Power first. A 100 MW AI hall holds about 50,000 Blackwell GPUs in NVL72 racks. See data center power for how sites secure that load.
  • Floor and structure. NVL72 racks are heavy and dense; many older halls were built for 5 to 10 kW per rack.
  • Cooling plant. Liquid-cooled racks need coolant distribution units, a warm-water loop and heat rejection sized to the rack load.
  • Air-cooled options. HGX B200 and B300 servers still fit air-cooled halls at about 14 to 15 kW per server.
  • Where they run. See the largest data centers in the world and our Texas data centers map.

The power, cooling and hardware companies behind these deployments exhibit at Intelligence Disrupt 2027 in Dallas, March 22–24.

Questions

How much power does an H100 use?
Up to 700 W per H100 SXM GPU. A DGX H100 server with eight GPUs draws up to 10.2 kW.
Does the B200 need liquid cooling?
No. The DGX B200 is air-cooled at up to about 14.3 kW for eight GPUs. The GB200 NVL72 rack, which uses the same Blackwell GPUs, is liquid-cooled only.
How much power does a GB200 NVL72 rack use?
Up to 132 kW per rack according to Vertiv, which designed its reference power and cooling with NVIDIA. Supermicro lists 125 to 135 kW.
How many GPUs fit in one megawatt?
About 500 Blackwell GPUs in NVL72 racks (seven racks of 72) or about 780 H100s in DGX servers, counting IT load only. Cooling and other overhead reduce that at the utility meter.
How much power does a B300 use?
About 1,100 W per GPU according to partner datasheets, and about 14 kW for a DGX B300 server with eight GPUs.
When does Vera Rubin ship?
NVIDIA says Vera Rubin NVL72 is in full production and ships in the second half of 2026. It has not published the rack's power.
How does the AMD MI355X compare?
It is rated at 1,400 W per GPU and is liquid-cooled. AMD's air-cooled version, the MI350X, is rated at 1,000 W.
What is a typical data center rack density?
About 8 kW per rack on average in Uptime Institute's 2024 survey, against 125 to 140 kW for an NVL72 rack.

More guides

Sources

  1. NVIDIA, H100 · 2026-11
  2. NVIDIA, H200 · 2026-11
  3. NVIDIA, DGX H100/H200 user guide · 2026-11
  4. NVIDIA, DGX B200 · 2026-11
  5. NVIDIA, DGX B200 user guide · 2026-11
  6. NVIDIA, GB200 NVL72 · 2026-11
  7. Vertiv, GB200 NVL72 reference architecture · 2024-10-14
  8. Supermicro, GB200 NVL72 SuperCluster datasheet · 2026-11
  9. NVIDIA, DGX B300 · 2026-11
  10. Supermicro, HGX B300 datasheet · 2026-11
  11. NVIDIA, GB300 NVL72 · 2026-11
  12. NVIDIA, Vera Rubin NVL72 · 2026-11
  13. NVIDIA, Rubin platform announcement (CES 2026) · 2026-01-05
  14. NVIDIA technical blog, Vera Rubin POD · 2026-03-16
  15. AMD, Instinct MI355X · 2026-11
  16. AMD, Helios rack brochure · 2026-11
  17. Uptime Institute, Global Data Center Survey 2024 · 2024
  18. Microsoft, Fairwater Atlanta · 2025-11-12

The power is on this floor. Be in the room.

March 22–24, 2027 · Irving Convention Center · Dallas

Intelligence Disrupt 2027Dallas · Mar 22–24Passes from $199Get tickets