NVIDIA GPU power and cooling requirements
An H100 or H200 draws up to 700 W, a B200 up to 1,000 W and a B300 about 1,100 W. An eight-GPU server needs 10 to 15 kW and can still be air-cooled, but a GB200 or GB300 NVL72 rack draws 125 to 140 kW and must be liquid-cooled. This guide lists the power, memory and cooling needs of each platform, and shows how many GPUs a megawatt of data center capacity holds.
Published November 20, 2026. Figures are NVIDIA's and AMD's, or their partners' where the makers do not publish them, as listed in the sources.
Power and cooling by platform
| Platform | GPU power | Memory | System or rack power | Cooling | Availability |
|---|---|---|---|---|---|
| H100 SXM | Up to 700 W | 80 GB HBM3 | DGX H100: 10.2 kW (8 GPUs) | Air | Shipping |
| H200 SXM | Up to 700 W | 141 GB HBM3e | DGX H200: 10.2 kW (8 GPUs) | Air | Shipping |
| B200 (HGX/DGX) | Up to 1,000 W | 1,440 GB per 8 GPUs | DGX B200: about 14.3 kW | Air | Shipping |
| B300 (HGX/DGX) | About 1,100 W (partners) | 288 GB HBM3e | DGX B300: about 14 kW | Air or liquid | Shipping |
| GB200 NVL72 | Not published per GPU | 13.4 TB per rack | Up to 132 kW per rack | Liquid only | In deployment |
| GB300 NVL72 | Not published per GPU | 20 TB per rack | 132–140 kW per rack (Supermicro) | Liquid only | Available |
| Vera Rubin NVL72 | Not published | 288 GB HBM4 per GPU | Not published | Liquid (45 °C warm water) | Ships H2 2026 |
| AMD MI355X | 1,400 W | 288 GB HBM3E | Not published | Liquid | Shipping since June 2025 |
| AMD MI455X (Helios rack) | Not published | Up to 432 GB HBM4 | Not published | Liquid | In production (AMD, July 2026) |
NVIDIA publishes per-GPU power for its eight-GPU servers but only rack-level figures for NVL72 systems, and none yet for Vera Rubin; rack figures above come from Vertiv and Supermicro where NVIDIA does not publish them.
Why AI racks need liquid cooling
Uptime Institute's 2024 survey put the average data center rack at about 8 kW, with most racks at 4 to 6 kW and few above 30 kW. A GB200 or GB300 NVL72 rack draws 125 to 140 kW, about 15 to 17 times the average, in one cabinet. Air cannot carry that much heat out of a rack, so NVL72 systems are built for direct-to-chip liquid cooling, and Vera Rubin racks run on 45 °C warm-water loops. Eight-GPU servers at 10 to 15 kW can still be air-cooled, which is why many existing halls run HGX B200 and B300 rather than NVL72. Read more in our liquid cooling guide.
How many GPUs fit in a megawatt
Dividing 1 MW of IT load by each system's rated power gives the counts below. At the utility meter, cooling and other overhead take a share: at a PUE of 1.2, 1 MW at the meter leaves about 833 kW for IT, enough for six NVL72 racks, or 432 GPUs.
| System | Per MW of IT load | GPUs |
|---|---|---|
| DGX H100 (10.2 kW, 8 GPUs) | 98 servers | 784 |
| DGX B200 (14.3 kW, 8 GPUs) | 69 servers | 552 |
| GB200 NVL72 (132 kW, 72 GPUs) | 7 racks | 504 |
| GB300 NVL72 (132–140 kW, 72 GPUs) | 7 racks | 504 |
What to plan for
- Power first. A 100 MW AI hall holds about 50,000 Blackwell GPUs in NVL72 racks. See data center power for how sites secure that load.
- Floor and structure. NVL72 racks are heavy and dense; many older halls were built for 5 to 10 kW per rack.
- Cooling plant. Liquid-cooled racks need coolant distribution units, a warm-water loop and heat rejection sized to the rack load.
- Air-cooled options. HGX B200 and B300 servers still fit air-cooled halls at about 14 to 15 kW per server.
- Where they run. See the largest data centers in the world and our Texas data centers map.
The power, cooling and hardware companies behind these deployments exhibit at Intelligence Disrupt 2027 in Dallas, March 22–24.
Questions
- How much power does an H100 use?
- Up to 700 W per H100 SXM GPU. A DGX H100 server with eight GPUs draws up to 10.2 kW.
- Does the B200 need liquid cooling?
- No. The DGX B200 is air-cooled at up to about 14.3 kW for eight GPUs. The GB200 NVL72 rack, which uses the same Blackwell GPUs, is liquid-cooled only.
- How much power does a GB200 NVL72 rack use?
- Up to 132 kW per rack according to Vertiv, which designed its reference power and cooling with NVIDIA. Supermicro lists 125 to 135 kW.
- How many GPUs fit in one megawatt?
- About 500 Blackwell GPUs in NVL72 racks (seven racks of 72) or about 780 H100s in DGX servers, counting IT load only. Cooling and other overhead reduce that at the utility meter.
- How much power does a B300 use?
- About 1,100 W per GPU according to partner datasheets, and about 14 kW for a DGX B300 server with eight GPUs.
- When does Vera Rubin ship?
- NVIDIA says Vera Rubin NVL72 is in full production and ships in the second half of 2026. It has not published the rack's power.
- How does the AMD MI355X compare?
- It is rated at 1,400 W per GPU and is liquid-cooled. AMD's air-cooled version, the MI350X, is rated at 1,000 W.
- What is a typical data center rack density?
- About 8 kW per rack on average in Uptime Institute's 2024 survey, against 125 to 140 kW for an NVL72 rack.
More guides
- AI data centers: what they are, how they work and what they cost
- GPU cloud: providers, prices and the power behind them
- Liquid cooling for data centers
- Data center power: how much it takes and how to get it
- Bitcoin miners turning into AI and HPC data centers
- Texas data centers: Dallas-Fort Worth and the AI campuses
- Stargate: every OpenAI data center site and where it stands
- The largest data centers in the world
- How much does it cost to build a data center?
- PUE and how much power data centers use
Sources
- NVIDIA, H100 · 2026-11
- NVIDIA, H200 · 2026-11
- NVIDIA, DGX H100/H200 user guide · 2026-11
- NVIDIA, DGX B200 · 2026-11
- NVIDIA, DGX B200 user guide · 2026-11
- NVIDIA, GB200 NVL72 · 2026-11
- Vertiv, GB200 NVL72 reference architecture · 2024-10-14
- Supermicro, GB200 NVL72 SuperCluster datasheet · 2026-11
- NVIDIA, DGX B300 · 2026-11
- Supermicro, HGX B300 datasheet · 2026-11
- NVIDIA, GB300 NVL72 · 2026-11
- NVIDIA, Vera Rubin NVL72 · 2026-11
- NVIDIA, Rubin platform announcement (CES 2026) · 2026-01-05
- NVIDIA technical blog, Vera Rubin POD · 2026-03-16
- AMD, Instinct MI355X · 2026-11
- AMD, Helios rack brochure · 2026-11
- Uptime Institute, Global Data Center Survey 2024 · 2024
- Microsoft, Fairwater Atlanta · 2025-11-12
The power is on this floor. Be in the room.
March 22–24, 2027 · Irving Convention Center · Dallas
Intelligence Disrupt and Mining Disrupt are NOT affiliated with any other brands, groups, events, meetups, individuals, sponsors, exhibitors, agents, or referrals, except the Industry Ambassadors listed on this site. We do not sell any lists. Beware of scams claiming otherwise.
There are imitators and scammers using our name to solicit sponsors and attendees. Always verify directly through our official Telegram group. Stay vigilant!
Intelligence Disrupt Policy: No refunds. No outside food or drinks. No third-party event solicitations.
Unauthorized solicitation, sales, advertising, product demonstrations, or distribution of promotional materials, including magazines, brochures, flyers, catalogs, business literature, and promotional giveaways, is strictly prohibited anywhere within the event venue unless expressly authorized by Intelligence Disrupt.
Marketing activities are reserved exclusively for approved exhibitors, sponsors, and authorized event partners. Attendees found engaging in unauthorized promotional activities may be required to cease immediately, surrender promotional materials, and may have their event credentials revoked without refund at the sole discretion of event management.

