Home Blog Spatial Lab Disciplines Agentic Tools
Learn • AI Academy
IP Network Infrastructure About Connect

Thermal Density & Liquid Cooling: Cold Plates, CDUs & Immersion

Thermodynamics of 1,000W+ processors, microchannel cold plates, primary vs secondary loops, Coolant Distribution Units (CDUs), and dielectric immersion physics.

Foundational Knowledge & Simpler Primers
Need a simpler explanation or feeling stuck?

To build solid intuition for this module, review these foundational primers:

Unsure of mathematical notation or technical terms on this page? Our 57-term AI Glossary breaks down every concept with plain-English analogies and rigorous engineering specs.
Open AI Glossary (57 Terms)

1. Theoretical Motivation & Foundations

As frontier AI accelerators cross 1,000 Watts TDP per socket, the thermal resistance of air cooling (θ_ja) reaches a physical impasse. High airflow velocities cannot extract heat from sub-1000mm^2 dies without generating deafening fan noise, massive auxiliary fan power consumption, and thermal throttling. Liquid cooling provides a heat capacity thousands of times higher than air. In Direct-to-Chip (D2C) liquid cooling, copper microchannel cold plates extract heat directly from the GPU/CPU dies, transferring thermal energy via a closed water-glycol secondary loop to a Coolant Distribution Unit (CDU). The CDU uses plate-and-frame heat exchangers to hand off heat to the facility's primary cooling tower or adiabatic dry-cooler loop. For extreme densities, Single-Phase or Two-Phase Dielectric Immersion submerges entire compute trays directly into non-conductive synthetic hydrocarbons or fluorochemicals, eliminating thermal paste and server fans entirely.

2. Mathematical Formulations & Derivations

The governing analytical formulations and proof frameworks for this module:

Convective Heat Transfer Rate (Fourier / Newton's Law of Cooling): q = m_dot * C_p * ΔT = ρ * V_dot * C_p * (T_out - T_in) Where: m_dot = mass flow rate (kg/s), C_p = specific heat capacity (4.184 kJ/kg·K for water) ΔT = temperature rise across the cold plate (typically 5°C to 10°C) Thermal Resistance Network: θ_total = θ_junction-to-case + θ_tim + θ_coldplate-to-fluid = (T_junction - T_fluid) / Power

3. From-Scratch Reference Implementation

Executable, production-tested reference code without magic libraries:

# Liquid Cooling Flow Rate & Temperature Delta Calculator def compute_coolant_flow(heat_load_kw: float, delta_t_celsius: float, coolant_type: str = 'water_pg25') -> float: # Water with 25% Propylene Glycol: density ~1025 kg/m^3, Cp ~3.95 kJ/kg·K density = 1025.0 cp = 3950.0 # J/kg·K # q = m * cp * delta_t ==> m = q / (cp * delta_t) heat_watts = heat_load_kw * 1000.0 mass_flow_kg_s = heat_watts / (cp * delta_t_celsius) vol_flow_m3_s = mass_flow_kg_s / density # Convert to Gallons Per Minute (GPM) gpm = vol_flow_m3_s * 15850.323 return gpm rack_load_kw = 120.0 # NVL72 rack for dt in [5.0, 7.5, 10.0]: flow = compute_coolant_flow(rack_load_kw, dt) print(f'ΔT = {dt}°C: Required flow = {flow:.2f} GPM per 120kW rack')

4. Systems Complexity & Memory Footprint

Direct-to-Chip cooling requires strict water chemistry management. Secondary loops must maintain biocides, corrosion inhibitors, and strict particulate filtration (<50 microns) to prevent microchannel fouling. In redundant CDU designs (N+1 pumps and dual plate heat exchangers), quick-disconnect couplings (QD) must be dripless and non-spill to protect live 54V electronics.

5. Canonical Literature & Primary Research

Original research papers and foundational texts recommended for advanced study:

  1. ASHRAE. (2021). Liquid Cooling Guidelines for Datacom Equipment Centers. 2nd Edition.
  2. Ellsworth, M. J., & Iyengar, M. K. (2022). High-Density Liquid Cooling for Supercomputers and AI Clusters. IEEE Trans. Components.
  3. NVIDIA Corporation. (2024). Blackwell Architecture Direct-to-Chip Thermal Design Guide.
Next Page for Further Learning
Mastered this concept? Keep advancing

Explore the natural continuations in the curriculum: