AI Server System BOM & Rack Cost — Historical Time Series Data
Full system-level bill of materials for AI training servers — from DGX H100 (8-GPU) through GB200 NVL72 (72-GPU rack). Tracks how rack economics evolved as HBM and networking costs exploded.
AI Server System BOM & Rack Cost
Full system-level bill of materials for AI training servers — from DGX H100 (8-GPU) through GB200 NVL72 (72-GPU rack). Tracks how rack economics evolved as HBM and networking costs exploded.
Data Table
| Period | Series | Value |
|---|---|---|
DGX H100 (2023) | GPU (COGS) | 26.6 |
DGX H100 (2023) | Networking | 8 |
DGX H100 (2023) | Power & Cooling | 4 |
DGX H100 (2023) | Memory, Storage & Chassis | 6.4 |
GB200 NVL72 (2024) | GPU (COGS) | 460.8 |
GB200 NVL72 (2024) | Networking | 80 |
GB200 NVL72 (2024) | Power & Cooling | 120 |
GB200 NVL72 (2024) | Memory, Storage & Chassis | 65 |
Methodology & Sources
Synthesized from Epoch.ai hardware cost database, SemiAnalysis system architecture deep dives, and analyst estimates. All costs are approximate manufacture/procurement costs, not list prices.
Citations:
- Epoch.ai / NVIDIA DGX spec (Dec 2023)
- SemiAnalysis (Dec 2023)
- Data center analyst estimates (Dec 2023)
- Silicon Analysts estimate (Mar 2026)
- Silicon Analysts / chipSpecs.ts (Mar 2026)
- SemiAnalysis rack cost analysis (Dec 2024)
- NVIDIA NVL72 spec / Silicon Analysts (Mar 2026)
Related Tools
Related Analysis
Market intelligence on this data
All market intelligence →TSMC $265B US CapEx Commitment + ASML 30% EUV Capacity Surge Signal Multi-Year AI Supply Expansion — with Equipment Price Hike Risk
TSMC CapEx: +$100B incremental US commitment (total $265B), 2026 CapEx at high end of $52–56B range; ASML EUV/DUV capacity: +30% per year for 2 years; ASML 2026 revenue guidance raised ~15–19% vs prior midpoint (€38B → €44B midpoint); ASML EUV price hike quantum not yet disclosed — wafer/packaging cost pass-through risk flagged but unquantified.
SK Hynix CEO Flags 2027 as Worst-Ever HBM Supply Crunch; $26.5B IPO Capital Earmarked for Capacity Expansion
Capacity expansion funded: $26.5B raised (new fab + packaging facility + EUV scanners); Supply gap: demand forecasted to exceed supply through 2030+; No specific yield or price-per-unit figure disclosed.
HBM Supply Shortage Persists as SK Hynix Commands 56.4% Market Share; Micron Commits $250B to Domestic DRAM Expansion
HBM shortage: supply constrained with SK Hynix holding 56.4% market share per SEC filing; Micron US DRAM capacity target: 40% of total output domestically by 2035; Micron data center segment gross margin reached 87% on $11.5B revenue (up 103% QoQ), signaling sustained premium pricing on memory inputs to AI hardware.
SK Hynix Commits $706B to HBM/DRAM Scale-Up as ISM Flags Memory Components in Active Short Supply
Capacity: P&T7 packaging facility targeted for end-2027; M17 NAND fab operations targeted H1 2029; SK Group aggregate HBM/DRAM CapEx: ~$706B committed. Supply tightness signal: ISM June 2026 survey flags memory in active short supply (no precise % figure cited). Bernstein projects SK Hynix DRAM gross margins peaking at ~92.7% in Q4 2026, implying sustained elevated HBM ASPs through at least 2028.