AI Server System BOM & Rack Cost — Historical Time Series Data
Full system-level bill of materials for AI training servers — from DGX H100 (8-GPU) through GB200 NVL72 (72-GPU rack). Tracks how rack economics evolved as HBM and networking costs exploded.
AI Server System BOM & Rack Cost
Full system-level bill of materials for AI training servers — from DGX H100 (8-GPU) through GB200 NVL72 (72-GPU rack). Tracks how rack economics evolved as HBM and networking costs exploded.
Data Table
| Period | Series | Value |
|---|---|---|
DGX H100 (2023) | GPU (COGS) | 26.6 |
DGX H100 (2023) | Networking | 8 |
DGX H100 (2023) | Power & Cooling | 4 |
DGX H100 (2023) | Memory, Storage & Chassis | 6.4 |
GB200 NVL72 (2024) | GPU (COGS) | 460.8 |
GB200 NVL72 (2024) | Networking | 80 |
GB200 NVL72 (2024) | Power & Cooling | 120 |
GB200 NVL72 (2024) | Memory, Storage & Chassis | 65 |
Methodology & Sources
Synthesized from Epoch.ai hardware cost database, SemiAnalysis system architecture deep dives, and analyst estimates. All costs are approximate manufacture/procurement costs, not list prices.
Citations:
- Epoch.ai / NVIDIA DGX spec (Dec 2023)
- SemiAnalysis (Dec 2023)
- Data center analyst estimates (Dec 2023)
- Silicon Analysts estimate (Mar 2026)
- Silicon Analysts / chipSpecs.ts (Mar 2026)
- SemiAnalysis rack cost analysis (Dec 2024)
- NVIDIA NVL72 spec / Silicon Analysts (Mar 2026)
Related Tools
Related Analysis
Market intelligence on this data
All market intelligence →Samsung & SK Hynix Commit $518B South Korea Fab Buildout, Signaling Multi-Year HBM Supply Expansion
Capacity: Combined ~$518B CapEx across Samsung + SK Hynix new fabs; +81 trillion won (~$52B) dedicated advanced packaging cluster in Chungcheong; Samsung Electro-Mechanics 15 trillion won (~$9.7B) for AI server package substrates. Timeline: multi-year buildout, no near-term capacity relief quantified.
ASE Advanced Packaging Quotes Surge 20%+ Amid AI-Driven Demand Crunch
Est. packaging BOM increase: +20% or greater on advanced packaging line items; direct upward pressure on CoWoS-tier and SiP packaging costs for AI accelerator builds including H200/B100-class systems.
ASE Advanced Packaging Quotes Surge 20%+ as WF₆ Supply Shock Threatens Process Materials
Packaging cost impact: +20%+ on ASE advanced packaging quotes; WF₆ supply reduction: -25% of global high-end capacity (2,200 tons removed from 8,000–9,000 ton annual market)
South Korea Commits $518B HBM & Packaging Capacity Supercycle; Nvidia China Revenue Under Structural Pressure from Huawei
Capacity: +HBM/packaging capacity (scale unquantified in unit terms, but $518B CapEx over ~10 years across Samsung + SK Hynix fabs); packaging cluster: ~$52B (81T KRW) dedicated spend. China revenue displacement: unquantified but described as Huawei 'overtaking' Nvidia in domestic market.