AI Server System BOM & Rack Cost — Historical Time Series Data
Full system-level bill of materials for AI training servers — from DGX H100 (8-GPU) through GB200 NVL72 (72-GPU rack). Tracks how rack economics evolved as HBM and networking costs exploded.
AI Server System BOM & Rack Cost — latest readings
8 data points across 4 series, covering DGX H100 (2023) to GB200 NVL72 (2024). Values below are free; the full point-level history is available with Pro.
| Series | Period | Latest ($K) | Change |
|---|---|---|---|
| GPU (COGS) | GB200 NVL72 (2024) | 486 | +1727.1% versus DGX H100 (2023) |
| Networking | GB200 NVL72 (2024) | 80 | +900.0% versus DGX H100 (2023) |
| Power & Cooling | GB200 NVL72 (2024) | 120 | +2900.0% versus DGX H100 (2023) |
| Memory, Storage & Chassis | GB200 NVL72 (2024) | 65 | +915.6% versus DGX H100 (2023) |
AI Server System BOM & Rack Cost
Full system-level bill of materials for AI training servers — from DGX H100 (8-GPU) through GB200 NVL72 (72-GPU rack). Tracks how rack economics evolved as HBM and networking costs exploded.
Data Table
| Period | Series | Value |
|---|---|---|
DGX H100 (2023) | GPU (COGS) | 26.6 |
DGX H100 (2023) | Networking | 8 |
DGX H100 (2023) | Power & Cooling | 4 |
DGX H100 (2023) | Memory, Storage & Chassis | 6.4 |
GB200 NVL72 (2024) | GPU (COGS) | 486 |
GB200 NVL72 (2024) | Networking | 80 |
GB200 NVL72 (2024) | Power & Cooling | 120 |
GB200 NVL72 (2024) | Memory, Storage & Chassis | 65 |
Methodology & Sources
Synthesized from Epoch.ai hardware cost database, SemiAnalysis system architecture deep dives, and analyst estimates. All costs are approximate manufacture/procurement costs, not list prices.
Citations:
- Epoch.ai / NVIDIA DGX spec (Dec 2023)
- SemiAnalysis (Dec 2023)
- Data center analyst estimates (Dec 2023)
- Silicon Analysts estimate (Mar 2026)
- Silicon Analysts / chipSpecs.ts (Mar 2026)
- SemiAnalysis rack cost analysis (Dec 2024)
- NVIDIA NVL72 spec / Silicon Analysts (Mar 2026)
Related Tools
Related Analysis
Market intelligence on this data
All market intelligence →SK Hynix Breaks Ground on Indiana HBM Fab: $4B US Domestic Capacity Confirmed
CapEx commitment: ~$4B USD; production ramp targeted 2029; near-term (2026–2028) HBM supply capacity unchanged.
Nvidia Flags 'Extreme' Memory Costs Compressing Margins; Supply Meets Only 70% of Demand — HBM Shortage Structural, Not Transient
Gross margin pressure: Nvidia guiding below current ~75% GM due to memory cost overage; supply gap: ~30% of current customer demand unmet; FY2028 revenue upside capped by HBM supply constraint (analyst Stacy Rasgon, Bernstein, quantifies constrained vs. unconstrained delta as implying >$200B in suppressed revenue potential).
HBM4/4e Supply Squeeze Drives 50%+ Price Surge Threat; Nvidia Passes 15%+ Cost Hike Downstream
HBM price impact: +50%+ potential increase in 2027 (TrendForce via Polinews); AI server system pricing: +15%+ (Nvidia, multiple sources); AMD CoWoS demand: +308% YoY to 530,000 wafers in 2026 (Morgan Stanley); Global HBM TAM: ~$35B (2025) → ~$100B (2028), ~40% CAGR (Micron, Hot Chips 2026)
Nvidia Confirms >15% AI Server Price Hikes Driven by Soaring HBM Costs
Est. AI server BOM cost increase: +15% or more on affected Vera Rubin / Grace Blackwell system configurations; memory (HBM) identified as primary cost driver.