In One Timeline

Why It Costs $400 Million to Train One AI (To Scale)

The training-compute cost of frontier AI models, from AlexNet (2012) to today's $400M runs.

2credits2sourcesAll episodes
Source pages are linked directly so license details can be verified at the original host.
Used For
Credit
Source
01Data-center server racks
Victor GrigasWikimedia Foundation Servers-8055 35.jpg / CC BY-SA 3.0
commons.wikimedia.org
02GeForce GTX 580 GPU die
Fritzchens FritzNVIDIA@40nm@Fermi@GF110@GeForce GTX 580@UA10B338 1041A1 N2Y540.000 GF110-375-A1 DSC06727 (28114557571).jpg / CC0
commons.wikimedia.org

Data sources & references

01Epoch AI — Notable AI Models database (epoch.ai)
02Sevilla et al. 2022 — Compute Trends Across Three Eras of Machine Learning