SERVER
NVIDIA DGX B200 (8-GPU)
NVIDIA's newest Blackwell-generation factory-built server. 192 GB per GPU across eight GPUs gives 1.5 TB of pooled memory in one box — enough to run most open models available today on a single machine.
Specs, in plain English
- GPU memory 192 GB per GPU × 8 GPUs = 1536 GB total GPU memory is fast on-card RAM that has to hold a model's parameters plus working data while it runs. If a model is bigger than the GPU memory available, it simply will not load.
- Number of GPUs 8 How many GPUs work together as one system. More GPUs pool their memory into one bigger pool, which is how you fit models too large for a single card — but they need fast links between them to act as one machine.
- CPU 2x Intel Xeon Platinum 8570 (56-core) The CPU prepares and feeds data to the GPUs and runs the software around the model. For running big AI models it rarely limits which model you can run — the GPU memory does.
- System RAM 2048 GB System RAM (separate from GPU memory) holds the operating system, the data pipeline, and anything staged before it reaches the GPU. More headroom here means fewer slowdowns under load.
- Power draw 14300 W Power draw is how much electricity the machine pulls when running flat out. It determines your electric bill, and how much cooling and electrical wiring the room needs.
- Price $515,000 The purchase price of the hardware itself — it does not include electricity, cooling, networking, or setup labor.
What this means in everyday terms
This machine draws 14300 watts — about like 12 homes running continuously. Left on 24/7 it uses about 343 kWh a day, which is roughly 3.8 electric-car batteries worth of energy every day.
Homes = watts ÷ 1,200. Daily energy (kWh) = watts × 24 ÷ 1,000. EV batteries/day = daily kWh ÷ 90.