AWS vs Azure
The two largest clouds, priced against each other on the GPUs both of them rent. Neither is competing on rate card — what the premium buys is regions, contracts and the rest of the estate you already run there.
Amazon Web Services
- Cheapest on-demand
- $0.42/GPU-hr NVIDIA Tesla T4 16GB
- GPU models
- 12 53 offers
- How they sell
- Hyperscaler
- Registered in
- 🇺🇸 🇱🇺 United States, Luxembourg
Microsoft Azure
- Cheapest on-demand
- $3.67/GPU-hr NVIDIA A100 PCIe 80GB
- GPU models
- 4 42 offers
- How they sell
- Hyperscaler
- Registered in
- 🇺🇸 United States
The same GPUs, both prices
Cards both of them rent, cheapest published per-GPU on-demand rate each. Dearest first.
| GPU | Amazon Web Services | Microsoft Azure | Difference |
|---|---|---|---|
| NVIDIA H100 SXM5 80GB | $6.88/hr | $12.29/hr | 44% cheaper on Amazon Web Services |
| NVIDIA A100 SXM4 80GB | $3.43/hr | $4.10/hr | 16% cheaper on Amazon Web Services |
Per GPU per hour, on-demand list prices as each provider last published them. Rates exclude tax and vary by region; a cheaper rate is not the same machine, the same network or the same support.
Only on one side
Amazon Web Services only
- NVIDIA Tesla T4 16GB$0.42/hr
- NVIDIA L4 24GB$0.80/hr
- NVIDIA A10G 24GB$1.01/hr
- NVIDIA L40S 48GB$1.86/hr
- NVIDIA A100 SXM4 40GB$2.74/hr
- NVIDIA Tesla V100 16GB$3.06/hr
- NVIDIA RTX PRO 6000 Blackwell 96GB$3.36/hr
- NVIDIA Tesla V100 32GB$3.90/hr
- NVIDIA B200 SXM6 180GB$14.24/hr
- NVIDIA B300 SXM6 288GB$17.80/hr
Microsoft Azure only
- NVIDIA A100 PCIe 80GB$3.67/hr
- NVIDIA H100 NVL 94GB$6.98/hr