L40S vs A100

Ada workstation silicon against Ampere datacenter silicon. The L40S has FP8 and the newer architecture; the A100 has 80 GB of HBM and the bandwidth to feed it. Which one a job needs, and what each costs to rent today.

Illustrative render of a NVIDIA L40S 48GB: a generic body for its form factor, carrying the model name. Not a product photograph.
L40S 48GBAda Lovelace
$0.79/ GPU-hour
cheapest at GPU.ai · 29 providers list it
Memory48 GB
Bandwidth864 GB/s
Board power350 W
Every L40S 48GB offer →
Illustrative render of a NVIDIA A100 SXM4 80GB: a generic body for its form factor, carrying the model name. Not a product photograph.
A100 SXM4 80GBAmpere
$0.75/ GPU-hour
cheapest at Vast.ai · 17 providers list it
Memory80 GB
Bandwidth2,039 GB/s
Board power400 W
Every A100 SXM4 80GB offer →
Short answer
What separates them
Memory is the difference
48 vs 80 GB
0.60× the capacity per card — the number that decides how many cards a model needs.
Bandwidth moves with it
0.4× more
864 GB/s against 2,039 GB/s, as the vendor publishes them.
Only one has FP8
L40S 48GB only
The A100 SXM4 80GB has no FP8 path — that row is blank because the silicon lacks it, not because the number is missing.
The gap depends on where you rent
0.54–0.86×
Across the 8 providers listing both, that is the range of what the L40S 48GB costs relative to the A100 SXM4 80GB.
Specs side by side
SpecL40S 48GBA100 SXM4 80GB
Memory
Capacity GB4880
Bandwidth GB/s8642,039
Compute
BF16 dense TFLOPS312
FP8 dense TFLOPS733
TF32 dense TFLOPS366156
FP32 TFLOPS91.619.5
FP64 TFLOPS9.7
INT8 dense TOPS624
Platform
NVLink GB/s64600
Board power W350400
Max MIG instances7
Silicon
ArchitectureAda Lovelace 2023Ampere 2020

Violet marks the stronger figure. Throughput numbers are the vendors' own published dense peaks, read from L40S 48GB's product page and A100 SXM4 80GB's product page — not speeds we measured. Process node and transistor count are absent because they are not on the pages we read; architecture comes from our hand-compiled hardware registry, which has no fetch behind it.

Both cards, by providerPrices confirmed 13h ago
ProviderL40S 48GBA100 SXM4 80GBRatio
RunPod Community Cloudcheapest$0.79$1.390.57×Deploy
Massed Compute$0.97$1.380.70×Deploy
Runcrate$0.97$1.490.65×Deploy
Geodd$1.00$1.490.67×Deploy
Verda$1.50$1.740.86×Deploy
Crusoe Cloud$1.50$2.300.65×Deploy

On-demand, per GPU, USD, from providers publishing a comparable rate for both cards. 16 more list one of the two but not both. Spot and committed rates are excluded — they are not comparable to on-demand, and mixing them would turn a different product into what looks like a discount.

What actually decides it

FP8 is present on one side and absent on the other

  • The L40S 48GB publishes 733 dense TFLOPS at FP8. The A100 SXM4 80GB publishes no FP8 figure at all.
  • That is an absent capability rather than a smaller number — the blank cell in the spec table is the silicon, not a gap in our data.

Where you rent moves more money than which card you pick

  • The same L40S 48GB is published between $0.79 and $7.58 — a 9.6× spread across 18 providers for identical hardware.
  • The gap between the two cards is 1.05×. Choosing the provider is worth more than choosing the card, and it is the part a spec sheet cannot tell you.
Other comparisons

More pairings need both cards' specs fetched first.

Working out what a whole run costs?
The calculator prices a job by hours and cards, from these same rates.
Open the calculator