Together AI vs Vast.ai
GPU specialist against peer marketplace, priced against each other on the 3 GPUs both of them rent. Published per-GPU on-demand rates as each provider last stated them, with what their own pages say about billing, commitment and egress beside the numbers.
Vast.ai is cheaper on 3 of the 3 cards both of them rent, by a median of 32%.
- How they sell
- GPU specialist An operator whose whole business is renting these cards.
- GPU models
- 6 19 offers
- Registered in
- 🇺🇸 United States
- How they sell
- Peer marketplace A stranger whose machine the platform vets to some degree. Reliability, bandwidth and how long the machine stays online vary by host, not just by price.
- GPU models
- 21 58 offers
- Registered in
- 🇺🇸 United States
These are not the same product. A GPU specialist and a peer marketplace differ in who your counterparty is, which is why the rates below can be far apart without either being wrong. The prices are comparable; what stands behind them is not.
The 3 cards both of them rent, cheapest published per-GPU on-demand rate each. Dearest first.
| GPU | Together AI | Vast.ai | Difference |
|---|---|---|---|
| NVIDIA B200 SXM6 180GB | $8.19/hr | $6.25/hr | 24% cheaper on Vast.ai |
| NVIDIA H200 SXM5 141GB | $5.99/hr | $4.08/hr | 32% cheaper on Vast.ai |
| NVIDIA H100 SXM5 80GB | $3.99/hr | $1.87/hr | 53% cheaper on Vast.ai |
Per GPU per hour, on-demand list prices as each provider last published them. Rates exclude tax and vary by region; a cheaper rate is not the same machine, the same network or the same support.
| Together AI | Vast.ai | |
|---|---|---|
| Billing granularityOn short jobs this outweighs the rate: an hour minimum on a 90-second run costs more than a 30% dearer per-second rate. | Hourly for clusters; per token, megapixel or second for serverless | Per second |
| Minimum commitment | $5 minimum credit; no term on on-demand | $5 minimum to start |
| Payment model | Prepaid credits, then invoices with itemised usage | Prepaid credits; optional auto top-up |
| Free credits | None — no free trials | not stated |
| Egress | FREE on managed storage | Priced per byte by each host |
| Regions | not stated | 40+ data centres worldwide |
Neither site tells you whether your data trains their models, an uptime SLA, whether you get credits when it breaks or whether a commitment auto-renews. We looked on both and record the absence rather than filling it in — if you need any of it, ask before you commit.
- NVIDIA B300 SXM6 288GB$9.99/hr
- NVIDIA RTX 3090 24GB$0.12/hr
- NVIDIA RTX 4070 12GB$0.14/hr
- NVIDIA RTX 4070 Ti Super 16GB$0.21/hr
- NVIDIA RTX 5080 16GB$0.27/hr
- NVIDIA RTX PRO 4000 Blackwell 24GB$0.27/hr
- NVIDIA RTX PRO 4500 Blackwell 32GB$0.35/hr
- NVIDIA RTX A6000 48GB$0.40/hr
- NVIDIA RTX 4090 24GB$0.43/hr
- NVIDIA RTX 5090 32GB$0.47/hr
- NVIDIA RTX 6000 Ada 48GB$0.54/hr
- NVIDIA RTX 4080 Super 16GB$0.64/hr
- NVIDIA A100 SXM4 80GB$0.67/hr
Is Together AI cheaper than Vast.ai?
Vast.ai is cheaper on 3 of the 3 cards both of them rent, by a median of 32%.
Which GPUs do Together AI and Vast.ai both rent?
NVIDIA B200 SXM6 180GB, NVIDIA H200 SXM5 141GB, NVIDIA H100 SXM5 80GB — 3 in total, on published per-GPU on-demand rates.
What is the cheapest GPU at Together AI and at Vast.ai?
Of the cards both rent, Together AI starts at $3.99 per GPU-hour and Vast.ai at $1.87.
Are Together AI and Vast.ai the same kind of provider?
No. Together AI is a GPU specialist — an operator whose whole business is renting these cards. Vast.ai is a peer marketplace — a stranger whose machine the platform vets to some degree. Reliability, bandwidth and how long the machine stays online vary by host, not just by price. The rates are comparable; what stands behind them is not.