A40
The A40 is a cloud GPU with 48 GB of memory and 300 W TDP. It is currently available from 5 providers starting at $0.28/hr, with a market median of $0.49/hr across 17 offerings.
Best deal
Hardware specifications
- Architecture
- Ampere
- VRAM
- 48 GB
- Memory bandwidth
- 696 GB/s
- FP16
- 150 TFLOPS
- FP32
- 37 TFLOPS
- TDP
- 300 W
Same across all providers.
Market comparison
All-time price history
Offerings
| Provider | Cloud | Count | vCPU | RAM | Region | Per GPU hr | SPOT | Total/hr | |
|---|---|---|---|---|---|---|---|---|---|
GPU Finder 0.0% 30d | — | ×1 | — | — | Indiana, US | $0.28/hr | — | $0.28/hr | Launch ↗ |
Vultr 0.0% 30dReferral link | — | ×1 | 4 | 20 GB | ewr | $0.29/hr | — | $0.29/hr | Launch ↗ |
AI Galaxy 0.0% 30dReferral link | — | ×1 | — | — | CN | $0.33/hr | — | $0.33/hr | Launch ↗ |
GPU Finder 0.0% 30d | — | ×1 | — | — | Vietnam, VN | $0.34/hr | $0.32/hr | $0.34/hr | Launch ↗ |
RunPodPromoted 0.0% 30dReferral link | Community | ×1 | — | — | — | $0.35/hr | — | $0.35/hr | Launch ↗ |
HardwareHQ 0.0% 30dReferral link | — | ×1 | — | — | — | $0.35/hr | — | $0.35/hr | Launch ↗ |
GPU Finder 0.0% 30d | — | ×1 | — | — | Global | $0.49/hr | — | $0.49/hr | Launch ↗ |
RunPodPromoted 0.0% 30dReferral link | Secure | ×1 | — | — | — | $0.49/hr | — | $0.49/hr | Launch ↗ |
GPU Finder 0.0% 30d | — | ×1 | — | — | Global | $0.49/hr | — | $0.49/hr | Launch ↗ |
HardwareHQ 0.0% 30dReferral link | — | ×2 | — | — | — | $0.35/hr | — | $0.70/hr | Launch ↗ |
HardwareHQ 0.0% 30dReferral link | — | ×1 | — | — | — | $0.79/hr | — | $0.79/hr | Launch ↗ |
HardwareHQ 0.0% 30dReferral link | — | ×1 | — | — | — | $1.28/hr | — | $1.28/hr | Launch ↗ |
HardwareHQ 0.0% 30dReferral link | — | ×4 | — | — | — | $0.35/hr | — | $1.40/hr | Launch ↗ |
GPU Finder 0.0% 30d | — | ×1 | — | — | london-uk-1, singapore-singapore-1, sydney-australia-1 | $1.86/hr | — | $1.86/hr | Launch ↗ |
GPU Finder 0.0% 30d | — | ×1 | — | — | london-uk-1, singapore-singapore-1, sydney-australia-1 | $1.86/hr | — | $1.86/hr | Launch ↗ |
HardwareHQ 0.0% 30dReferral link | — | ×1 | — | 120 GB | — | $1.86/hr | — | $1.86/hr | Launch ↗ |
HardwareHQ 0.0% 30dReferral link | — | ×8 | — | — | — | $0.35/hr | — | $2.80/hr | Launch ↗ |
LLMs that fit
| Model | Params | 16-bit | 8-bit | 4-bit |
|---|---|---|---|---|
DeepSeek V4 Flash DeepSeek | 284B | Not released | Not released | Barely fits on 5× |
Solar Open2 250B Upstage | 250B 15B active | Needs >8 GPUs | Needs >8 GPUs | Barely fits on 5× |
Qwen3 235B-A22B Alibaba | 235B 22B active | Needs >8 GPUs | Barely fits on 8× | Barely fits on 5× |
Laguna-S 2.1 Poolside | 118B 8B active | Barely fits on 8× | Barely fits on 4× | 3× · 36 GB free |
gpt-oss-120b OpenAI | 117B 5.1B active | Not released | Not released | Barely fits on 2× |
Llama 3.1 70B Meta | 70B | Barely fits on 4× | Barely fits on 2× | 2× · 42 GB free |
Qwen3.6 35B-A3B Alibaba | 35B 3B active | 3× · 40.8 GB free | 2× · 39.6 GB free | 1× · 14.4 GB free |
Qwen3 32B Alibaba | 32.8B | Barely fits on 2× | 2× · 44.4 GB free | 1× · 18 GB free |
Qwen2.5 14B Alibaba | 14B | 1× · 12.6 GB free | 1× · 28.7 GB free | 1× · 36.6 GB free |
Llama 3.1 8B Meta | 8B | 1× · 27.1 GB free | 1× · 36.6 GB free | 1× · 41.3 GB free |
Mistral 7B Mistral AI | 7B | 1× · 29.8 GB free | 1× · 38 GB free | 1× · 42.1 GB free |
Qwen3 4B Alibaba | 4B | 1× · 36.4 GB free | 1× · 41.6 GB free | 1× · 44.3 GB free |
Estimates: model weights plus 20% for KV cache and runtime overhead, at short context lengths. Long contexts and large batches need more. Rows marked “tight” hold the weights but not that full margin. A ×N figure is the total VRAM across N of these GPUs and makes no claim about interconnect throughput.
Similar GPUs
See more GPUs like this in
Frequently asked questions
How much does the A40 cost per hour?
The cheapest A40 offering starts at $0.28/hr, and the market median is $0.49/hr.
Which cloud providers offer the A40?
We track A40 offerings from GPU Finder, Vultr, AI Galaxy, RunPod, HardwareHQ.
How much VRAM does the A40 have?
The A40 has 48 GB of VRAM.
What LLMs can run on the A40?
With 48 GB of VRAM, the A40 can run 12 of our tracked models in 4-bit quantization, including DeepSeek V4 Flash, Solar Open2 250B, Qwen3 235B-A22B. 8 models fit in 16-bit precision.
What's the biggest LLM I can run on multiple A40s?
With 8× A40 (384 GB total), the largest tracked model that fits in 16-bit is Qwen3.6 35B-A3B (35B params), which needs 3× GPUs.
Where is the A40 cheapest?
The cheapest A40 offering in our catalog is GPU Finder at $0.28/hr per GPU-hour (×1).