RTX 4070 Ti SUPER vs RTX 3090 for local LLMs
VRAM decides which models fit entirely on the GPU; bandwidth decides how fast they generate. Here is how the two cards compare.
Which one for local LLMs?
The RTX 3090 has more VRAM (24 GB vs 16 GB), so it runs larger models entirely on the GPU.
The RTX 3090 has the higher memory bandwidth (936 GB/s vs 672 GB/s), so it should generate faster when a model fits on both.
RTX 4070 Ti SUPER · Specifications
- VRAM
- 16 GB GDDR6X
- Bandwidth
- 672 GB/s
- Board power
- 285 W
- Architecture
- Ada Lovelace
- Largest model fully in VRAM
- gpt-oss-20b
Official specData updated 38 days agoSource: NVIDIA specifications
RTX 3090 · Specifications
- VRAM
- 24 GB GDDR6X
- Bandwidth
- 936 GB/s
- Board power
- 350 W
- Architecture
- Ampere
- Largest model fully in VRAM
- Qwen3 32B
Official specData updated 38 days agoSource: NVIDIA specifications
| Model | RTX 4070 Ti SUPER · 16 GB | RTX 3090 · 24 GB |
|---|---|---|
| Qwen3 32B | CPU/GPU offload3–5.5 tok/s | Compatible31–42 tok/s |
| gpt-oss-20b | Excellent85–234 tok/s | Excellent147–163 tok/s |
| Qwen3 30B-A3B | CPU/GPU offload27–54 tok/s | Excellent120–200 tok/s |
| Llama 3.1 8B Instruct | Excellent80–113 tok/s | Excellent106–153 tok/s |
| Qwen3 14B | Excellent48–65 tok/s | Excellent63–89 tok/s |
| Qwen3 8B | Excellent77–109 tok/s | Excellent101–147 tok/s |
| Llama 3.3 70B Instruct | Not recommended0.7–1.3 tok/s | Not recommended0.9–1.7 tok/s |
| Gemma 3 27B IT | CPU/GPU offload6–11 tok/s | Excellent37–51 tok/s |
For each model, the highest-precision quantization that runs entirely in fast memory; otherwise the one with the best result. Speeds are ranges; "estimate" unless a benchmark exists for this exact hardware.
EstimateData updated 38 days agoSource: Run LLM Locally engine