Meta
Llama 3.3 70B
A dense 70B model. Slow for one user on a Spark, useful for batch work.
Recommended: DGX Spark, 128 GB unified, $0.79 / hour, billed per minute. Check availability.
Recommended: DGX Spark, 128 GB unified, $0.79 / hour, billed per minute. Check availability.
Configure
Every build below is published on Hugging Face and fits at least one GPU we rent. Pick the quantization and engine: the memory it needs, the GPUs it fits and the recommended GPU follow, and Deploy takes that exact build, revision and GPU to the console. Only the one-click preset is tested by GPUwerk.
| Quantization | Q4_K_M GGUF |
|---|---|
| Engine | llama.cpp |
| Status | Untested by GPUwerk |
| Weights | 42.5 GB |
| GPU memory it needs | About 51.9 GB with a 32k-token cache, an estimate |
| Recommended GPU | DGX Spark, $0.79 / hour |
| Weights source | unsloth/Llama-3.3-70B-Instruct-GGUF, revision 8f14c5c5d06f, file Llama-3.3-70B-Instruct-Q4_K_M.gguf |
| Licence on the card | llama3.3 |
| GPU | Memory | Price | Availability | Deploy |
|---|---|---|---|---|
| RTX 5090x86 · Blackwell | 32 GB GDDR7 | Does not fit: GGUF models run on llama.cpp, which has no x86_64 build yet; pick a DGX Spark, or a safetensors build for vLLM. | ||
| DGX SparkArm · GB10 · recommended | 128 GB unified | $0.79 / hour | Check availability | Run it yourself Llama 3.3 70B Q4_K_M GGUF on DGX Spark |
| RTX PRO 6000x86 · Blackwell | 96 GB GDDR7 | Does not fit: GGUF models run on llama.cpp, which has no x86_64 build yet; pick a DGX Spark, or a safetensors build for vLLM. | ||
| H100 SXMx86 · Hopper | 80 GB HBM3 | Does not fit: GGUF models run on llama.cpp, which has no x86_64 build yet; pick a DGX Spark, or a safetensors build for vLLM. | ||
| H200x86 · Hopper | 141 GB HBM3e | Does not fit: GGUF models run on llama.cpp, which has no x86_64 build yet; pick a DGX Spark, or a safetensors build for vLLM. | ||
| B200x86 · Blackwell | 180 GB HBM3e | Does not fit: GGUF models run on llama.cpp, which has no x86_64 build yet; pick a DGX Spark, or a safetensors build for vLLM. | ||
| B300x86 · Blackwell | 288 GB HBM3e | Does not fit: GGUF models run on llama.cpp, which has no x86_64 build yet; pick a DGX Spark, or a safetensors build for vLLM. | ||
| Quantization | Q8_0 GGUF |
|---|---|
| Engine | llama.cpp |
| Status | Untested by GPUwerk |
| Weights | 75 GB |
| GPU memory it needs | About 89.2 GB with a 32k-token cache, an estimate |
| Recommended GPU | DGX Spark, $0.79 / hour |
| Weights source | unsloth/Llama-3.3-70B-Instruct-GGUF, revision 8f14c5c5d06f, file Llama-3.3-70B-Instruct-Q8_0-00001-of-00002.gguf |
| Licence on the card | llama3.3 |
| GPU | Memory | Price | Availability | Deploy |
|---|---|---|---|---|
| RTX 5090x86 · Blackwell | 32 GB GDDR7 | Does not fit: GGUF models run on llama.cpp, which has no x86_64 build yet; pick a DGX Spark, or a safetensors build for vLLM. | ||
| DGX SparkArm · GB10 · recommended | 128 GB unified | $0.79 / hour | Check availability | Run it yourself Llama 3.3 70B Q8_0 GGUF on DGX Spark |
| RTX PRO 6000x86 · Blackwell | 96 GB GDDR7 | Does not fit: GGUF models run on llama.cpp, which has no x86_64 build yet; pick a DGX Spark, or a safetensors build for vLLM. | ||
| H100 SXMx86 · Hopper | 80 GB HBM3 | Does not fit: GGUF models run on llama.cpp, which has no x86_64 build yet; pick a DGX Spark, or a safetensors build for vLLM. | ||
| H200x86 · Hopper | 141 GB HBM3e | Does not fit: GGUF models run on llama.cpp, which has no x86_64 build yet; pick a DGX Spark, or a safetensors build for vLLM. | ||
| B200x86 · Blackwell | 180 GB HBM3e | Does not fit: GGUF models run on llama.cpp, which has no x86_64 build yet; pick a DGX Spark, or a safetensors build for vLLM. | ||
| B300x86 · Blackwell | 288 GB HBM3e | Does not fit: GGUF models run on llama.cpp, which has no x86_64 build yet; pick a DGX Spark, or a safetensors build for vLLM. | ||
Builds by the model's maker, NVIDIA and Unsloth, read from Hugging Face on 21 November 2026. Memory is an estimate (weights x 1.15 plus 3 GB); GGUF runs on llama.cpp, which GPUwerk builds for the DGX Spark only, and NVFP4 needs a Blackwell GPU. SGLang is not offered: there is no SGLang runtime yet.
Details
About the model.
| Maker | Meta |
|---|---|
| Task | Text |
| Parameters | 70B, dense |
| Licence | See the model card |
6.0 tok/s for one request on one DGX Spark, measured by GPUwerk with vLLM on 2 September 2026. Every other speed figure is in the model guide, with its source.
Quick start
- Deploy a DGX Spark with a base image (DGX OS or Ubuntu).
- Follow the Llama 3.3 70B guide to download the weights and start vLLM.
- Connect over SSH or the browser terminal; the machine is yours until you terminate it.
SSH, the browser terminal, VNC and your workspace work the same on every instance. Terminate when you are done and billing ends.
Related models
Qwen3 Coder 30B
A coding model for agents and editors, with tool calls turned on.
Qwen3.6 35B-A3B
A fast mixture-of-experts model for chat and agents, also on the pay-per-token API.
GPT-OSS 120B
OpenAI's open-weight 120B model, quantized to fit one DGX Spark.