LLM VRAM calculator
A model download is only part of its memory cost. Choose a concrete build and conversation length to estimate weights, KV cache, runtime overhead and compute buffers. No hardware profile or download is required.
Estimated memory: 7.4 GB
deepseek-ocr:3b · F16 · 4,096 tokens · ollama
- Model weights
- 6.2 GB
- Context / KV cache
- 0.2 GB
- Runtime overhead
- 0.4 GB
- Compute buffers
- 0.5 GB
- Total estimate
- 7.4 GB
The KV cache is calculated from the stored architecture; runtime overhead and compute buffers are still estimates. These are working-memory estimates, not a VRAM-capacity guarantee. Your display and operating system need headroom. On Apple Silicon, CPU and GPU share the same memory pool.
Download: 6.2 GB. Build size from tag: 3B parameters. GB here means 1,024³ bytes.
Build manifest · Catalog checked 2026-10-13. Architecture retrieved 2026-10-13 from the GGUF source.
Download this exact build
ollama pull deepseek-ocr:3bFor a generation-capable build, run ollama run deepseek-ocr:3b, then enter /set parameter num_ctx 4096 before your prompt. Check the source for base versus instruct behavior.
How to use the number
Compare quantizations of the same build at the same context. A lower-bit build often uses less memory but can change output quality. Longer context grows the KV cache for autoregressive models. Encoder-only models can have different cache behavior. This calculator describes inference, not training or fine-tuning.
The engine estimates one loaded model. Parallel requests, vision inputs, other applications and runtime settings can raise actual use. A fit does not predict tokens per second.