A Radeon RX 7800 XT has 16GB of VRAM. Checked against 225 models from the Ollama library, 178 have good/excellent reference fits on the GPU at 4K context and 25 more run with part of the model in system RAM.
The 7800 XT and 6800 XT both have 16 GB. The current Ollama Windows ROCm list includes the 7800 XT; check the separate support rows before treating the two as interchangeable.
Architecture
RDNA 3
Memory
16 GB GDDR6
Interface
256-bit
Memory bandwidth
624 GB/s
AMD’s published memory bandwidth, up to this value; no inference speed is inferred from it. Bandwidth source. Bandwidth is not an input to the memory-fit engine.
Ollama acceleration by operating system
Windows: vulkan, rocm when the corresponding driver/backend is installed.
Linux: vulkan, rocm when the corresponding driver/backend is installed.
ROCm support requires the driver stack documented by Ollama. A vendor logo or installed DLL alone does not establish that this card is supported.
Confirm the loaded model's processor allocation with ollama ps. Intel Macs use the Ollama CPU path; Apple Silicon uses its integrated Metal GPU.
Editorial examples chosen for their documented tasks, all Q4_K_M at 4,096 tokens. Check the verdict before downloading. These are estimates, not benchmark rankings.
Speed ceiling: up to ~69 tokens/s (theoretical, from memory bandwidth; real speed is lower and unmeasured)
ollama run qwen2.5:14b
After opening Ollama's prompt, enter /set parameter num_ctx 4096 to match this calculation, within the model's supported maximum. Install a current Ollama release that supports the build. Setup and troubleshooting.
Models that fit — largest memory first — for a Radeon RX 7800 XT
Largest first — these have good/excellent reference fits with 16GB of VRAM at 4K context. A good fit can include a small estimated CPU offload. These are technical defaults, not a quality ranking.
Showing the 25 largest of 178 models that run well.
How these results were calculated
Each model is evaluated at 4K context against 16GB of VRAM, counting model weights, KV cache, compute buffers and runtime overhead, minus a reserve for the display and operating system. Download sizes come from the official Ollama registry.
Reference scenario: Windows 11, 32GB of system RAM, an illustrative 8-core/16-thread CPU and 500GB free disk. Available RAM, driver version and free VRAM are unknown; the engine applies reserves. Supported GPU drivers/backends are assumed installed. Your own machine may differ — RAM, free disk space and whether an acceleration backend is actually installed all change the answer, which is what the PC scan measures directly.
Radeon RX 7800 XT local AI — frequently asked questions
How many AI models can a Radeon RX 7800 XT run?
Out of 225 models in the Ollama library, 178 have good/excellent reference fits on a Radeon RX 7800 XT's 16GB of VRAM at 4K context, and a further 25 run with part of the model offloaded to system RAM, more slowly.
What is the largest AI model a Radeon RX 7800 XT can run?
The heaviest build that has a good/excellent reference fit is solar-pro:22b (22B parameters), needing about 15.0 GB of memory from a 12.4 GB download.
Is 16GB of VRAM enough for local AI?
16GB is enough for 178 of the 225 builds evaluated here, under the stated reference assumptions. Fit alone does not tell you whether a build is suitable for chat, coding or embeddings. Very large models still need either partial CPU offload or a card with more memory.