CanMyPCRunAILocal AI compatibility

AMD · 24GB VRAM

What AI models can a Radeon RX 7900 XTX run?

A Radeon RX 7900 XTX has 24GB of VRAM. Checked against 225 models from the Ollama library, 193 have good/excellent reference fits on the GPU at 4K context and 15 more run with part of the model in system RAM.

193

run well

15

with trade-offs

225

builds evaluated

Which Radeon RX 7900 XTX does this cover?

The XTX has 24 GB, compared with 20 GB on the XT. Ollama lists ROCm support for this model on both Windows and Linux; a working driver stack is still required.

Architecture
RDNA 3
Memory
24 GB GDDR6
Interface
See board specification
Memory bandwidth
Not verified here

Ollama acceleration by operating system

  • Windows: vulkan, rocm when the corresponding driver/backend is installed.
  • Linux: vulkan, rocm when the corresponding driver/backend is installed.
  • ROCm support requires the driver stack documented by Ollama. A vendor logo or installed DLL alone does not establish that this card is supported.
  • Confirm the loaded model's processor allocation with ollama ps. Intel Macs use the Ollama CPU path; Apple Silicon uses its integrated Metal GPU.

Hardware specifications · Ollama support table · reviewed 2026-09-15.

Compare Radeon RX 7900 XT (20 GB). Use the same model, quantization and context to see what the capacity difference changes.

Four builds to compare by task

Editorial examples chosen for their documented tasks, all Q4_K_M at 4,096 tokens. Check the verdict before downloading. These are estimates, not benchmark rankings.

Short conversations and summaries

llama3.2:3b

A small instruction-tuned model for trying local chat with more memory headroom. Review summaries against the source text.

Task and build source · Catalog checked 2026-10-13

Excellent fit

Est. memory 2.9 GB · medium confidence

Model fully fits in usable GPU VRAM.

ollama run llama3.2:3b

General instruction following

llama3.1:8b

An 8B instruction-tuned alternative to compare on your own prompts. It needs more memory than the 3B example and can still give incorrect answers.

Task and build source · Catalog checked 2026-10-13

Excellent fit

Est. memory 5.8 GB · medium confidence

Model fully fits in usable GPU VRAM.

ollama run llama3.1:8b

Code explanation and editing

qwen2.5-coder:7b

A code-focused instruct build. Review generated changes and run your tests; a memory fit is not evidence that its code is correct.

Task and build source · Catalog checked 2026-10-13

Excellent fit

Est. memory 5.3 GB · medium confidence

Model fully fits in usable GPU VRAM.

ollama run qwen2.5-coder:7b

A larger general-purpose comparison

qwen2.5:14b

A 14B instruct build for comparing answers when memory allows. Larger size does not establish better results for every task.

Task and build source · Catalog checked 2026-10-13

Excellent fit

Est. memory 10.2 GB · medium confidence

Model fully fits in usable GPU VRAM.

ollama run qwen2.5:14b

After opening Ollama's prompt, enter /set parameter num_ctx 4096 to match this calculation, within the model's supported maximum. Install a current Ollama release that supports the build. Setup and troubleshooting.

Models that fit — largest memory first — for a Radeon RX 7900 XTX

Largest first — these have good/excellent reference fits with 24GB of VRAM at 4K context. A good fit can include a small estimated CPU offload. These are technical defaults, not a quality ranking.

Models that run well on a Radeon RX 7900 XTX
ModelBuildMemory neededVerdict
codeboogaOllama Librarycodebooga:34b-v0.1-q4_K_MQ4_K_M~21.5 GBGood fit
phind-codellamaMicrosoftphind-codellama:34b-python-q4_K_MQ4_K_M~21.5 GBGood fit
qwqAlibaba Cloudqwq:32b-preview-q4_K_MQ4_K_M~21.4 GBGood fit
olmo-3.1Allen Institute for AIolmo-3.1:32bQ4_K_M~21.0 GBGood fit
command-rCoherecommand-r:35b-08-2024-q4_K_MQ4_K_M~20.9 GBGood fit
qwen3-coderAlibaba Cloudqwen3-coder:30bQ4_K_M~19.4 GBGood fit
clefOllama Libraryclef:27bQ4_K_M~18.5 GBGood fit
qwen3.8Alibaba Cloudqwen3.8:27bQ4_K_M~18.3 GBGood fit
muse-glimmerOllama Librarymuse-glimmer:30bQ4_K_M~17.4 GBExcellent fit
mistral-small3.1Mistral AImistral-small3.1:24bQ4_K_M~16.6 GBExcellent fit
devstral-small-2Mistral AIdevstral-small-2:24bQ4_K_M~16.3 GBExcellent fit
mistral-small3.2Mistral AImistral-small3.2:24bQ4_K_M~16.3 GBExcellent fit
lfm2Ollama Librarylfm2:24bQ4_K_M~16.1 GBExcellent fit
devstralMistral AIdevstral:24bQ4_K_M~15.4 GBExcellent fit
magistralMistral AImagistral:24bQ4_K_M~15.4 GBExcellent fit
solar-proUpstagesolar-pro:22bQ4_K_M~15.0 GBExcellent fit
mistral-smallMistral AImistral-small:22b-instruct-2409-q4_K_MQ4_K_M~14.7 GBExcellent fit
codestralMistral AIcodestral:22b-v0.1-q4_K_MQ4_K_M~14.7 GBExcellent fit
gpt-ossOpenAIgpt-oss:20bMXFP4~14.5 GBExcellent fit
gpt-oss-safeguardOpenAIgpt-oss-safeguard:20bMXFP4~14.5 GBExcellent fit
phi4-reasoningMicrosoftphi4-reasoning:14bQ4_K_M~12.4 GBExcellent fit
deepseek-coder-v2DeepSeek AIdeepseek-coder-v2:16b-lite-base-q4_K_MQ4_K_M~11.9 GBExcellent fit
deepseek-v2DeepSeek AIdeepseek-v2:16b-lite-chat-q4_K_MQ4_K_M~11.9 GBExcellent fit
everythinglmOllama Libraryeverythinglm:13b-16k-q4_K_MQ4_K_M~11.4 GBExcellent fit
nexusravenOllama Librarynexusraven:13b-q4_K_MQ4_K_M~11.4 GBExcellent fit

Showing the 25 largest of 193 models that run well.

How these results were calculated

Each model is evaluated at 4K context against 24GB of VRAM, counting model weights, KV cache, compute buffers and runtime overhead, minus a reserve for the display and operating system. Download sizes come from the official Ollama registry.

Reference scenario: Windows 11, 32GB of system RAM, an illustrative 8-core/16-thread CPU and 500GB free disk. Available RAM, driver version and free VRAM are unknown; the engine applies reserves. Supported GPU drivers/backends are assumed installed. Your own machine may differ — RAM, free disk space and whether an acceleration backend is actually installed all change the answer, which is what the PC scan measures directly.

Radeon RX 7900 XTX local AI — frequently asked questions

How many AI models can a Radeon RX 7900 XTX run?
Out of 225 models in the Ollama library, 193 have good/excellent reference fits on a Radeon RX 7900 XTX's 24GB of VRAM at 4K context, and a further 15 run with part of the model offloaded to system RAM, more slowly.
What is the largest AI model a Radeon RX 7900 XTX can run?
The heaviest build that has a good/excellent reference fit is codebooga:34b-v0.1-q4_K_M (34B parameters), needing about 21.5 GB of memory from a 18.8 GB download.
Is 24GB of VRAM enough for local AI?
24GB is enough for 193 of the 225 builds evaluated here, under the stated reference assumptions. Fit alone does not tell you whether a build is suitable for chat, coding or embeddings. Very large models still need either partial CPU offload or a card with more memory.

Compare other graphics cards