GeForce RTX 5090

With 32 GB

One entry per model, up to 30, sorted by popularity. For each model we show the largest (most precise) quantization that fits in this memory with a context of at least 8K tokens. The context length is the longest one that quantization fits (for models whose maximum is under 8K, such as embedding models, that maximum). Models that are not for chat or text generation are labelled with their use. "Left" is the memory minus the estimate; under 5% of the memory is marked "tight" (not a guarantee that it fits).

• Qwen3.8-27B UD-Q8_K_XL
  Context length 16,384 Estimated 33.7 GB 0.63 GB left (tight) Speed 34–46
• Ornith-1.5-9B BF16
  Context length 262,144 Estimated 28.1 GB 6.24 GB left Speed 58–78
• Huihui-Qwen3.6-35B-A3B-abliterated-MTP Q6_K Image input
  Context length 131,072 Estimated 33.0 GB 1.36 GB left (tight) Speed not estimated (MoE)
• Ornith-1.5-35B-A3B Q6_K_L Image input
  Context length 65,536 Estimated 33.2 GB 1.13 GB left (tight) Speed not estimated (MoE)
• Huihui-Qwen3.8-27B-abliterated UD-Q8_K_XL Image input
  Context length 16,384 Estimated 33.7 GB 0.63 GB left (tight) Speed 34–46
• OTel-2.0-Decision-26B-A4B-4bit Q8_0
  Context length 262,144 Estimated 33.6 GB 0.74 GB left (tight) Speed not estimated (MoE)
• Qwen3.8-27B-iMatrix-NVFP4-MTP NVFP4 Image input
  Context length 131,072 Estimated 26.9 GB 7.44 GB left Speed 63–84
• Tiel-Coder-35B-A3B-GGUF-MTP UD-Q6_K_XL Image input
  Context length 32,768 Estimated 34.0 GB 0.34 GB left (tight) Speed not estimated (MoE)
• gemma-4-12B-it BF16 Image input
  Context length 262,144 Estimated 29.7 GB 4.66 GB left Speed 45–60
• Qwen3.8-27B-Uncensored Q8_0
  Context length 32,768 Estimated 32.4 GB 1.96 GB left Speed 37–49
• Ornith-1.0-9B BF16
  Context length 262,144 Estimated 27.6 GB 6.72 GB left Speed 60–80
• mxbai-embed-large-v1 F32 Embedding (not for chat)
  Context length 512 Estimated 2.41 GB 31.9 GB left Speed 804–1,072
• Qwen3.6-35B-A3B-MTP UD-Q6_K_XL Image input
  Context length 16,384 Estimated 34.1 GB 0.30 GB left (tight) Speed not estimated (MoE)
• Qwen3.5-9B-The-Defiant-Fable-Uncensored-Heretic-NEO-IMATRIX-MAX-MTP BF16 Image input
  Context length 262,144 Estimated 28.1 GB 6.26 GB left Speed 58–78
• MOSS-Music-8B-Instruct F16 Speech / audio
  Context length 40,960 Estimated 23.3 GB 11.1 GB left Speed 66–87
• Qwen3.8-27B-Uncensored-HauhauCS-Aggressive-MTP Q8_K Image input
  Context length 16,384 Estimated 33.7 GB 0.63 GB left (tight) Speed 34–46
• gemma-4-26B-A4B-it UD-Q8_K_XL Image input
  Context length 131,072 Estimated 31.7 GB 2.65 GB left Speed not estimated (MoE)
• Qwen3-VL-8B-Instruct BF16 Image input
  Context length 65,536 Estimated 26.9 GB 7.46 GB left Speed 66–87
• Qwen3.5-9B BF16 Image input
  Context length 262,144 Estimated 28.1 GB 6.26 GB left Speed 58–78
• Ornith-1.5-9B-uncensored F16
  Context length 262,144 Estimated 27.6 GB 6.75 GB left Speed 60–80
• Qwen3.6-35B-A3B UD-Q6_K_XL Image input
  Context length 65,536 Estimated 34.3 GB 0.06 GB left (tight) Speed not estimated (MoE)
• Ternary-Bonsai-2-27B Q2_0
  Context length 262,144 Estimated 26.0 GB 8.35 GB left Speed 141–188
• Swift-1.5-Qwen3.8-27B-GSQ-RCO IQ3_S
  Context length 262,144 Estimated 30.5 GB 3.86 GB left Speed 89–118
• Qwen3.5-4B BF16 Image input
  Context length 262,144 Estimated 18.4 GB 16.0 GB left Speed 124–165
• Ornith-1.0-35B Q6_K
  Context length 131,072 Estimated 32.3 GB 2.02 GB left Speed not estimated (MoE)
• Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NEO-CODER-MAX-MTP Q8_0 Image input
  Context length 32,768 Estimated 33.6 GB 0.77 GB left (tight) Speed 36–47
• Dirk-Qwen3.8-27B UD-Q8_K_XL Image input
  Context length 16,384 Estimated 33.7 GB 0.63 GB left (tight) Speed 34–46
• Wan2.1 IQ4_NL
  Context length 65,536 Estimated 34.3 GB 0.03 GB left (tight) Speed 37–50
• Qwen3.8-27B-GSQ-RCO IQ3_S Image input
  Context length 262,144 Estimated 30.5 GB 3.86 GB left Speed 89–118
• Qwen3-ASR-1.7B F16 Speech / audio
  Context length 65,536 Estimated 12.5 GB 21.9 GB left Speed 263–350