GeForce RTX 4050 Laptop GPU

With 6 GB

One entry per model, up to 30, sorted by popularity. For each model we show the largest (most precise) quantization that fits in this memory with a context of at least 8K tokens. The context length is the longest one that quantization fits (for models whose maximum is under 8K, such as embedding models, that maximum). Models that are not for chat or text generation are labelled with their use. "Left" is the memory minus the estimate; under 5% of the memory is marked "tight" (not a guarantee that it fits).

• gemma-4-12B-it IQ2_S Image input
  Context length 8,192 Estimated 6.42 GB 0.02 GB left (tight)
• mxbai-embed-large-v1 F32 Embedding (not for chat)
  Context length 512 Estimated 2.41 GB 4.03 GB left
• Qwen3.5-9B-The-Defiant-Fable-Uncensored-Heretic-NEO-IMATRIX-MAX-MTP IQ2_M Image input
  Context length 8,192 Estimated 6.31 GB 0.13 GB left (tight)
• MOSS-Music-8B-Instruct F16 Speech / audio
  Context length 16,384 Estimated 4.99 GB 1.45 GB left
• Qwen3.5-9B UD-Q3_K_XL Image input
  Context length 8,192 Estimated 6.42 GB 0.02 GB left (tight)
• Ornith-1.5-9B-uncensored Q3_K_L
  Context length 8,192 Estimated 6.29 GB 0.15 GB left (tight)
• Qwen3.5-4B Q8_0 Image input
  Context length 16,384 Estimated 6.26 GB 0.19 GB left (tight)
• Wan2.1 Q4_K_M
  Context length 32,768 Estimated 6.10 GB 0.34 GB left
• Qwen3-ASR-1.7B F16 Speech / audio
  Context length 8,192 Estimated 5.88 GB 0.56 GB left
• gemma-4-E4B-it-qat-q4_0 Q4_0 Image input
  Context length 8,192 Estimated 6.40 GB 0.04 GB left (tight)
• Ternary-Bonsai-2-9B Q8_0 Image input
  Context length 65,536 Estimated 5.92 GB 0.52 GB left
• HyperCLOVAX-SEED-Text-Instruct-1.5B-Q4_K_M Q4_K_M
  Context length 32,768 Estimated 5.12 GB 1.32 GB left
• Hy-MT2-7B Q4_K_M
  Context length 4,096 Estimated 5.96 GB 0.48 GB left
• Ternary-Bonsai-2-2B Q2_0 Image input
  Context length 262,144 Estimated 4.83 GB 1.61 GB left
• MiMo-V2.6-Distill-Qwen-9B IQ3_M Image input
  Context length 8,192 Estimated 6.21 GB 0.23 GB left (tight)
• Cyber-Ornith-1.5-9B-OBLITERATED Q3_K_L
  Context length 8,192 Estimated 6.29 GB 0.15 GB left (tight)
• Sharp-Spark-X2.5-4B Q6_K_XL
  Context length 32,768 Estimated 5.74 GB 0.70 GB left
• AdaVaR-3B Q8_0
  Context length 32,768 Estimated 5.34 GB 1.10 GB left
• Qwen3.5-9B-Kimi-k3-Distilled Q3_K_L
  Context length 8,192 Estimated 6.42 GB 0.03 GB left (tight)
• Qwen3-4B-Instruct-2507 Q8_0
  Context length 8,192 Estimated 6.34 GB 0.11 GB left (tight)
• B1-9B Q3_K_L
  Context length 8,192 Estimated 6.42 GB 0.03 GB left (tight)
• Qwen3-VL-4B-Instruct Q8_0 Image input
  Context length 8,192 Estimated 6.34 GB 0.11 GB left (tight)
• Qwen2.5-7B-Instruct Q4_K_L
  Context length 8,192 Estimated 6.41 GB 0.04 GB left (tight)
• Qwen3-4B Q8_0
  Context length 8,192 Estimated 6.34 GB 0.11 GB left (tight)
• Qwen-Image-2.1-Turbo-Uncensored Q3_K Image / video generation
  Context length 8,192 Estimated 6.24 GB 0.20 GB left (tight)
• gemma-4-E4B-it UD-Q4_K_XL Image input
  Context length 8,192 Estimated 6.38 GB 0.07 GB left (tight)
• gemma-4-E2B-it UD-Q8_K_XL Image input
  Context length 8,192 Estimated 6.42 GB 0.02 GB left (tight)
• Spark-X2.6-4B Q8_0
  Context length 16,384 Estimated 5.90 GB 0.54 GB left
• Gemma-4-E4B-Uncensored-HauhauCS-Aggressive IQ4_XS Image input
  Context length 8,192 Estimated 6.32 GB 0.12 GB left (tight)
• Qwen3-VL-8B-Instruct-abliterated Q3_K_M
  Context length 8,192 Estimated 6.41 GB 0.04 GB left (tight)