Apple Silicon (Mac)
Apple M5 Pro
Data as of
- Memory bandwidth
- 307 GB/s
- Source
- Checked:
With 24 GB
One entry per model, up to 30, sorted by popularity. For each model we show the largest (most precise) quantization that fits in this memory with a context of at least 8K tokens. The context length is the longest one that quantization fits (for models whose maximum is under 8K, such as embedding models, that maximum). Models that are not for chat or text generation are labelled with their use. "Left" is the memory minus the estimate; under 5% of the memory is marked "tight" (not a guarantee that it fits).
-
Context length 8,192 Estimated 25.6 GB 0.17 GB left (tight) Speed 7.7–10
-
Ornith-1.5-9B BF16Context length 131,072 Estimated 23.8 GB 1.94 GB left Speed 10–13
-
Context length 131,072 Estimated 25.5 GB 0.26 GB left (tight) Speed not estimated (MoE)
-
Context length 65,536 Estimated 24.9 GB 0.87 GB left (tight) Speed not estimated (MoE)
-
Context length 8,192 Estimated 25.7 GB 0.09 GB left (tight) Speed 7.7–10
-
Context length 262,144 Estimated 23.6 GB 2.22 GB left Speed not estimated (MoE)
-
Context length 65,536 Estimated 22.6 GB 3.15 GB left Speed 11–14
-
Context length 65,536 Estimated 25.2 GB 0.57 GB left (tight) Speed not estimated (MoE)
-
Context length 16,384 Estimated 25.7 GB 0.09 GB left (tight) Speed 7.7–10
-
Context length 16,384 Estimated 24.7 GB 1.06 GB left (tight) Speed 8.2–11
-
Ornith-1.0-9B BF16Context length 131,072 Estimated 23.3 GB 2.43 GB left Speed 10–14
-
Context length 512 Estimated 2.41 GB 23.4 GB left Speed 138–184
-
Context length 65,536 Estimated 25.3 GB 0.46 GB left (tight) Speed not estimated (MoE)
-
Context length 131,072 Estimated 23.8 GB 1.97 GB left Speed 10–13
-
Context length 40,960 Estimated 23.3 GB 2.49 GB left Speed 11–15
-
Context length 65,536 Estimated 25.7 GB 0.05 GB left (tight) Speed 9.1–12
-
Context length 32,768 Estimated 25.4 GB 0.42 GB left (tight) Speed not estimated (MoE)
-
Context length 32,768 Estimated 22.1 GB 3.70 GB left Speed 11–15
-
Context length 131,072 Estimated 23.8 GB 1.97 GB left Speed 10–13
-
Context length 131,072 Estimated 23.3 GB 2.46 GB left Speed 10–14
-
Context length 65,536 Estimated 25.3 GB 0.45 GB left (tight) Speed not estimated (MoE)
-
Ternary-Bonsai-2-27B Q2_0Context length 131,072 Estimated 17.4 GB 8.35 GB left Speed 24–32
-
Context length 131,072 Estimated 21.9 GB 3.86 GB left Speed 15–20
-
Context length 262,144 Estimated 18.4 GB 7.42 GB left Speed 21–28
-
Ornith-1.0-35B Q4_K_MContext length 131,072 Estimated 25.0 GB 0.78 GB left (tight) Speed not estimated (MoE)
-
Context length 8,192 Estimated 25.3 GB 0.45 GB left (tight) Speed 7.8–10
-
Context length 32,768 Estimated 25.3 GB 0.44 GB left (tight) Speed 8.4–11
-
Wan2.1 Q4_K_MContext length 65,536 Estimated 22.3 GB 3.43 GB left Speed 11–15
-
Context length 131,072 Estimated 21.9 GB 3.86 GB left Speed 15–20
-
Context length 65,536 Estimated 12.5 GB 13.3 GB left Speed 45–60
With 48 GB
One entry per model, up to 30, sorted by popularity. For each model we show the largest (most precise) quantization that fits in this memory with a context of at least 8K tokens. The context length is the longest one that quantization fits (for models whose maximum is under 8K, such as embedding models, that maximum). Models that are not for chat or text generation are labelled with their use. "Left" is the memory minus the estimate; under 5% of the memory is marked "tight" (not a guarantee that it fits).
-
Qwen3.8-27B UD-Q8_K_XLContext length 262,144 Estimated 49.8 GB 1.70 GB left (tight) Speed 5.9–7.8
-
Ornith-1.5-9B BF16Context length 262,144 Estimated 28.1 GB 23.4 GB left Speed 10–13
-
Context length 262,144 Estimated 44.3 GB 7.26 GB left Speed not estimated (MoE)
-
Context length 262,144 Estimated 44.3 GB 7.25 GB left Speed not estimated (MoE)
-
Context length 131,072 Estimated 48.6 GB 2.97 GB left Speed 4.7–6.3
-
Context length 262,144 Estimated 33.6 GB 17.9 GB left Speed not estimated (MoE)
-
Context length 262,144 Estimated 35.5 GB 16.0 GB left Speed 11–14
-
Context length 262,144 Estimated 45.3 GB 6.22 GB left Speed not estimated (MoE)
-
Context length 262,144 Estimated 29.7 GB 21.8 GB left Speed 7.7–10
-
Context length 262,144 Estimated 47.4 GB 4.11 GB left Speed 6.3–8.5
-
Ornith-1.0-9B BF16Context length 262,144 Estimated 27.6 GB 23.9 GB left Speed 10–14
-
Context length 512 Estimated 2.41 GB 49.1 GB left Speed 138–184
-
Context length 262,144 Estimated 45.6 GB 5.96 GB left Speed not estimated (MoE)
-
Context length 262,144 Estimated 28.1 GB 23.4 GB left Speed 10–13
-
Context length 40,960 Estimated 23.3 GB 28.3 GB left Speed 11–15
-
Context length 262,144 Estimated 49.8 GB 1.70 GB left (tight) Speed 5.9–7.8
-
Context length 262,144 Estimated 34.4 GB 17.1 GB left Speed not estimated (MoE)
-
Context length 131,072 Estimated 36.6 GB 15.0 GB left Speed 11–15
-
Context length 262,144 Estimated 28.1 GB 23.4 GB left Speed 10–13
-
Context length 262,144 Estimated 27.6 GB 23.9 GB left Speed 10–14
-
Context length 262,144 Estimated 44.9 GB 6.61 GB left Speed not estimated (MoE)
-
Ternary-Bonsai-2-27B Q2_0Context length 262,144 Estimated 26.0 GB 25.5 GB left Speed 24–32
-
Context length 262,144 Estimated 30.5 GB 21.0 GB left Speed 15–20
-
Context length 262,144 Estimated 18.4 GB 33.2 GB left Speed 21–28
-
Ornith-1.0-35B Q8_0Context length 262,144 Estimated 43.4 GB 8.13 GB left Speed not estimated (MoE)
-
Context length 262,144 Estimated 48.6 GB 2.92 GB left Speed 6.1–8.1
-
Context length 262,144 Estimated 49.8 GB 1.70 GB left (tight) Speed 5.9–7.8
-
Wan2.1 IQ4_NLContext length 262,144 Estimated 47.2 GB 4.33 GB left Speed 6.4–8.5
-
Context length 262,144 Estimated 30.5 GB 21.0 GB left Speed 15–20
-
Context length 65,536 Estimated 12.5 GB 39.1 GB left Speed 45–60
With 64 GB
One entry per model, up to 30, sorted by popularity. For each model we show the largest (most precise) quantization that fits in this memory with a context of at least 8K tokens. The context length is the longest one that quantization fits (for models whose maximum is under 8K, such as embedding models, that maximum). Models that are not for chat or text generation are labelled with their use. "Left" is the memory minus the estimate; under 5% of the memory is marked "tight" (not a guarantee that it fits).
-
Context length 32,768 Estimated 68.5 GB 0.23 GB left (tight) Speed not estimated (MoE)
-
Qwen3.8-27B BF16Context length 131,072 Estimated 64.4 GB 4.27 GB left Speed 3.4–4.5
-
Ornith-1.5-9B BF16Context length 262,144 Estimated 28.1 GB 40.6 GB left Speed 10–13
-
Context length 262,144 Estimated 44.3 GB 24.4 GB left Speed not estimated (MoE)
-
Context length 16,384 Estimated 68.4 GB 0.28 GB left (tight) Speed not estimated (MoE)
-
Context length 262,144 Estimated 44.3 GB 24.4 GB left Speed not estimated (MoE)
-
Context length 131,072 Estimated 64.4 GB 4.27 GB left Speed 3.4–4.5
-
Context length 262,144 Estimated 33.6 GB 35.1 GB left Speed not estimated (MoE)
-
Context length 262,144 Estimated 35.5 GB 33.2 GB left Speed 11–14
-
Context length 262,144 Estimated 45.3 GB 23.4 GB left Speed not estimated (MoE)
-
Context length 262,144 Estimated 29.7 GB 39.0 GB left Speed 7.7–10
-
Context length 262,144 Estimated 47.4 GB 21.3 GB left Speed 6.3–8.5
-
Ornith-1.0-9B BF16Context length 262,144 Estimated 27.6 GB 41.1 GB left Speed 10–14
-
Context length 512 Estimated 2.41 GB 66.3 GB left Speed 138–184
-
Context length 262,144 Estimated 45.6 GB 23.1 GB left Speed not estimated (MoE)
-
Context length 262,144 Estimated 28.1 GB 40.6 GB left Speed 10–13
-
Context length 40,960 Estimated 23.3 GB 45.4 GB left Speed 11–15
-
Context length 262,144 Estimated 49.8 GB 18.9 GB left Speed 5.9–7.8
-
Context length 262,144 Estimated 57.3 GB 11.5 GB left Speed not estimated (MoE)
-
Context length 262,144 Estimated 55.9 GB 12.8 GB left Speed 11–15
-
Context length 32,768 Estimated 68.4 GB 0.27 GB left (tight) Speed not estimated (MoE)
-
Context length 262,144 Estimated 28.1 GB 40.6 GB left Speed 10–13
-
Context length 262,144 Estimated 27.6 GB 41.1 GB left Speed 10–14
-
Context length 262,144 Estimated 44.9 GB 23.8 GB left Speed not estimated (MoE)
-
Context length 131,072 Estimated 63.6 GB 5.12 GB left Speed 3.4–4.6
-
Context length 262,144 Estimated 30.5 GB 38.2 GB left Speed 15–20
-
Context length 262,144 Estimated 18.4 GB 50.4 GB left Speed 21–28
-
Ornith-1.0-35B Q8_0Context length 262,144 Estimated 43.4 GB 25.3 GB left Speed not estimated (MoE)
-
Context length 262,144 Estimated 48.6 GB 20.1 GB left Speed 6.1–8.1
-
Context length 262,144 Estimated 49.8 GB 18.9 GB left Speed 5.9–7.8
Frequently asked questions
- Which local LLMs run on Apple M5 Pro?
- On this site, 998 models have a quantization that fits in 64 GB at 8,192 tokens (estimated). Popular ones include Qwen3.8-27B, Qwen3.8-Flash-Next-GSQ-RCO, Ornith-1.5-9B, Huihui-Qwen3.6-35B-A3B-abliterated-MTP, Ornith-1.5-35B-A3B.
- What is the largest model that runs on Apple M5 Pro?
- Among the models listed here, Grok-1 (about 316.5B); IQ1_S fits in 64 GB (estimated at 8,192 tokens).
- How fast does Apple M5 Pro generate text?
- With 307 GB/s of memory bandwidth, Qwen3.8-27B at BF16 (54.7 GB) runs at an estimated 3.4–4.5 tokens per second (60–80% of bandwidth ÷ file size; prompt processing not included).