Skip to content
localllm
日本語

Apple Silicon (Mac)

Apple M6

Data as of

Source
Checked:

With 16 GB

One entry per model, up to 30, sorted by popularity. For each model we show the largest (most precise) quantization that fits in this memory with a context of at least 8K tokens. The context length is the longest one that quantization fits (for models whose maximum is under 8K, such as embedding models, that maximum). Models that are not for chat or text generation are labelled with their use. "Left" is the memory minus the estimate; under 5% of the memory is marked "tight" (not a guarantee that it fits).

With 24 GB

One entry per model, up to 30, sorted by popularity. For each model we show the largest (most precise) quantization that fits in this memory with a context of at least 8K tokens. The context length is the longest one that quantization fits (for models whose maximum is under 8K, such as embedding models, that maximum). Models that are not for chat or text generation are labelled with their use. "Left" is the memory minus the estimate; under 5% of the memory is marked "tight" (not a guarantee that it fits).

With 32 GB

One entry per model, up to 30, sorted by popularity. For each model we show the largest (most precise) quantization that fits in this memory with a context of at least 8K tokens. The context length is the longest one that quantization fits (for models whose maximum is under 8K, such as embedding models, that maximum). Models that are not for chat or text generation are labelled with their use. "Left" is the memory minus the estimate; under 5% of the memory is marked "tight" (not a guarantee that it fits).

Frequently asked questions

Which local LLMs run on Apple M6?
On this site, 965 models have a quantization that fits in 32 GB at 8,192 tokens (estimated). Popular ones include Qwen3.8-27B, Ornith-1.5-9B, Huihui-Qwen3.6-35B-A3B-abliterated-MTP, Ornith-1.5-35B-A3B, Huihui-Qwen3.8-27B-abliterated.
What is the largest model that runs on Apple M6?
Among the models listed here, Mixtral-8x22B-Instruct-v0.1 (about 140.6B); IQ1_S fits in 32 GB (estimated at 8,192 tokens).