Skip to content
localllm

Compare

Compare models side by side

Choose up to 4 models to see their file size, memory, license and third-party evaluations side by side.

Clear all

Type a name to see suggestions. You can also use "Add to compare" on a model page.

Comparison table

Item Sage-A1.5-Q8_0 InternScience ✕ Remove
Parameters 35.5B
Architecture qwen35moe
Max context length 262,144
Representative quantization and size Measured Q8_0 · 37.8 GB
Memory at 8K Estimated 39.1 GB
Memory at 32K Estimated 39.6 GB
VRAM it fits (8K) Estimated VRAM 48 GB+
Smallest quantization (8K) Estimated Q8_0 · 37.8 GB → 39.1 GB
License Apache License 2.0 Commercial OK
llama.cpp support llama.cpp b7990 and later
Downloads (30 days, total) 508,308
Human preference (LMArena) -
Capabilities (Epoch AI) -
Hard science (GPQA) -