Skip to content
localllm

Compare

Compare models side by side

Choose up to 4 models to see their file size, memory, license and third-party evaluations side by side.

Clear all

Type a name to see suggestions. You can also use "Add to compare" on a model page.

Comparison table

Item Llama-3-ELYZA-hermes-2x8B keitokei1994 ✕ Remove
Parameters 13.7B
Architecture llama
Max context length 8,192
Representative quantization and size Measured Q4_K_M · 8.33 GB
Memory at 8K Estimated 10.2 GB
Memory at 32K Estimated -
VRAM it fits (8K) Estimated VRAM 12 GB+
Smallest quantization (8K) Estimated Q4_K_S · 7.89 GB → 9.77 GB
License Meta Llama 3 Community License Conditional
llama.cpp support Supported before llama.cpp b4409
Downloads (30 days, total) 105
Human preference (LMArena) -
Capabilities (Epoch AI) -
Hard science (GPQA) -