Skip to content
localllm

Compare

Compare models side by side

Choose up to 4 models to see their file size, memory, license and third-party evaluations side by side.

Clear all

Type a name to see suggestions. You can also use "Add to compare" on a model page.

Comparison table

Item Anime-Speech-Japanese-Captioner NandemoGHS ✕ Remove
Parameters 30.5B
Architecture qwen3vlmoe
Max context length 65,536
Representative quantization and size Measured Q4_K_M · 18.6 GB
Memory at 8K Estimated 20.2 GB
Memory at 32K Estimated 22.6 GB
VRAM it fits (8K) Estimated VRAM 24 GB+
Smallest quantization (8K) Estimated Q2_K · 11.3 GB → 12.9 GB
License Creative Commons Attribution-NonCommercial 4.0 (CC BY-NC 4.0) Non-commercial
llama.cpp support llama.cpp b6887 and later
Downloads (30 days, total) 2,144
Human preference (LMArena) -
Capabilities (Epoch AI) -
Hard science (GPQA) -