Skip to content
localllm

Compare

Compare models side by side

Choose up to 4 models to see their file size, memory, license and third-party evaluations side by side.

Clear all

Type a name to see suggestions. You can also use "Add to compare" on a model page.

Comparison table

Item NVIDIA-Nemotron-3.5-Transcribe-30B-A4B nvidia ✕ Remove
Parameters 32.9B
Architecture nemotron_h_moe
Max context length 1,048,576
Representative quantization and size Measured F16 · 1.67 GB
Memory at 8K Estimated 2.58 GB
Memory at 32K Estimated 2.73 GB
VRAM it fits (8K) Estimated VRAM 4 GB+
Smallest quantization (8K) Estimated F16 · 1.67 GB → 2.58 GB
License OpenMDW License 1.1 Commercial OK
llama.cpp support llama.cpp b7418 and later
Downloads (30 days, total) 153,778
Human preference (LMArena) -
Capabilities (Epoch AI) -
Hard science (GPQA) -