nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4
Text Generation • 33B • Updated • 1.01M • 494
Inference Optimized Checkpoints (with Model Optimizer)
A collection of generative models quantized and optimized for inference with Model Optimizer.
-
-
nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4
Text Generation • 67B • Updated • 444k • 455 -
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4
Text Generation • 18B • Updated • 675k • 190 -
nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-FP8
Text Generation • 124B • Updated • 35.8k • 291 -
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-FP8
Text Generation • 32B • Updated • 125k • 366 -
nvidia/GLM-5.2-NVFP4
Text Generation • 381B • Updated • 44.4k • 329 -
nvidia/DeepSeek-V4-Pro-NVFP4
Text Generation • 1.6T • Updated • 40.6k • 80 -
nvidia/Qwen3.5-397B-A17B-NVFP4
Text Generation • 204B • Updated • 14k • 111 -
nvidia/Kimi-K2.6-NVFP4
Text Generation • Updated • 155k • 47 -
nvidia/Kimi-K2.5-NVFP4
Text Generation • 518B • Updated • 191k • 91 -
nvidia/Qwen3-VL-235B-A22B-Instruct-NVFP4
119B • Updated • 669 • 9 -
nvidia/GLM-5-NVFP4
Text Generation • 435B • Updated • 2.25k • 32 -
nvidia/MiniMax-M2.7-NVFP4
Text Generation • 116B • Updated • 4.12k • 67 -
nvidia/GLM-5.1-NVFP4
Text Generation • 382B • Updated • 2.53k • 47 -
nvidia/diffusiongemma-26B-A4B-it-NVFP4
Text Generation • 14B • Updated • 27.1k • 147 -
nvidia/MiniMax-M3-NVFP4
Text Generation • 220B • Updated • 29.4k • 92 -
nvidia/MiniMax-M2.5-NVFP4
Text Generation • 116B • Updated • 30.3k • 42 -
nvidia/Gemma-4-31B-IT-NVFP4
Text Generation • 21B • Updated • 1.14M • • 587 -
nvidia/Gemma-4-26B-A4B-NVFP4
Text Generation • 14B • Updated • 1.77M • 169 -
nvidia/Wan2.2-T2V-A14B-Diffusers-NVFP4
Text-to-Video • Updated • 16 -
nvidia/Qwen3.6-35B-A3B-NVFP4
Text Generation • 19B • Updated • 4.02M • 678 -
nvidia/DeepSeek-R1-0528-NVFP4-v2
Text Generation • 394B • Updated • 20.3k • 28 -
nvidia/Kimi-K2-Thinking-NVFP4
Text Generation • 519B • Updated • 250k • 41 -
nvidia/Qwen3-Next-80B-A3B-Thinking-NVFP4
Text Generation • Updated • 1.57k • 66 -
nvidia/Qwen3-Next-80B-A3B-Instruct-NVFP4
Text Generation • Updated • 3.43k • 47 -
nvidia/Llama-3.3-70B-Instruct-NVFP4
41B • Updated • 6.95k • 53 -
nvidia/Llama-3.3-70B-Instruct-FP8
71B • Updated • 7.42k • 32 -
nvidia/Qwen3-235B-A22B-FP8
Text Generation • 235B • Updated • 322 • 5 -
nvidia/Llama-3.1-8B-Instruct-NVFP4
5B • Updated • 16.8k • 18 -
nvidia/Llama-3.1-8B-Instruct-FP8
Text Generation • 8B • Updated • 38k • • 43 -
nvidia/Qwen3-30B-A3B-NVFP4
Text Generation • 16B • Updated • 6.56k • 42 -
nvidia/DeepSeek-R1-0528-NVFP4
Text Generation • 397B • Updated • 3.37k • 48 -
nvidia/Qwen3-235B-A22B-NVFP4
Text Generation • 133B • Updated • 31.3k • 28 -
nvidia/Qwen3-32B-NVFP4
Text Generation • 17B • Updated • 10.2k • 26 -
nvidia/Qwen3-14B-NVFP4
Text Generation • 8B • Updated • 36.1k • 20 -
nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-FP8
Any-to-Any • 33B • Updated • 91.4k • 74 -
nvidia/Qwen3-14B-FP8
Text Generation • 15B • Updated • 1.45k • 10 -
nvidia/Qwen3-8B-NVFP4
Text Generation • 5B • Updated • 117k • 30 -
nvidia/Qwen3-8B-FP8
Text Generation • 8B • Updated • 3.57k • 10 -
nvidia/Llama-3_3-Nemotron-Super-49B-v1_5-FP8
Text Generation • 50B • Updated • 9.69k • 34 -
nvidia/Llama-3_1-Nemotron-Ultra-253B-v1-FP8
Text Generation • 253B • Updated • 847 • 16 -
nvidia/Llama-4-Scout-17B-16E-Instruct-NVFP4
56B • Updated • 472 • 37 -
nvidia/Llama-4-Scout-17B-16E-Instruct-FP8
109B • Updated • 4.85k • 18 -
nvidia/Llama-4-Maverick-17B-128E-Instruct-FP8
402B • Updated • 14 • 15 -
nvidia/Phi-4-reasoning-plus-FP8
15B • Updated • 163 • 7 -
nvidia/Qwen2.5-VL-7B-Instruct-NVFP4
Text Generation • 5B • Updated • 1.18M • 28 -
black-forest-labs/FLUX.1-dev-onnx
Text-to-Image • Updated • 109 -
nvidia/DeepSeek-R1-NVFP4
Text Generation • 397B • Updated • 1.86k • 287 -
nvidia/DeepSeek-R1-NVFP4-v2
Text Generation • 394B • Updated • 2.22k • 10 -
nvidia/DeepSeek-V3-0324-NVFP4
Text Generation • 397B • Updated • 9.35k • 23 -
nvidia/Llama-3_3-Nemotron-Super-49B-v1-FP8
Text Generation • 50B • Updated • 952 • 15 -
nvidia/Llama-3.1-70B-Instruct-FP8
Text Generation • 71B • Updated • 4.43k • 21 -
nvidia/Llama-3.1-405B-Instruct-FP8
Text Generation • 406B • Updated • 2.34k • 20 -
nvidia/Llama-3.1-405B-Instruct-NVFP4
230B • Updated • 3.3k • 19 -
nvidia/Phi-4-multimodal-instruct-NVFP4
4B • Updated • 996 • 20 -
nvidia/Phi-4-multimodal-instruct-FP8
6B • Updated • 596 • 9 -
nvidia/Phi-4-reasoning-plus-NVFP4
8B • Updated • 570 • 14 -
nvidia/Qwen2.5-VL-7B-Instruct-FP8
Text Generation • 8B • Updated • 1.71k • 10 -
nvidia/DeepSeek-V3.1-NVFP4
Text Generation • 394B • Updated • 2.98k • 17 -
nvidia/DeepSeek-V3.2-NVFP4
Text Generation • 394B • Updated • 2.29k • 19 -
nvidia/Qwen3-Coder-480B-A35B-Instruct-NVFP4
Text Generation • 241B • Updated • 1.09k • 22 -
nvidia/Qwen3-235B-A22B-Thinking-2507-NVFP4
Text Generation • 120B • Updated • 262 • 8 -
nvidia/Qwen3-235B-A22B-Instruct-2507-NVFP4
Text Generation • 120B • Updated • 1.1k • 13 -
nvidia/GLM-4.7-NVFP4
Text Generation • 183B • Updated • 802 • 19 -
nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-NVFP4
Any-to-Any • 18B • Updated • 70.2k • 205 -
nvidia/Wan2.2-T2V-A14B-Diffusers-FP8
Text-to-Video • Updated • 16 -
stepfun-ai/Step-3.7-Flash-NVFP4
Image-Text-to-Text • 104B • Updated • 2.38k • 67 -
nvidia/Qwen3.5-122B-A10B-NVFP4
Text Generation • 65B • Updated • 40.3k • 65 -
nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4
Text Generation • 561B • Updated • 26.5k • • 378 -
nvidia/DeepSeek-V4-Flash-NVFP4
Text Generation • 291B • Updated • 60k • 119 -
nvidia/Qwen3.6-27B-NVFP4
Text Generation • 18B • Updated • 261k • 447 -
nvidia/Mistral-Medium-3.5-128B-NVFP4
Text Generation • 84B • Updated • 30.8k • 36 -
nvidia/Qwen3.5-397B-A17B-NVFP4-V2
Text Generation • Updated • 39.1k • 18 -
nvidia/Kimi-K2.7-Code-NVFP4
Text Generation • Updated • 4.36k • 19 -
thinkingmachines/Inkling-NVFP4
Image-Text-to-Text • 553B • Updated • 35.4k • 100 -
nvidia/Qwen-Image-Flash
Text-to-Image • 20B • Updated • 307 • 97 -
nvidia/Kimi-K3-NVFP4
Text Generation • 1.4T • Updated • 5.85k • 42 -
LGAI-EXAONE/K-EXAONE-2.0-750B-A37B-NVFP4
Text Generation • 411B • Updated • 444 • 36 -
nvidia/Qwen3.8-2.4T-A95B-NVFP4
Text Generation • 1.3T • Updated • 2.97k • 24 -
nvidia/DeepSeek-V4-Pro-0813-NVFP4
Text Generation • 1.7T • Updated • 804 • 21 -
nvidia/DeepSeek-V4-Flash-0731-NVFP4
Text Generation • 304B • Updated • 2.24k • 57 -
nvidia/Muse-Glimmer-30B-NVFP4
Image-Text-to-Text • 20B • Updated • 3.44k • 29 -
nvidia/Qwen3.8-Flash-Next-NVFP4
Image-Text-to-Text • 120B • Updated • 163k • 448 -
nvidia/Qwen3.8-27B-NVFP4
Text Generation • 18B • Updated • 267k • 236 -
nvidia/GLM-5.3-Flash-NVFP4
Image-Text-to-Text • 321B • Updated • 101k • 182 -
nvidia/DeepSeek-V4.1-Flash-NVFP4
Image-Text-to-Text • 763B • Updated • 33.2k • 128 -
nvidia/GLM-5.3-NVFP4
Text Generation • 391B • Updated • 246k • 48 -
nvidia/Qwen-Image-NVFP4
Text-to-Image • 12B • Updated • 112 • 10 -
nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-NVFP4
Image-Text-to-Text • 66B • Updated • 58.5k • • 267 -
nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16
Image-Text-to-Text • 124B • Updated • 73.8k • 119 -
nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-NVFP4-LiLiCorr
Text Generation • 1.0B • Updated • 6.73k • 12 -
stepfun-ai/Step-5-Preview-NVFP4
321B • Updated • 1.57k • 18 -
nvidia/Muse-Spark-Open-816B-A42B-DFlash2
Image-Text-to-Text • 4B • Updated • 2.63k • 9 -
nvidia/DeepSeek-V4.1-Flash-1017-NVFP4
Image-Text-to-Text • 665B • Updated • 9.12k • 188