Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

14,882

Base only

Active filters: quantized

ReallyFloppyPenguin/Polaris-4B-Preview-GGUF

4B • Updated Jun 23, 2025 • 68

ReallyFloppyPenguin/Arch-Agent-7B-GGUF

8B • Updated Jun 23, 2025 • 77

ReallyFloppyPenguin/Nanonets-OCR-s-GGUF

3B • Updated Jun 23, 2025 • 70

kanrishaurus/llama3-8b-sahabatai-v1-instruct-GGUF

Text Generation • 8B • Updated Jun 23, 2025 • 1

steampunque/Qwen2.5-VL-7B-Instruct-MP-GGUF

8B • Updated Feb 18 • 86

TheMelonGod/Jan-nano-exl2

Text Generation • Updated Jun 30, 2025 • 6

NVFP4/DeepSeek-Prover-V2-7B-FP4

4B • Updated Jul 23, 2025 • 6 • 1

NVFP4/DeepSeek-R1-0528-Qwen3-8B-FP4

5B • Updated Jul 23, 2025 • 63 • 2

NVFP4/Qwen3-32B-FP4

Text Generation • 19B • Updated Jul 23, 2025 • 1.08k • 3

NVFP4/Polaris-4B-Preview-FP4

2B • Updated Jul 23, 2025 • 47 • 1

NVFP4/Polaris-7B-Preview-FP4

5B • Updated Jul 23, 2025 • 6 • 1

hdtrnk/Wan2.1_Phantom_FusioniX

Image-to-Video • Updated Jun 25, 2025 • 3

muranAI/DeepSeek-R1-0528-Qwen3-8B-GGUF

8B • Updated Jun 28, 2025 • 194 • 1

hrsvrn/Flux.1-kontext-dev-gguf

12B • Updated Jun 26, 2025 • 5

onnx-community/distiluse-base-multilingual-v2-merged-onnx

Feature Extraction • Updated Jun 26, 2025 • 1

muranAI/gemma-3n-E4B-it-GGUF

Text Generation • 7B • Updated Jun 28, 2025 • 1.22k • 3

agentlans/gemma-3-4b-it-GGUF

4B • Updated Jun 27, 2025 • 31

lym00/Wan2.1_T2V_1.3B_SelfForcing_VACE-GGUF

Image-to-Video • 2B • Updated Jun 28, 2025 • 593 • 4

muranAI/Mistral-Small-3.1-24B-Instruct-2503-GGUF

Text Generation • 24B • Updated Jun 28, 2025 • 167 • 1

vnyaryan/playwright4model_q4_k_m

Text Generation • 3B • Updated Jun 28, 2025 • 12

vnyaryan/playwright5model_q4_k_m

Text Generation • 3B • Updated Jun 28, 2025 • 10

LibraxisAI/Llama-3_1-Nemotron-Ultra-253B-v1-MLX-Q5

Text Generation • 253B • Updated May 11 • 104

agentlans/Qwen3-4B-multilingual-sft

4B • Updated Jun 29, 2025 • 8

agentlans/Qwen3-4B-multilingual-sft-GGUF

Text Generation • 4B • Updated Jun 29, 2025 • 29

RedHatAI/Qwen3-30B-A3B-FP8-block

Text Generation • 31B • Updated Oct 27, 2025 • 8.54k

TheMelonGod/Irixxed-Magcap-12B-Slerp-exl2

Text Generation • Updated Jul 1, 2025 • 11

mlx-community/Qwen3-32B-3bit

33B • Updated Jul 1, 2025 • 26 • 2

steampunque/ultravox-v0_5-llama-3_1-8b-MP-GGUF

8B • Updated Feb 18 • 18

ReallyFloppyPenguin/OCRFlux-3B-GGUF

3B • Updated Jul 2, 2025 • 30 • 1

QuantStack/MAGREF_Wan2.1_I2V_14B-GGUF

Image-to-Video • 16B • Updated Jul 2, 2025 • 624 • 12