Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42

Base only

Active filters: iq4_xs

Solstice-AI/Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-GGUF-UltraOptimised-DSpark-MTP

Image-Text-to-Text • 27B • Updated 26 days ago • 14k • 14

geantendormi/K2-Horizon-7B-Uno-Uncensored-GGUF

Text Generation • 9B • Updated 17 days ago • 4.38k • 3

cygnal/Qwen3.8-Flash-Next-Heretic2-IQ4XS-NGQ4-GGUF

Image-Text-to-Text • 177B • Updated 15 days ago • 4.77k • 6

kataguru/Qwen3.8-27B-Titan-v3.2-GGUF

Text Generation • 27B • Updated 3 days ago • 809 • 1

Deaquay/T-Rex-mini-IQ4_XS-GGUF

8B • Updated Apr 9, 2025 • 13

Deaquay/T-Rex-mini-I1-GGUF

8B • Updated Apr 9, 2025 • 121

Ex0bit/Elbaz-Prime-Intellect-3_Prism_Abliterated

Text Generation • 107B • Updated Dec 3, 2025 • 108 • 5

kaushall13/Qwen3.5-9B-GGUF-SBGQ

Text Generation • 9B • Updated Mar 26 • 41

ospost/gpt-oss-20b-sft-GGUF

21B • Updated Apr 1 • 48

dxx117/MiniMax-M2.7-IQ4_XS-HQ-GGUF

Text Generation • 229B • Updated Apr 14 • 18

end000/Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-IQ4_XS-GGUF

Text Generation • 35B • Updated Apr 19 • 37 • 1

Krasnopjorovs/Qwen3.6-35B-A3B-IQ4_XS-Imatrix

Text Generation • 35B • Updated Apr 22 • 48 • 1

andreribeiro87/telco-troubleshooting-agentic-challenge-gguf

Text Generation • 35B • Updated May 3 • 55

localweights/Qwen3.6-27B-MTP-IQ4_XS-GGUF

27B • Updated May 7 • 97 • 5

localweights/Qwen3.6-35B-A3B-MTP-IQ4_XS-GGUF

36B • Updated May 7 • 389 • 4

zaydiscold/Qwopus3.6-27B-v2-IQ4_XS-GGUF

27B • Updated May 23 • 22 • 1

prokopsafranek/gemma-4-26B-A4B-it-GGUF

Text Generation • 25B • Updated Jun 4 • 132 • 1

KeinNiemand/Kuwutu-7B-CYOA-GGUF

Text Generation • 8B • Updated Jun 17 • 134

jairo/Llama-3.1-70B-LatamGPT-SFT-1.0-GGUF

Text Generation • 71B • Updated Jun 7 • 298 • 1

pearsonkyle/Qwopus3.6-27B-Coder-imatrix-MTP-GGUF

Text Generation • 27B • Updated Jun 25 • 156 • 5

wepiqx/gemma-4-12B-it-SHQ6-GGUF

Text Generation • 12B • Updated Jun 23 • 190 • 1

wepiqx/gemma-4-12B-OBLITERATED-SHQ7-GGUF

Text Generation • 12B • Updated Jun 23 • 248 • 3

pearsonkyle/tmax-27b-imatrix-MTP-GGUF

Text Generation • 27B • Updated Jul 2 • 276 • 1

pearsonkyle/Ornith-1.0-9B-imatrix-GGUF

Text Generation • 9B • Updated Jul 11 • 371 • 2

xero0000/Gemma-4-26B-A4B-it-vram14-iq4xs-imat

Text Generation • 25B • Updated Jul 19 • 90 • 1

Abiray/Laguna-S-2.1-IQ4_XS-Q4_K_M-GGUF

Text Generation • 84B • Updated Jul 22 • 99 • 13

pearsonkyle/Qwen3.8-27B-imatrix-MTP-GGUF

Image-Text-to-Text • 27B • Updated Aug 15 • 2.19k • 10

Verkiki/Qwen3.8-27b-Fable5-Distill-Abliterated-GGUF

Text Generation • 0.5B • Updated Aug 18 • 568 • 5

Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF

Text Generation • 27B • Updated Aug 18 • 2.34k • 2

Hob-forge/Qwen3.5-4B-Instruct-GGUF

Text Generation • 4B • Updated Aug 22 • 1.11k • 1