Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

61

Base only

Active filters: iq2_xxs

huihui-ai/Huihui-DeepSeek-V4-Flash-0731-abliterated-GGUF

Text Generation • 284B • Updated Aug 3 • 366k • 215

DogContext/GLM-5.3-Flash-Uncensored-Q2-ds4

Text Generation • 321B • Updated 13 days ago • 29.9k • 14

autotrust/GLM-5.3-Flash-GGUF-DGX-Spark

Text Generation • 279B • Updated 12 days ago • 2.62k • 2

huihui-ai/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated Jun 6 • 167k • 144

zenlm/zen5-max-gguf

Text Generation • 1.6T • Updated Jul 14 • 85 • 2

apetersson/DeepSeek-V4-Flash-0731-Abliterated-DS4-Headroom128

Text Generation • 284B • Updated Aug 1 • 3.84k • 35

Baekpica/dots3-note-prev-Mixed-Quant-GGUF

Text Generation • 281B • Updated 28 days ago • 306 • 3

cdtio33/Ornith-1.5-397B-IQ2_XXS-DFlash-Drafter-GGUF

Text Generation • 1B • Updated 1 day ago • 334 • 1

autotrust/GLM-5.3-GGUF-DGX-Spark

Text Generation • 563B • Updated 12 days ago • 1.09k • 1

fresherbz/MiMo-V2.6-Flash-MOPD-IQ2_XXS-GGUF

Text Generation • 309B • Updated 5 days ago • 188 • 1

antirez/deepseek-v4-gguf

Text Generation • 284B • Updated Aug 31 • 1.43M • 477

bleysg/DeepSeek-V4-Flash-IQ2XXS-Q2K-FP8-120GB-target

Text Generation • 84B • Updated May 11 • 165 • 7

opensota/deepseek-v4-gguf

Text Generation • 284B • Updated May 12 • 101 • 2

jedisct1/DeepSeek-V4-Flash-imatrix-aligned

Text Generation • 284B • Updated May 13 • 202 • 5

dusterbloom/SR2AM-v1.0-30B-IQ2XXS-asym-GGUF

Text Generation • 31B • Updated May 24 • 34

zenlm/zen5-pro-gguf

Text Generation • 284B • Updated Jul 14 • 418 • 1

Keepser/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated May 31 • 182 • 2

rbinrs/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated Jun 14 • 141 • 2

kavenmartinez/Qwen3.6-27B-IQ2_XXS-webgpu-GGUF

Text Generation • 27B • Updated Jun 15 • 30

nahid37/deepseek-v4-gguf

Text Generation • 284B • Updated Jun 22 • 280

Ninnix96/Qwen3.6-35B-A3B-gguf

Text Generation • 35B • Updated Aug 2 • 694 • 2

eadx/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated Jul 5 • 103

wangyanwei123/deepseek-v4-gguf

Text Generation • 284B • Updated Jul 7 • 146

windy88/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated Jul 8 • 71

andreaborio/DeepSeek-V4-Flash-Hebrus-GGUF

Text Generation • Updated Aug 15 • 209 • 2

ox-ox/DeepSeek-V4-Flash-0731-gguf-ds4

Text Generation • 284B • Updated Aug 1 • 318 • 25

schlaflos/DeepSeek-V4-Flash-0731-antirez-ds4-GGUF

Text Generation • 20B • Updated Aug 1 • 106 • 10

apetersson/DeepSeek-V4-Flash-0731-Abliterated-DS4-Quality128

Text Generation • 284B • Updated Aug 4 • 1.73k • 7

apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128

Text Generation • 284B • Updated Aug 4 • 187 • 5

Ninnix96/KAT-Coder-V2.5-Dev-gguf

Text Generation • 35B • Updated Aug 2 • 92 • 1