Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

25,000

Base only

Active filters: llama-cpp

prism-ml/Bonsai-27B-gguf

Text Generation • 27B • Updated Jul 17 • 561k • 819

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 27B • Updated Jul 18 • 605k • • 1.25k

Jackrong/Qwen-Tool-Calling-Template-Fix

Text Generation • Updated 6 days ago • 1 • 13

AlicanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF

Text Generation • 8B • Updated Jun 4, 2025 • 11.5k • 296

RavichandranJ/Dolphin3-Cyber-8B-GGUF

Text Generation • 8B • Updated Jun 8 • 53.8k • 174

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated Jun 10 • 317k • 147

jica98/qwen3.5-4B-super-coder

Text Generation • 4B • Updated Jun 27 • 31.9k • 79

Tesslate/OmniCoder-9B-GGUF

9B • Updated Mar 12 • 7.08k • 336

douyamv/Qwen3.8-27B-abliterated-GGUF

Text Generation • Updated 16 days ago • 14

ge525/Qwen3.8-9B-Distill-uncensored-heretic-Q4_K_M-GGUF

Text Generation • 9B • Updated 7 days ago • 7.24k • 11

OliviaRossi/Qwopus-KAT-Coder-35B-Merged-GGUF

Text Generation • 36B • Updated 3 days ago • 5.79k • 4

audarai/Audar-ASR-V1-Turbo

Automatic Speech Recognition • 2B • Updated 10 days ago • 1.41k • 12

gaston-parravicini/LFM2.5-8B-A1B-Uncensored-Gaston-GGUF

Text Generation • 8B • Updated May 30 • 20.5k • 26

chenyumo/moziAI-35B-A3B-MOE-MTP-Uncensored

Text Generation • 35B • Updated 4 days ago • 9.05k • 5

huihui-ai/BaronLLM_Offensive_Security-abliterated-GGUF

Text Generation • 8B • Updated Jun 11, 2025 • 518 • 58

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 106k • 772

barozp/Qwen3.6-28B-REAP20-A3B-GGUF

Text Generation • 28B • Updated Apr 19 • 9.1k • 75

deadbydawn101/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

Text Generation • 36B • Updated Jun 13 • 18.3k • 144

mitkox/Huihui-Qwen3.8-27B-abliterated-Q4_K_M-GGUF

Image-Text-to-Text • 27B • Updated 14 days ago • 4.22k • 4

Blackfrost-AI/Qwen-3.8-2.4T-A95B-Derisked-IQ1_0-GGUF

Text Generation • 2.4T • Updated 4 days ago • 70 • 2

Axway/Rukopys-OCR-4B-GGUF

Image-to-Text • 4B • Updated 5 days ago • 339 • 2

erayyapagci/DeepSeek-V4-Flash-IQ2XXS-TM64-Q4KAttention-v1

Text Generation • 284B • Updated 2 days ago • 556 • 2

OliviaRossi/Ornith-Qwopus-KAT-Coder-35B-Merged-GGUF

Text Generation • 36B • Updated about 1 hour ago • 72 • 2

SC117/Qwen3.8-27B-Uncensored-FIT-GGUF

Text Generation • 27B • Updated about 6 hours ago • 1 • 2

NoelJacob/Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Apr 24, 2024 • 821 • 5

filvyb/Llama3-8b-CunnyGPT-16bit-Q8_0-GGUF

8B • Updated Jun 21, 2024 • 60 • 7

joshnader/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 6.18k • 10

hugging-quants/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Sep 25, 2024 • 58.6k • 31

itlwas/Mistral-7B-Instruct-v0.1-Q4_K_M-GGUF

Text Generation • 7B • Updated Dec 19, 2024 • 107 • 6

localattention/ShowUI-2B-Q4_K_M-GGUF

2B • Updated Jan 9, 2025 • 77 • 4