Edit Models filters

Model Tree

deepseek-ai/DeepSeek-V3-0324

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

18

Base only

Active filters: jan, deepseek-ai/DeepSeek-V3-0324

unsloth/DeepSeek-V3-0324-GGUF-UD

Text Generation • 671B • Updated Apr 28, 2025 • 1.99k • 24

bartowski/deepseek-ai_DeepSeek-V3-0324-GGUF

Text Generation • 671B • Updated Apr 4, 2025 • 998 • 26

lmstudio-community/DeepSeek-V3-0324-GGUF

Text Generation • 671B • Updated Mar 25, 2025 • 576 • 12

DevQuasar-12/deepseek-ai.DeepSeek-V3-0324-GGUF

Text Generation • 671B • Updated Mar 30, 2025 • 213 • 2

mmnga/DeepSeek-V3-0324-experts-pertok-4-gguf

671B • Updated Mar 25, 2025 • 21

MaziyarPanahi/DeepSeek-V3-0324-GGUF

Text Generation • 671B • Updated Mar 25, 2025 • 178k • 23

unsloth/DeepSeek-V3-0324-GGUF

Text Generation • 671B • Updated May 22, 2025 • 13.6k • 200

ubergarm/DeepSeek-V3-0324-GGUF

Text Generation • 672B • Updated Jul 10, 2025 • 38 • 36

tflsxyy/DeepSeek-V3-0324-MoE-Pruner-E160-IQ1_S

426B • Updated Apr 29, 2025 • 15 • 4

Kebob/DeepSeek-V3-0324-IK_GGUF

671B • Updated Jul 6, 2025 • 14 • 1

bobchenyx/DeepSeek-V3-0324-MLA-GGUF

Text Generation • 671B • Updated Oct 20, 2025 • 12 • 2

gghfez/DeepSeek-V3-0324-IQ3_KS

Text Generation • 672B • Updated Jul 26, 2025 • 6 • 2

AmpereComputing/deepseek-v3-0324-gguf

671B • Updated Jul 28, 2025 • 7

gghfez/DeepSeek-V3-0324-IQ2_KS

Text Generation • 672B • Updated Oct 18, 2025 • 32

sokann/DeepSeek-V3-0324-GGUF

672B • Updated Jul 31, 2025 • 9

lmganon123/DeepSeek-V3-0324_IK_GGUF_Q2

672B • Updated Aug 17, 2025 • 1

moxin-org/DeepSeek-V3-0324-Moxin-GGUF

Text Generation • 671B • Updated Nov 30, 2025 • 32 • 8

Doctor-Shotgun/DeepSeek-V3-0324-GGUF

671B • Updated Dec 20, 2025 • 17