Edit Models filters

Model Tree

ibm-granite/granite-4.2-3b

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

53

Base only

Active filters: ibm-granite/granite-4.2-3b

ibm-granite/granite-4.2-3b-GGUF

4B • Updated Sep 2 • 313k • 34

bartowski/granite-4.2-3b-GGUF

Text Generation • 4B • Updated Aug 25 • 3.86k • 6

ibm-granite/granite-4.2-3b-fp8

Text Generation • 4B • Updated Sep 2 • 1.26k • 3

ibm-granite/granite-4.2-3b-mxfp4

Text Generation • 4B • Updated Sep 2 • 933 • 2

ibm-granite/granite-4.2-3b-nvfp4

Text Generation • 4B • Updated Sep 2 • 1.34k • 1

lmstudio-community/granite-4.2-3b-GGUF

4B • Updated Aug 25 • 1.08k

Orvena/granite-4.2-3b-MLX-4bit

Text Generation • 4B • Updated Aug 25 • 177 • 1

lmstudio-community/granite-4.2-3b-MLX-4bit

Text Generation • 4B • Updated Aug 25 • 1.02k

lmstudio-community/granite-4.2-3b-MLX-6bit

Text Generation • 4B • Updated Aug 25 • 284

lmstudio-community/granite-4.2-3b-MLX-8bit

Text Generation • 4B • Updated Aug 25 • 1.25k

NANI-Nithin/granite-4.2-3b-GGUF

Text Generation • 4B • Updated 29 days ago • 3.37k • 1

liodon-ai/granite-4.2-3b-imatrix-GGUF

Text Generation • 4B • Updated Aug 25 • 428

nightmedia/granite-4.2-3b-q8-hi-mlx

Text Generation • 4B • Updated Aug 26 • 97

kingjones777/Granite-4.2-3B-ROCmFP4-COHERENT-GGUF

Text Generation • 4B • Updated Aug 26 • 62

kingjones777/Granite-4.2-3B-ROCmFPX-Q8_0-AGENT-GGUF

Text Generation • 4B • Updated Aug 26 • 52

kingjones777/Granite-4.2-3B-ROCmFPX-Q8_0-GGUF

Text Generation • 4B • Updated Aug 26 • 61

kingjones777/Granite-4.2-3B-ROCmFP4-STRIX_LEAN-GGUF

Text Generation • 4B • Updated Aug 26 • 58

0xzknw/Granite-4.2-3B-Heretic-NX-PRIME-GGUF

Text Generation • 4B • Updated Aug 26 • 271

mradermacher/granite-4.2-3b-GGUF

4B • Updated Aug 26 • 390 • 1

mradermacher/granite-4.2-3b-i1-GGUF

4B • Updated Aug 26 • 1.48k • 2

salohcin714/granite-4.2-3b-6bit-mlx

Text Generation • 4B • Updated Aug 27 • 76

salohcin714/granite-4.2-3b-5bit-mlx

Text Generation • 4B • Updated Aug 27 • 83

salohcin714/granite-4.2-3b-4bit-mlx

Text Generation • 4B • Updated Aug 27 • 22

salohcin714/granite-4.2-3b-3bit-mlx

Text Generation • 4B • Updated Aug 27 • 84

salohcin714/granite-4.2-3b-2bit-mlx

Text Generation • 4B • Updated Aug 27 • 85

salohcin714/granite-4.2-3b-mxfp8-mlx

Text Generation • 4B • Updated Aug 27 • 17

salohcin714/granite-4.2-3b-mxfp4-mlx

Text Generation • 4B • Updated Aug 27 • 79

salohcin714/granite-4.2-3b-nvfp4-mlx

Text Generation • 4B • Updated Aug 27 • 88

salohcin714/granite-4.2-3b-8bit-awq-mlx

Text Generation • 4B • Updated Aug 28 • 31

salohcin714/granite-4.2-3b-8bit-gptq-mlx

Text Generation • 4B • Updated Aug 28 • 52