Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

arxiv: 2311.07911

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

176

Base only

Active filters: 2311.07911

google/gemma-3-270m-it

Text Generation • 0.3B • Updated Aug 14, 2025 • 88.8k • 614

google/gemma-3-270m

Text Generation • 0.3B • Updated Aug 14, 2025 • 1.38M • 1.07k

aisingapore/Gemma-SEA-LION-v4.5-E2B-IT

Any-to-Any • 5B • Updated 9 days ago • 3.48k • 14

litert-community/gemma-3-270m-it

Text Generation • Updated Apr 8 • 1.22k • 65

HuggingFaceH4/starchat2-15b-v0.1

Text Generation • 16B • Updated Mar 13, 2024 • 59 • 112

HuggingFaceH4/zephyr-orpo-141b-A35b-v0.1

Text Generation • 141B • Updated Apr 18, 2024 • 167 • 270

blockblockblock/zephyr-orpo-141b-A35b-v0.1-bpw2.25

Text Generation • Updated Apr 12, 2024 • 7 • 1

blockblockblock/zephyr-orpo-141b-A35b-v0.1-bpw2.5

Text Generation • Updated Apr 12, 2024 • 8

blockblockblock/zephyr-orpo-141b-A35b-v0.1-bpw3

Text Generation • Updated Apr 12, 2024 • 9

blockblockblock/zephyr-orpo-141b-A35b-v0.1-bpw3.5

Text Generation • Updated Apr 12, 2024 • 13

blockblockblock/zephyr-orpo-141b-A35b-v0.1-bpw3.7

Text Generation • Updated Apr 12, 2024 • 10

blockblockblock/zephyr-orpo-141b-A35b-v0.1-bpw4

Text Generation • Updated Apr 12, 2024 • 9

blockblockblock/zephyr-orpo-141b-A35b-v0.1-bpw4.2

Text Generation • Updated Apr 12, 2024 • 7

blockblockblock/zephyr-orpo-141b-A35b-v0.1-bpw4.4

Text Generation • Updated Apr 12, 2024 • 9

MaziyarPanahi/zephyr-orpo-141b-A35b-v0.1-AWQ

Text Generation • 141B • Updated Apr 12, 2024 • 9 • 3

blockblockblock/zephyr-orpo-141b-A35b-v0.1-bpw4.6

Text Generation • Updated Apr 13, 2024 • 7

blockblockblock/zephyr-orpo-141b-A35b-v0.1-bpw4.8

Text Generation • Updated Apr 13, 2024 • 12

blockblockblock/zephyr-orpo-141b-A35b-v0.1-bpw5

Text Generation • Updated Apr 13, 2024 • 7

SinclairSchneider/zephyr-orpo-141b-A35b-v0.1-bnb-4bit

Text Generation • 143B • Updated Apr 14, 2024 • 10

stelterlab/starchat2-15b-v0.1-AWQ

Text Generation • 16B • Updated Apr 27, 2024 • 10

RichardErkhov/HuggingFaceH4_-_starchat2-15b-v0.1-4bits

Text Generation • 16B • Updated May 1, 2024 • 10

RichardErkhov/HuggingFaceH4_-_starchat2-15b-v0.1-8bits

Text Generation • 16B • Updated May 1, 2024 • 6

RichardErkhov/HuggingFaceH4_-_starchat2-15b-v0.1-gguf

16B • Updated May 1, 2024 • 219

RichardErkhov/HuggingFaceH4_-_zephyr-orpo-141b-A35b-v0.1-gguf

141B • Updated May 3, 2024 • 48

Apel-sin/starchat2-15b-v0.1-exl2

Updated May 23, 2024 • 2

typhoon-ai/llama-3-typhoon-v1.5x-8b-instruct

Text Generation • 8B • Updated Mar 31, 2025 • 42 • • 18

typhoon-ai/llama-3-typhoon-v1.5x-70b-instruct

Text Generation • 71B • Updated Mar 31, 2025 • 124 • • 8

typhoon-ai/llama-3-typhoon-v1.5x-70b-instruct-awq

Text Generation • 71B • Updated Mar 31, 2025 • 16 • 2

aisingapore/Llama-SEA-LION-v2-8B-IT

Text Generation • 8B • Updated 9 days ago • 234 • • 17

RichardErkhov/scb10x_-_llama-3-typhoon-v1.5x-70b-instruct-gguf

71B • Updated Aug 3, 2024 • 940