Inference Optimization

community

AI & ML interests

None defined yet.

Recent Activity

kylesayrs updated a model 1 day ago

inference-optimization/Kimi-K3-0.40B-MXFP4

nm-research updated a model 2 days ago

inference-optimization/qwe3-8B-selfdistill-v3-fresh3ep_ckpt2

nm-research published a model 2 days ago

inference-optimization/qwe3-8B-selfdistill-v3-fresh3ep_ckpt2

View all activity

inference-optimization 's models 446

inference-optimization/DeepSeek-R1-Distill-Llama-8B-NVFP4

Text Generation • 5B • Updated Aug 14 • 90

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v9-ckpt10

2B • Updated Aug 14 • 10

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v8-ckpt9

2B • Updated Aug 13 • 13

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v8-ckpt8

2B • Updated Aug 13 • 12

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v8-ckpt7

2B • Updated Aug 13 • 12

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v8-ckpt6

2B • Updated Aug 13 • 9

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v8-ckpt5

2B • Updated Aug 12 • 9

inference-optimization/Qwen3.8-1.0B-A0.6B-NVFP4-FP8

1.0B • Updated Aug 12 • 41 • 1

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v8-ckpt4

2B • Updated Aug 12 • 9

inference-optimization/Qwen3.8-1.0B-A0.6B

Text Generation • 1.0B • Updated Aug 12 • 4.47k • 4

inference-optimization/Qwen3-VL-Reranker-0.1B-tiny

98.7M • Updated Aug 12 • 401

inference-optimization/granite-vision-4.1-0.2B-tiny

0.2B • Updated Aug 12 • 260

inference-optimization/gemma-4-unified-0.8B-tiny

0.8B • Updated Aug 12 • 268

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v8-ckpt3

2B • Updated Aug 12 • 13

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v8-ckpt2

2B • Updated Aug 12 • 10

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v8-ckpt1

2B • Updated Aug 12 • 11

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v8-ckpt0

2B • Updated Aug 11 • 9

inference-optimization/tinysmokeqwen3-fp8-kv-only

2.64M • Updated Aug 11 • 7

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.1536anc.codemultilang.v2-v5-ckpt0

2B • Updated Aug 10 • 11

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.1536anc.codemultilang.v2-v5-ckpt1

2B • Updated Aug 10 • 11

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.1536anc.codemultilang.v2-v5-ckpt2

2B • Updated Aug 10 • 12

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.1536anc.codemultilang.v2-v5-ckpt3

2B • Updated Aug 10 • 8

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.1536anc.codemultilang.v2-v5-ckpt4

2B • Updated Aug 10 • 11

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.1536anc.codemultilang.v2-v5-ckpt5

2B • Updated Aug 10 • 11

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.1536anc.codemultilang.v2-v5-ckpt6

2B • Updated Aug 10 • 10

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.1536anc.codemultilang.v2-v5-ckpt7

2B • Updated Aug 10 • 10

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.1536anc.codemultilang.v2-v5-ckpt8

2B • Updated Aug 10 • 13

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.1536anc.codemultilang.v2-v5-ckpt9

2B • Updated Aug 10 • 11

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.1536anc.codemultilang.v2-v5-ckpt10

2B • Updated Aug 10 • 13

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.1536anc.codemultilang.v2-v5-ckpt11

2B • Updated Aug 10 • 15