Ornith-1.5 for local boxes: 35B REAP prune (vLLM/transformers) and 9B EXL3 (24GB).
-
oxfrug/Ornith-1.5-35B-A3B-REAP-20pct
Text Generation • 30B • Updated • 1.97k -
oxfrug/Ornith-1.5-9B-exl3
Text Generation • 4B • Updated • 175 -
ornith-ai/Ornith-1.5-35B-A3B
Text Generation • 36B • Updated • 402k • 642 -
REAP the Experts: Why Pruning Prevails for One-Shot MoE compression
Paper • 2510.13999 • Published • 23