The speed improvement is universal since trunk shapes get compressed down from 8.5 bit per weight to 6.05, less bytes = faster. Both are fully resident for 96GB macs.
Beamivalice PRO
beamster
ยท
AI & ML interests
Sushi quant for Apple Silicon
Recent Activity
repliedto their post 1 day ago
Update on Sushi ๐ฃ release plan.
1.7.x series - new engine stabilisation, expect frequent releases
1.8.x-pre-release - Hy4 Flash support!
This could still be changed, if new and better weights dropped unexpectedly.
For now Sushi ๐ฃ 1.7.0 dropped. The best Sushi's quality quant for Qwen3.8 Flash, updated with STQ 4bpw pack. It gives +10% speed, +20% quality and left oQ4e to dust. Best package for 96GB+ mac!
๐ https://huggingface.co/beamster/Qwen3.8-Flash-Next-Sushi-STQ-4bpw
โญ๏ธ https://github.com/beamivalice/sushi
reacted to theirpost with ๐ 2 days ago
Update on Sushi ๐ฃ release plan.
1.7.x series - new engine stabilisation, expect frequent releases
1.8.x-pre-release - Hy4 Flash support!
This could still be changed, if new and better weights dropped unexpectedly.
For now Sushi ๐ฃ 1.7.0 dropped. The best Sushi's quality quant for Qwen3.8 Flash, updated with STQ 4bpw pack. It gives +10% speed, +20% quality and left oQ4e to dust. Best package for 96GB+ mac!
๐ https://huggingface.co/beamster/Qwen3.8-Flash-Next-Sushi-STQ-4bpw
โญ๏ธ https://github.com/beamivalice/sushi
posted an update 2 days ago
Update on Sushi ๐ฃ release plan.
1.7.x series - new engine stabilisation, expect frequent releases
1.8.x-pre-release - Hy4 Flash support!
This could still be changed, if new and better weights dropped unexpectedly.
For now Sushi ๐ฃ 1.7.0 dropped. The best Sushi's quality quant for Qwen3.8 Flash, updated with STQ 4bpw pack. It gives +10% speed, +20% quality and left oQ4e to dust. Best package for 96GB+ mac!
๐ https://huggingface.co/beamster/Qwen3.8-Flash-Next-Sushi-STQ-4bpw
โญ๏ธ https://github.com/beamivalice/sushi
Organizations
None yet