INT4 quantizations of Qwen3.8-27B calibrated at 262k context: AWQ and GPTQ weights, each in bf16-KV and calibrated fp8-e4m3 KV editions.
-
abhishekchohan/Qwen3.8-27B-AWQ-INT4-FP8KV
Image-Text-to-Text • 28B • Updated • 8.27k • 2 -
abhishekchohan/Qwen3.8-27B-AWQ-INT4
Image-Text-to-Text • 28B • Updated • 2.69k -
abhishekchohan/Qwen3.8-27B-GPTQ-INT4-FP8KV
Image-Text-to-Text • 28B • Updated • 48k • 2 -
abhishekchohan/Qwen3.8-27B-GPTQ-INT4
Image-Text-to-Text • 28B • Updated • 510