HandH1998

HandH1998's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in meituan/DeepSeek-R1-Block-INT8 over 1 year ago

After deploying with the latest sglang, I found that the responses when calling the interface were chaotic.

4

#13 opened over 1 year ago by

ShiningMaker

是否有明确的sglang镜像版本推荐：）

1

#14 opened over 1 year ago by

wangkkk956

New activity in meituan/DeepSeek-R1-Channel-INT8 over 1 year ago

Add `quantization_config` in config.json?

4

#4 opened over 1 year ago by

WeiwenXia

运行channel INT8后sglang报错OOM

1

#3 opened over 1 year ago by

zhangneilc

New activity in meituan/DeepSeek-R1-Block-INT8 over 1 year ago

量化类型

1

#11 opened over 1 year ago by

a-r-c

New activity in meituan/DeepSeek-R1-Channel-INT8 over 1 year ago

Difference with Block-wise Int8?

1

#1 opened over 1 year ago by

leo98xh

New activity in meituan/DeepSeek-R1-Block-INT8 over 1 year ago

Why hasn't the model file size changed?

1

#9 opened over 1 year ago by

yu5

New activity in QuixiAI/DeepSeek-V3-AWQ over 1 year ago

What calibration dataset do you use when applying AWQ?

2

#5 opened over 1 year ago by

HandH1998