Qwen
/

Qwen2.5-14B-Instruct-GPTQ-Int8

Text Generation

text-generation-inference

8-bit precision

Model card Files Files and versions

Resources

View closed (1)

Improve language tag

#3 opened about 1 month ago by

RuntimeError: probability tensor contains either `inf`, `nan` or element < 0

#2 opened 6 months ago by