vllm error
👍
1
#3 opened about 1 month ago
by
chu88
Can you create an 8bit version?
#2 opened about 2 months ago
by
MilesQLi
test the inference script and quantized model, but have error as below
6
#1 opened 2 months ago
by
wikeeyang