QuantTrio
/

GLM-4.5-AWQ

Text Generation

4-bit precision

Model card Files Files and versions Community

Resources

View closed (0)

do we need new quants for vllm 10.1?

#4 opened 15 days ago by

Does it possible to create a version without MTP layer to save some VRAM

#3 opened 21 days ago by

how did you make it

#2 opened 22 days ago by

How many GPU Memory AWQ need?

#1 opened 23 days ago by