Exl2 quants for Qwen1.5-0.5B-Chat
Automatically quantized using the auto quant script from hf-scripts
Created as an example for Auto EXL2 HF upload
BPW:
Model tree for Anthonyg5005/Qwen1.5-0.5B-Chat-exl2
Base model
Qwen/Qwen1.5-0.5B-ChatCreated as an example for Auto EXL2 HF upload
Base model
Qwen/Qwen1.5-0.5B-Chat