grimulkan
/

Goliath-longLORA-120b-rope8-32k-6bpw_h8_exl2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Goliath-longLORA-120b-rope8-32k-6bpw_h8_exl2 / README.md

grimulkan's picture

Update README.md

ad85052 verified 8 months ago

|

history blame contribute delete

No virus

175 Bytes

metadata

license: llama2

This is an EXL2 6-bit quantization of Goliath-longLORA-120b-rope8-32k-fp16