TheBloke
/

OpenAssistant-Llama2-13B-Orca-8K-3319-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

OpenAssistant-Llama2-13B-Orca-8K-3319-GPTQ / README.md

Commit History

Update for Transformers GPTQ support

9323370

TheBloke commited on Aug 20, 2023

Re-done GPTQ, quantised with sequence length 8K

e3ce21d

TheBloke commited on Jul 25, 2023

Re-done GPTQ, quantised with sequence length 8K

040dc6e

TheBloke commited on Jul 25, 2023

Initial GPTQ model commit

1fba035

TheBloke commited on Jul 25, 2023

Initial GPTQ model commit

878cdfc

TheBloke commited on Jul 25, 2023