neuralmagic
/

Nous-Hermes-2-Yi-34B-marlin

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Nous-Hermes-2-Yi-34B-marlin

File size: 51 Bytes

ba190a7

auto-gptq==0.7.1
torch==2.2.1
transformers
protobuf