neuralmagic
/

Nous-Hermes-2-Yi-34B-marlin

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Nous-Hermes-2-Yi-34B-marlin

Commit History

Create requirements.txt

ba190a7
verified

robertgshaw2 commited on Mar 6, 2024

Create quantization/apply_gptq_save_marlin.py

9c861d2
verified

robertgshaw2 commited on Mar 6, 2024

Create README.md

c5218f8
verified

robertgshaw2 commited on Mar 6, 2024

Upload folder using huggingface_hub

7236431
verified

robertgshaw2 commited on Mar 6, 2024

initial commit

462e5fd
verified

robertgshaw2 commited on Mar 6, 2024