Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

TheBloke
/
starchat-beta-GPTQ

Text Generation
Transformers
Safetensors
gpt_bigcode
Generated from Trainer
text-generation-inference
4-bit precision
gptq
Model card Files Files and versions Community
8
New discussion
Resources
  • PR & discussions documentation
  • Code of Conduct
  • Hub documentation

Working in text-geration-webui, with a little surprise...

1
#8 opened almost 2 years ago by
mwettach

Got an unexpected keyword argument 'model_name_or_path'

9
#6 opened almost 2 years ago by
kllisre

is it possible to make this work with huggingface/text-generation-inference ?

1
#5 opened almost 2 years ago by
captainst

gptq_model-4bit--1g.safetensors does not contain metadata.

3
#3 opened almost 2 years ago by
kenM1

FYI in case you're getting Spanish after the answer is complete

1
#2 opened almost 2 years ago by
CommaLlama

is this working properly?

23
#1 opened almost 2 years ago by
Boffy
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs