Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

TheBloke
/
zephyr-7B-beta-GPTQ

Text Generation
Transformers
Safetensors
English
mistral
Generated from Trainer
conversational
text-generation-inference
4-bit precision
gptq
Model card Files Files and versions Community
6
New discussion
Resources
  • PR & discussions documentation
  • Code of Conduct
  • Hub documentation

RuntimeError: qweight and qzeros have incompatible shapes.

#6 opened over 1 year ago by
bpandey23

[AUTOMATED] Model Memory Requirements

#5 opened over 1 year ago by
model-sizer-bot

Which dataset did you use to quantise this model?

#4 opened over 1 year ago by
deepak-banka

KoboldAI - The model entered does not exist

#3 opened over 1 year ago by
statistx

Running Zyphyr-7B-beta locally for QnA Chat

2
#2 opened over 1 year ago by
riyazmuthyalapati

Context Length and Max New Tokens

3
#1 opened over 1 year ago by
Shivam098
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs