Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

TheBloke
/
Llama-2-70B-Chat-GPTQ

Text Generation
Transformers
Safetensors
PyTorch
English
llama
facebook
meta
llama-2
text-generation-inference
4-bit precision
gptq
Model card Files Files and versions Community
52
Llama-2-70B-Chat-GPTQ
Ctrl+K
Ctrl+K
  • 3 contributors
History: 95 commits
clayp's picture
clayp
Further update with slight improvements to the prompt template, also removed the system message
546dc72 almost 2 years ago
  • .gitattributes
    1.52 kB
    initial commit almost 2 years ago
  • LICENSE.txt
    7.02 kB
    Initial GPTQ model commit almost 2 years ago
  • Notice
    112 Bytes
    Initial GPTQ model commit almost 2 years ago
  • README.md
    22.6 kB
    Further update with slight improvements to the prompt template, also removed the system message almost 2 years ago
  • USE_POLICY.md
    4.77 kB
    Upload folder using huggingface_hub almost 2 years ago
  • config.json
    629 Bytes
    Initial GPTQ model commit almost 2 years ago
  • generation_config.json
    137 Bytes
    Initial GPTQ model commit almost 2 years ago
  • gptq_model-4bit--1g.safetensors
    35.3 GB
    LFS
    Initial GPTQ model commit almost 2 years ago
  • quantize_config.json
    183 Bytes
    Initial GPTQ model commit almost 2 years ago
  • special_tokens_map.json
    411 Bytes
    Initial GPTQ model commit almost 2 years ago
  • tokenizer.json
    1.84 MB
    Initial GPTQ model commit almost 2 years ago
  • tokenizer.model
    500 kB
    LFS
    Initial GPTQ model commit almost 2 years ago
  • tokenizer_config.json
    745 Bytes
    Initial GPTQ model commit almost 2 years ago