Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
shuyuej
's Collections
Quantization
Quantization
updated
Dec 9, 2024
A collection of quantized models. All the models can be fine-tuned by adding a LoRA Adapter.
Upvote
3
shuyuej/Command-R-Plus-GPTQ
Text Generation
•
Updated
Jul 25, 2024
•
19
•
1
shuyuej/Meta-Llama-3-8B-Instruct-GPTQ
Text Generation
•
Updated
Jul 25, 2024
•
106
•
1
shuyuej/Command-R-GPTQ
Text Generation
•
Updated
Jul 25, 2024
•
21
•
1
shuyuej/Meta-Llama-3-70B-Instruct-GPTQ
Text Generation
•
Updated
Jul 25, 2024
•
15
shuyuej/gemma-2-27b-it-GPTQ
Text Generation
•
Updated
Sep 28, 2024
•
350
•
3
shuyuej/Mixtral-8x7B-Instruct-v0.1-GPTQ
Text Generation
•
Updated
Jul 25, 2024
•
5
shuyuej/Mixtral-8x22B-Instruct-v0.1-GPTQ
Text Generation
•
Updated
Jul 25, 2024
•
10
shuyuej/Command-R-Plus-Smaller-GPTQ
Text Generation
•
Updated
Jul 25, 2024
•
9
shuyuej/gemma-2b-it-GPTQ
Text Generation
•
Updated
Jul 25, 2024
•
82
shuyuej/gemma-7b-it-GPTQ
Text Generation
•
Updated
Jul 25, 2024
•
82
shuyuej/gemma-2-9b-it-GPTQ
Text Generation
•
Updated
Jul 25, 2024
•
95
shuyuej/Command-R-HF-GPTQ
Text Generation
•
Updated
Jul 25, 2024
•
6
shuyuej/Command-R-Smaller-HF-GPTQ
Text Generation
•
Updated
Jul 25, 2024
•
11
shuyuej/Meta-Llama-3.1-8B-Instruct-GPTQ
Text Generation
•
Updated
Jul 25, 2024
•
265
•
1
shuyuej/Meta-Llama-3.1-70B-Instruct-GPTQ
Text Generation
•
Updated
Nov 29, 2024
•
25
•
3
shuyuej/Mistral-7B-Instruct-v0.1-GPTQ
Text Generation
•
Updated
Jul 25, 2024
•
84
shuyuej/Mistral-7B-Instruct-v0.2-GPTQ
Text Generation
•
Updated
Jul 25, 2024
•
81
shuyuej/Mistral-Nemo-Instruct-2407-GPTQ
Text Generation
•
Updated
Jul 25, 2024
•
5.96k
•
5
shuyuej/Mistral-7B-Instruct-v0.3-GPTQ
Text Generation
•
Updated
Jul 25, 2024
•
80
shuyuej/Mistral-Nemo-Base-2407-GPTQ
Text Generation
•
Updated
Jul 25, 2024
•
84
shuyuej/mathstral-7B-v0.1-GPTQ
Text Generation
•
Updated
Jul 25, 2024
•
119
shuyuej/Llama-Guard-3-8B-GPTQ
Text Generation
•
Updated
Jul 25, 2024
•
82
shuyuej/Meta-Llama-3.1-8B-GPTQ
Text Generation
•
Updated
Jul 25, 2024
•
97
shuyuej/Meta-Llama-3-8B-GPTQ
Text Generation
•
Updated
Jul 25, 2024
•
78
•
1
shuyuej/Llama-2-13b-hf-GPTQ
Text Generation
•
Updated
Jul 25, 2024
•
80
shuyuej/Llama-2-7b-hf-GPTQ
Text Generation
•
Updated
Jul 25, 2024
•
82
shuyuej/Llama-2-13b-chat-hf-GPTQ
Text Generation
•
Updated
Jul 25, 2024
•
79
shuyuej/Llama-2-7b-chat-hf-GPTQ
Text Generation
•
Updated
Jul 25, 2024
•
80
shuyuej/Mistral-Large-Instruct-2407-GPTQ
Text Generation
•
Updated
Jul 25, 2024
•
16
•
3
shuyuej/Meta-Llama-3.1-70B-Smaller-GPTQ
Text Generation
•
Updated
Jul 25, 2024
•
4
shuyuej/Meta-Llama-3.1-70B-Instruct-Smaller-GPTQ
Text Generation
•
Updated
Jul 25, 2024
•
10
shuyuej/Meta-Llama-3.1-70B-GPTQ
Text Generation
•
Updated
Aug 7, 2024
•
5
shuyuej/Meta-Llama-Guard-2-8B-GPTQ
Text Generation
•
Updated
Jul 25, 2024
•
78
shuyuej/Mixtral-8x7B-v0.1-GPTQ
Text Generation
•
Updated
Jul 25, 2024
•
10
shuyuej/Mixtral-8x22B-v0.1-GPTQ
Text Generation
•
Updated
Jul 26, 2024
•
16
shuyuej/Mistral-Large-Instruct-2407-Smaller-GPTQ
Text Generation
•
Updated
Jul 25, 2024
•
7
shuyuej/gemma-2b-GPTQ
Text Generation
•
Updated
Jul 26, 2024
•
83
shuyuej/gemma-7b-GPTQ
Text Generation
•
Updated
Jul 26, 2024
•
77
shuyuej/gemma-2-9b-GPTQ
Text Generation
•
Updated
Jul 26, 2024
•
76
shuyuej/gemma-2-27b-GPTQ
Text Generation
•
Updated
Sep 28, 2024
•
12
shuyuej/Qwen2-1.5B-GPTQ
Text Generation
•
Updated
Jul 26, 2024
•
85
shuyuej/Qwen2-57B-A14B-GPTQ
Text Generation
•
Updated
Jul 28, 2024
•
13
shuyuej/Qwen2-0.5B-GPTQ
Text Generation
•
Updated
Jul 26, 2024
•
77
shuyuej/Qwen2-1.5B-Instruct-GPTQ
Text Generation
•
Updated
Jul 26, 2024
•
80
shuyuej/Qwen2-0.5B-Instruct-GPTQ
Text Generation
•
Updated
Jul 26, 2024
•
77
shuyuej/Qwen2-7B-Instruct-GPTQ
Text Generation
•
Updated
Jul 26, 2024
•
82
shuyuej/Qwen2-57B-A14B-Instruct-GPTQ
Text Generation
•
Updated
Jul 28, 2024
•
12
shuyuej/Qwen2-72B-Instruct-GPTQ
Text Generation
•
Updated
Jul 28, 2024
•
7
shuyuej/Qwen2-72B-GPTQ
Text Generation
•
Updated
Jul 28, 2024
•
10
shuyuej/Linq-Embed-Mistral-GPTQ
Feature Extraction
•
Updated
Jul 29, 2024
•
28
shuyuej/gte-Qwen2-1.5B-instruct-GPTQ
Text Generation
•
Updated
Jul 29, 2024
•
41
shuyuej/gte-Qwen2-7B-instruct-GPTQ
Text Generation
•
Updated
Jul 29, 2024
•
154
•
2
shuyuej/bge-multilingual-gemma2-GPTQ
Feature Extraction
•
Updated
Jul 29, 2024
•
152
•
4
shuyuej/e5-mistral-7b-instruct-GPTQ
Feature Extraction
•
Updated
Jul 29, 2024
•
22
shuyuej/SFR-Embedding-2_R-GPTQ
Feature Extraction
•
Updated
Nov 21, 2024
•
23
•
1
shuyuej/bge-en-icl-GPTQ
Feature Extraction
•
Updated
Jul 29, 2024
•
82
•
2
shuyuej/SFR-Embedding-Mistral-GPTQ
Feature Extraction
•
Updated
Jul 29, 2024
•
16
shuyuej/gte-Qwen1.5-7B-instruct-GPTQ
Text Generation
•
Updated
Jul 29, 2024
•
8
shuyuej/Phi-3-vision-128k-instruct-GPTQ
Text Generation
•
Updated
Jul 30, 2024
•
110
shuyuej/Phi-3-medium-128k-instruct-GPTQ
Text Generation
•
Updated
Jul 30, 2024
•
69
shuyuej/Phi-3-medium-4k-instruct-GPTQ
Text Generation
•
Updated
Jul 30, 2024
•
109
shuyuej/Phi-3-small-128k-instruct-GPTQ
Text Generation
•
Updated
Jul 30, 2024
•
57
shuyuej/Phi-3-small-8k-instruct-GPTQ
Text Generation
•
Updated
Jul 30, 2024
•
56
shuyuej/Phi-3-mini-128k-instruct-GPTQ
Text Generation
•
Updated
Jul 30, 2024
•
107
shuyuej/Phi-3-mini-4k-instruct-GPTQ
Text Generation
•
Updated
Jul 30, 2024
•
110
shuyuej/aya-23-8B-GPTQ
Text Generation
•
Updated
Jul 30, 2024
•
101
shuyuej/aya-23-35B-GPTQ
Text Generation
•
Updated
Jul 30, 2024
•
9
shuyuej/Mistral-Nemo-Instruct-2407-GPTQ-INT8
Updated
Aug 7, 2024
•
39
•
1
shuyuej/vicuna-13b-v1.5-GPTQ
Updated
Aug 10, 2024
•
3
shuyuej/vicuna-7b-v1.5-GPTQ
Updated
Aug 10, 2024
•
3
shuyuej/Mistral-Small-Instruct-2409-GPTQ
Updated
Sep 24, 2024
•
2
shuyuej/OLMoE-1B-7B-0924-GPTQ
Updated
Sep 25, 2024
•
5
shuyuej/Llama-Guard-3-1B-GPTQ
Updated
Sep 25, 2024
•
7
shuyuej/Llama-3.2-1B-Instruct-GPTQ
Updated
Sep 25, 2024
•
11.1k
•
2
shuyuej/Llama-3.2-1B-GPTQ
Updated
Sep 25, 2024
•
59
shuyuej/Llama-3.2-3B-Instruct-GPTQ
Updated
Sep 25, 2024
•
582
shuyuej/Llama-3.2-3B-GPTQ
Updated
Sep 25, 2024
•
94
shuyuej/c4ai-command-r-08-2024-GPTQ
Updated
Sep 26, 2024
•
59
shuyuej/c4ai-command-r-plus-08-2024-GPTQ
Updated
Sep 28, 2024
•
4
shuyuej/gemma-2-2b-GPTQ
Updated
Sep 28, 2024
•
4
shuyuej/gemma-2-2b-it-GPTQ
Updated
Sep 28, 2024
•
4
shuyuej/Llama-3.3-70B-Instruct-GPTQ
Updated
Dec 22, 2024
•
1.46k
•
5
Upvote
3
Share collection
View history
Collection guide
Browse collections