Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
XelotX
/
c4ai-command-r-08-2024-XelotX-_Quants
like
0
GGUF
conversational
Model card
Files
Files and versions
Community
Deploy
Use this model
No model card
Downloads last month
460
GGUF
Model size
32.3B params
Architecture
command-r
Chat template
Hardware compatibility
Log In
to view the estimation
2-bit
Q2_K
12.8 GB
3-bit
Q3_K_S
14.7 GB
Q3_K_M
16.2 GB
Q3_K_L
17.6 GB
4-bit
Q4_K_S
18.8 GB
Q4_0
18.7 GB
Q4_1
20.6 GB
Q4_K_M
19.8 GB
5-bit
Q5_K_S
22.5 GB
Q5_0
22.5 GB
Q5_1
24.4 GB
Q5_K_M
23.1 GB
6-bit
Q6_K
26.5 GB
8-bit
Q8_0
34.3 GB
16-bit
BF16
64.6 GB
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
๐
Ask for provider support
Collection including
XelotX/c4ai-command-r-08-2024-XelotX-_Quants
c4ai-command-r
Collection
6 items
โข
Updated
Jan 20