Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
XelotX
/
Hermes-2-Theta-Llama-3-8B-32k-XelotX-BF16_Quants
like
0
GGUF
conversational
Model card
Files
Files and versions
Community
Deploy
Use this model
No model card
Downloads last month
7
GGUF
Model size
8.03B params
Architecture
llama
Chat template
Hardware compatibility
Log In
to view the estimation
2-bit
Q2_K
3.18 GB
3-bit
Q3_K_S
3.66 GB
Q3_K_M
4.02 GB
Q3_K_L
4.32 GB
4-bit
Q4_K_S
4.69 GB
Q4_0
4.66 GB
Q4_1
5.13 GB
5-bit
Q5_K_S
5.6 GB
Q5_0
5.6 GB
Q5_1
6.07 GB
Q5_K_M
5.73 GB
6-bit
Q6_K
6.6 GB
8-bit
Q8_0
8.54 GB
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
๐
Ask for provider support
Collection including
XelotX/Hermes-2-Theta-Llama-3-8B-32k-XelotX-BF16_Quants
Hermes-2-Theta-Llama-3-8B-32k
Collection
3 items
โข
Updated
Jan 20