Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Casual-Autopsy
/
vntl-llama3-8b-v2-imatrix-gguf
like
0
Translation
GGUF
English
Japanese
Inference Endpoints
conversational
Model card
Files
Files and versions
Community
Deploy
Use this model
83bd628
vntl-llama3-8b-v2-imatrix-gguf
1 contributor
History:
8 commits
Casual-Autopsy
Upload Q8 Quant
83bd628
verified
26 days ago
.gitattributes
2.74 kB
Upload Q8 Quant
26 days ago
README.md
97 Bytes
Create README.md
26 days ago
imatrix.dat
4.99 MB
LFS
Upload imatrix.dat
26 days ago
vntl-llama3-8b-v2-hf-iq3_m.gguf
3.78 GB
LFS
Upload Q3 Quants
26 days ago
vntl-llama3-8b-v2-hf-iq3_xs.gguf
3.52 GB
LFS
Upload Q3 Quants
26 days ago
vntl-llama3-8b-v2-hf-iq4_nl.gguf
4.68 GB
LFS
Upload Q4 Quants
26 days ago
vntl-llama3-8b-v2-hf-iq4_xs.gguf
4.45 GB
LFS
Upload Q4 Quants
26 days ago
vntl-llama3-8b-v2-hf-q3_k_l.gguf
4.32 GB
LFS
Upload Q3 Quants
26 days ago
vntl-llama3-8b-v2-hf-q3_k_m.gguf
4.02 GB
LFS
Upload Q3 Quants
26 days ago
vntl-llama3-8b-v2-hf-q3_k_s.gguf
3.66 GB
LFS
Upload Q3 Quants
26 days ago
vntl-llama3-8b-v2-hf-q3_k_xl.gguf
4.78 GB
LFS
Upload Q3 Quants
26 days ago
vntl-llama3-8b-v2-hf-q4_k_l.gguf
5.31 GB
LFS
Upload Q4 Quants
26 days ago
vntl-llama3-8b-v2-hf-q4_k_m.gguf
4.92 GB
LFS
Upload Q4 Quants
26 days ago
vntl-llama3-8b-v2-hf-q4_k_s.gguf
4.69 GB
LFS
Upload Q4 Quants
26 days ago
vntl-llama3-8b-v2-hf-q5_k_l.gguf
6.06 GB
LFS
Upload Q5 Quants
26 days ago
vntl-llama3-8b-v2-hf-q5_k_m.gguf
5.73 GB
LFS
Upload Q5 Quants
26 days ago
vntl-llama3-8b-v2-hf-q5_k_s.gguf
5.6 GB
LFS
Upload Q5 Quants
26 days ago
vntl-llama3-8b-v2-hf-q6_k.gguf
6.6 GB
LFS
Upload Q6 Quants
26 days ago
vntl-llama3-8b-v2-hf-q6_k_l.gguf
6.85 GB
LFS
Upload Q6 Quants
26 days ago
vntl-llama3-8b-v2-hf-q8_0.gguf
8.54 GB
LFS
Upload Q8 Quant
26 days ago
