Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Casual-Autopsy
/
vntl-llama3-8b-v2-imatrix-gguf
like
0
Translation
GGUF
English
Japanese
Inference Endpoints
conversational
Model card
Files
Files and versions
Community
Deploy
Use this model
6aa9a24
vntl-llama3-8b-v2-imatrix-gguf
1 contributor
History:
10 commits
Casual-Autopsy
Update README.md
6aa9a24
verified
18 days ago
.gitattributes
Safe
2.8 kB
Upload Full BF16
25 days ago
README.md
Safe
4.38 kB
Update README.md
18 days ago
imatrix.dat
4.99 MB
LFS
Upload imatrix.dat
26 days ago
vntl-llama3-8b-v2-hf-bf16.gguf
Safe
16.1 GB
LFS
Upload Full BF16
25 days ago
vntl-llama3-8b-v2-hf-iq3_m.gguf
Safe
3.78 GB
LFS
Upload Q3 Quants
26 days ago
vntl-llama3-8b-v2-hf-iq3_xs.gguf
Safe
3.52 GB
LFS
Upload Q3 Quants
26 days ago
vntl-llama3-8b-v2-hf-iq4_nl.gguf
Safe
4.68 GB
LFS
Upload Q4 Quants
26 days ago
vntl-llama3-8b-v2-hf-iq4_xs.gguf
Safe
4.45 GB
LFS
Upload Q4 Quants
26 days ago
vntl-llama3-8b-v2-hf-q3_k_l.gguf
Safe
4.32 GB
LFS
Upload Q3 Quants
26 days ago
vntl-llama3-8b-v2-hf-q3_k_m.gguf
Safe
4.02 GB
LFS
Upload Q3 Quants
26 days ago
vntl-llama3-8b-v2-hf-q3_k_s.gguf
Safe
3.66 GB
LFS
Upload Q3 Quants
26 days ago
vntl-llama3-8b-v2-hf-q3_k_xl.gguf
Safe
4.78 GB
LFS
Upload Q3 Quants
26 days ago
vntl-llama3-8b-v2-hf-q4_k_l.gguf
Safe
5.31 GB
LFS
Upload Q4 Quants
26 days ago
vntl-llama3-8b-v2-hf-q4_k_m.gguf
Safe
4.92 GB
LFS
Upload Q4 Quants
26 days ago
vntl-llama3-8b-v2-hf-q4_k_s.gguf
Safe
4.69 GB
LFS
Upload Q4 Quants
26 days ago
vntl-llama3-8b-v2-hf-q5_k_l.gguf
Safe
6.06 GB
LFS
Upload Q5 Quants
26 days ago
vntl-llama3-8b-v2-hf-q5_k_m.gguf
Safe
5.73 GB
LFS
Upload Q5 Quants
26 days ago
vntl-llama3-8b-v2-hf-q5_k_s.gguf
Safe
5.6 GB
LFS
Upload Q5 Quants
26 days ago
vntl-llama3-8b-v2-hf-q6_k.gguf
Safe
6.6 GB
LFS
Upload Q6 Quants
26 days ago
vntl-llama3-8b-v2-hf-q6_k_l.gguf
Safe
6.85 GB
LFS
Upload Q6 Quants
26 days ago
vntl-llama3-8b-v2-hf-q8_0.gguf
Safe
8.54 GB
LFS
Upload Q8 Quant
26 days ago