Hugging Face's logo

Darkhn
/
L3.3-70B-Animus-V1-GGUF

GGUF
llama.cpp
Model card Files Community

L3.3-70B-Animus-V1-GGUF

GGUF model files for L3.3-70B-Animus-V1 (original base: L3.3-70B-Animus-V1).

This repository contains the following quantization: Q5_K_M.

Files

  • L3.3-70B-Animus-V1-Q5_K_M.gguf

Converted and quantized using llama.cpp.

Downloads last month
227
GGUF
Model size
70.6B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Darkhn/L3.3-70B-Animus-V1-GGUF

Base model

meta-llama/Llama-3.1-70B
Finetuned
meta-llama/Llama-3.3-70B-Instruct
Finetuned
SicariusSicariiStuff/Negative_LLAMA_70B
Finetuned
Darkhn/L3.3-70B-Animus-V1
Quantized
(2)
this model

Collection including Darkhn/L3.3-70B-Animus-V1-GGUF