Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Deci
/
DeciLM-7B-instruct-GGUF
like
40
Follow
Deci AI
111
Text Generation
Transformers
GGUF
llama
Inference Endpoints
conversational
License:
apache-2.0
Model card
Files
Files and versions
Community
2
Train
Deploy
Use this model
main
DeciLM-7B-instruct-GGUF
3 contributors
History:
16 commits
harpreetsahota
Create config.json
9d724a1
verified
9 months ago
.gitattributes
Safe
1.72 kB
Added DeciLM-7B-instruct model with uniform GQA in GGUF format, in multiple quantization levels.
11 months ago
README.md
Safe
2.72 kB
Update README.md
11 months ago
config.json
Safe
675 Bytes
Create config.json
9 months ago
decilm-7b-uniform-gqa-f16.gguf
Safe
14.2 GB
LFS
Added DeciLM-7B-instruct model with uniform GQA in GGUF format, in multiple quantization levels.
11 months ago
decilm-7b-uniform-gqa-f32.gguf
Safe
28.4 GB
LFS
Added DeciLM-7B-instruct model with uniform GQA in GGUF format, in multiple quantization levels.
11 months ago
decilm-7b-uniform-gqa-q8_0.gguf
Safe
7.55 GB
LFS
Added DeciLM-7B-instruct model with uniform GQA in GGUF format, in multiple quantization levels.
11 months ago