Quantized Llama models in 2,4, and 8 bit versions
Divyanshu Kumar
divyanshusingh
AI & ML interests
NLP, CV, Federated Learning
Recent Activity
new activity
6 days ago
meta-llama/Llama-Guard-4-12B:The model is not working with vLLM or transformers library as well
new activity
6 days ago
meta-llama/Llama-Guard-4-12B:The model is not working with vLLM or transformers library as well
updated
a model
4 months ago
mili-ai/gliner_large_v2.1-onnx
Organizations
Collections
2
models
12

divyanshusingh/Mistral-7B-Instruct-v0.2-GGUF
Updated
•
2

divyanshusingh/Mistral-7B-Instruct-v0.3-GGUF
Updated

divyanshusingh/Mistral-Nemo-Instruct-2407-GGUF
Updated
•
16

divyanshusingh/Mistral-7B-Instruct-v0.1-GGUF
Updated
•
4

divyanshusingh/Llama-2-7b-chat-GGUF
Updated
•
1

divyanshusingh/CodeLlama-7b-GGUF
Updated
•
2

divyanshusingh/Llama-3-8b-Instruct-GGUF
Updated

divyanshusingh/Llama-3.1-8b-Instruct-GGUF
Updated
•
4

divyanshusingh/lora_ft_indicbart
Updated

divyanshusingh/my_awesome_model
Updated
datasets
0
None public yet