Hugging Face's logo
Munish Kumar's picture
43 5 571

Munish Kumar

munish0838
wawakaka's profile picture Jaishak's profile picture davanstrien's profile picture
·
https://hf.co/QuantFactory

AI & ML interests

LLM Quantizations

Recent Activity

liked a model 21 days ago
munish0838/Mistral-7B-OpenOrca-Q4_K_M-GGUF
liked a model 21 days ago
munish0838/Matter-0.1-7B-GGUF
liked a model 21 days ago
munish0838/Matter-0.1-7B-boost-GGUF
View all activity

Organizations

Open-Source AI Meetup's profile picture Blog-explorers's profile picture Indic Benchmarks's profile picture Quant Factory's profile picture Hugging Face Discord Community's profile picture Dataset Tools's profile picture Data Is Better Together Contributor's profile picture AI Classroom's profile picture Hugging Face MCP Course's profile picture

munish0838's activity

New activity in OpenMeditron/Meditron3-Gemma2-2B 4 months ago

GGUF

3
#1 opened 4 months ago by
amogusgaysex
New activity in QuantFactory/Ministral-3b-instruct-GGUF 8 months ago

Heads up: this isn't the new ministral 3b

👍 2
2
#1 opened 8 months ago by
bartowski
New activity in QuantFactory/LLAMA-3_8B_Unaligned_BETA-GGUF 8 months ago

Requesting Re-Quant. Tokenizer Updated with better chatml Support

1
#1 opened 8 months ago by
Luni
New activity in QuantFactory/Mistral-Nemo-Instruct-2407-GGUF 11 months ago

Error loading model in llama.cpp ?

8
#1 opened 11 months ago by
ubergarm
New activity in QuantFactory/internistai-base-7b-v0.2-GGUF 11 months ago

Add paper and citation
#1 opened 11 months ago by
maximegmd
New activity in munish0838/Gemma2-9b-Matter-0.1-Slim-A 11 months ago

Adding `safetensors` variant of this model
#1 opened 11 months ago by
SFconvertbot
New activity in munish0838/Phi-3-mini-4k-instruct-Matter-0.1-Slim-A 11 months ago

Adding `safetensors` variant of this model
#1 opened 11 months ago by
SFconvertbot
New activity in munish0838/llama-3-8b-Instruct-Matter-0.1-Slim-A 12 months ago

Adding `safetensors` variant of this model
#1 opened 12 months ago by
SFconvertbot
New activity in munish0838/Mistral-v0.3-Instruct-Matter-Slim-A 12 months ago

Adding `safetensors` variant of this model
#1 opened 12 months ago by
SFconvertbot
New activity in QuantFactory/dolphin-2.9-llama3-8b-GGUF 12 months ago

What am I doing wrong? Using Oobabooga.

3
#1 opened about 1 year ago by
Goldenblood56

does not appear to have a file named config.json

2
#2 opened about 1 year ago by
atubong
New activity in QuantFactory/Meta-Llama-3-8B-Instruct-GGUF 12 months ago

Compatibility with llama-cpp and Ollama

6
#17 opened about 1 year ago by
liashchynskyi
New activity in QuantFactory/Llama-3-Alpha-Ko-8B-Instruct-GGUF about 1 year ago

Is the original model allganize/Llama-3-Alpha-Ko-8B-Instruct?

3
#1 opened about 1 year ago by
coconut00
New activity in QuantFactory/Phi-3-mini-128k-instruct-GGUF about 1 year ago

error when loading the model

5
#3 opened about 1 year ago by
StefanStroescu
New activity in mistralai/Codestral-22B-v0.1 about 1 year ago

How to convert to HF format?

👀 ➕ 8
5
#6 opened about 1 year ago by
ddh0
New activity in internlm/internlm2-math-plus-1_8b about 1 year ago

Rename configuration_internlm.py to configuration_internlm2.py
#1 opened about 1 year ago by
munish0838
New activity in internlm/internlm2-math-plus-7b about 1 year ago

Rename configuration_internlm.py to configuration_internlm2.py
#1 opened about 1 year ago by
munish0838
New activity in QuantFactory/Phi-3-mini-128k-instruct-GGUF about 1 year ago

I have now tried two quantizations 8_0, and 6_K, they both fail like you see below.

3
#2 opened about 1 year ago by
BigDeeper

Working with llama cpp ?

4
#1 opened about 1 year ago by
ivanpzk
New activity in QuantFactory/Meta-Llama-3-8B-Instruct-GGUF about 1 year ago

This quantized Llama3 cannot answer in different language like original Meta Llama3 model

1
#16 opened about 1 year ago by
taiSupermicro