106 16 191

Michael Han

shimmyshimmer

https://unsloth.ai

AI & ML interests

None yet

Recent Activity

new activity about 4 hours ago

unsloth/Meta-Llama-3.1-8B-Instruct:How to merge these 4 split model files?

liked a model 1 day ago

mlx-community/Unsloth-Phi-4-4bit

liked a model 1 day ago

codelion/Llama-3.2-3B-o1-lora

View all activity

Organizations

shimmyshimmer's activity

New activity in unsloth/Meta-Llama-3.1-8B-Instruct about 4 hours ago

How to merge these 4 split model files?

#3 opened 2 days ago by

AnsonTeng

New activity in unsloth/QwQ-32B-Preview 1 day ago

Am I the only person using this?

#1 opened 1 day ago by

patruff

New activity in unsloth/DeepSeek-V3-GGUF 2 days ago

What is the required GPU size to run Is a 4090 possible and does it support ollama

#5 opened 9 days ago by

sminbb

New activity in unsloth/Mistral-Nemo-Instruct-2407 2 days ago

fix position embeddings

#1 opened 4 days ago by

PatentPilotAI

New activity in microsoft/phi-4 3 days ago

Is there a fine-tuning cookbook for phi4 ?

#27 opened 3 days ago by

sbhctashi

New activity in unsloth/DeepSeek-V3-bf16 3 days ago

Encountering Unknown quantization type, got fp8 - supported types are: XXXXX

#1 opened 4 days ago by

ivanmanu

New activity in unsloth/DeepSeek-V3-GGUF 5 days ago

First review, Q5-K-M require 502Gb RAM, better than Meta 405billions

#11 opened 5 days ago by

krustik

New activity in unsloth/DeepSeek-V3-GGUF 6 days ago

Issue with --n-gpu-layers 5 Parameter: Model Only Running on CPU

#10 opened 6 days ago by

vuk123

I’m new to GGUF quants

#9 opened 6 days ago by

fsaudm

New activity in unsloth/DeepSeek-V3-GGUF 8 days ago

why use q5 for key cache?

#7 opened 8 days ago by

CHNtentes

New activity in unsloth/DeepSeek-V3-GGUF 9 days ago

Are these imatrix GGUF quants?

#1 opened 10 days ago by

Kearm

llama.cpp cannot load Q6_K model

#3 opened 9 days ago by

vmajor

New activity in unsloth/DeepSeek-V3-GGUF 10 days ago

Getting error with Q3-K-M

#2 opened 10 days ago by

alain401

New activity in unsloth/Qwen2.5-Coder-32B-Instruct-128K-GGUF 14 days ago

More info about this model?

#1 opened 2 months ago by

sirus

New activity in unsloth/Hermes-3-Llama-3.1-70B-bnb-4bit 18 days ago

Model card is 405B and not 70B

#1 opened 18 days ago by

Spestly

New activity in unsloth/Llama-3.3-70B-Instruct-GGUF 19 days ago

RAM requirements for running Llama-3.3-70B-Instruct-Q5_K_M.gguf

#4 opened 20 days ago by

hyadav22

New activity in unsloth/c4ai-command-r-plus-08-2024-bnb-4bit 27 days ago

NameError: name 'CohereLayerNorm' is not defined

#1 opened 29 days ago by

joelniklaus

New activity in unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit 27 days ago

Strange behaviour of Llama3.2-vision - it behaves like text model

#9 opened 29 days ago by

jirkazcech

New activity in unsloth/llama-3-8b-bnb-4bit 27 days ago

'LlamaForCausalLM' object has no attribute 'max_seq_length'

#8 opened 6 months ago by

AronVic

New activity in unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit 29 days ago

Can you post the script that was used to quantize this model please?

#2 opened 4 months ago by

ctranslate2-4you