Matthew Gammett

Permahuman's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in bartowski/Qwen_Qwen3-30B-A3B-GGUF about 1 month ago

What are folks opinion on 4KM quants? Are they viable?

👍 1

1

#3 opened about 1 month ago by

Permahuman

New activity in FunAGI/Qwen2.5-Omni-7B-GPTQ-4bit 2 months ago

test the inference script and quantized model, but have error as below

6

#1 opened 2 months ago by

wikeeyang

New activity in Qwen/Qwen2.5-Omni-7B 3 months ago

Can this be quantized with bitsAndBytes?

8

#6 opened 3 months ago by

Permahuman

New activity in bartowski/mistralai_Mistral-Small-3.1-24B-Instruct-2503-GGUF 3 months ago

Does this include the vision capabilities?

4

#1 opened 3 months ago by

x0wllaar

New activity in Tyrannosaurus/TinyGPT-V over 1 year ago

Quants?

1

#1 opened over 1 year ago by

KatyTheCutie