Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
warshanks 's Collections
Menlo Research AWQ
AWQ Quants
Mistral Quants
MedGemma MLX
Lingshu MLX
DeepSeek MLX
Medical MLX
Nemotron MLX
TheDrummer MLX
Abliterated MLX
Arcee AI MLX
Jedi MLX-VLM
MiMo-VL MLX-VLM
Sarvam-M MLX

AWQ Quants

updated 6 days ago

W4A16 quants made with llmcompressor

Upvote
1

  • warshanks/Qwen3-4B-abliterated-AWQ

    Text Generation • 1B • Updated 13 days ago • 42

  • warshanks/Josiefied-Qwen3-4B-abliterated-v2-AWQ

    Text Generation • 1B • Updated 15 days ago • 36

  • warshanks/Ministral-8B-Instruct-2410-AWQ

    2B • Updated 13 days ago • 25

  • warshanks/Jan-nano-AWQ

    Text Generation • 1B • Updated 12 days ago • 33 • 1

  • warshanks/Jan-nano-128k-AWQ

    Text Generation • 1B • Updated 10 days ago • 21

  • warshanks/Dolphin-Mistral-24B-Venice-Edition-AWQ

    4B • Updated 7 days ago • 20

  • warshanks/Lucy-AWQ

    Text Generation • 0.8B • Updated 6 days ago • 16

  • warshanks/Lucy-128k-AWQ

    Text Generation • 0.8B • Updated 6 days ago • 13
Upvote
1
  • Collection guide
  • Browse collections
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs