Hugging Face's logo

featherless-ai-quants
/
SongTonyLi-Llama-3.2-1B-Instruct-SFT-D_chosen-HuggingFaceH4-ultrafeedback_binarized-Xlarge-GGUF

Text Generation
GGUF
conversational
Model card Files
xet
Community
SongTonyLi-Llama-3.2-1B-Instruct-SFT-D_chosen-HuggingFaceH4-ultrafeedback_binarized-Xlarge-GGUF / README.md
m8than's picture
m8than
Upload folder using huggingface_hub
362b12f verified
preview code
|
raw
history blame contribute delete
5.36 kB
metadata
base_model: >-
  SongTonyLi/Llama-3.2-1B-Instruct-SFT-D_chosen-HuggingFaceH4-ultrafeedback_binarized-Xlarge
pipeline_tag: text-generation
quantized_by: featherless-ai-quants

SongTonyLi/Llama-3.2-1B-Instruct-SFT-D_chosen-HuggingFaceH4-ultrafeedback_binarized-Xlarge GGUF Quantizations 🚀

Featherless AI Quants

Optimized GGUF quantization files for enhanced model performance

Powered by Featherless AI - run any model you'd like for a simple small fee.

Available Quantizations 📊

Quantization Type File Size
IQ4_XS SongTonyLi-Llama-3.2-1B-Instruct-SFT-D_chosen-HuggingFaceH4-ultrafeedback_binarized-Xlarge-IQ4_XS.gguf 713.71 MB
Q2_K SongTonyLi-Llama-3.2-1B-Instruct-SFT-D_chosen-HuggingFaceH4-ultrafeedback_binarized-Xlarge-Q2_K.gguf 553.96 MB
Q3_K_L SongTonyLi-Llama-3.2-1B-Instruct-SFT-D_chosen-HuggingFaceH4-ultrafeedback_binarized-Xlarge-Q3_K_L.gguf 698.59 MB
Q3_K_M SongTonyLi-Llama-3.2-1B-Instruct-SFT-D_chosen-HuggingFaceH4-ultrafeedback_binarized-Xlarge-Q3_K_M.gguf 658.84 MB
Q3_K_S SongTonyLi-Llama-3.2-1B-Instruct-SFT-D_chosen-HuggingFaceH4-ultrafeedback_binarized-Xlarge-Q3_K_S.gguf 611.96 MB
Q4_K_M SongTonyLi-Llama-3.2-1B-Instruct-SFT-D_chosen-HuggingFaceH4-ultrafeedback_binarized-Xlarge-Q4_K_M.gguf 770.28 MB
Q4_K_S SongTonyLi-Llama-3.2-1B-Instruct-SFT-D_chosen-HuggingFaceH4-ultrafeedback_binarized-Xlarge-Q4_K_S.gguf 739.71 MB
Q5_K_M SongTonyLi-Llama-3.2-1B-Instruct-SFT-D_chosen-HuggingFaceH4-ultrafeedback_binarized-Xlarge-Q5_K_M.gguf 869.28 MB
Q5_K_S SongTonyLi-Llama-3.2-1B-Instruct-SFT-D_chosen-HuggingFaceH4-ultrafeedback_binarized-Xlarge-Q5_K_S.gguf 851.21 MB
Q6_K SongTonyLi-Llama-3.2-1B-Instruct-SFT-D_chosen-HuggingFaceH4-ultrafeedback_binarized-Xlarge-Q6_K.gguf 974.46 MB
Q8_0 SongTonyLi-Llama-3.2-1B-Instruct-SFT-D_chosen-HuggingFaceH4-ultrafeedback_binarized-Xlarge-Q8_0.gguf 1259.88 MB

⚡ Powered by Featherless AI

Key Features

  • 🔥 Instant Hosting - Deploy any Llama model on HuggingFace instantly
  • 🛠️ Zero Infrastructure - No server setup or maintenance required
  • 📚 Vast Compatibility - Support for 2400+ models and counting
  • 💎 Affordable Pricing - Starting at just $10/month

Links:
Get Started | Documentation | Models