Marc Sun's picture

Marc Sun

marcsun13

·

AI & ML interests

LLM, Quantization, Training, Inference

Recent Activity

liked a model 5 days ago

deepseek-ai/DeepSeek-R1-0528

reacted to sayakpaul's post with 🚀 6 days ago

Diffusers supports a good variety of quantization backends. It can be challenging to navigate through them, given the complex nature of diffusion pipelines in general. So, @derekl35 set out to write a comprehensive guide that puts users in the front seat. Explore the different backends we support, learn the trade-offs they offer, and finally, check out the cool space we built that lets you compare quantization results. Give it a go here: https://lnkd.in/gf8Pi4-2

reacted to sayakpaul's post with 🤗 6 days ago

Diffusers supports a good variety of quantization backends. It can be challenging to navigate through them, given the complex nature of diffusion pipelines in general. So, @derekl35 set out to write a comprehensive guide that puts users in the front seat. Explore the different backends we support, learn the trade-offs they offer, and finally, check out the cool space we built that lets you compare quantization results. Give it a go here: https://lnkd.in/gf8Pi4-2

View all activity

Organizations

Articles 10

Article

29

Exploring Quantization Backends in Diffusers

Article

32

Introducing AutoRound: Intel’s Advanced Quantization for LLMs and VLMs

View all Articles

models 19

marcsun13/Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • Updated Mar 20 • 8

marcsun13/phi-4-bnb-4bit

Text Generation • Updated Mar 18 • 10

marcsun13/Llama-3.2-1B-bnb-4bit

Text Generation • Updated Mar 18 • 9

marcsun13/Llama-3.2-1B-Instruct-SpinQuant_INT4_EO8

marcsun13/paligemma_vqav2

marcsun13/Meta-Llama-3-8B-torchao-int8_weight_only

Updated Oct 18, 2024 • 2

marcsun13/sft_openassistant-guanaco

Text Generation • Updated Jul 5, 2024 • 12

marcsun13/gemma-2-27b-it-bnb-colab

Text Generation • Updated Jul 4, 2024 • 11

marcsun13/gemma-2-9b-it-GPTQ

Text Generation • Updated Jul 3, 2024 • 377 • 3

marcsun13/test_push_checkpoint

Fill-Mask • Updated Jun 28, 2024 • 4

datasets 0

None public yet