Hugging Face's logo
Marc Sun's picture
37 45 71

Marc Sun

marcsun13
andito's profile picture wildblount's profile picture Theartplug's profile picture
·

AI & ML interests

LLM, Quantization, Training, Inference

Recent Activity

updated a model 5 days ago
marcsun13/Llama-3.1-8B-Instruct-bnb-4bit
published a model 5 days ago
marcsun13/Llama-3.1-8B-Instruct-bnb-4bit
updated a Space 5 days ago
bnb-community/bnb-my-repo
View all activity

Organizations

Hugging Face's profile picture Hugging Face Internal Testing Organization's profile picture HuggingFaceM4's profile picture Hugging Face OSS Metrics's profile picture accelerate's profile picture Hugging Face Smol Models Research's profile picture Quanto library's profile picture LocalLLaMA's profile picture MLX Community's profile picture Hugging Face 1Bit LLMs's profile picture Paris AI Running Club's profile picture LLHF's profile picture SLLHF's profile picture Hugging Quants's profile picture Hugging Face Party @ PyTorch Conference's profile picture qrias's profile picture DDUF's profile picture gg-hf-g's profile picture Bitsandbytes Community's profile picture

marcsun13's activity

published an article 18 days ago
view article
Article

LLM Inference on Edge: A Fun and Easy Guide to run LLMs via React Native on your Phone!

By medmekk and 1 other •
• 45
published an article 5 months ago
published an article 6 months ago
view article
Article

Fine-tuning LLMs to 1.58bit: extreme quantization made easy

By medmekk and 5 others •
• 227
published an article 6 months ago
published an article 8 months ago
view article
Article

Llama 3.1 - 405B, 70B & 8B with multilinguality and long context

By philschmid and 7 others •
• 231
published an article about 1 year ago
view article
Article

quanto: a pytorch quantization toolkit

By dacorvo and 2 others •
• 35
published an article over 1 year ago
view article
Article

Overview of natively supported quantization schemes in 🤗 Transformers

By ybelkada and 4 others •
• 12
published an article over 1 year ago
view article
Article

Making LLMs lighter with AutoGPTQ and transformers

By marcsun13 and 5 others •
• 45