37 45 71

Marc Sun

marcsun13

AI & ML interests

LLM, Quantization, Training, Inference

Recent Activity

updated a model 5 days ago

marcsun13/Llama-3.1-8B-Instruct-bnb-4bit

published a model 5 days ago

marcsun13/Llama-3.1-8B-Instruct-bnb-4bit

updated a Space 5 days ago

bnb-community/bnb-my-repo

View all activity

Organizations

marcsun13's activity

upvoted an article 6 days ago

Article

NVIDIA's GTC 2025 Announcement for Physical AI Developers: New Open Models and Datasets

7 days ago

• 29

upvoted 2 articles 13 days ago

Article

Welcome Gemma 3: Google's all new multimodal, multilingual, long context open LLM

13 days ago

• 342

Article

LLM Inference on Edge: A Fun and Easy Guide to run LLMs via React Native on your Phone!

18 days ago

• 45

upvoted a paper 3 months ago

LoftQ: LoRA-Fine-Tuning-Aware Quantization for Large Language Models

Paper • 2310.08659 • Published Oct 12, 2023 • 27

upvoted an article 5 months ago

Article

Fixing Gradient Accumulation

Oct 16, 2024

• 52

upvoted 3 articles 6 months ago

Article

Fine-tuning LLMs to 1.58bit: extreme quantization made easy

Sep 18, 2024

• 227

Article

Accelerate 1.0.0

Sep 13, 2024

• 52

Article

SmolLM - blazingly fast and remarkably powerful

Jul 16, 2024

• 344

upvoted an article 8 months ago

Article

XetHub is joining Hugging Face!

Aug 8, 2024

• 84

upvoted an article 10 months ago

Article

Benchmarking Text Generation Inference

May 29, 2024

• 30

upvoted a paper 10 months ago

Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations

Paper • 2405.18392 • Published May 28, 2024 • 12

upvoted an article 10 months ago

Article

License to Call: Introducing Transformers Agents 2.0

May 13, 2024

• 131

upvoted a paper 11 months ago

BitNet: Scaling 1-bit Transformers for Large Language Models

Paper • 2310.11453 • Published Oct 17, 2023 • 98

upvoted an article 11 months ago

Article

Welcome Llama 3 - Meta's new open LLM

Apr 18, 2024

• 286

upvoted a collection 11 months ago

Meta Llama 3

Collection

This collection hosts the transformers and original repos of the Meta Llama 3 and Llama Guard 2 releases • 5 items • Updated Dec 6, 2024 • 726

upvoted 3 articles 11 months ago

Article

Vision Language Models Explained

Apr 11, 2024

• 293

Article

Introducing Idefics2: A Powerful 8B Vision-Language Model for the community

Apr 15, 2024

• 175

Article

Overview of natively supported quantization schemes in 🤗 Transformers

Sep 12, 2023

• 12

upvoted 2 articles 12 months ago

Article

Making LLMs lighter with AutoGPTQ and transformers

Aug 23, 2023

• 45

Article

A Gentle Introduction to 8-bit Matrix Multiplication for transformers at scale using transformers, accelerate and bitsandbytes

Aug 17, 2022

• 81