Shuming Ma

shumingma's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

authored a paper about 1 month ago

BitNet v2: Native 4-bit Activations with Hadamard Transformation for 1-bit LLMs

Paper • 2504.18415 • Published Apr 25 • 43

New activity in microsoft/bitnet-b1.58-2B-4T about 1 month ago

Eval numbers for Llama 3.2 1B in Table 1 don't match Meta's results

3

#28 opened about 1 month ago by

AlexA5432

Important confirmation: about the deviation from the model that was originally uploaded

5

#12 opened about 2 months ago by

AXCXEPT

upvoted 2 papers about 2 months ago

BitNet: Scaling 1-bit Transformers for Large Language Models

Paper • 2310.11453 • Published Oct 17, 2023 • 103

BitNet b1.58 2B4T Technical Report

Paper • 2504.12285 • Published Apr 16 • 73

New activity in microsoft/bitnet-b1.58-2B-4T-gguf about 2 months ago

gguf not llama.cpp compatible yet

3

#2 opened about 2 months ago by

lefromage

New activity in microsoft/bitnet-b1.58-2B-4T about 2 months ago

Missing configuration_bitnet.py.

👍 6

5

#9 opened about 2 months ago by

here4code

authored a paper about 2 months ago

BitNet b1.58 2B4T Technical Report

Paper • 2504.12285 • Published Apr 16 • 73

New activity in microsoft/bitnet-b1.58-2B-4T about 2 months ago

configuration_bitnet.py missing

➕ 👀 10

15

#4 opened about 2 months ago by

lefromage

Technical Report Link Missing

1

#1 opened about 2 months ago by

G-reen

upvoted a collection about 2 months ago

BitNet

Collection

🔥BitNet family of large language models (1-bit LLMs). • 7 items • Updated May 1 • 42

liked 3 models about 2 months ago

microsoft/bitnet-b1.58-2B-4T-gguf

Text Generation • Updated May 1 • 10.7k • 175

microsoft/bitnet-b1.58-2B-4T-bf16

Text Generation • Updated May 1 • 3.06k • 27

microsoft/bitnet-b1.58-2B-4T

Text Generation • Updated May 1 • 39.7k • 1.05k

authored 2 papers 6 months ago

BitNet a4.8: 4-bit Activations for 1-bit LLMs

Paper • 2411.04965 • Published Nov 7, 2024 • 69

MH-MoE:Multi-Head Mixture-of-Experts

Paper • 2411.16205 • Published Nov 25, 2024 • 29

upvoted a paper 7 months ago

BitNet a4.8: 4-bit Activations for 1-bit LLMs

Paper • 2411.04965 • Published Nov 7, 2024 • 69

commented a paper 8 months ago

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Paper • 2402.17764 • Published Feb 27, 2024 • 618 •

143

upvoted an article 9 months ago

view article

Article

Fine-tuning LLMs to 1.58bit: extreme quantization made easy

By and 5 others •

Sep 18, 2024

• 246

upvoted a paper 11 months ago

Q-Sparse: All Large Language Models can be Fully Sparsely-Activated

Paper • 2407.10969 • Published Jul 15, 2024 • 23