The Open Arabic LLM Leaderboard 2
β’
29
Technology Innovation Institute
Enterprise
company
AI & ML interests
Large language models
Articles
tiiuae's activity
IChahedΒ
authored
a
paper
3 months ago
DhiyaEddineΒ
authored
a
paper
4 months ago
yellowvmΒ
authored
a
paper
6 months ago
ybelkadaΒ
authored
a
paper
6 months ago
JingweiZuoΒ
authored
a
paper
6 months ago
yellowvmΒ
authored
2
papers
6 months ago
Post
3542
Falcon Mamba now available now in llama.cpp !
Check out GGUF files uploaded here: tiiuae/falconmamba-7b-66b9a580324dd1598b0f6d4a
Check out GGUF files uploaded here: tiiuae/falconmamba-7b-66b9a580324dd1598b0f6d4a
- 3 replies
Post
4029
FalconMamba 7B - a new model from TII (Technology Innovation Institute) is out !
- Blogpost: https://huggingface.co/blog/falconmamba
- Link to collection: tiiuae/falconmamba-7b-66b9a580324dd1598b0f6d4a
- Link to playground: tiiuae/falcon-mamba-playground
- Blogpost: https://huggingface.co/blog/falconmamba
- Link to collection: tiiuae/falconmamba-7b-66b9a580324dd1598b0f6d4a
- Link to playground: tiiuae/falcon-mamba-playground
wdevazelhesΒ
authored
a
paper
10 months ago
Post
Check out quantized weights from ISTA-DAS Lab directly in their organisation page: https://huggingface.co/ISTA-DASLab ! With official weights of AQLM (for 2bit quantization) & QMoE (1-bit MoE quantization)
Read more about these techniques below:
AQLM paper: Extreme Compression of Large Language Models via Additive Quantization (2401.06118)
QMoE: QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models (2310.16795)
Some useful links below:
AQLM repo: https://github.com/Vahe1994/AQLM
How to use AQLM & transformers: https://huggingface.co/docs/transformers/quantization#aqlm
How to use AQLM & PEFT: https://huggingface.co/docs/peft/developer_guides/quantization#aqlm-quantizaion
Great work from @BlackSamorez and team !
Read more about these techniques below:
AQLM paper: Extreme Compression of Large Language Models via Additive Quantization (2401.06118)
QMoE: QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models (2310.16795)
Some useful links below:
AQLM repo: https://github.com/Vahe1994/AQLM
How to use AQLM & transformers: https://huggingface.co/docs/transformers/quantization#aqlm
How to use AQLM & PEFT: https://huggingface.co/docs/peft/developer_guides/quantization#aqlm-quantizaion
Great work from @BlackSamorez and team !
Post
Try out Mixtral 2-bit on a free-tier Google Colab notebook right now!
https://colab.research.google.com/drive/1-xZmBRXT5Fm3Ghn4Mwa2KRypORXb855X?usp=sharing
AQLM method has been recently introduced on transformers main branch
The 2bit model can be found here: BlackSamorez/Mixtral-8x7b-AQLM-2Bit-1x16-hf-test-dispatch
And you can read more about the method here: https://huggingface.co/docs/transformers/main/en/quantization#aqlm
Great work @BlackSamorez and team!
https://colab.research.google.com/drive/1-xZmBRXT5Fm3Ghn4Mwa2KRypORXb855X?usp=sharing
AQLM method has been recently introduced on transformers main branch
The 2bit model can be found here: BlackSamorez/Mixtral-8x7b-AQLM-2Bit-1x16-hf-test-dispatch
And you can read more about the method here: https://huggingface.co/docs/transformers/main/en/quantization#aqlm
Great work @BlackSamorez and team!
-
- 5 replies
ybelkadaΒ
authored
a
paper
over 1 year ago
Hamza-AlobeidliΒ
authored
a
paper
over 1 year ago
ybelkadaΒ
authored
a
paper
over 1 year ago
ybelkadaΒ
authored
3
papers
almost 2 years ago
Petals: Collaborative Inference and Fine-tuning of Large Models
Paper
β’
2209.01188
β’
Published
β’
1
Do Pedestrians Pay Attention? Eye Contact Detection in the Wild
Paper
β’
2112.04212
β’
Published
β’
1
LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale
Paper
β’
2208.07339
β’
Published
β’
5
ybelkadaΒ
authored
a
paper
about 2 years ago