ISTA-DASLab/Llama-2-7b-AQLM-2Bit-1x16-hf
Text Generation • 1B • Updated • 268 • 5
AI & ML interests
None defined yet.
Recent Activity
View all activity
Papers
MatryoshkaLoRA: Learning Accurate Hierarchical Low-Rank Representations for LLM Fine-Tuning
GSQ: Highly-Accurate Low-Precision Scalar Quantization for LLMs via Gumbel-Softmax Sampling
ISTA-DASLab/Mixtral-8x7b-AQLM-2Bit-1x16-hf
Text Generation • 7B • Updated • 149 • 23
ISTA-DASLab/gemma-2b-AQLM-2Bit-2x8-hf
Text Generation • 1B • Updated • 14 • 4
ISTA-DASLab/gemma-2b-AQLM-2Bit-1x16-hf
Text Generation • 0.8B • Updated • 117 • 6
ISTA-DASLab/Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf
Text Generation • 7B • Updated • 16 • 19
ISTA-DASLab/Llama-2-13b-AQLM-4Bit-2x16-hf
Text Generation • Updated • 8
ISTA-DASLab/Llama-2-70b-AQLM-4Bit-2x16-hf
Text Generation • 18B • Updated • 9
ISTA-DASLab/switch-c-2048_qmoe
Updated • 7 • 4
ISTA-DASLab/switch-large-128_qmoe
Updated • 11
ISTA-DASLab/switch-base-128_qmoe
Updated • 11 • 1