SpectraSuite/QuantLM_3.9B_6bit_Unpacked
Text Generation
•
4B
•
Updated
•
8
QuantLMs-6Bit-Unpacked
QuantLMs, unpacked to FP16 format - compatible with FP16 GEMMs. After unpacking, QuantLMs have the same architecture as LLaMa.
-
-
SpectraSuite/QuantLM_2.3B_6bit_Unpacked
Text Generation • 2B • Updated • 11 -
SpectraSuite/QuantLM_1.5B_6bit_Unpacked
Text Generation • 2B • Updated • 9 -
SpectraSuite/QuantLM_1.1B_6bit_Unpacked
Text Generation • 1B • Updated • 27 -
SpectraSuite/QuantLM_830M_6bit_Unpacked
Text Generation • 0.8B • Updated • 28 -
SpectraSuite/QuantLM_560M_6bit_Unpacked
Text Generation • 0.6B • Updated • 6 -
SpectraSuite/QuantLM_390M_6bit_Unpacked
Text Generation • 0.4B • Updated • 8 -
SpectraSuite/QuantLM_190M_6bit_Unpacked
Text Generation • 0.2B • Updated • 7 -
SpectraSuite/QuantLM_99M_6bit_Unpacked
Text Generation • 0.1B • Updated • 13