SpectraSuite/QuantLM_3.9B_8bit_Unpacked
Text Generation
•
4B
•
Updated
•
12
QuantLMs-8Bit-Unpacked
QuantLMs, unpacked to FP16 format - compatible with FP16 GEMMs. After unpacking, QuantLMs have the same architecture as LLaMa.
-
-
SpectraSuite/QuantLM_2.3B_8bit_Unpacked
Text Generation • 2B • Updated • 16 -
SpectraSuite/QuantLM_1.5B_8bit_Unpacked
Text Generation • 2B • Updated • 11 -
SpectraSuite/QuantLM_1.1B_8bit_Unpacked
Text Generation • 1B • Updated • 13 -
SpectraSuite/QuantLM_830M_8bit_Unpacked
Text Generation • 0.8B • Updated • 11 -
SpectraSuite/QuantLM_560M_8bit_Unpacked
Text Generation • 0.6B • Updated • 11 -
SpectraSuite/QuantLM_390M_8bit_Unpacked
Text Generation • 0.4B • Updated • 18 -
SpectraSuite/QuantLM_190M_8bit_Unpacked
Text Generation • 0.2B • Updated • 58 -
SpectraSuite/QuantLM_99M_8bit_Unpacked
Text Generation • 0.1B • Updated • 32