Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
SpectraSuite 's Collections
TriLMs-Unpacked
FloatLMs
QuantLMs-8Bit-Unpacked
QuantLMs-6Bit-Unpacked
QuantLMs-4Bit-Unpacked
QuantLMs-3Bit-Unpacked

QuantLMs-6Bit-Unpacked

updated Jul 18, 2024

QuantLMs, unpacked to FP16 format - compatible with FP16 GEMMs. After unpacking, QuantLMs have the same architecture as LLaMa.

Upvote
-

  • SpectraSuite/QuantLM_3.9B_6bit_Unpacked

    Text Generation • Updated Jul 18, 2024 • 3

  • SpectraSuite/QuantLM_2.3B_6bit_Unpacked

    Text Generation • Updated Jul 18, 2024 • 7

  • SpectraSuite/QuantLM_1.5B_6bit_Unpacked

    Text Generation • Updated Jul 18, 2024 • 5

  • SpectraSuite/QuantLM_1.1B_6bit_Unpacked

    Text Generation • Updated Jul 18, 2024 • 5

  • SpectraSuite/QuantLM_830M_6bit_Unpacked

    Text Generation • Updated Jul 18, 2024 • 5

  • SpectraSuite/QuantLM_560M_6bit_Unpacked

    Text Generation • Updated Jul 18, 2024 • 5

  • SpectraSuite/QuantLM_390M_6bit_Unpacked

    Text Generation • Updated Jul 18, 2024 • 7

  • SpectraSuite/QuantLM_190M_6bit_Unpacked

    Text Generation • Updated Jul 18, 2024 • 12

  • SpectraSuite/QuantLM_99M_6bit_Unpacked

    Text Generation • Updated Jul 18, 2024 • 5
Upvote
-
  • Collection guide
  • Browse collections
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs