Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
DeusImperator 's Collections
EXL2 70B for 24GB VRAM
Small models 8bpw EXL2 quants
Mid-range models exl2 quants
Exl2 8bpw MAX quants

Exl2 8bpw MAX quants

updated Sep 22, 2024

8 BPW exl2 quants using modified quantization script to force using best quantization method for each layer for max quality

Upvote
-

  • DeusImperator/Lyra4-Gutenberg-12B_exl2_8bpw_max

    Text Generation • Updated Sep 12, 2024 • 9 • 1

  • DeusImperator/Lyra4-Gutenberg-12B_exl2_8bpw_max_rpcal_mk2

    Text Generation • Updated Sep 12, 2024 • 6

  • DeusImperator/Nemomix-v4.0-12B_exl2_8bpw_max

    Text Generation • Updated Aug 1, 2024 • 8

  • DeusImperator/MN-12B-Lyra-v1_exl2_8bpw_max

    Updated Aug 6, 2024 • 2

  • DeusImperator/MN-12B-Lyra-v4_exl2_8bpw_max_rpcal_mk2

    Updated Sep 10, 2024

  • DeusImperator/Lumimaid-v0.2-12B_exl2_8bpw_max

    Text Generation • Updated Jul 29, 2024 • 8

  • DeusImperator/Celeste-12B-V1.6_exl2_8bpw_max

    Text Generation • Updated Jul 29, 2024 • 8 • 1

  • DeusImperator/mini-magnum-12b-v1.1_exl2_8bpw_max

    Text Generation • Updated Jul 24, 2024 • 8

  • DeusImperator/MN-12B-Lyra-v4_exl2_8bpw_max

    Updated Sep 9, 2024

  • DeusImperator/mistral-doryV2-12b_exl2_8bpw_max

    Text Generation • Updated Jul 25, 2024 • 9
Upvote
-
  • Collection guide
  • Browse collections
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs