Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

Lewdiculous
/
Moistral-11B-v2-GGUF-IQ-Imatrix-Testing

GGUF
Model card Files Files and versions Community
1
Moistral-11B-v2-GGUF-IQ-Imatrix-Testing
Ctrl+K
Ctrl+K
  • 1 contributor
History: 12 commits
Lewdiculous's picture
Lewdiculous
Q6_K, Q8_0, F16
019c61d verified over 1 year ago
  • .gitattributes
    2.38 kB
    Q6_K, Q8_0, F16 over 1 year ago
  • LICENSE
    0 Bytes
    initial commit over 1 year ago
  • Moistral-11B-v2-F16.gguf
    21.5 GB
    LFS
    Q6_K, Q8_0, F16 over 1 year ago
  • Moistral-11B-v2-IQ3_M-imat.gguf
    4.85 GB
    LFS
    IQ3_M over 1 year ago
  • Moistral-11B-v2-IQ3_S-imat.gguf
    4.69 GB
    LFS
    IQ3_S over 1 year ago
  • Moistral-11B-v2-IQ3_XS-imat.gguf
    4.45 GB
    LFS
    IQ3_XS over 1 year ago
  • Moistral-11B-v2-IQ3_XXS-imat.gguf
    4.17 GB
    LFS
    IQ3_XXS over 1 year ago
  • Moistral-11B-v2-IQ4_XS-imat.gguf
    5.77 GB
    LFS
    IQ4_XS over 1 year ago
  • Moistral-11B-v2-Q4_K_M-imat.gguf
    6.46 GB
    LFS
    Q4_K_M over 1 year ago
  • Moistral-11B-v2-Q4_K_S-imat.gguf
    6.12 GB
    LFS
    Q4_K_S over 1 year ago
  • Moistral-11B-v2-Q5_K_M-imat.gguf
    7.6 GB
    LFS
    Q5_K_M, Q5_K_S over 1 year ago
  • Moistral-11B-v2-Q5_K_S-imat.gguf
    7.4 GB
    LFS
    Q5_K_M, Q5_K_S over 1 year ago
  • Moistral-11B-v2-Q6_K-imat.gguf
    8.81 GB
    LFS
    Q6_K, Q8_0, F16 over 1 year ago
  • Moistral-11B-v2-Q8_0-imat.gguf
    11.4 GB
    LFS
    Q6_K, Q8_0, F16 over 1 year ago
  • README.md
    185 Bytes
    Update README.md over 1 year ago
  • imatrix.dat
    7.48 MB
    LFS
    Q6_K, Q8_0, F16 over 1 year ago