vilsonrodrigues's picture
Create README.md
37f9e0a verified
metadata
license: apache-2.0
tags:
  - mistral
  - pruned

A Mistral-7B pruned50

Please see my tutorial to execute this model:

https://vilsonrodrigues.medium.com/sparse-quantize-and-serving-llms-with-neuralmagic-autogptq-and-vllm-03961b72ec3a