numen-tech
/

Mistral-7B-Instruct-v0.3-w4a16g128asym

Model card Files Files and versions Community

Mistral-7B-Instruct-v0.3-w4a16g128asym / README.md

numen-tech's picture

Add weights

396d73f about 1 year ago

|

history blame contribute delete

194 Bytes

metadata

license: apache-2.0

4-bit OmniQuant quantized version of Mistral-7B-Instruct-v0.3.