quant of PocketDoc's Dans-AdventurousWinds-Mk2-7b

python3 convert.py \
    -i /input/PocketDoc_Dans-AdventurousWinds-Mk2-7b/ \
    -c /input/wikitext/0000.parquet \
    -o /output/temp/ \
    -cf /output/8.0bpw/ \
    -b 8.0 \
    -hb 8
Downloads last month
2
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Datasets used to train waldie/Dans-AdventurousWinds-Mk2-7b-8bpw-h8-exl2