MikeRoz
/

DS-R1-Distill-70B-ArliAI-RpR-v4-Large-exl2

Text Generation

Model card Files Files and versions Community

exllamav2 quantizations of ArliAI's DS-R1-Distill-70B-ArliAI-RpR-v4-Large

2.25bpw h6 (20.678 GiB)
4.25bpw h6 (36.616 GiB)
6.00bpw h6 (50.561 GiB)
8.00bpw h8 (66.658 GiB) (Queued for upload)
measurement.json

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

Text Generation

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for MikeRoz/DS-R1-Distill-70B-ArliAI-RpR-v4-Large-exl2

Base model

deepseek-ai/DeepSeek-R1-Distill-Llama-70B

Finetuned

ArliAI/DS-R1-Distill-70B-ArliAI-RpR-v4-Large

Quantized

(6)

this model