Quantized using the default exllamav3 (0.0.2) quantization process.
- Original model: https://huggingface.co/nbeerbower/EVA-Gutenberg3-Qwen2.5-32B
- exllamav3: https://github.com/turboderp-org/exllamav3
EVA-Gutenberg3-Qwen2.5-32B
EVA-UNIT-01/EVA-Qwen2.5-32B-v0.2 finetuned on jondurbin/gutenberg-dpo-v0.1, nbeerbower/gutenberg2-dpo, and nbeerbower/gutenberg-moderne-dpo.
Method
ORPO tuned with 8x A100 for 2 epochs.
- Downloads last month
- 4
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for MetaphoricalCode/EVA-Gutenberg3-Qwen2.5-32B-exl3-5bpw-hb6
Base model
Qwen/Qwen2.5-32B
Finetuned
EVA-UNIT-01/EVA-Qwen2.5-32B-v0.2
Finetuned
nbeerbower/EVA-Gutenberg3-Qwen2.5-32B