EXL3 quantization of OpenReasoning-Nemotron-7B, 8 bits per weight, including output layers.

Downloads last month
8
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for isogen/OpenReasoning-Nemotron-7B-exl3-8bpw-h8

Base model

Qwen/Qwen2.5-7B
Quantized
(26)
this model