Doctor-Shotgun
/

L3.3-70B-Magnum-v5-SFT-Alpha-FP8-Dynamic

Text Generation

text-generation-inference

compressed-tensors

Model card Files Files and versions Community

L3.3-70B-Magnum-v5-SFT-Alpha-FP8-Dynamic

Dynamic fp8 quantization of Doctor-Shotgun/L3.3-70B-Magnum-v5-SFT-Alpha using llm-compressor.

Downloads last month: 4

Safetensors

Model size

70.6B params

Tensor type

BF16

·

F8_E4M3

·

Inference Providers NEW

Text Generation

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support