relaxml
/

Llama-3.1-70B-Instruct-2Bit-YAQA-QTIP

Model card Files Files and versions Community

No model card

Downloads last month: 16

Safetensors

Model size

10.7B params

Tensor type

BF16

·

I16

·

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including relaxml/Llama-3.1-70B-Instruct-2Bit-YAQA-QTIP

YAQA

YAQA hessians (Sketch B) and models with the QTIP quantizer. See https://github.com/Cornell-RelaxML/yaqa/tree/main for more details. • 9 items • Updated 2 days ago • 1