Spaces:

VPTQ-community
/

README

Running

using VPTQ for my own models

by Jamessl - opened Jul 26

Jul 26

Is there any notebook available that helps be use vptq quants for my own models cause i am unable to find any way to quantize myself,the only options i see are using existing quantized models

OpenSourceRonin

VPTQ-community org Jul 27

https://github.com/microsoft/VPTQ

Jamessl

Aug 6

•

edited Aug 6

https://github.com/microsoft/VPTQ
will check it out
thank you!

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment