This is repo hosts quantized versions of the following models: https://huggingface.co/fireworks-ai/firefunction-v1
Quantization was done with this script: https://github.com/CharlesMod/quantizeHFmodel
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
๐
Ask for provider support