Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

8-bit precision

text-generation-inference

Inference Endpoints

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

282

Full-text search

Active filters: autogptq

fbaldassarri/openlm-research_open_llama_7b_v2-autogptq-int8-gs128-sym

Text Generation • Updated Apr 3 • 8

fbaldassarri/openlm-research_open_llama_7b_v2-autogptq-int4-gs64-sym

Text Generation • Updated Apr 6 • 7

fbaldassarri/openlm-research_open_llama_3b_v2-autogptq-int8-gs128-asym

Text Generation • Updated Apr 6 • 10

fbaldassarri/openlm-research_open_llama_3b_v2-autogptq-int8-gs128-sym

Text Generation • Updated Apr 6 • 9

fbaldassarri/openlm-research_open_llama_3b_v2-autogptq-int8-gs64-asym

Text Generation • Updated Apr 10 • 18

fbaldassarri/openlm-research_open_llama_3b_v2-autogptq-int8-gs64-sym

Text Generation • Updated Apr 10 • 21

fbaldassarri/allenai_Llama-3.1-Tulu-3-8B-SFT-autogptq-int4-gs128-asym

Text Generation • Updated Apr 12 • 28

fbaldassarri/allenai_Llama-3.1-Tulu-3-8B-SFT-autogptq-int4-gs128-sym

Text Generation • Updated Apr 13 • 36

fbaldassarri/allenai_Llama-3.1-Tulu-3-8B-DPO-autogptq-int4-gs128-asym

Text Generation • Updated Apr 15 • 33

fbaldassarri/allenai_Llama-3.1-Tulu-3-8B-DPO-autogptq-int4-gs128-sym

Text Generation • Updated Apr 15 • 33

fbaldassarri/ibm-granite_granite-3.2-2b-instruct-autogptq-int4-gs128-asym

Text Generation • Updated about 1 month ago • 62

fbaldassarri/ibm-granite_granite-3.2-2b-instruct-autogptq-int4-gs128-sym

Text Generation • Updated about 1 month ago • 41

fbaldassarri/ibm-granite_granite-3.2-2b-instruct-autogptq-int8-gs128-asym

Text Generation • Updated 30 days ago • 37

fbaldassarri/ibm-granite_granite-3.2-2b-instruct-autogptq-int8-gs128-sym

Text Generation • Updated 30 days ago • 51

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autogptq-int4-gs128-asym

Text Generation • Updated 30 days ago • 57

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autogptq-int4-gs128-sym

Text Generation • Updated 30 days ago • 49

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autogptq-int8-gs128-asym

Text Generation • Updated 30 days ago • 19

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autogptq-int8-gs128-sym

Text Generation • Updated 30 days ago • 33

fbaldassarri/ibm-granite_granite-3.3-2b-base-autogptq-int4-gs128-asym

Text Generation • Updated 28 days ago • 23

fbaldassarri/ibm-granite_granite-3.3-2b-base-autogptq-int4-gs128-sym

Text Generation • Updated 28 days ago • 12

fbaldassarri/ibm-granite_granite-3.3-2b-base-autogptq-int8-gs128-asym

Text Generation • Updated 28 days ago • 129

fbaldassarri/ibm-granite_granite-3.3-2b-base-autogptq-int8-gs128-sym

Text Generation • Updated 28 days ago • 150

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autogptq-int4-gs64-asym

Text Generation • Updated 26 days ago • 6

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autogptq-int4-gs64-sym

Text Generation • Updated 26 days ago • 9

fbaldassarri/ibm-granite_granite-3.3-2b-base-autogptq-int4-gs64-asym

Text Generation • Updated 26 days ago • 8

fbaldassarri/ibm-granite_granite-3.3-2b-base-autogptq-int4-gs64-sym

Text Generation • Updated 26 days ago • 7

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autogptq-int8-gs64-asym

Text Generation • Updated 25 days ago • 7

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autogptq-int8-gs64-sym

Text Generation • Updated 25 days ago • 9

fbaldassarri/ibm-granite_granite-3.3-2b-base-autogptq-int8-gs64-asym

Text Generation • Updated 25 days ago • 7

fbaldassarri/ibm-granite_granite-3.3-2b-base-autogptq-int8-gs64-sym

Text Generation • Updated 25 days ago • 5