mobiuslabsgmbh/Llama-3.1-8B-Instruct_gemlite-ao_a16w4_gs_128_pack_32bit
Text Generation
•
Updated
•
7
•
1
Edit Models filters
Inference Providers
Active filters:
torchao
mobiuslabsgmbh/Llama-3.1-8B-Instruct_gemlite-ao_a16w4_gs_128_pack_16bit
Text Generation
•
Updated
•
10
•
1
mobiuslabsgmbh/Phi-4-mini-instruct_gemlite-ao_a16w4_gs_128_pack_32bit
Text Generation
•
Updated
•
10
•
1
mobiuslabsgmbh/Phi-4-mini-instruct_gemlite-ao_a16w4_gs_128_pack_16bit
Text Generation
•
Updated
•
10
•
1
mobiuslabsgmbh/Qwen2.5-7B-Instruct_gemlite-ao_a16w4_gs_128_pack_32bit
Text Generation
•
Updated
•
35
•
1
mobiuslabsgmbh/Qwen3-32B_gemlite-ao_a16w4_gs_128_pack_32bit
Text Generation
•
Updated
•
12
•
1
mobiuslabsgmbh/Qwen2.5-VL-7B-Instruct_gemlite-ao_a16w4_gs_128_pack_32bit
Image-Text-to-Text
•
Updated
•
17
•
1
jerryzh168/llama3-int4wo-128
Updated
•
8
medmekk/Meta-Llama-3-8B-quantized-int8_weight_only
Updated
•
4
medmekk/Meta-Llama-3-8B-quantized-int8_dynamic_activation_int8_weight
Updated
•
2
medmekk/Meta-Llama-3-8B-quantized-int4_weight_only
Updated
•
7
medmekk/Meta-Llama-3-8B-quantized-int8_weight_only-2
Updated
•
2
medmekk/Meta-Llama-3-8B-quantized-int4_weight_only-2
Updated
•
3
medmekk/Meta-Llama-3-8B-torchao-int4_weight_only-gs-64
Updated
•
1
medmekk/Meta-Llama-3-8B-torchao-int4_weight_only-gs-32
Updated
•
5
medmekk/Meta-Llama-3-8B-torchao-int4_weight_only-gs_256
Updated
•
4
medmekk/Meta-Llama-3-8B-torchao-int8_weight_only
Updated
•
2
medmekk/Meta-Llama-3-8B-torchao-int8_dynamic_activation_int8_weight
Updated
•
11
medmekk/gpt2-torchao-int8_weight_only
Updated
•
4
medmekk/Llama-3.1-70B-torchao-int8_weight_only
Updated
•
6
medmekk/new_model
Updated
•
2
medmekk/qsdf
Updated
•
4
medmekk/new_gpt2
Updated
•
9
medmekk/an_other_torchao
Updated
•
3
medmekk/an_other_torchao_dynamic
Updated
•
5
marcsun13/Meta-Llama-3-8B-torchao-int8_weight_only
Updated
•
5
medmekk/new_tesing_model
Updated
•
3
medmekk/testing_int4
Updated
•
1
medmekk/quantized_int8_2
Updated
•
3
medmekk/quantized_int4
Updated
•
6