zay25/mnlp-model-A8W8-torchao
Text Generation
•
Updated
•
58
Edit Models filters
Inference Providers
Active filters:
torchao
keko24/qwen-int4
Text Generation
•
Updated
•
19
zay25/test-A8W8
Text Generation
•
Updated
•
25
zechen-nlp/Qwen3-0.6B-Base-torchao-w8a8
Text Generation
•
Updated
•
90
Cloudmaster/Llama-3.2-3B-torchao-final00
Text Generation
•
Updated
•
33
Cloudmaster/Llama-3.2-3B-torchao-final-woclass
Text Generation
•
Updated
•
14
Cloudmaster/Llama-3.2-3B-torchao-final-wattn
Text Generation
•
Updated
•
49
•
1
Cloudmaster/Llama-3.2-3B-torchao-final01
Text Generation
•
Updated
•
8
Cloudmaster/Llama-3.2-3B-torchao-final02
Text Generation
•
Updated
•
8
oskdabk/test_model_2
Text Generation
•
Updated
•
89
Cloudmaster/Llama-3.2-3B-torchao-final03
Text Generation
•
Updated
•
24
drisspg/fp8-opt-125m
Text Generation
•
Updated
•
90
jerryzh168/opt-125m-int8wo-partial-quant
Text Generation
•
Updated
•
61
Cloudmaster/Llama-3.2-3B-torchao-W8A8
Text Generation
•
Updated
•
12
Cloudmaster/Llama-3.2-3B-torchao-W8-g128
Text Generation
•
Updated
•
12
Cloudmaster/Llama-3.2-3B-torchao-W8-g256
Text Generation
•
Updated
•
12
Cloudmaster/Llama-3.2-3B-torchao-W8-g64
Text Generation
•
Updated
•
11
Cloudmaster/Llama-3.2-3B-torchao-W8-g32
Text Generation
•
Updated
•
11
Cloudmaster/Llama-3.2-3B-torchao-W8A4-g128
Text Generation
•
Updated
•
12
testdummyvt/Qwen2.5-VL-3B-Instruct-int8-weightonly-torchao
Image-Text-to-Text
•
Updated
•
48
appy1234/Llama3.1-8B-Int8DynamicActivationInt8WeightQuantized
Text Generation
•
Updated
•
5
appy1234/Llama-3.2-3B-Instruct-Int8DynamicActivationInt8WeightQuantized
Text Generation
•
Updated
•
5
mobicham/Qwen2.5-VL-3B-Instruct_int8wo_ao
Image-Text-to-Text
•
Updated
•
4
arthurrpp/qwen3-0.6B-sq-w8a8
Updated
•
51