fxmarty/llama-tiny-testing-quark-indev
Updated
•
3
Edit Models filters
Inference Providers
Active filters:
quark
fxmarty/llama-tiny-int4-per-group-sym
Updated
•
13
fxmarty/llama-tiny-w-fp8-a-fp8
Updated
•
8
fxmarty/llama-tiny-w-fp8-a-fp8-o-fp8
Updated
•
13
fxmarty/llama-tiny-w-int8-per-tensor
Updated
•
31
fxmarty/llama-small-int4-per-group-sym-awq
Updated
•
20
fxmarty/quark-legacy-int8
Updated
•
9
fxmarty/llama-tiny-w-int8-b-int8-per-tensor
Updated
•
6
fxmarty/llama-small-int4-per-group-sym-awq-old
Updated
•
10
amd-quark/llama-tiny-w-int8-per-tensor
Updated
•
51
amd-quark/llama-tiny-w-int8-b-int8-per-tensor
Updated
•
57
amd-quark/llama-tiny-w-fp8-a-fp8
Updated
•
57
amd-quark/llama-tiny-w-fp8-a-fp8-o-fp8
Updated
•
57
amd-quark/llama-tiny-int4-per-group-sym
Updated
•
58
amd-quark/llama-small-int4-per-group-sym-awq
Updated
•
55
amd-quark/quark-legacy-int8
Updated
•
7
amd/Llama-3.1-8B-Instruct-FP8-KV-Quark-test
Updated
•
2.6k
amd/Llama-3.1-8B-Instruct-w-int8-a-int8-sym-test
Updated
•
1.97k
EmbeddedLLM/Llama-3.1-8B-Instruct-w_fp8_per_channel_sym
Text Generation
•
Updated
•
15
amd/DeepSeek-R1-Distill-Llama-8B-awq-asym-uint4-g128-lmhead
Text Generation
•
Updated
•
6
amd-quark/llama-tiny-fp8-quark-quant-method
Updated
•
1.29k
aigdat/Qwen2.5-Coder-7B-quantized-ppl-14
Updated
•
5
aigdat/Qwen2-7B-Instruct_quantized_int4_bfloat16
Updated
•
5
aigdat/Qwen2.5-1.5B-Instruct-awq-uint4-bfloat16
Updated
•
8
aigdat/Qwen2.5-0.5B-Instruct-awq-int4-asym-g128-fp16
Updated
•
8
superbigtree/Mistral-Nemo-Instruct-2407-FP8
Updated
•
21
aigdat/BioMistral-7B_quantized_int4_float16
Updated
•
6
aigdat/omost-phi-3-mini-128k_quantized_int4_float16
Updated
•
4
superbigtree/Mistral-Nemo-Instruct-2407-FP8_aq
Updated
•
7
aigdat/Llama-3.2-1B-Instruct-awq-uint4-float16
Updated
•
20