-
-
-
-
-
-
Inference Providers
Active filters:
int8
OpenNMT/nllb-200-distilled-1.3B-ct2-int8
Translation
•
Updated
•
57
•
14
RedHatAI/granite-3.1-8b-instruct-quantized.w8a8
Text Generation
•
8B
•
Updated
•
2.72k
•
2
magicunicorn/whisper-small-amd-npu-int8
Updated
•
3
•
1
groxaxo/Qwen3-32B-AWorld-W8A16
9B
•
Updated
•
33
•
1
groxaxo/Huihui-gpt-oss-20b-BF16-abliterated-W8A16
20B
•
Updated
•
7
•
1
groxaxo/gpt-oss-20b-ShiningValiant3-W8A16
Text Generation
•
20B
•
Updated
•
5
•
1
Intel/distilbert-base-uncased-finetuned-sst-2-english-int8-static-inc
Text Classification
•
Updated
•
21
•
6
Intel/bert-base-uncased-mrpc-int8-qat-inc
Text Classification
•
Updated
•
9
•
1
Intel/albert-base-v2-sst2-int8-static-inc
Text Classification
•
Updated
•
18
Intel/bert-base-uncased-finetuned-swag-int8-static-inc
Multiple Choice
•
Updated
•
9
•
1
Intel/bert-base-uncased-mrpc-int8-static-inc
Text Classification
•
Updated
•
12
Intel/distilbert-base-uncased-finetuned-conll03-english-int8-static-inc
Token Classification
•
Updated
•
7
•
1
Intel/camembert-base-mrpc-int8-dynamic-inc
Text Classification
•
Updated
•
13
Intel/bert-base-uncased-mrpc-int8-dynamic-inc
Text Classification
•
Updated
•
11
Intel/roberta-base-mrpc-int8-static-inc
Text Classification
•
Updated
•
12
Intel/bart-large-mrpc-int8-dynamic-inc
Text Classification
•
Updated
•
14
Intel/xlnet-base-cased-mrpc-int8-static-inc
Text Classification
•
Updated
•
14
Intel/electra-small-discriminator-mrpc-int8-static-inc
Text Classification
•
Updated
•
9
echarlaix/distilbert-sst2-inc-dynamic-quantization-magnitude-pruning-0.1
Text Classification
•
Updated
•
3
Intel/MiniLM-L12-H384-uncased-mrpc-int8-static-inc
Text Classification
•
Updated
•
13
Intel/MiniLM-L12-H384-uncased-mrpc-int8-qat-inc
Text Classification
•
Updated
•
8
Intel/distilbert-base-cased-distilled-squad-int8-static-inc
Question Answering
•
Updated
•
7
Intel/bert-base-uncased-squad-int8-static-inc
Question Answering
•
Updated
•
8
•
1
echarlaix/t5-small-int8-dynamic
Translation
•
Updated
•
9
•
4
echarlaix/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic
Text Classification
•
Updated
•
1.33k
•
1
Intel/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic-inc
Text Classification
•
Updated
•
8
•
1
Intel/distilbert-base-uncased-distilled-squad-int8-static-inc
Question Answering
•
Updated
•
1.35k
•
5
Intel/roberta-base-squad2-int8-static-inc
Updated
•
10
•
1
Intel/roberta-large-mnli-int8-static-inc
Text Classification
•
Updated
•
10
Intel/vit-base-patch16-224-int8-static-inc
Image Classification
•
Updated
•
17
•
1