Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

8-bit precision

text-generation-inference

4-bit precision

Carbon Emissions

text-embeddings-inference

Misc with no match

Mixture of Experts

Models

147

Full-text search

Active filters: nncf

AIFunOver/Falcon3-10B-Instruct-openvino-8bit

Text Generation • Updated Dec 27, 2024 • 11

AIFunOver/Falcon3-10B-Instruct-openvino-4bit

Text Generation • Updated Dec 27, 2024 • 10

AIFunOver/phi-4-openvino-fp16

Text Generation • Updated Jan 9 • 20 • 1

AIFunOver/phi-4-openvino-8bit

Text Generation • Updated Jan 9 • 15

AIFunOver/phi-4-openvino-4bit

Text Generation • Updated Jan 9 • 38 • 2

AIFunOver/Sky-T1-32B-Preview-openvino-8bit

Text Generation • Updated Jan 14 • 8

AIFunOver/Sky-T1-32B-Preview-openvino-4bit

Text Generation • Updated Jan 14 • 13

AIFunOver/Qwen2.5-7B-Instruct-1M-openvino-fp16

Text Generation • Updated Jan 28 • 12

AIFunOver/Qwen2.5-7B-Instruct-1M-openvino-8bit

Text Generation • Updated Jan 28 • 28

AIFunOver/Qwen2.5-7B-Instruct-1M-openvino-4bit

Text Generation • Updated Jan 28 • 13

AIFunOver/Qwen2.5-14B-Instruct-1M-openvino-8bit

Text Generation • Updated Jan 28 • 8

AIFunOver/Qwen2.5-14B-Instruct-1M-openvino-4bit

Text Generation • Updated Jan 28 • 13

AIFunOver/DeepSeek-R1-Distill-Qwen-32B-openvino-8bit

Text Generation • Updated Jan 28 • 9

AIFunOver/DeepSeek-R1-Distill-Qwen-32B-openvino-4bit

Text Generation • Updated Jan 28 • 58

AIFunOver/DeepSeek-R1-Distill-Llama-8B-openvino-8bit

Text Generation • Updated Jan 29 • 12

AIFunOver/DeepSeek-R1-Distill-Llama-8B-openvino-4bit

Text Generation • Updated Jan 29 • 31

hsuwill000/Qwen2.5-0.5B-Instruct-openvino-4bit

Text Generation • Updated Feb 5 • 7

boysbytes/DeepSeek-R1-Distill-Qwen-1.5B-openvino-8bit

Text Generation • Updated Feb 9 • 17

boysbytes/DeepSeek-R1-Distill-Qwen-1.5B-openvino-4bit

Text Generation • Updated Feb 9 • 17

bal723/TinyLlama-1.1B-Chat-v1.0-openvino-4bit

Updated Mar 5 • 3

hsuwill000/Qwen2.5-1.5B-Instruct-abliterated-openvino-8bit

Text Generation • Updated Mar 7 • 14

windchant/DeepSeek-R1-Distill-Qwen-1.5B-openvino-8bit

Text Generation • Updated Mar 11 • 6

windchant/DeepSeek-R1-Distill-Qwen-1.5B-openvino-4bit

Text Generation • Updated Mar 11 • 6

windchant/Qwen2.5-0.5B-Instruct-openvino-4bit

Text Generation • Updated Mar 11 • 8

Keenah285/Phi-3-mini-4k-instruct-openvino-4bit

Text Generation • Updated Apr 18 • 10

DomosFS/french-bge-m3-openvino-8bit

Sentence Similarity • Updated 10 days ago • 126

yzu1114621/resnet-50-openvino-8bit

Image Classification • Updated 4 days ago • 17