Inference Providers

·

Metrics for top trending models

Kimi-K2-Thinking
novita
cheapest
0.6 2.5 262144 2.02 24 Yes No
Kimi-K2-Thinking
together
fastest
1.2 4 262144 0.88 95 Yes No
DeepSeek-OCR
novita
0.03 0.03 8192 0.90 161 No Yes
MiniMax-M2
novita
0.3 1.2 204800 1.17 51 No No
Llama-3.1-8B-Instruct
novita
cheapest
0.02 0.05 16384 0.76 77 No No
Llama-3.1-8B-Instruct
nebius
0.03 0.09 131072 0.48 188 No Yes
Llama-3.1-8B-Instruct
cerebras
fastest
0.1 0.1 - 0.41 1051 No No
Llama-3.1-8B-Instruct
sambanova
0.1 0.2 16384 0.47 658 Yes Yes
Llama-3.1-8B-Instruct
nscale
0.06 0.06 131072 0.93 59 No Yes
Llama-3.1-8B-Instruct
fireworks-ai
0.2 0.2 131072 0.40 220 No No
Llama-3.1-8B-Instruct
scaleway
- - - 0.49 95 Yes Yes
Llama-3.1-8B-Instruct
ovhcloud
- - - 0.53 41 Yes Yes
gpt-oss-20b
groq
fastest
0.1 0.5 131072 0.30 748 Yes No
gpt-oss-20b
novita
0.04 0.15 131072 1.00 112 No Yes
gpt-oss-20b
nebius
0.05 0.2 131072 0.45 162 Yes Yes
gpt-oss-20b
nscale
0.05 0.2 131072 0.97 87 Yes Yes
gpt-oss-20b
hyperbolic
cheapest
0.1 0.1 131072 0.96 237 No No
gpt-oss-20b
together
0.05 0.2 131072 0.36 272 Yes Yes
gpt-oss-20b
fireworks-ai
0.05 0.2 131072 0.61 116 Yes No
gpt-oss-20b
ovhcloud
- - - 0.46 79 Yes Yes
GLM-4.6
novita
cheapest
0.6 2.2 204800 0.72 30 Yes No
GLM-4.6
cerebras
fastest
- - - 0.41 244 Yes No
GLM-4.6
zai-org
- - - 3.26 48 No No
gpt-oss-120b
groq
0.15 0.75 131072 0.25 411 Yes No
gpt-oss-120b
novita
cheapest
0.05 0.25 131072 1.05 122 No Yes
gpt-oss-120b
nebius
0.15 0.6 131072 0.48 117 Yes Yes
gpt-oss-120b
cerebras
fastest
0.25 0.69 - 0.31 631 Yes No
gpt-oss-120b
sambanova
0.22 0.59 131072 1.66 335 Yes Yes
gpt-oss-120b
nscale
0.1 0.4 131072 0.96 112 Yes Yes
gpt-oss-120b
hyperbolic
0.3 0.3 131072 0.80 263 Yes No
gpt-oss-120b
together
0.15 0.6 131072 1.10 57 Yes Yes
gpt-oss-120b
fireworks-ai
0.15 0.6 131072 0.82 82 No No
gpt-oss-120b
scaleway
- - - 0.48 145 Yes Yes
gpt-oss-120b
ovhcloud
- - - 0.37 132 Yes Yes
DeepSeek-V3.2-Exp
novita
0.27 0.41 163840 0.93 28 Yes Yes
DeepSeek-R1
novita
0.7 2.5 64000 0.93 24 Yes No
DeepSeek-R1
sambanova
fastest
- - - 1.16 158 Yes Yes
DeepSeek-R1
hyperbolic
cheapest
2 2 163840 1.37 25 No No
DeepSeek-R1
together
3 7 163840 1.21 23 No Yes
DeepSeek-R1
fireworks-ai
- - - - - - -
Qwen3-VL-8B-Instruct
novita
0.08 0.5 131072 0.99 66 Yes Yes
Qwen3-8B
nscale
0.07 0.18 40960 0.95 59 Yes No
cogito-671b-v2.1
together
cheapest fastest
1.25 1.25 163840 0.63 63 No Yes
cogito-671b-v2.1
fireworks-ai
- - 163840 0.57 51 Yes No
Kimi-K2-Instruct-0905
groq
fastest
- - 262144 0.29 193 Yes No
Kimi-K2-Instruct-0905
novita
cheapest
0.6 2.5 262144 0.61 31 Yes Yes
Kimi-K2-Instruct-0905
together
1 3 262144 0.66 52 Yes Yes
Qwen2.5-7B-Instruct
together
0.3 0.3 32768 0.37 107 Yes Yes
Qwen3-4B-Instruct-2507
nscale
0.01 0.03 262144 1.85 58 Yes No
gemma-3-27b-it
nebius
cheapest fastest
0.2 0.6 110000 3.96 47 No Yes
gemma-3-27b-it
scaleway
- - - 0.61 42 Yes No
Qwen3-Coder-30B-A3B-Instruct
nebius
cheapest fastest
0.1 0.3 262144 0.59 113 Yes Yes
Qwen3-Coder-30B-A3B-Instruct
fireworks-ai
- - - - - - -
Qwen3-Coder-30B-A3B-Instruct
scaleway
- - - 0.50 63 Yes No
Qwen3-Coder-30B-A3B-Instruct
ovhcloud
- - - 0.44 97 Yes Yes
Qwen3-VL-30B-A3B-Instruct
novita
0.2 0.7 131072 0.60 81 Yes Yes
Llama-3.2-3B-Instruct
novita
cheapest fastest
0.03 0.05 32768 0.65 108 Yes No
Llama-3.2-3B-Instruct
sambanova
- - - - - - -
Llama-3.2-3B-Instruct
hyperbolic
0.1 0.1 131072 0.98 102 No No
Llama-3.2-3B-Instruct
together
0.06 0.06 131072 1.25 98 Yes Yes
Qwen2.5-VL-7B-Instruct
hyperbolic
0.2 0.2 32768 0.60 108 No No
Qwen3-Next-80B-A3B-Instruct
novita
0.15 1.5 131072 0.83 129 Yes No
Qwen3-Next-80B-A3B-Instruct
hyperbolic
cheapest fastest
0.3 0.3 262144 0.72 164 Yes No
Qwen3-Next-80B-A3B-Instruct
together
0.15 1.5 262144 0.54 130 Yes Yes
Kimi-K2-Instruct
novita
cheapest
0.57 2.3 131072 1.08 31 Yes Yes
Kimi-K2-Instruct
nebius
fastest
0.5 2.4 131072 0.51 62 Yes Yes
Kimi-K2-Instruct
together
1 3 131072 1.18 39 Yes Yes
Kimi-K2-Instruct
fireworks-ai
0.6 2.5 131072 1.03 47 Yes No
Llama-3.2-1B-Instruct
novita
- - 131000 0.72 208 No No
Llama-3.2-1B-Instruct
sambanova
- - - - - - -
DeepSeek-R1-Distill-Qwen-1.5B
nscale
0.1 0.1 131072 1.02 137 No No
Qwen3-32B
groq
0.29 0.59 131072 0.30 260 Yes No
Qwen3-32B
novita
0.1 0.45 40960 0.86 44 No No
Qwen3-32B
nebius
0.1 0.3 40960 0.56 40 Yes Yes
Qwen3-32B
cerebras
fastest
0.4 0.8 - 0.36 800 No No
Qwen3-32B
sambanova
0.4 0.8 32768 1.72 213 Yes Yes
Qwen3-32B
nscale
cheapest
0.08 0.25 40960 1.04 25 Yes Yes
Qwen3-32B
ovhcloud
- - - 0.51 39 Yes Yes
SmolLM3-3B
hf-inference
- - - 0.25 87 Yes Yes
Meta-Llama-3-8B-Instruct
groq
- - - - - - -
Meta-Llama-3-8B-Instruct
novita
0.04 0.04 8192 0.78 82 No No
Meta-Llama-3-8B-Instruct
together
- - - - - - -
Qwen3-30B-A3B-Instruct-2507
nebius
0.1 0.3 262144 0.37 83 Yes Yes
Qwen3-VL-235B-A22B-Thinking
novita
0.98 3.95 131072 1.04 42 No No
Qwen3-Coder-480B-A35B-Instruct
novita
cheapest
0.29 1.2 262144 0.89 40 Yes Yes
Qwen3-Coder-480B-A35B-Instruct
nebius
fastest
0.4 1.8 262144 0.37 71 Yes Yes
Qwen3-Coder-480B-A35B-Instruct
cerebras
- - - - - - -
Qwen3-Coder-480B-A35B-Instruct
hyperbolic
2 2 262144 2.04 44 No No
Qwen3-Coder-480B-A35B-Instruct
together
2 2 262144 0.64 49 Yes Yes
Qwen3-Coder-480B-A35B-Instruct
fireworks-ai
0.45 1.8 262144 1.34 60 Yes No
GLM-4.5-Air
novita
cheapest fastest
0.13 0.85 131072 0.65 83 Yes No
GLM-4.5-Air
nebius
0.2 1.2 131072 0.45 70 Yes Yes
GLM-4.5-Air
fireworks-ai
- - - - - - -
GLM-4.5-Air
zai-org
- - - 2.95 49 Yes No
gemma-2-2b-it
nebius
0.02 0.06 8192 0.42 105 No Yes
Llama-4-Maverick-17B-128E-Instruct
groq
cheapest fastest
0.2 0.6 131072 0.28 459 Yes No
Llama-4-Maverick-17B-128E-Instruct
sambanova
0.63 1.8 131072 2.15 287 Yes Yes
Llama-4-Maverick-17B-128E-Instruct
fireworks-ai
0.22 0.88 1048576 0.68 75 Yes No
Llama-3.3-70B-Instruct
groq
0.59 0.79 131072 0.29 270 Yes No
Llama-3.3-70B-Instruct
novita
cheapest
0.13 0.39 131072 0.70 21 Yes No
Llama-3.3-70B-Instruct
nebius
0.25 0.75 131072 0.44 134 Yes Yes
Llama-3.3-70B-Instruct
cerebras
fastest
0.85 1.2 - 0.31 1028 Yes No
Llama-3.3-70B-Instruct
sambanova
0.6 1.2 131072 0.49 290 Yes Yes
Llama-3.3-70B-Instruct
nscale
0.4 0.4 131072 1.09 16 No Yes
Llama-3.3-70B-Instruct
hyperbolic
0.4 0.4 131072 1.24 89 No No
Llama-3.3-70B-Instruct
together
0.88 0.88 131072 0.43 80 Yes Yes
Llama-3.3-70B-Instruct
fireworks-ai
0.9 0.9 131072 0.51 134 No No
Llama-3.3-70B-Instruct
scaleway
- - - 0.72 33 Yes Yes
Llama-3.3-70B-Instruct
ovhcloud
- - - 0.49 34 Yes Yes
DeepSeek-V3-0324
novita
0.27 1.12 163840 0.92 32 Yes Yes
DeepSeek-V3-0324
nebius
0.75 2.25 32768 1.13 120 No No
DeepSeek-V3-0324
sambanova
fastest
3 4.5 131072 1.32 139 Yes Yes
DeepSeek-V3-0324
hyperbolic
1.25 1.25 163840 1.07 40 No No
DeepSeek-V3-0324
together
1.25 1.25 131072 0.73 30 Yes Yes
DeepSeek-V3-0324
fireworks-ai
cheapest
0.9 0.9 163840 2.38 47 Yes No
Qwen3-235B-A22B-Instruct-2507
novita
cheapest
0.09 0.58 131072 1.02 25 Yes Yes
Qwen3-235B-A22B-Instruct-2507
nebius
0.2 0.6 262144 0.71 19 Yes Yes
Qwen3-235B-A22B-Instruct-2507
cerebras
fastest
0.6 1.2 - 0.40 345 Yes No
Qwen3-235B-A22B-Instruct-2507
nscale
0.2 0.6 32768 1.21 23 Yes Yes
Qwen3-235B-A22B-Instruct-2507
hyperbolic
2 2 262144 0.68 129 Yes No
Qwen3-235B-A22B-Instruct-2507
together
0.2 0.6 262144 0.51 34 Yes Yes
Qwen3-235B-A22B-Instruct-2507
fireworks-ai
0.22 0.88 262144 0.67 35 Yes No
Qwen3-235B-A22B-Instruct-2507
scaleway
- - - 0.47 68 Yes Yes
gpt-oss-safeguard-20b
groq
- - 131072 0.22 811 Yes No
Llama-3.1-70B-Instruct
fireworks-ai
0.9 0.9 131072 0.49 137 No No
DeepSeek-V3.1
novita
cheapest
0.27 1 131072 1.29 29 Yes No
DeepSeek-V3.1
together
0.6 1.7 131072 0.85 66 Yes No
DeepSeek-V3.1
fireworks-ai
fastest
- - 163840 0.92 67 Yes No
Qwen3-VL-235B-A22B-Instruct
novita
0.3 1.5 131072 0.94 36 Yes Yes
cogito-671b-v2.1-FP8
together
1.25 1.25 163840 0.82 62 No Yes
Qwen3-14B
nscale
0.07 0.2 40960 1.00 47 Yes No
DeepSeek-V3
novita
fastest
0.4 1.3 64000 1.28 28 Yes No
DeepSeek-V3
together
cheapest
1.25 1.25 131072 0.87 26 Yes Yes
DeepSeek-V3
fireworks-ai
- - - - - - -
DeepSeek-V3.1-Terminus
novita
0.27 1 131072 0.85 32 No Yes
QwQ-32B
groq
- - - - - - -
QwQ-32B
nebius
- - - - - - -
QwQ-32B
sambanova
- - - - - - -
QwQ-32B
nscale
cheapest
0.18 0.2 131072 0.98 26 Yes Yes
QwQ-32B
hyperbolic
fastest
0.4 0.4 131072 2.41 47 Yes No
QwQ-32B
fireworks-ai
- - - - - - -
DeepSeek-R1-0528-Qwen3-8B
novita
0.06 0.09 128000 0.78 70 No No
Qwen3-VL-30B-A3B-Thinking
novita
0.2 1 131072 0.78 93 Yes Yes
Apertus-8B-Instruct-2509
publicai
- - - 1.27 74 No Yes
DeepSeek-R1-Distill-Qwen-7B
nscale
0.15 0.15 131072 0.98 65 No No
GLM-4.5
novita
0.6 2.2 131072 0.64 58 Yes No
GLM-4.5
nebius
0.6 2.2 131072 0.47 36 Yes Yes
GLM-4.5
fireworks-ai
cheapest fastest
0.55 2.19 131072 0.86 80 Yes No
GLM-4.5
zai-org
- - - 4.09 41 Yes No
Qwen3-4B-Thinking-2507
nscale
0.01 0.03 262144 0.86 91 Yes No
DeepSeek-R1-Distill-Qwen-32B
novita
cheapest fastest
0.3 0.3 64000 0.76 36 No Yes
DeepSeek-R1-Distill-Qwen-32B
nscale
0.3 0.3 131072 0.94 25 No Yes
Qwen2.5-Coder-32B-Instruct
nscale
cheapest
0.06 0.2 131072 0.95 28 No Yes
Qwen2.5-Coder-32B-Instruct
hyperbolic
fastest
0.2 0.2 32768 1.12 72 No No
Qwen2.5-Coder-32B-Instruct
together
- - - - - - -
Qwen2.5-Coder-32B-Instruct
scaleway
- - - 0.51 39 Yes No
Qwen3-Next-80B-A3B-Thinking
novita
0.15 1.5 131072 0.96 105 Yes No
Qwen3-Next-80B-A3B-Thinking
hyperbolic
cheapest fastest
0.3 0.3 262144 0.64 189 Yes No
Qwen3-Next-80B-A3B-Thinking
together
0.15 1.5 262144 0.44 119 Yes Yes
Qwen2.5-Coder-7B-Instruct
nscale
0.01 0.03 131072 1.13 60 No Yes
Llama-4-Scout-17B-16E-Instruct
groq
fastest
0.11 0.34 131072 0.29 360 Yes No
Llama-4-Scout-17B-16E-Instruct
novita
0.1 0.5 131072 0.64 39 No No
Llama-4-Scout-17B-16E-Instruct
sambanova
- - - - - - -
Llama-4-Scout-17B-16E-Instruct
nscale
cheapest
0.09 0.29 890000 1.07 33 Yes Yes
Llama-4-Scout-17B-16E-Instruct
together
0.18 0.59 1048576 0.44 99 Yes Yes
Llama-4-Scout-17B-16E-Instruct
fireworks-ai
0.15 0.6 1048576 0.80 44 Yes No
DeepSeek-R1-Distill-Qwen-14B
novita
cheapest fastest
0.15 0.15 32768 0.87 65 No No
DeepSeek-R1-Distill-Qwen-14B
nscale
0.2 0.2 131072 1.22 37 No Yes
Qwen2.5-VL-72B-Instruct
nebius
cheapest
0.25 0.75 32000 0.48 30 No Yes
Qwen2.5-VL-72B-Instruct
hyperbolic
- - - - - - -
Qwen2.5-VL-72B-Instruct
ovhcloud
fastest
- - - 0.55 31 No Yes
NVIDIA-Nemotron-Nano-12B-v2
nebius
0.07 0.2 131072 0.50 123 No Yes
L3-70B-Euryale-v2.1
novita
1.48 1.48 8192 0.91 39 No No
GLM-4.5V-FP8
zai-org
- - - 4.21 35 Yes No
DeepSeek-R1-Distill-Llama-70B
groq
- - - - - - -
DeepSeek-R1-Distill-Llama-70B
novita
0.8 0.8 8192 1.20 31 No Yes
DeepSeek-R1-Distill-Llama-70B
sambanova
fastest
0.7 1.4 131072 1.14 189 No No
DeepSeek-R1-Distill-Llama-70B
nscale
cheapest
0.75 0.75 131072 1.29 16 No Yes
DeepSeek-R1-Distill-Llama-70B
scaleway
- - - 0.74 25 No Yes
DeepSeek-R1-Distill-Llama-70B
ovhcloud
- - - 0.43 24 No Yes
Qwen3-235B-A22B
novita
0.2 0.8 40960 1.09 30 No No
Qwen3-235B-A22B
nscale
cheapest
0.2 0.6 32000 1.17 21 Yes Yes
Qwen3-235B-A22B
together
0.2 0.6 40960 0.54 39 Yes Yes
Qwen3-235B-A22B
fireworks-ai
fastest
0.22 0.88 131072 0.87 67 Yes No
Llama-4-Maverick-17B-128E-Instruct-FP8
novita
cheapest
0.17 0.85 1048576 0.44 36 No No
Llama-4-Maverick-17B-128E-Instruct-FP8
together
fastest
0.27 0.85 1048576 0.47 75 Yes Yes
GLM-4.6-FP8
zai-org
- - - 3.41 49 Yes No
Qwen2.5-72B-Instruct
novita
cheapest
0.38 0.4 32000 0.73 31 Yes No
Qwen2.5-72B-Instruct
hyperbolic
0.4 0.4 131072 1.58 49 Yes No
Qwen2.5-72B-Instruct
together
fastest
1.2 1.2 131072 0.51 61 Yes Yes
Qwen2.5-72B-Instruct
fireworks-ai
- - - - - - -
GLM-4.5V
novita
cheapest fastest
0.6 1.8 65536 1.00 68 Yes No
GLM-4.5V
zai-org
- - - 3.37 39 Yes No
GLM-4-32B-0414
novita
0.55 1.66 32000 0.89 37 No No
Qwen3-30B-A3B-Thinking-2507
nebius
0.1 0.3 262144 0.48 108 Yes Yes
DeepSeek-R1-Distill-Llama-8B
novita
- - - - - - -
DeepSeek-R1-Distill-Llama-8B
nscale
0.05 0.05 131072 0.98 56 No No
Arch-Router-1.5B
hf-inference
- - - 0.21 70 No Yes
Qwen3-235B-A22B-Thinking-2507
novita
0.3 3 131072 0.62 26 Yes No
Qwen3-235B-A22B-Thinking-2507
cerebras
- - - - - - -
Qwen3-235B-A22B-Thinking-2507
fireworks-ai
cheapest fastest
0.22 0.88 262144 0.66 57 Yes No
Qwen2.5-VL-32B-Instruct
fireworks-ai
0.22 0.88 128000 0.63 43 No No
Qwen3-30B-A3B
novita
cheapest
0.09 0.45 40960 0.93 75 No No
Qwen3-30B-A3B
fireworks-ai
fastest
0.15 0.6 131072 0.82 143 Yes No
c4ai-command-a-03-2025
cohere
- - - 0.46 47 Yes No
ERNIE-4.5-0.3B-PT
novita
- - 120000 0.90 106 No No
Baichuan-M2-32B
novita
0.07 0.07 131072 1.98 23 No Yes
DeepSeek-R1-0528
novita
0.7 2.5 163840 0.89 27 Yes No
DeepSeek-R1-0528
nebius
cheapest
0.8 2.4 163840 0.65 16 Yes Yes
DeepSeek-R1-0528
sambanova
fastest
5 7 131072 2.01 179 Yes Yes
DeepSeek-R1-0528
hyperbolic
3 3 163840 1.64 25 No No
DeepSeek-R1-0528
together
3 7 163840 1.02 27 No Yes
DeepSeek-R1-0528
fireworks-ai
3 8 163840 1.03 58 No No
ERNIE-4.5-21B-A3B-PT
novita
0.07 0.28 120000 1.01 82 No No
Llama-Guard-4-12B
groq
0.2 0.2 131072 0.25 8 No No
GLM-4.1V-9B-Thinking
novita
0.035 0.138 65536 0.75 70 No No
Llama-3.1-405B-Instruct
sambanova
- - - - - - -
Llama-3.1-405B-Instruct
fireworks-ai
3 3 131072 0.56 62 Yes No
Qwen3-Coder-480B-A35B-Instruct-FP8
together
2 2 262144 0.64 55 Yes Yes
GLM-4.5-Air-FP8
together
0.2 1.1 131072 0.47 115 Yes Yes
command-a-vision-07-2025
cohere
- - - 0.29 64 No No
c4ai-command-r7b-arabic-02-2025
cohere
- - - 0.35 70 Yes No
aya-expanse-32b
cohere
- - - 0.29 43 No No
c4ai-command-r7b-12-2024
cohere
- - - 0.29 97 Yes No
Hermes-4-405B
nebius
1 3 131072 0.66 35 No No
Hermes-2-Pro-Llama-3-8B
novita
0.14 0.14 8192 0.71 105 No No
ERNIE-4.5-VL-28B-A3B-PT
novita
0.14 0.56 30000 0.74 77 No No
Apertus-70B-Instruct-2509
publicai
- - - 1.13 50 No Yes
Qwen2.5-Coder-3B-Instruct
nscale
0.01 0.03 32768 1.07 84 No Yes
L3-8B-Stheno-v3.2
novita
0.05 0.05 8192 0.94 55 No No
Dobby-Unhinged-Llama-3.3-70B
fireworks-ai
0.9 0.9 131072 0.41 52 No No
DeepSeek-Prover-V2-671B
novita
0.7 2.5 160000 0.88 16 No No
WizardLM-2-8x22B
novita
0.62 0.62 65535 0.64 33 No No
Mixtral-8x22B-Instruct-v0.1
nscale
cheapest
1.2 1.2 65536 1.09 25 No Yes
Mixtral-8x22B-Instruct-v0.1
together
- - - - - - -
Mixtral-8x22B-Instruct-v0.1
fireworks-ai
fastest
1.2 1.2 65536 0.53 68 No No
Meta-Llama-3-70B-Instruct
groq
- - - - - - -
Meta-Llama-3-70B-Instruct
novita
0.51 0.74 8192 0.83 27 No Yes
Meta-Llama-3-70B-Instruct
hyperbolic
cheapest fastest
0.4 0.4 8192 1.06 88 No No
Meta-Llama-3-70B-Instruct
together
0.88 0.88 8192 0.39 81 No Yes
marin-8b-instruct
together
0.18 0.18 4096 0.31 177 No Yes
cogito-v2-preview-llama-405B
together
3.5 3.5 32768 1.16 26 Yes Yes
cogito-v2-preview-llama-109B-MoE
together
0.18 0.59 32767 0.94 78 Yes Yes
cogito-v2-preview-llama-70B
together
0.88 0.88 32768 0.87 52 Yes Yes
command-a-translate-08-2025
cohere
- - - 0.51 63 Yes No
command-a-reasoning-08-2025
cohere
- - - 0.30 81 Yes No
L3-8B-Lunaris-v1
novita
0.05 0.05 8192 0.80 67 No No
aya-vision-32b
cohere
- - - 0.42 56 No No
c4ai-command-r-08-2024
cohere
- - - 0.30 56 Yes No
Gemma-SEA-LION-v4-27B-IT
publicai
- - - 1.72 48 No Yes
ERNIE-4.5-VL-424B-A47B-Base-PT
novita
0.42 1.25 123000 1.16 43 No No
Qwen2.5-Coder-7B
nebius
0.03 0.09 32768 0.57 195 No Yes
gemma-2-9b-it
groq
- - - - - - -
gemma-2-9b-it
nebius
0.03 0.09 8192 0.48 116 No Yes
Llama-3_1-Nemotron-Ultra-253B-v1
nebius
0.6 1.8 131072 0.47 40 No Yes
Llama-3.3-Swallow-70B-Instruct-v0.4
sambanova
0.6 1.2 131072 1.46 160 No Yes
ERNIE-4.5-300B-A47B-Base-PT
novita
0.28 1.1 123000 1.19 27 No Yes
Hermes-4-70B
nebius
0.13 0.4 131072 0.50 86 No No
MiniMax-M1-80k
novita
0.55 2.2 1000000 1.25 44 Yes No
Qwen3-235B-A22B-FP8
together
0.2 0.6 40960 0.48 37 Yes Yes