Optimizing GLM4-MoE for Production: 65% Faster TTFT with SGLang
•
10
Inference Provider
VERIFIED
5,682,866 monthly requests
AI & ML interests
AI inference, open-source model APIs, serverless GPUs, and on-demand GPU instances.
Recent Activity
View all activity
Articles
novita/Eagle3-Spec-Minimax-M2.5-Exp14
Text Generation • Updated • 235
novita/Behemoth-123B-v1.2-FP8
123B • Updated • 1
novita/Cydonia-24B-v3-FP8
24B • Updated • 3
novita/NemoMix-Unleashed-12B-FP8
12B • Updated • 3
novita/MN-12B-Mag-Mell-R1-FP8
12B • Updated • 1
novita/Deepseek-R1-0528-W4AFP8
349B • Updated • 9 • 1
novita/Deepseek-V3.1-W4AFP8
349B • Updated • 3
novita/Deepseek-R1-W4AFP8
349B • Updated • 1
novita/Deepseek-V3-0324-W4AFP8
349B • Updated • 2.78k • 1
novita/Sao10K-L3-8B-Stheno-v3.2-AWQ-FP8
8B • Updated • 1
novita/inflatebot-MN-12B-Mag-Mell-R1-AWQ-FP8
12B • Updated
novita/DeepSeek-R1-Distill-Llama-70B-w8a8kv8-s888
71B • Updated • 218 • 2