Adaptive Orchestration for Large-Scale Inference on Heterogeneous Accelerator Systems Balancing Cost, Performance, and Resilience
Paper
•
2503.20074
•
Published
•
6
Yahav Biran
yahavb
·
AI & ML interests
Architect at AWS
Recent Activity
updated
a model
about 3 hours ago
yahavb/inf2-bs32-tp16-mml16k-llama-31-8b-vllm
published
a model
about 3 hours ago
yahavb/inf2-bs32-tp16-mml16k-llama-31-8b-vllm
updated
a model
about 5 hours ago
yahavb/inf2-bs16-tp16-mml16k-llama-31-8b-vllm
Organizations
