Auxiliary-Loss-Free Load Balancing Strategy for Mixture-of-Experts
Paper
•
2408.15664
•
Published
•
12
Damai Dai
DeepSeekDDM
AI & ML interests
None yet
Recent Activity
updated
a model
about 1 month ago
deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B
updated
a model
about 1 month ago
deepseek-ai/DeepSeek-R1-Distill-Qwen-7B
updated
a model
about 1 month ago
deepseek-ai/DeepSeek-R1-Distill-Llama-8B
Organizations
