Hugging Face's logo
WizardLM's picture
149 5 37

WizardLM

WizardLM
damilojohn's profile picture rafsankabir's profile picture spielhoelle's profile picture
Ā·

AI & ML interests

NLP, LLM

Recent Activity

liked a model 16 days ago
tencent/Hunyuan-A13B-Instruct
liked a model 7 months ago
deepseek-ai/DeepSeek-V3
reacted to their post with šŸš€ 12 months ago
šŸ”„ šŸ”„šŸ”„ Excited to announce WizardLM new Paper: Auto Evol-Instruct! šŸ¦ Twitter: https://x.com/WizardLM_AI/status/1812857977122202087 šŸ“ƒ Paper: https://arxiv.org/pdf/2406.00770 šŸ¤– 1. Fully AI-Powered Pipeline Auto Evol-Instruct automatically involves an iterative process of optimizing an Evol-Instruct V1 into an optimal one. The pipeline consists of two critical stages: Evol Trajectory Analysis, where the optimizer LLM analyzes the issues and failures exposed in instruction evolution performed by the evol LLM, and Evolving Method Optimization, where the optimizer LLM addresses these issues to progressively develop an effective evolving method. The optimal evolving method is then used to convert the entire instruction dataset into more diverse and complex forms, facilitating improved instruction tuning. šŸ“ˆ2. Scaling Evol-Instruct with Arena Learning With Auto Evol-Instruct, the evolutionary synthesis data of WizardLM-2 has scaled up from WizardLM-1 to dozens of domains, covering tasks in all aspects of large language models. This allows Arena Learning to train and learn from an almost infinite pool of high-difficulty instruction data, fully unlocking all the potential of Arena Learning.
View all activity

Organizations

WizardLM Team's profile picture WizardDev's profile picture