Yucheng

liyucheng

AI & ML interests

Robust LLMs Evaluation and Efficient LLMs Inference.

Recent Activity

updated a model 2 days ago
MInference/llava-vid
published a model 2 days ago
MInference/llava-vid
updated a dataset 3 days ago
MInference/v-niah-haystack
View all activity

Articles

Organizations

University of Surrey NLP Group's profile picture Creative Language ToolKit's profile picture RealTimeData's profile picture LatestEval's profile picture Social Post Explorers's profile picture MInference's profile picture Story's profile picture

liyucheng's activity

upvoted an article 6 months ago
view article
Article

MInference 1.0: 10x Faster Million Context Inference with a Single GPU

By liyucheng
12
upvoted an article 7 months ago
view article
Article

Unlocking Longer Generation with Key-Value Cache Quantization

38
upvoted 2 articles 8 months ago
view article
Article

Mixture of Experts Explained

255