MInference 1.0: 10x Faster Million Context Inference with a Single GPU
•
12
Yucheng
liyucheng
AI & ML interests
Robust LLMs Evaluation and Efficient LLMs Inference.
Recent Activity
updated
a model
2 days ago
MInference/llava-vid
published
a model
2 days ago
MInference/llava-vid
updated
a dataset
3 days ago
MInference/v-niah-haystack
Articles
Organizations
spaces
1
datasets
34
liyucheng/annotation_xw
Viewer
•
Updated
•
6k
•
84
liyucheng/fw-story-shard7
Viewer
•
Updated
•
7.89M
•
82
liyucheng/l-fineweb
Viewer
•
Updated
•
205M
•
26
liyucheng/annotation
Viewer
•
Updated
•
3.08k
•
44
liyucheng/parsed_arxiv
Viewer
•
Updated
•
49k
•
64
liyucheng/mind-interests
Viewer
•
Updated
•
50k
•
38
liyucheng/intention
Viewer
•
Updated
•
19.1k
•
6
liyucheng/long_paper_chunks
Viewer
•
Updated
•
368
•
32
liyucheng/mini_zh_news
Viewer
•
Updated
•
500
•
32
liyucheng/pg19-3k-long
Viewer
•
Updated
•
3k
•
30