DistServe/test-amd-ci-profiler
Updated
•
1
DistServe
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
DistServe's activity
MathewLuo22
published
a
dataset
1 day ago
MathewLuo22
updated
2
datasets
1 day ago
MathewLuo22
published
2
datasets
1 day ago
zhisbug
authored
a
paper
3 months ago
GindaChen
authored
3
papers
3 months ago
DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving
Paper
•
2401.09670
•
Published
•
2
Mnemosyne: Parallelization Strategies for Efficiently Serving Multi-Million Context Length LLM Inference Requests Without Approximations
Paper
•
2409.17264
•
Published
Efficiently Serving LLM Reasoning Programs with Certaindex
Paper
•
2412.20993
•
Published
•
38
zhisbug
authored
11
papers
4 months ago
LightSeq: Sequence Level Parallelism for Distributed Training of Long Context Transformers
Paper
•
2310.03294
•
Published
•
2
Online Speculative Decoding
Paper
•
2310.07177
•
Published
•
2
Judging LLM-as-a-judge with MT-Bench and Chatbot Arena
Paper
•
2306.05685
•
Published
•
34
Evaluating the Robustness of Text-to-image Diffusion Models against Real-world Attacks
Paper
•
2306.13103
•
Published
•
2
DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving
Paper
•
2401.09670
•
Published
•
2
Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
Paper
•
2402.02057
•
Published
Efficient Memory Management for Large Language Model Serving with PagedAttention
Paper
•
2309.06180
•
Published
•
25
CLLMs: Consistency Large Language Models
Paper
•
2403.00835
•
Published
•
4
Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference
Paper
•
2403.04132
•
Published
•
41
Toward Inference-optimal Mixture-of-Expert Large Language Models
Paper
•
2404.02852
•
Published
Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length
Paper
•
2404.08801
•
Published
•
68