Cooool!
Xiang Li
xiangli
AI & ML interests
None yet
Recent Activity
commented on
an
article
1 day ago
Introducing multi-backends (TRT-LLM, vLLM) support for Text Generation Inference
liked
a model
15 days ago
hexgrad/Kokoro-82M
upvoted
a
collection
25 days ago
InternVL2.5-MPO
Organizations
None yet
xiangli's activity
commented on
Introducing multi-backends (TRT-LLM, vLLM) support for Text Generation Inference
1 day ago
upvoted
a
collection
25 days ago
fp16 or bf16 version?
3
#6 opened 4 months ago
by
xiangli
OSError: /lyraChatGLM/lyraChatGLM/libnvinfer_plugin.so: invalid ELF header
17
#8 opened over 1 year ago
by
Laity0806
about 310 tokens/s
6
#6 opened over 1 year ago
by
lchustc
Speed comparison with fastertransformer for ChatGLM?
2
#10 opened over 1 year ago
by
xiangli