Article
You could have designed state of the art positional encoding
By
•
•
287Joonhyung Lee
joonhyung-lee-naver
AI & ML interests
None yet
Recent Activity
upvoted
an
article
13 days ago
You could have designed state of the art positional encoding
commented on
an
article
2 months ago
Accelerating LLM Inference with TGI on Intel Gaudi
upvoted
an
article
2 months ago
Accelerating LLM Inference with TGI on Intel Gaudi
Organizations
joonhyung-lee-naver's activity
upvoted
an
article
13 days ago
commented on
Accelerating LLM Inference with TGI on Intel Gaudi
2 months ago
Great work!
upvoted
an
article
2 months ago
Article
Accelerating LLM Inference with TGI on Intel Gaudi
By
and 4 others
•
•
13
liked
a
Space
4 months ago
reacted to
regisss's
post with 🔥
4 months ago
Post
1755
Nice paper comparing the fp8 inference efficiency of Nvidia H100 and Intel Gaudi2:
An Investigation of FP8 Across Accelerators for LLM Inference (2502.01070)
The conclusion is interesting: "Our findings highlight that the Gaudi 2, by leveraging FP8, achieves higher throughput-to-power efficiency during LLM inference"
One aspect of AI hardware accelerators that is often overlooked is how they consume less energy than GPUs. It's nice to see researchers starting carrying out experiments to measure this!
Gaudi3 results soon...
The conclusion is interesting: "Our findings highlight that the Gaudi 2, by leveraging FP8, achieves higher throughput-to-power efficiency during LLM inference"
One aspect of AI hardware accelerators that is often overlooked is how they consume less energy than GPUs. It's nice to see researchers starting carrying out experiments to measure this!
Gaudi3 results soon...
authored
2
papers
10 months ago
liked
a
Space
about 1 year ago