1.14k
The Ultra-Scale Playbook
🌌
The ultimate guide to training LLM on large GPU Clusters
Régis Pierrard
regisss
AI & ML interests
None yet
Recent Activity
liked
a Space
1 day ago
nanotron/ultrascale-playbook
posted
an
update
7 days ago
Nice paper comparing the fp8 inference efficiency of Nvidia H100 and Intel Gaudi2: https://huggingface.co/papers/2502.01070
The conclusion is interesting: "Our findings highlight that the Gaudi 2, by leveraging FP8, achieves higher throughput-to-power efficiency during LLM inference"
One aspect of AI hardware accelerators that is often overlooked is how they consume less energy than GPUs. It's nice to see researchers starting carrying out experiments to measure this!
Gaudi3 results soon...
upvoted
a
paper
8 days ago
An Investigation of FP8 Across Accelerators for LLM Inference
Organizations
regisss's activity
liked
a
Space
1 day ago
liked
a
Space
2 months ago
liked
5
Spaces
5 months ago
66
Image Filtering On Encrypted Data Using Fully Homomorphic Encryption
📸
Encrypt, filter, and decrypt images using FHE
81
Sentiment Analysis On Encrypted Data Using Fully Homomorphic Encryption
🥷
Encrypt tweets for safe sentiment analysis
45
Health Prediction On Encrypted Data Using Fully Homomorphic Encryption
🩺
Encrypt and predict health conditions
23
Encrypted Anonymization Using Fully Homomorphic Encryption
🕵
Anonymize text using FHE
25
Encrypted Credit Card Approval Prediction Using Fully Homomorphic Encryption
💳
Predict credit card approval using encrypted data
liked
2
Spaces
9 months ago
liked
a
Space
about 1 year ago
liked
2
Spaces
over 1 year ago