Article
1
Michael Benayoun
michaelbenayoun
AI & ML interests
None yet
Recent Activity
updated
a model
6 days ago
optimum-internal-testing/optimum-neuron-cache-ci
updated
a model
6 days ago
optimum-internal-testing/optimum-neuron-cache-ci
updated
a model
6 days ago
optimum-internal-testing/optimum-neuron-cache-ci
Organizations
Articles 2
Article
2
Introducing Optimum: The Optimization Toolkit for Transformers at Scale
Papers and resources related to distributed training.
-
PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel
Paper • 2304.11277 • Published • 2 -
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism
Paper • 1909.08053 • Published • 3 -
Reducing Activation Recomputation in Large Transformer Models
Paper • 2205.05198 • Published -
GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism
Paper • 1811.06965 • Published • 1
Papers and resources related to distributed training.
-
PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel
Paper • 2304.11277 • Published • 2 -
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism
Paper • 1909.08053 • Published • 3 -
Reducing Activation Recomputation in Large Transformer Models
Paper • 2205.05198 • Published -
GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism
Paper • 1811.06965 • Published • 1
models
16
michaelbenayoun/deepseekv3-tiny-4kv-heads-4-layers-random
Text Generation
•
5.27M
•
Updated
•
18
michaelbenayoun/granite-tiny-4kv-heads-4layers-random
Text Generation
•
4.2M
•
Updated
•
1.43k
michaelbenayoun/qwen3-tiny-4kv-heads-4layers-random
Text Generation
•
5.47M
•
Updated
•
48.7k
michaelbenayoun/qwen3-tiny-4kv-heads-8layers-random
Text Generation
•
6.61M
•
Updated
•
130
michaelbenayoun/lora-qkv-included-llama-2-tiny-4kv-heads-4layers-random
Updated
michaelbenayoun/lora-2-qkv-included-llama-2-tiny-4kv-heads-4layers-random
Updated
michaelbenayoun/llama-2-tiny-4kv-heads-4layers-random
Text Generation
•
8.54M
•
Updated
•
204k
michaelbenayoun/llama-2-tiny-4kv-heads-16layers-random
Text Generation
•
8.98M
•
Updated
•
17
michaelbenayoun/t5-tiny-random
2.96M
•
Updated
•
2.83k
michaelbenayoun/llama-2-tiny-4kv-heads-2layers-random
Feature Extraction
•
2.08M
•
Updated
•
9
datasets
0
None public yet