Motif-Technologies
/

optimizer

Model card Files Files and versions

optimizer / test

Ctrl+K

Ctrl+K

15 contributors

History: 24 commits

dongseokmotif's picture

feat: extend QK-Clip to support MLA (MuonClip Algorithm 1) [skip-build] (#28)

e8e2c81 unverified 20 days ago

README.md

1.3 kB
Support param group with various placements (#13) 5 months ago
__init__.py

0 Bytes
Support param group with various placements (#13) 5 months ago
conftest.py

5.58 kB
Add torch.compile, CUDA graph, and compiled momentum [skip-build] about 1 month ago
optimizer

23 Bytes
Support param group with various placements (#13) 5 months ago
pytest.ini

45 Bytes
Support param group with various placements (#13) 5 months ago
run_test.sh

74 Bytes
Support param group with various placements (#13) 5 months ago
run_test_moe.sh

124 Bytes
Refactor pipeline to async generator pattern (#16) about 2 months ago
test_cpu_memory_peak.py

18 kB
Replace cpu_offload constructor param with turn_on/turn_off API (#26) 25 days ago
test_cpu_offload.py

32.9 kB
feat: extend QK-Clip to support MLA (MuonClip Algorithm 1) [skip-build] (#28) 20 days ago
test_muon.py

17.1 kB
Replace toy PP tests with real-model-based pipeline tests [skip-build] about 1 month ago
test_muon_moe.py

17 kB
Replace toy PP tests with real-model-based pipeline tests [skip-build] about 1 month ago
test_normalize_fqn.py

3.9 kB
Update tests for MoE and parallel optimizations [skip-build] about 1 month ago
utils.py

9.36 kB
Update tests for MoE and parallel optimizations [skip-build] about 1 month ago