Commit History
Support param group with various placements (#13)
e2b41e5
unverified
Merge pull request #14 from MotifTechnologies/fix_bug_in_fsdp
5458c82
unverified
TaehyunKim
commited on
Add built binary [skip-build]
6ec5093
github-actions[bot]
commited on
fix bug in fsdp
811726c
feat(workflow): add Slack notifications for build start, success, and failure [skip-build] (#12)
0b8d958
unverified
Merge pull request #11 from MotifTechnologies/ca1207-patch-1
53deea3
unverified
TaehyunKim
commited on
Add built binary [skip-build]
de5bead
github-actions[bot]
commited on
Update torch-ext/optimizer/muon.py
b0230e7
unverified
TaehyunKim
commited on
Update torch-ext/optimizer/muon.py
ff2fcfb
unverified
TaehyunKim
commited on
Update muon.py
c16b438
unverified
TaehyunKim
commited on
Merge pull request #10 from MotifTechnologies/fix_a2a_gs_assert
4f71bc9
unverified
TaehyunKim
commited on
Add built binary [skip-build]
aee4dc0
github-actions[bot]
commited on
fix assert in a2a gather scatter
3dafb3e
fix: use [skip-build] keyword to prevent build [skip-build]
94799ac
Merge pull request #9 from MotifTechnologies/all2all_gather_scatter
1a3da4d
unverified
TaehyunKim
commited on
Add built binary [ci skip]
e93bd1e
github-actions[bot]
commited on
delete state in split_func
15336dc
Add built binary [ci skip]
678578a
github-actions[bot]
commited on
change owner_params to owned_params
6943c45
modify pre step (overlap step) can get from arsgs
589b763
add doc strings + init self rank on init_assign_params
267e8a0
Add built binary [ci skip]
99af74f
github-actions[bot]
commited on
Merge branch 'all2all_gather_scatter' of https://github.com/MotifTechnologies/optimizer into all2all_gather_scatter
37be0d0
license added for flash_muon
d7cd571
Add built binary [ci skip]
f88998f
github-actions[bot]
commited on
apply pre-commit hook
fceb334
consider multi node
39c42e0
misc
35894d1
use inpalce op in update_g
6e9baad
use COMM_DTYPE instead of hardcoded dtype
2a8631f
apply all2all scatter gather
ff6d675
feat(muon_clip) : add muon clip (#6)
d65066c
unverified
feat(muon) : add tuned-abc-values & blfoat16 communication
f7faa93
feat: update muon to receive paramgroups, not model (#4)
b0f46c7
unverified
fix(muon): add update_p stage and dealloc tensors properly
99e7c0c
feat(muon): add test for muon
3261444
chore: add .gitignore
79fc8ba
chore: add push-to-hf workflow
268d190
add more exclude files
9c787fc
Merge pull request #1 from MotifTechnologies/pre-commit_test_and_apply_lint
9d8a41d
unverified
TaehyunKim
commited on