- Seattle, WA USA
- https://www.linkedin.com/in/lessw2020
Popular repositories Loading
-
Ranger-Deep-Learning-Optimizer
Ranger-Deep-Learning-Optimizer PublicRanger - a synergistic optimizer using RAdam (Rectified Adam), Gradient Centralization and LookAhead in one codebase
-
Best-Deep-Learning-Optimizers
Best-Deep-Learning-Optimizers PublicCollection of the latest, greatest, deep learning optimizers (for Pytorch) - CNN, NLP suitable
-
res2net-plus
res2net-plus PublicRes2Net architecture with improved stem and Mish activation function
-
Ranger-Mish-ImageWoof-5
Ranger-Mish-ImageWoof-5 PublicRepo to build on / reproduce the record breaking Ranger-Mish-SelfAttention setup on FastAI ImageWoof dataset 5 epochs
2,319 contributions in the last year
Skip to contributions year listDay of Week | July Jul | August Aug | September Sep | October Oct | November Nov | December Dec | January Jan | February Feb | March Mar | April Apr | May May | June Jun | |||||||||||||||||||||||||||||||||||||||||
Sunday Sun | |||||||||||||||||||||||||||||||||||||||||||||||||||||
Monday Mon | |||||||||||||||||||||||||||||||||||||||||||||||||||||
Tuesday Tue | |||||||||||||||||||||||||||||||||||||||||||||||||||||
Wednesday Wed | |||||||||||||||||||||||||||||||||||||||||||||||||||||
Thursday Thu | |||||||||||||||||||||||||||||||||||||||||||||||||||||
Friday Fri | |||||||||||||||||||||||||||||||||||||||||||||||||||||
Saturday Sat |
Contribution activity
July 2025
Created 25 commits in 4 repositories
Created 6 repositories
-
lessw2020/tma_intro
Cuda
This contribution was made on Jul 10
-
lessw2020/TetraJet-MXFP4Training
Python
This contribution was made on Jul 9
-
lessw2020/T-MAC
C++
This contribution was made on Jul 8
-
lessw2020/SageAttention
Cuda
This contribution was made on Jul 8
-
lessw2020/fast-hadamard-transform
C
This contribution was made on Jul 8
-
lessw2020/Quartet
Jupyter Notebook
This contribution was made on Jul 8
Created a pull request in simveit/tma_intro that received 1 comment
add utils file, improve readme with directions, create default out dir
This PR: 1 - adds the missing utils file to allow clone and build success. 2 - makes a default out dir, also to allow for immediate clone and succe…
Opened 5 other pull requests in 2 repositories
danielvegamyhre/private-torchao
3
merged
1
open
-
refactor AO quantization into common utils, shared by both rowwise and colwise, add debug_quant_modes testing
This contribution was made on Jul 7
-
integrated rowwise and colwise speedups
This contribution was made on Jul 6
-
return scales as torch.float8_e8m0fnu instead of uint8
This contribution was made on Jul 3
-
working mxfp8 quantization cpp extension
This contribution was made on Jul 3
Dao-AILab/fast-hadamard-transform
1
open
-
Update cpp extension with blackwell support
This contribution was made on Jul 8
Reviewed 1 pull request in 1 repository
lessw2020/FAdam_PyTorch
1 pull request
-
fixed NaN, added a 'maximize' argument for gradient ascent, torchtitan alternative
This contribution was made on Jul 1
Created an issue in simveit/tma_intro that received 2 comments
missing utils.h (pulled a utils from your other repo which worked, but not sure if that's what is intended)
Thanks for the repo! I went to build but hit missing utils.h. Perusing your repos, I found: https://github.com/simveit/effective_transpose/blob/mai…