[WIP] Add nonlinearity between Down and Up weights, expose alpha hyperparameter#111
Draft
brian6091 wants to merge 15 commits intocloneofsimo:developfrom
Draft
[WIP] Add nonlinearity between Down and Up weights, expose alpha hyperparameter#111brian6091 wants to merge 15 commits intocloneofsimo:developfrom
brian6091 wants to merge 15 commits intocloneofsimo:developfrom
Commits
Commits on Jan 5, 2023
- authored
- authored
- authored
- authored
- authored
- authored
- authored
- authored
- authored
- authored
- authored
- authored
- authored
- authored