Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
Andy-wyx committed Dec 14, 2023
1 parent d2607e8 commit 8ed2284
Showing 1 changed file with 10 additions and 1 deletion.
11 changes: 10 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -53,12 +53,21 @@ A full version final report can be found here: [LINK TO PDF]
See the final report: [Link to PDF]

## Future Work
* Enable GPU mode for semiHebbNet

**Training & Experiments**
* Try to train semiHebbNet in one phase, find the best learning rate for Hebbian layers and linear layers respectively.
* More Hyperparameter tuning on these models to compare their Peak Accuracy.
* Compare Efficiency in the same experimental settings.(same epoch, dataset, lr, hardward etc)

**Algorithms & Learning rules**
* Implement modified Gupta's update rule
* Explore more Biologically Plausible Neural Networks e.g. [SCALING FORWARD GRADIENT WITH LOCAL LOSSES](https://arxiv.org/abs/2210.03310)

**Others**
* Enable GPU mode for semiHebbNet and Feedback Alignment
* Interpretability: Figure out a way to make XPlique applicable to our models. (our models have no filters as attributes, and are not differentiable sometimes)


## Useful Resources
Except for torchvision models, [GluonCV](https://github.com/dmlc/gluon-cv/tree/master/gluoncv/model_zoo) includes many pretrained sota models in CV.

Expand Down

0 comments on commit 8ed2284

Please sign in to comment.