Skip to content

Commit

Permalink
cite and show it is available already
Browse files Browse the repository at this point in the history
  • Loading branch information
lucidrains committed Oct 16, 2024
1 parent 8340361 commit 9fb2977
Showing 1 changed file with 23 additions and 0 deletions.
23 changes: 23 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -95,6 +95,18 @@ synthesized_ema_output = synthesized_ema(data)

```

For testing out the claims of a free lunch from the <a href="https://arxiv.org/abs/2402.09240">`Switch EMA`</a> paper, just set `update_model_with_ema_every` as so

```python

ema = EMA(
net,
...,
update_model_with_ema_every = 10000 # say 10k steps is 1 epoch
)

```

## Citations

```bibtex
Expand All @@ -118,3 +130,14 @@ synthesized_ema_output = synthesized_ema(data)
url = {https://api.semanticscholar.org/CorpusID:270258586}
}
```

```bibtex
@article{Li2024SwitchEA,
title = {Switch EMA: A Free Lunch for Better Flatness and Sharpness},
author = {Siyuan Li and Zicheng Liu and Juanxi Tian and Ge Wang and Zedong Wang and Weiyang Jin and Di Wu and Cheng Tan and Tao Lin and Yang Liu and Baigui Sun and Stan Z. Li},
journal = {ArXiv},
year = {2024},
volume = {abs/2402.09240},
url = {https://api.semanticscholar.org/CorpusID:267657558}
}
```

0 comments on commit 9fb2977

Please sign in to comment.