-
This project is for the competition and is implemented in PyTorch.
-
I used resnet-152 and got my best score 0.92563 on Kaggle. I have tried some model fusion tricks but it didn't work better.
-
Firstly randomly crop the image. When the val loss doesn't decrease any more, cancel the crop setting for possible improvement of the model.
-
The weight decay is used periodically.
-
Use SGD + Momentum + Nesterov.
-
When the validation loss decreases to very low, validate the model more frequently to find the best one.
-
Initially use small batch size for fast convergence. Later on increase the batch size for more steady training.