This is an unofficial implementation of Deep Mutual Learning by Pytorch to do classification on cifar100.
The algorithm was proposed in 《Deep Mutual Learning》 (CVPR 2017).
Pytorch 1.0.0
tensorboard 1.14.0
Overview of the algorithm:
The default network for DML is ResNet32.
Train 2 models using DML by main.py:
python train.py --model_num 2
Use tensorboard to monitor training process on choosing port:
tensorboard --logdir logs --port 6006
| Network | ind_avg_acc | Dml_avg_acc |
|---|---|---|
| ResNet32 | 69.83% | 71.03% |