pytorch_arch_relu

Comparison of ReLU

https://www.joeltok.com/blog/pytorch-convert-f-relu-to-nn-relu#:~:text=comes%20before%20it.-,F.,initialise%20the%20method%20with%20nn.

https://discuss.pytorch.org/t/is-nn-relu-more-computationally-heavy-than-f-relu/66200 https://discuss.pytorch.org/t/whats-the-difference-between-nn-relu-vs-f-relu/27599