ReLU

ReLU

2019/06/17

-----

Fig. ReLU（圖片來源）。

-----

References

A Practical Guide to ReLU – TinyMind – Medium
https://medium.com/tinymind/a-practical-guide-to-relu-b83ca804f1f7

Neural Networks  an Alternative to ReLU – Towards Data Science
https://towardsdatascience.com/neural-networks-an-alternative-to-relu-2e75ddaef95c

What is the 'dying ReLU' problem in neural networks  - Quora
https://www.quora.com/What-is-the-dying-ReLU-problem-in-neural-networks

'Dead ReLU Problem' 产生的原因 - Programming is an art form. - CSDN博客
https://blog.csdn.net/disiwei1012/article/details/79204243