Highway

Highway

2019/11/08

-----

Fig. Highway（圖片來源：Pixabay）

-----

Fig. RNN

// Understanding LSTM Networks -- colah's blog

-----

Fig. 6. LSTM

// Understanding LSTM Networks -- colah's blog

-----

Fig. GRU

// Understanding LSTM Networks -- colah's blog

-----

Fig. FNN vs RNN

// Special Structure (v6)

-----

// Special Structure (v6)

-----

// 李宏毅深度学习-六-HighwayNetwork和LSTM _

-----

// Special Structure (v6)

-----

// Special Structure (v6)

-----

// Highway v1

-----

// Highway v1

-----

// Review  Highway Networks — Gating Function To Highway (Image Classification)

-----

// Highway v1

-----

// Review  Highway Networks — Gating Function To Highway (Image Classification)

-----

// Highway v1

-----

// Highway v2

-----

// Highway v2

-----

// Highway v2

-----

// Highway v2

-----






-----

References

Highway v1

Srivastava, Rupesh Kumar, Klaus Greff, and Jürgen Schmidhuber. "Highway networks." arXiv preprint arXiv:1505.00387 (2015).

https://arxiv.org/pdf/1505.00387.pdf

Highway v2

Srivastava, Rupesh K., Klaus Greff, and Jürgen Schmidhuber. "Training very deep networks." Advances in neural information processing systems. 2015.

https://papers.nips.cc/paper/5850-training-very-deep-networks.pdf

Understanding LSTM Networks -- colah's blog
http://colah.github.io/posts/2015-08-Understanding-LSTMs/

Review  Highway Networks — Gating Function To Highway (Image Classification)
https://towardsdatascience.com/review-highway-networks-gating-function-to-highway-image-classification-5a33833797b5

Highway Networks with TensorFlow - Jim Fleming - Medium
https://medium.com/jim-fleming/highway-networks-with-tensorflow-1e6dfa667daa

-----

李宏毅深度学习-六-HighwayNetwork和LSTM _
http://shartoo.github.io/LHYDeepLearning_highway/

李宏毅：Highway Network & Grid LSTM - jiaojiaolou的博客 - CSDN博客
https://blog.csdn.net/jiaojiaolou/article/details/90412860

-----

李宏毅_ATDL_Lecture_6 - HackMD
https://hackmd.io/@shaoeChen/H1AYoB-5E?type=view 

# 李宏毅老師的教學投影片 pdf
Special Structure (v6)
http://speech.ee.ntu.edu.tw/~tlkagk/courses/MLDS_2017/Lecture/Special%20Structure%20(v6).pdf 

# 李宏毅老師的教學影片
Highway Network & Grid LSTM - YouTube
https://www.youtube.com/watch?v=dxB6299gpvI&list=PLJV_el3uVTsPMxPbjeX7PicgWbY7F8wW9&index=6 

Hung-yi Lee
http://speech.ee.ntu.edu.tw/~tlkagk/courses_MLDS17.html