Thursday, December 05, 2019

Nadam

Nadam

2019/12/02

----- 


// An Overview on Optimization Algorithms in Deep Learning 2 - Taihong Xiao

-----


# Nadam

-----

References

# Nadam
Dozat, Timothy. "Incorporating nesterov momentum into adam." (2016).
https://openreview.net/pdf?id=OM0jvwB8jIp57ZJjtNEZ 

-----

An Overview on Optimization Algorithms in Deep Learning 2 - Taihong Xiao
https://prinsphield.github.io/posts/2016/02/overview_opt_alg_deep_learning2/

-----

深度学习最全优化方法总结比较(SGD,Adagrad,Adadelta,Adam,Adamax,Nadam) - 知乎
https://zhuanlan.zhihu.com/p/22252270

No comments: