Tuesday, December 24, 2019

ShakeDrop

›
ShakeDrop 2019/12/09 ----- # ShakeDrop ----- References # ShakeDrop Yamada, Yoshihiro, et al. "Shakedrop regularizatio...

Shake-Shake

›
Shake-Shake 2019/12/09 ----- # Shake-Shake ----- References # Shake-Shake Gastaldi, Xavier. "Shake-shake regularizatio...

NASNet（Scheduled DropPath）

›
NASNet（Scheduled DropPath） 2019/12/09 ----- # NASNet（Scheduled DropPath） ----- # NASNet（Scheduled DropPath） ----- # N...

ResNet-D

›
ResNet-D 2019/11/12 前言： 論文《Deep networks with stochastic depth》，我將其命名為 ResNet-D，取其名稱中的 depth。此外，論文裡的實驗隨機丟棄一些殘差層來訓練網路，使用的技巧是 dropout。經由...

DropPath

›
DropPath 2019/12/09 ----- # FractalNet（DropPath） ----- # FractalNet（DropPath） ----- References # FractalNet（DropPath） ...

Dropconnect

›
Dropconnect 2019/12/09 ----- # DropConnect ----- # DropConnect ----- // Dropout, DropConnect, and Maxout Mechanism Ne...

Dropout

›
Dropout 2019/12/09 ----- // DNN tip ----- # Dropout ----- # Dropout ----- # Dropout ----- # Dropout -...

Early Stopping

›
Early Stopping 2019/12/20 ----- // Improving Deep Neural Networks  Hyperparameter tuning, Regularization and Optimization - week 1...

L0

›
L0 2019/12/09 ----- // Regularization in Machine Learning  Connect the dots ----- // Foundations of Machine Learning  Part 4...

L1

›
L1 2019/12/09 ----- // Lasso Regression - R Statistics Blog ----- // Topographic _ Regularized Feature Learning in Tensorfl...

L2

›
L2 2019/12/09 ----- // Ridge Regression - R Statistics Blog ----- // Topographic _ Regularized Feature Learning in Tensorflo...

ResNet-U

›
ResNet-U 2019/12/24 ----- References # ResNet-U Liu, Tianyi, et al. "Towards Understanding the Importance of Shortcut Conn...

ResNet-V

›
ResNet-V 2019/12/20 ----- # ResNet-V ----- References # ResNet-V Li, Hao, et al. "Visualizing the loss landscape of ne...

ResNet-F

›
ResNet-F 2019/12/24 ----- References # ResNet-F Zhang, Hongyi, Yann N. Dauphin, and Tengyu Ma. "Fixup initialization: Residua...

IterNorm

›
IterNorm 2019/12/24 ----- References # IterNorm Huang, Lei, et al. "Iterative Normalization: Beyond Standardization towards E...

KN

›
KN 2019/12/24 ----- References # KN Wang, Guangrun, et al. "Kalman normalization: Normalizing internal representations across...

DBN

›
DBN 2019/12/24 ----- References # DBN Huang, Lei, et al. "Decorrelated batch normalization." Proceedings of the IEEE Con...

GWNN

›
GWNN 2019/12/24 ----- References # GWNN Luo, Ping. "Learning deep architectures via generalized whitened neural networks....

Whitening

›
Whitening 2019/12/24 ----- // Statistical Whitening - Joe Marino ----- // Statistical Whitening - Joe Marino ----- //...