The Star Also Rises

Sunday, August 23, 2020

Word2vec v3

Word2vec v3

2020/08/21

-----

References

[1] Word2vec v3：Simplified Word2vec v1 and v2

Rong, Xin. "word2vec parameter learning explained." arXiv preprint arXiv:1411.2738 (2014).

https://arxiv.org/pdf/1411.2738.pdf

[2] Word2vec v2
https://hemingwang.blogspot.com/2020/07/word2vec-v2.html

[3] Word2vec v1
https://hemingwang.blogspot.com/2020/07/word2vec-v1.html

-----

Word2vec v2

Word2vec v2

2020/07/23

-----

References

[1] Word2vec v2：Hierarchical Softmax and Negative Sampling

Mikolov, Tomas, et al. "Efficient estimation of word representations in vector space." arXiv preprint arXiv:1301.3781 (2013).

https://arxiv.org/pdf/1301.3781.pdf

[2] Hierarchical Softmax
https://hemingwang.blogspot.com/2020/07/hierarchical-softmax.html

[3] Negative Sampling
https://hemingwang.blogspot.com/2020/07/negative-sampling.html

-----

Word2vec v1

Word2vec v1

2020/07/23

-----

References

[1] Word2vec v1：CBOW and Skip-gram

[2] CBOW
https://hemingwang.blogspot.com/2020/08/cbow.html

[3] Skip-gram
https://hemingwang.blogspot.com/2020/08/skip-gram.html

-----

SegFix

SegFix

2020/08/23

-----

https://pixabay.com/zh/photos/lost-places-washroom-factory-1819466/

-----

References

Yuan, Yuhui, et al. "Segfix: Model-agnostic boundary refinement for segmentation." arXiv preprint arXiv:2007.04269 (2020).
https://arxiv.org/pdf/2007.04269.pdf

-----

OCRNet

OCRNet

2020/08/23

-----

https://pixabay.com/zh/photos/spartan-young-man-ocr-4649323/

-----

References

Yuan, Yuhui, Xilin Chen, and Jingdong Wang. "Object-contextual representations for semantic segmentation." arXiv preprint arXiv:1909.11065 (2019).
https://arxiv.org/pdf/1909.11065.pdf

ECCV 2020 | OCRNet化解语义分割上下文信息缺失难题
https://www.msra.cn/zh-cn/news/features/eccv-2020-ocrnet

-----

https://pixabay.com/zh/photos/job-job-offer-workplace-job-search-3241018/

-----

References

Wang, Jingdong, et al. "Deep high-resolution representation learning for visual recognition." IEEE transactions on pattern analysis and machine intelligence (2020).
https://arxiv.org/pdf/1908.07919.pdf

-----

ParseNet

ParseNet

2020/08/23

-----

https://blog.buildo.io/a-tour-of-abstract-syntax-trees-906c0574a067

-----

References

Liu, Wei, Andrew Rabinovich, and Alexander C. Berg. "Parsenet: Looking wider to see better." arXiv preprint arXiv:1506.04579 (2015).
https://arxiv.org/pdf/1506.04579.pdf

Semantic Segmentation

Semantic Segmentation

2020/08/23

-----

Instance Segmentation

Instance Segmentation

2020/08/23

-----

https://medium.com/swlh/object-detection-and-instance-segmentation-a-detailed-overview-94ca109274f2

-----

Hypercolumn

MNC

DeepMask

SharpMask

MultiPathNet

InstanceFCN

FCIS
https://hemingwang.blogspot.com/2019/10/fcis.html

Mask R-CNN
https://hemingwang.blogspot.com/2019/10/mask-r-cnn.html

MaskX R-CNN

MaskLab

PANet

HTC

RetinaMask

MS R-CNN

YOLACT

-----

PFPNet

PFPNet

2020/08/23

-----

https://pixabay.com/zh/photos/louvres-pyramid-museum-monument-632905/

-----

References

Kirillov, Alexander, et al. "Panoptic feature pyramid networks." Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2019.
https://openaccess.thecvf.com/content_CVPR_2019/papers/Kirillov_Panoptic_Feature_Pyramid_Networks_CVPR_2019_paper.pdf

-----

Panoptic Segmentation

Panoptic Segmentation

2020/08/23

-----

https://pixabay.com/zh/photos/sky-water-new-outdoors-abstract-1450789/

-----

References

Kirillov, Alexander, et al. "Panoptic segmentation." Proceedings of the IEEE conference on computer vision and pattern recognition. 2019.
https://openaccess.thecvf.com/content_CVPR_2019/papers/Kirillov_Panoptic_Segmentation_CVPR_2019_paper.pdf

-----

Panoptic Segmentation

Panoptic Segmentation

2020/08/23

-----

https://medium.com/@danielmechea/what-is-panoptic-segmentation-and-why-you-should-care-7f6c953d2a6a

-----

（一）Panoptic Segmentation
https://hemingwang.blogspot.com/2020/08/panoptic-segmentation_23.html

（二）PFPNet
http://hemingwang.blogspot.com/2020/08/pfpnet.html

-----

Friday, August 21, 2020

Context2vec

Context2vec

2020/08/21

-----

https://pixabay.com/zh/photos/background-texture-book-font-2956789/

-----

https://hemingwang.blogspot.com/2020/08/context2vec.html

-----

References

Melamud, Oren, Jacob Goldberger, and Ido Dagan. "context2vec: Learning generic context embedding with bidirectional lstm." Proceedings of the 20th SIGNLL conference on computational natural language learning. 2016.
https://www.aclweb.org/anthology/K16-1006.pdf

A Study on CoVe, Context2Vec, ELMo, ULMFiT and BERT – AH's Blog
https://ahmedhanibrahim.wordpress.com/2019/07/01/a-study-on-cove-context2vec-elmo-ulmfit-and-bert/

-----

Wednesday, August 19, 2020

RNN Encoder Decoder 2

RNN Encoder Decoder 2

2020/08/19

-----

https://pixabay.com/zh/illustrations/head-wire-rack-numbering-system-1231873/

-----

References

[1] RNN Encoder Decoder 2 - using GRU

Cho, Kyunghyun, et al. "On the properties of neural machine translation: Encoder-decoder approaches." arXiv preprint arXiv:1409.1259 (2014).

https://arxiv.org/pdf/1409.1259.pdf

-----

RNN Encoder-Decoder 1

RNN Encoder-Decoder 1

2020/08/19

-----

https://pixabay.com/zh/illustrations/cyber-attack-encryption-smartphone-4444450/

-----

References

[1] RNN Encoder-Decoder 1 - using GRU

Cho, Kyunghyun, et al. "Learning phrase representations using RNN encoder-decoder for statistical machine translation." arXiv preprint arXiv:1406.1078 (2014).

https://arxiv.org/pdf/1406.1078.pdf

-----

Curriculum Learning

Curriculum Learning

2020/08/19

-----

https://pixabay.com/zh/photos/course-information-curriculum-614450/

-----

References

# Curriculum Learning
Bengio, Samy, et al. "Scheduled sampling for sequence prediction with recurrent neural networks." Advances in Neural Information Processing Systems. 2015.
https://papers.nips.cc/paper/5956-scheduled-sampling-for-sequence-prediction-with-recurrent-neural-networks.pdf

# Teacher Forcing Beam Search & Curriculum Learning
一文弄懂关于循环神经网络(RNN)的Teacher Forcing训练机制_落尘-CSDN博客_teacher forcing
https://blog.csdn.net/qq_30219017/article/details/89090690

-----

Beam Search

Beam Search

2020/08/19

-----

https://pixabay.com/zh/photos/young-asia-cambodia-face-woman-1822656/

-----

References

# Beam Search
Wiseman, Sam, and Alexander M. Rush. "Sequence-to-sequence learning as beam-search optimization." arXiv preprint arXiv:1606.02960 (2016).
https://arxiv.org/pdf/1606.02960.pdf

# Teacher Forcing & Beam Search
# 115 人贊同
简说Seq2Seq原理及实现 - 知乎
https://zhuanlan.zhihu.com/p/57155059

# Teacher Forcing Beam Search & Curriculum Learning
一文弄懂关于循环神经网络(RNN)的Teacher Forcing训练机制_落尘-CSDN博客_teacher forcing
https://blog.csdn.net/qq_30219017/article/details/89090690

-----

Teacher Forcing

Teacher Forcing

2020/08/19

-----

https://pixabay.com/zh/photos/learning-school-outdoor-asia-book-1782430/

-----

References

# Teacher Forcing
Lamb, Alex M., et al. "Professor forcing: A new algorithm for training recurrent networks." Advances in neural information processing systems. 2016.
https://arxiv.org/pdf/1610.09038.pdf

# Teacher Forcing & Beam Search
# 115 人贊同
简说Seq2Seq原理及实现 - 知乎
https://zhuanlan.zhihu.com/p/57155059

# Teacher Forcing Beam Search & Curriculum Learning
一文弄懂关于循环神经网络(RNN)的Teacher Forcing训练机制_落尘-CSDN博客_teacher forcing
https://blog.csdn.net/qq_30219017/article/details/89090690

-----