beginners

Jiphyeonjeon Season 1 - Beginners Class

• 수정 및 업데이트 요청 : 강명철([email protected]), 이윤재([email protected])
• 초급반 스케쥴: 구글 독스
  
  

Table of Contents

• Summary
• Presentations
  
  

Summary

by Subject

Subject	Season1
Neural Network	2
Embedding	2
Total	4

by Conference/Journals

Conference/Journal	Season1
Neural Computation	1
International Conference on Learning Representations	1
Transactions of the Association for Computational Linguistics	1
Journal of machine learning research	1
Total	4

by Published Year

Year	Season1
1997	1
2003	1
2013	1
2014	3
2017	2
2019	1
Total	9

Presentations

• 01 : Long Short-Term Memory

  • Paper, Video, Presentation
  • S. Hochreiter, J. Schmidhuber, Neural Computation 1997
  • Keywords: LSTM, Neural Network
  • Presentor : 송석리

• 02 : Efficient Estimation of Word Representations in Vector Space

  • Paper, Video, Presentation
  • Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013). arXiv preprint arXiv:1301.3781.
  • Keywords: Word2Vec
  • Presentor : 이영빈

• 03 : Enriching Word Vectors with Subword Information

  • Paper, Video, Presentation
  • Bojanowski, P., Grave, E., Joulin, A., & Mikolov, T. (2017). Transactions of the Association for Computational Linguistics, 5, 135-146.
  • Keywords: Fasttext
  • Presentor : 이기창

• 04 : A Neural Probabilistic Language Model

  • Paper, Video, Presentation
  • Bengio, Y., Ducharme, R., Vincent, P., & Jauvin, C. (2003). Journal of machine learning research, 3(Feb), 1137-1155.
  • Keywords: Statistical language modeling, artificial neural networks, distributed representation, curse of dimensionality
  • Presentor : 허치영

• 05 : Attention is all you need

  • Paper, Video, Presentation
  • Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., ... & Polosukhin, I. (2017). Advances in neural information processing systems, 30, 5998-6008.
  • Keywords: Attention, bahdanau attention, dot-product attention, teacher forcing, transformer
  • Presentor : 이정섭

• 06 : BERT: Pre-trainig of Deep Bidirectional Transformers for Language Understanding

  • Paper, Video, Presentation
  • Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova (2019). Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1, 4171-4186.
  • Keywords: BERT, Transformers, language representation model
  • Presentor : 오새찬

• 07 : GloVe: Global Vectors for Word Representation

  • Paper, Video, Presentation
  • Jeffrey Pennington, Richard Socher, Christopher Manning (2014). Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, 1532-1543.
  • Keywords: GloVe, Word Representation, Embedding
  • Presentor : 김지은

• 08 : Sequence to Sequence Learning with Neural Networks

  • Paper, Video, Presentation
  • Ilya Sutskever, Oriol Vinyals, Quoc V. Le (2014). Proceedings of the 27th International Conference on Neural Information Processing Systems, Volume 2, 3104-3112.
  • Keywords: seq2seq, Neural Network, LSTM, translation
  • Presentor : 심형민

• 09 : Deep Speech: Scaling up end-to-end speech recognition

  • Paper, Video, Presentation
  • Awni Hannun, Carl Case, Jared Casper, Bryan Catanzaro, Greg Diamos, Erich Elsen, Ryan Prenger, Sanjeev Satheesh, Shubho Sengupta, Adam Coates, et al. (2014). arXiv preprint arXiv:1412.5567.
  • Keywords: speech recognition, RNN
  • Presentor : 진승정

• 12 : BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension

  • Paper, Video, Presentation
  • Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Veselin Stoyanov, Luke Zettlemoyer (2020). Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 7871–7880.
  • Keywords: BART
  • Presentor : samuel kim

• 13 : Convolutional Neural Networks for Sentence Classification

  • Paper, Video, Presentation
  • Yoon Kim (2014). Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), 1746–1751.
  • Keywords:
  • Presentor : 유영재

• 14 : Neural machine translation by jointly learning to align and translate

  • Paper, Video, Presentation
  • *Dzmitry Bahdanau, Kyunghyun Cho, Yoshua Bengio (2014). 3rd International Conference on Learning Representations, ICLR 2015 *
  • Keywords: Attention
  • Presentor : 소현지