Skip to content

Latest commit

 

History

History
30 lines (26 loc) · 1.35 KB

README.md

File metadata and controls

30 lines (26 loc) · 1.35 KB
Raw

KorQuAD Project

미니컨 프로젝트 수행을 위해서 Deep Learning 분야를 공부합니다. (일정이 급해서 정리는 시간나는대로 하겠습니다.)

일정

cs231n 으로 기본 공부

  • (03-20) Lecture 2 : Linear Classification
  • (03-21) Lecture 3 : Loss Function, Optimization, Stochastic Gradient Descent
  • (03-22) Lecture 4 : Introduction to Neural Network, BackPropagation
  • (03-23) Lecture 6 : Training Neural Networks I
  • (03-25) Lecture 10 : RNN and LSTM

논문 리뷰

  • BiDAF(Bi-Directinal Attention Flow)
  • Attention is All You Need ( a.k.a. Transformers )
  • BERT : Pre-Training of Deep Bidirectional Transformers for Language Understanding

고민할것

  • Word Piece Model (???)
  • KorQuAD 전처리를 어떻게 할지? WPM??
  • fine-tuning 은 어떻게?

Reference