Basic idea of RNN
- Recurrent Neural Networks Tutorial(Very good)
- This tutorial has 4 parts:
- INtroduction to RNN
- Implementation of RNN
- Understanding BPTT
- Implementation of GRU/LSTM
- This tutorial has 4 parts:
- https://zybuluo.com/hanbingtao/note/541458
- Presenting the general idea of RNN, Bidirectional RNN, Deep RNN.
- Mathematical formula of training a Deep RNN
- Examples of RNN
papers:
- Recurrent neural network based language model
- https://www.isca-speech.org/archive/archive_papers/interspeech_2010/i10_1045.pdf
- Most cited paper about RNN in Google scholar
- To be continued
- Extensions of Recurrent neural network based language model
- Towards End-to-End Speech Recognition with Recurrent Neural Networks
- http://proceedings.mlr.press/v32/graves14.pdf
- To be continued
Project of RNN:
- https://github.com/karpathy/char-rnn
- Generator of chars using RNN/LSTM/GRU
- To be continued.