[GSoC][RNN] List of interesting papers/blogs/articles/projects about RNN

Basic idea of RNN

• Recurrent Neural Networks Tutorial(Very good)
  • http://www.wildml.com/2015/09/recurrent-neural-networks-tutorial-part-1-introduction-to-rnns/
  • This tutorial has 4 parts:
    • INtroduction to RNN
    • Implementation of RNN
    • Understanding BPTT
    • Implementation of GRU/LSTM

• https://zybuluo.com/hanbingtao/note/541458
  • Presenting the general idea of RNN, Bidirectional RNN, Deep RNN.
  • Mathematical formula of training a Deep RNN
  • Examples of RNN

• https://www.zybuluo.com/Dounm/note/591752
  • Word2vec

papers:

• Recurrent neural network based language model
  • https://www.isca-speech.org/archive/archive_papers/interspeech_2010/i10_1045.pdf
  • Most cited paper about RNN in Google scholar
  • To be continued

• Extensions of Recurrent neural network based language model
  • http://www.fit.vutbr.cz/research/groups/speech/publi/2011/mikolov_icassp2011_5528.pdf
  • To be continued

• Towards End-to-End Speech Recognition with Recurrent Neural Networks
  • http://proceedings.mlr.press/v32/graves14.pdf
  • To be continued

Project of RNN:

• https://github.com/karpathy/char-rnn
  • Generator of chars using RNN/LSTM/GRU
  • To be continued.