NeuralNet

The work of Nicolas Boulanger-Lewandowski was extensively focused on this topic, see his work [1]. He wrote a Theano deep learning tutorial on this topic [2], and several people (Kratarth Goel) [3][4] have advanced the work to use LSTM and deep belief networks. For a brief while RNN-NADE made an appearance as well, though I do not know of an open source implementation There are also a few of us who are working on more advanced versions of this model for speech synthesis, versus operating on the MIDI sequence. Stay tuned in the near future! I can say from experience that some of the samples from the LSTM-DBN are shockingly cool, and drove me to spend about a week using K-means coded speech. It made robo-voices at least but our research moved past that pretty fast. [1] http://www-etud.iro.umontreal.ca/~boulanni/ [2] http://deeplearning.net/

I know some more. Some of them are made as libraries, some are just code examples, where you however could extract out some relevant code. * PyLearn, LISA labs, http://deeplearning.net/software/pylearn2/ * LSTM, http://deeplearning.net/tutorial/lstm.html#lstm * LSTM, https://github.com/skaae/nntools * LSTM, https://github.com/JonathanRaiman/theano_lstm * LSTM, https://github.com/mohammadpz/Recurrent-Neural-Networks * LSTM, http://christianherta.de/lehre/dataScience/machineLearning/n... * LSTM, https://gist.github.com/jpuigcerver/9358036 * LSTM + CTC, https://github.com/kastnerkyle/net * Speech modeling, LSTM, https://github.com/kastnerkyle/speech_density * FF + RNN, https://github.com/lmjohns3/theano-nets * FF + RNN, https://github.com/lmjohns3/theanets Speech: https://github.com/lmjohns3/arrnn-experiment/blob/master/tas... * FF, https://