In the beginning of this chapter, we learned what RNNs are, how to train them, what problems might occur during training, and how to solve these problems. In the second part, we described the problem of language modeling and how RNNs help us solve some of the difficulties in modeling languages. The third section brought this information together in the form of a practical example on how to train a character-level language model to generate text based on Leo Tolstoy's War and Peace. The last section gave a brief overview of how deep learning, and especially RNNs, can be applied to the problem of speech recognition.

The RNNs discussed in this chapter are very powerful methods that have been very promising when it comes to a lot of tasks, such as language modeling and speech recognition. They are especially suited for modeling sequential problems where they could discover patterns over sequences.