Tackling the Limits of Deep Learning

Deep learning has made great progress in a variety of language tasks. However, there are still many practical and theoretical problems and limitations. In this talk I will introduce solutions to some of these: How to predict previously unseen words at test time. How to have a single input and output encoding for words. How to grow a single model for many tasks. How to use a single end-to-end trainable architecture for question answering.