We will first give a quick review of how information theory impacts AI, in particular how a complex system can evolve into a more complex system while satisfying the laws of information theory. Second we will investigate the problem of learnability. Deep neural networks are sometimes uncapable of learning surprisingly simple problems, we will try to hint a characterization of those problems.