Rigorous introduction to mathematical foundations of deep learning. Universal approximation theory, stochastic gradient descent algorithms and their convergence properties, approximation theory, neural tangent kernel, mean field overparametrized regime, different deep neural network architectures, reinforcement learning, deep learning for dynamical systems.