Generative AI

Generative AI

MET CS 788 (4 credits)

Prerequisites: MET CS 677, Python programming, mathematics required for machine learning, and familiarity with neural networks. Or instructor¿s consent. - The first part of the course covers statistical concepts required for generative artificial intelligence. We review regressions and optimization methods as well as traditional neural network architectures, including perceptron and multilayer perceptron. Next, we move to Convolutional Neural Networks and Recurrent Neural Networks and close this part with Attention and Transformers. The second part of the course focuses on generative neural networks. We start with traditional self-supervised learning algorithms (Self Organized Map and Restricted Boltzmann Machine), then explore Auto Encoder architectures and Generative Adversarial Networks and move toward architectures that construct generative models, including recent advances in NLP, including LLMs, and Retrieval Augmented Methods. Finally, we describe the Neural Radiance Field, 3D Gaussian Splatting, and text-2-image models.