{"id":23767,"date":"2026-07-05T14:07:26","date_gmt":"2026-07-05T18:07:26","guid":{"rendered":"https:\/\/www.bu.edu\/cs\/?p=23767"},"modified":"2026-09-03T14:13:23","modified_gmt":"2026-09-03T18:13:23","slug":"generative-ai-systems-beyond-llms-and-apis","status":"publish","type":"post","link":"https:\/\/www.bu.edu\/cs\/2026\/07\/05\/generative-ai-systems-beyond-llms-and-apis\/","title":{"rendered":"Generative AI Systems: What Students Learn Beyond Using LLM APIs"},"content":{"rendered":"<h1><b>Generative AI Systems: What Students Learn Beyond Using LLM APIs<\/b><\/h1>\n<h2><img loading=\"lazy\" src=\"\/cs\/files\/2026\/09\/AI-stock-636x428.png\" alt=\"\" width=\"636\" height=\"428\" class=\"alignnone size-medium wp-image-23768\" srcset=\"https:\/\/www.bu.edu\/cs\/files\/2026\/09\/AI-stock-636x428.png 636w, https:\/\/www.bu.edu\/cs\/files\/2026\/09\/AI-stock-1024x689.png 1024w, https:\/\/www.bu.edu\/cs\/files\/2026\/09\/AI-stock-768x517.png 768w, https:\/\/www.bu.edu\/cs\/files\/2026\/09\/AI-stock-800x538.png 800w, https:\/\/www.bu.edu\/cs\/files\/2026\/09\/AI-stock.png 1370w\" sizes=\"(max-width: 636px) 100vw, 636px\" \/><\/h2>\n<p><span style=\"font-weight: 400;\">Studying generative artificial intelligence (AI) systems at the graduate level means learning how to implement, evaluate, and deploy them. Read on to discover the knowledge and skills students actually gain about generative models at Boston University (BU).\u00a0<\/span><\/p>\n<h2><b>Using an LLM API Is Not the Same as Building a Generative AI System<\/b><\/h2>\n<p><span style=\"font-weight: 400;\">In 2025, <\/span><a href=\"https:\/\/www.usatoday.com\/story\/life\/health-wellness\/2025\/10\/26\/13-year-old-new-ai-invention-fall-device-grandma\/86708278007\/\"><span style=\"font-weight: 400;\">13-year-old Kevin Tang<\/span><\/a><span style=\"font-weight: 400;\"> used a large language model (LLM) application programming interface (API) to build a camera monitoring system to protect his grandmother and other elderly people from falls at home. He won $25,000 and the title of &#8220;America&#8217;s Top Young Scientist&#8221; for inventing the FallGuard system.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Kevin\u2019s feat is impressive, and the patent for FallGuard is pending. He also employed LLM tools to <\/span><a href=\"https:\/\/fallguard.net\/convert_mobile.html\"><span style=\"font-weight: 400;\">establish a website<\/span><\/a><span style=\"font-weight: 400;\"> where anyone can download the apps he created for video monitoring for falls at home.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">However, FallGuard relied on LLM APIs and existing tools. To take it a step further and build more complex systems in enterprises, a deeper knowledge of model behavior, architecture, evaluation, and deployment is needed.<\/span><\/p>\n<h3><b>API Use Is Only the Surface Layer<\/b><\/h3>\n<p><span style=\"font-weight: 400;\">Working with a chatbot interface or an API won&#8217;t provide the fundamentals of understanding how a generative AI system works \u2014 and how it can be reliable in business or organizational applications. As <\/span><a href=\"https:\/\/www.linkedin.com\/posts\/krider2010_you-cant-treat-llm-models-like-apis-while-share-7359622729127325697-5fd_\/\"><span style=\"font-weight: 400;\">engineering leader Dr. Claire Knight<\/span><\/a><span style=\"font-weight: 400;\"> puts it, &#8220;You can&#8217;t treat LLM models like APIs.&#8221; She elaborates, &#8220;The same prompt might give you a solid result at 2 p.m. and nonsense at 2:03 p.m.&#8221;\u00a0<\/span><\/p>\n<h3><b>Graduate Study Goes Beyond Consumption to System Design<\/b><\/h3>\n<p><span style=\"font-weight: 400;\">You&#8217;ve seen references to &#8220;<\/span><a href=\"https:\/\/www.inc.com\/ben-sherry\/what-is-tokenmaxxing-ai-productivity-hack\/91328999\"><span style=\"font-weight: 400;\">tokenmaxxing<\/span><\/a><span style=\"font-weight: 400;\">&#8221; and leaderboards at different companies that identify &#8220;Token Legends&#8221; among engineers who process massive amounts of tokens (which are essentially units of data) for their projects. Yet just being able to use large amounts of LLM resources isn&#8217;t the best fit for enterprise-level AI development. Students should understand models, tradeoffs, evaluation, and deployment if they want to move into professional building and adapting AI generative models in real-world businesses.<\/span><\/p>\n<h2><b>What Students Study in the Generative Models Module<\/b><\/h2>\n<p><span style=\"font-weight: 400;\">At Boston University, the <\/span><a href=\"https:\/\/www.bu.edu\/cs\/masters\/program\/online-csai\/\"><span style=\"font-weight: 400;\">online Master of Science (MS) in Computer Science &amp; Artificial Intelligence<\/span><\/a><span style=\"font-weight: 400;\"> degree covers skills and background necessary to work in production environments for generative AI system design.<\/span><\/p>\n<h3><b>Core Generative Architectures<\/b><\/h3>\n<p><span style=\"font-weight: 400;\">The Generative Models module, CX643, introduces students to the principles and applications that govern generative AI models. You&#8217;ll learn core architectures, including:<\/span><span style=\"font-weight: 400;\"><br \/>\n<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Diffusion models<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Generative adversarial networks (GANs)<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Variational autoencoders (VAES)<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Diffusion models<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Transformers (neural network architectures)\u00a0<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Large language models (LLMs)<\/span><\/li>\n<\/ul>\n<h3><b>Applications Across NLP, Vision, and Multimodal AI<\/b><\/h3>\n<p><span style=\"font-weight: 400;\">In addition to text-based uses, a <\/span><a href=\"https:\/\/www.bu.edu\/cs\/masters\/program\/online-csai\/curriculum-overview\/\"><span style=\"font-weight: 400;\">course in generative model architecture<\/span><\/a><span style=\"font-weight: 400;\"> covers principles of natural language processing, multimodal AI, and computer vision. This opens doors to a range of potential real-world use cases, from autonomous vehicles to advanced healthcare applications.<\/span><\/p>\n<h2><b>Generative AI Includes More Than LLMs<\/b><\/h2>\n<p><span style=\"font-weight: 400;\">Looking at the diverse uses of AI today, it&#8217;s easy to see how transformers and LLMs are just one facet of a multifaceted set of use cases. Graduate courses in generative AI, including the Generative Models module, cover multiple modes and functions within AI model families.<\/span><\/p>\n<h3><b>Why Transformers Matter<\/b><\/h3>\n<p><span style=\"font-weight: 400;\">Although methods of AI implementation are widely varied, <\/span><a href=\"https:\/\/developers.google.com\/machine-learning\/crash-course\/llm\/transformers\"><span style=\"font-weight: 400;\">transformers and LLMs<\/span><\/a><span style=\"font-weight: 400;\"> remain central points of access to the technology. Using encoders and decoders, natural language inputs are transformed through massive neural nets to obtain results. Transformers and LLMs are integral to modern generative AI because they support large-scale language understanding and generation.<\/span><\/p>\n<h3><b>How GANs, VAEs, and Diffusion Models Expand the Field<\/b><\/h3>\n<p><span style=\"font-weight: 400;\">Different model families and modes support different use cases and tasks. Graduate study in AI generative models and system design will include VAEs, (GANs), and AI diffusion models, which utilize distinct mathematical methods to expand the horizons of machine learning (ML) creativity.<\/span><\/p>\n<h2><b>Implementation Is a Core Part of the Learning Experience<\/b><\/h2>\n<p><span style=\"font-weight: 400;\">Learning about model families and methods of AI implementation provides a foundation for understanding their uses in real life. Still, there&#8217;s no replacement for actual implementation.\u00a0<\/span><\/p>\n<h3><b>Students Work With Industry-Standard Frameworks<\/b><\/h3>\n<p><span style=\"font-weight: 400;\">BU&#8217;s course for generative models emphasizes practical implementation. Students learn to evaluate and deploy architectures using industry-standard frameworks. You&#8217;ll reinforce skills in responsible AI implementation and real-world techniques.<\/span><\/p>\n<h3><b>Learning Means Building, Not Just Describing<\/b><\/h3>\n<p><span style=\"font-weight: 400;\">You won&#8217;t be stuck relying on textbooks or online modules in the course covering generative models. Instead, you can gain experience in not only working with LLMs but also variational autoencoders \u2014 plus knowledge of how to compress data, denoise it, and generate new, synthetic data. Additionally, the course covers GANs and diffusion models as well as LLMs and how to build with them.<\/span><\/p>\n<h2><b>Evaluation Is What Separates Real Systems Work From Simple Experimentation<\/b><\/h2>\n<p><span style=\"font-weight: 400;\">We&#8217;ve all heard the statistic that a large percentage of <\/span><a href=\"https:\/\/www.forbes.com\/sites\/andreahill\/2025\/08\/21\/why-95-of-ai-pilots-fail-and-what-business-leaders-should-do-instead\/\"><span style=\"font-weight: 400;\">AI pilot projects have failed<\/span><\/a><span style=\"font-weight: 400;\"> when they are brought to scale in businesses and organizations. Experimental uses of AI remain active and useful, but they are not enough to work in professional environments without the assessment and evaluation that contribute to their effective use.<\/span><\/p>\n<h3><b>Generative Systems Need to Be Assessed, Not Just Run<\/b><\/h3>\n<p><span style=\"font-weight: 400;\">When building a generative AI system, you&#8217;ll need to rely on your ability to evaluate output quality and track model behavior over time. Another important skill? Assessing how useful the system is in the real world. Practicality is crucial in successful AI model design and implementation.<\/span><\/p>\n<h3><b>Why Evaluation Matters for Real-World AI Work<\/b><\/h3>\n<p><span style=\"font-weight: 400;\">Without proper evaluation, AI models can refer to unseen data, cause real-world failures, and exhibit hidden biases. In order for models to perform safely and as designed when performing their assigned tasks, trust and reliability must be demonstrated via rigorous evaluation throughout the model&#8217;s lifecycle.<\/span><\/p>\n<h2><b>Deployment Is Part of the Skill Set, Too<\/b><\/h2>\n<p><span style=\"font-weight: 400;\">When it&#8217;s time to deploy models after they&#8217;ve been developed and initially tested, they will then enter production. This is why the computer science and AI master\u2019s program instills the skills you&#8217;ll need to move into the production phase.<\/span><\/p>\n<h3><b>Generative Models Need More Than a Working Notebook<\/b><\/h3>\n<p><span style=\"font-weight: 400;\">Although models that professionals design may seem to work perfectly while in development, when actual use cases are introduced in production, the situation can change rapidly. This phase of AI model development involves organizational dimensions, including integration into existing business workflows. Security, privacy, and compliance concerns all play a role at this stage.<\/span><\/p>\n<h3><b>From Generative Models to Production AI<\/b><\/h3>\n<p><span style=\"font-weight: 400;\">The Generative Models module emphasizes deployment, and the following module (Systems Deployment and Responsible Innovation) explicitly prepares students to move AI\/ML solutions from prototyping to production at scale. Issues like responsible use become more critical as systems move into real environments.<\/span><\/p>\n<h2><b>How This Module Fits Into the Broader CS &amp; AI Curriculum<\/b><\/h2>\n<p><span style=\"font-weight: 400;\">The Generative Models module follows the Mathematical Foundations of Data Science and Applied Machine Learning modules. The next module, Systems Deployment and Responsible Innovation, moves to a later stage of AI systems and model development in the\u00a0<\/span><a href=\"https:\/\/www.bu.edu\/cs\/masters\/program\/online-csai\/curriculum-overview\/\"><span style=\"font-weight: 400;\">program&#8217;s curriculum<\/span><\/a><span style=\"font-weight: 400;\">.<\/span><\/p>\n<h3><b>A Program Built Around Intelligent Systems in Production<\/b><\/h3>\n<p><span style=\"font-weight: 400;\">The online MS in Computer Science and AI degree at Boston University is designed for those who seek more than surface-level exposure to AI tools. The program prepares learners to design, build, and deploy intelligent systems that perform reliably in production environments.<\/span><\/p>\n<h3><b>Generative Models Build on Earlier AI Foundations<\/b><\/h3>\n<p><span style=\"font-weight: 400;\">The Generative Models module leverages what students learn in the Applied Machine Learning module \u2014 which introduces deep learning, generative models, and advanced neural network topics. You&#8217;ll experience hands-on work in Python and frameworks such as scikit-learn and PyTorch through the Applied Machine Learning module.<\/span><\/p>\n<h3><b>The Curriculum Moves From Models to Production<\/b><\/h3>\n<p><span style=\"font-weight: 400;\">BU\u2019s AI sequence for modules 1 through 4 progresses in the following order:<\/span><span style=\"font-weight: 400;\"><br \/>\n<\/span><\/p>\n<ol>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Mathematical Foundations of Data Science\u00a0<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Applied Machine Learning\u00a0<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Generative Models\u00a0<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Production-focused Systems Deployment and Responsible Innovation<\/span><\/li>\n<\/ol>\n<h2><b>Why This Matters for Future AI Careers<\/b><\/h2>\n<p><span style=\"font-weight: 400;\">Gaining a firm grasp of principles underlying AI model development and practical experience in model deployment is essential for <\/span><a href=\"https:\/\/www.bu.edu\/cs\/masters\/program\/online-csai\/career-impact\/\"><span style=\"font-weight: 400;\">working professionally<\/span><\/a><span style=\"font-weight: 400;\"> in the fast-growing AI sector.<\/span><\/p>\n<h3><b>These Skills Support More Than Basic AI Tool Use<\/b><\/h3>\n<p><span style=\"font-weight: 400;\">AI professionals who understand generative AI models at the system level are better prepared for advanced technical work alongside implementation and deployment than those who only know how to use prebuilt tools (like APIs).<\/span><\/p>\n<h3><span style=\"font-weight: 600;\">BU Connects This Preparation to Advanced Technical Roles<\/span><\/h3>\n<p><span style=\"font-weight: 400;\">Program graduates build portfolios showing they can design, build, and deploy advanced computing systems in real-world settings. In turn, they emerge <\/span><a href=\"https:\/\/www.bu.edu\/cs\/masters\/program\/online-csai\/career-impact\/\"><span style=\"font-weight: 400;\">better prepared for careers<\/span><\/a><span style=\"font-weight: 400;\"> and roles such as:<\/span><span style=\"font-weight: 400;\"><br \/>\n<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">AI systems developer<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Data system engineer<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Cloud AI architect<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Machine learning engineer<\/span><\/li>\n<\/ul>\n<h2><b>Start Building Generative AI Systems with an Online MS in Computer Science and AI Degree From BU<\/b><\/h2>\n<p><span style=\"font-weight: 400;\">Explore the <\/span><a href=\"https:\/\/www.bu.edu\/cs\/masters\/program\/online-csai\/curriculum-overview\/\"><span style=\"font-weight: 400;\">curriculum<\/span><\/a><span style=\"font-weight: 400;\"> for Boston University\u2019s online <\/span><a href=\"https:\/\/www.bu.edu\/cs\/masters\/program\/online-csai\/request-information\/\"><span style=\"font-weight: 400;\">MS in Computer Science and AI<\/span><\/a><span style=\"font-weight: 400;\"> to see how the Generative Models module fits into the larger curriculum for generative AI systems in production. This degree supports skills development and mastery of technical workflows along with organizational dimensions \u2014 such as compliance and business integration \u2014 and learning security and privacy techniques to safeguard AI systems and support reliable, well-designed generative AI systems.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Ready to take the next step? Review the <\/span><a href=\"https:\/\/www.bu.edu\/cs\/masters\/program\/online-csai\/application-requirements\/\"><span style=\"font-weight: 400;\">application requirements<\/span><\/a><span style=\"font-weight: 400;\"> and <\/span><a href=\"https:\/\/www.bu.edu\/cs\/masters\/program\/online-csai\/faqs\/\"><span style=\"font-weight: 400;\">frequently asked questions<\/span><\/a><span style=\"font-weight: 400;\"> about the program, then <\/span><a href=\"https:\/\/www.bu.edu\/cs\/masters\/program\/online-csai\/request-information\/\"><span style=\"font-weight: 400;\">request more information<\/span><\/a><span style=\"font-weight: 400;\"> today.\u00a0<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Generative AI Systems: What Students Learn Beyond Using LLM APIs Studying generative artificial intelligence (AI) systems at the graduate level means learning how to implement, evaluate, and deploy them. Read on to discover the knowledge and skills students actually gain about generative models at Boston University (BU).\u00a0 Using an LLM API Is Not the Same [&hellip;]<\/p>\n","protected":false},"author":17166,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[86],"tags":[],"_links":{"self":[{"href":"https:\/\/www.bu.edu\/cs\/wp-json\/wp\/v2\/posts\/23767"}],"collection":[{"href":"https:\/\/www.bu.edu\/cs\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.bu.edu\/cs\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/cs\/wp-json\/wp\/v2\/users\/17166"}],"replies":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/cs\/wp-json\/wp\/v2\/comments?post=23767"}],"version-history":[{"count":1,"href":"https:\/\/www.bu.edu\/cs\/wp-json\/wp\/v2\/posts\/23767\/revisions"}],"predecessor-version":[{"id":23769,"href":"https:\/\/www.bu.edu\/cs\/wp-json\/wp\/v2\/posts\/23767\/revisions\/23769"}],"wp:attachment":[{"href":"https:\/\/www.bu.edu\/cs\/wp-json\/wp\/v2\/media?parent=23767"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.bu.edu\/cs\/wp-json\/wp\/v2\/categories?post=23767"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.bu.edu\/cs\/wp-json\/wp\/v2\/tags?post=23767"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}