{"id":43015,"date":"2025-11-12T04:03:51","date_gmt":"2025-11-12T09:03:51","guid":{"rendered":"https:\/\/www.bu.edu\/cise\/?page_id=43015"},"modified":"2025-12-04T17:17:40","modified_gmt":"2025-12-04T22:17:40","slug":"cise-seminar-rana-shahout-harvard-university","status":"publish","type":"page","link":"https:\/\/www.bu.edu\/cise\/cise-seminar-rana-shahout-harvard-university\/","title":{"rendered":"CISE Seminar: Rana Shahout, Harvard University"},"content":{"rendered":"

Date: Friday, December 12, 2025
\nTime: 3:00PM-4:00PM
\nLocation: 665 Commonwealth Ave., CDS 1101<\/span><\/p>\n

\"\"Rana Shahout<\/b><\/span>
\nPostdoctoral Fellow<\/span><\/span>
\nHarvard University<\/span><\/strong><\/span><\/h4>\n
\n
\n
\n

Prediction-Aware Algorithms for Efficient AI Systems<\/b>
\nLarge Language Models (LLMs) have transformed what machines can do\u2014and how systems must be designed to serve them. These models are both computationally demanding and memory-bound, revealing the limits of traditional optimization methods that once sufficed for conventional systems.<\/span><\/p>\n

A central challenge in building LLM systems is achieving balance: minimizing computational and financial costs while ensuring response quality and meeting strict latency and throughput goals. Uniquely, LLMs also expose internal signals\u2014predictions that guide their own execution.<\/span><\/p>\n

This talk introduces prediction-aware algorithms that leverage these signals to improve system performance. Specifically, it presents algorithms that use predictions to enhance scheduling and resource management across two key settings: standalone LLM inference and API-augmented LLMs that interact with external tools. We show how prediction-guided scheduling and memory handling can reduce latency and improve efficiency in diverse deployment environments.<\/span><\/p>\n<\/div>\n<\/div>\n<\/div>\n

Rana Shahout<\/strong> is a Postdoctoral Fellow at Harvard University, working with Michael Mitzenmacher and Minlan Yu. She received her Ph.D. in Computer Science from the Technion and previously worked as a Senior Software Engineer at Mellanox (now NVIDIA). Her research combines machine learning, systems, and algorithmic theory to build adaptive, high-performance infrastructures. Rana is a recipient of the Eric and Wendy Schmidt Postdoctoral Award, the Zuckerman Postdoctoral Fellowship, the Weizmann Institute Women\u2019s Postdoctoral Career Development Award, and the ACC Feder Family Award for Best Student Work in Communications<\/span>.\u00a0<\/span><\/p>\n

Faculty Hosts:<\/span><\/strong> Ayse Coskun and Brian Kulis
\nStudent Host:\u00a0<\/strong>Beste Oztop<\/p>\n","protected":false},"excerpt":{"rendered":"

Date: Friday, December 12, 2025 Time: 3:00PM-4:00PM Location: 665 Commonwealth Ave., CDS 1101 Rana Shahout Postdoctoral Fellow Harvard University Prediction-Aware Algorithms for Efficient AI Systems Large Language Models (LLMs) have transformed what machines can do\u2014and how systems must be designed to serve them. These models are both computationally demanding and memory-bound, revealing the limits of […]<\/p>\n","protected":false},"author":24211,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"page-templates\/no-sidebars.php","meta":[],"_links":{"self":[{"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/pages\/43015"}],"collection":[{"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/users\/24211"}],"replies":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/comments?post=43015"}],"version-history":[{"count":9,"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/pages\/43015\/revisions"}],"predecessor-version":[{"id":43059,"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/pages\/43015\/revisions\/43059"}],"wp:attachment":[{"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/media?parent=43015"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}