- All Categories
- Featured Events
- Alumni
- Application Deadline
- Arts
- Campus Discourse
- Careers
- BU Central
- Center for the Humanities
- Charity & Volunteering
- Kilachand Center
- Commencement
- Conferences & Workshops
- Diversity & Inclusion
- Examinations
- Food & Beverage
- Global
- Health & Wellbeing
- Keyword Initiative
- Lectures
- LAW Community
- Meetings
- Orientation
- Other Events
- Religious Services & Activities
- Special Interest to Women
- Sports & Recreation
- Social Events
- Study Abroad
- Weeks of Welcome
- 2024 MFA Visual Narrative Thesis Exhibition9:00 am
- Spot On! Why is Cancer Occurring in Younger Folks? 9:00 am
- Professional Clothing Closet Open House10:00 am
- English Conversation Group10:00 am
- 2024 MFA Sculpture Thesis Exhibition11:00 am
- 2024 MFA Painting Thesis Exhibition11:00 am
- 2024 MFA Graphic Design, Print Media & Photography Thesis Exhibitions11:00 am
- Faculty & Staff Community Network Interest Meeting12:00 pm
- Resume & Cover Letter Drop-Ins12:00 pm
- Happy Terrier Walk1:00 pm
- Machine Learning in Medicine (MLxMed) Seminar: Yifan Peng, Assistant Professor, Cornell University2:00 pm
- Grief Group2:00 pm
- Daring to be free: Translating Narratives of Resistance in French2:30 pm
- Graduate Students Support Group3:00 pm
- MSE Talks: Thomas Russell3:00 pm
- Mary L. Cornille (GRS’87) Boston University Graduate Symposium in the History of Art & Architecture3:00 pm
- CISE Seminar: Rui Gao, University of Texas at Austin3:00 pm
- Arab & Muslim Student Support Group3:00 pm
- English Conversation Group3:30 pm
- Keynote lecture by Kathryn M. Floyd, Associate Professor of Art History, Auburn University5:00 pm
- Spring Student Gallery Reception5:30 pm
- BU Hillel: Dinner with the Director of Athletics Drew Marrochello6:00 pm
- Reception: 2024 MFA Graphic Design and Print Media & Photography Thesis Exhibitions6:00 pm
- 2024 MFA Sculpture Thesis Exhibition Reception7:00 pm
- La clemenza di Tito7:30 pm
- Boston University Dance Theatre Group's Visions 20248:00 pm
Machine Learning in Medicine (MLxMed) Seminar: Yifan Peng, Assistant Professor, Cornell University
Talk title:LLMs and Evidence Summarization
Talk abstract: Generative AI, exemplified by large language models (LLMs) shows great promise in assisting medical evidence summarization. However, concerns have been raised about the quality of outputs generated by pre-trained LLMs, which potentially results in harmful misinformation. In this talk, I will first discuss our investigation into the capabilities and limitations of LLMs, specifically GPT-3.5 and ChatGPT, in performing zero-shot medical evidence summarization across six clinical domains. Our study demonstrates that LLMs could be susceptible to generating factually inconsistent summaries and making overly convincing or uncertain statements, leading to potential harm due to misinformation. Furthermore, we observe that automatic metrics often do not strongly correlate with the quality of summaries. I will then discuss our research on the impact of fine-tuning LLMs to enhance their performance in evidence summarization. We found that compared to zero-shot learning, the fine-tuned LLMs improved the automatic evaluation metrics such as ROUGE, METEOR, CHRF, and PICO-F1. We also found that smaller fine-tuned models sometimes demonstrated superior performance compared to larger zero-shot models. The above trends of improvement were also manifested in both human and GPT4-simulated evaluations. Our findings confirmed the potential for LLMs to empower medical evidence summarization.
Bio: Peng is an assistant professor in the division of Health Sciences at Weill Cornell Medicine. His main research interests include BioNLP and medical image analysis, such as named entity recognition, information extraction, and disease diagnosis and prognosis. Before joining Cornell Medicine, he was a research fellow at the National Center for Biotechnology Information (NCBI), National Library of Medicine (NLM), National Institutes of Health (NIH). He obtained my Ph.D. degree from the University of Delaware. During his doctoral training, he investigated applications of machine learning in biomedical relation extraction, with a focus on deep analysis of the linguistic structures of biomedical texts. He is the first awardee at the NCBI to receive the NIH K99/R00 grant, which supports his work on using NLP and ML to extract radiology specific domain knowledge and build an automated reporting system.
When | 2:00 pm to 3:00 pm on Friday, April 19, 2024 |
---|---|
Location | Zoom |
Fees | Free |
Speakers | Yifan Peng, Assistant Professor of Population Health Sciences, Population Health Sciences , Weill Cornell Medical College |