{"id":9421,"date":"2025-01-06T13:09:00","date_gmt":"2025-01-06T18:09:00","guid":{"rendered":"https:\/\/www.bu.edu\/excellence\/?post_type=projects&#038;p=9421"},"modified":"2026-02-18T11:46:44","modified_gmt":"2026-02-18T16:46:44","slug":"generative-ai-efficacy","status":"publish","type":"projects","link":"https:\/\/www.bu.edu\/excellence\/projects\/generative-ai-efficacy\/","title":{"rendered":"Generative AI Efficacy"},"content":{"rendered":"<p style=\"text-align: center;\"><iframe style=\"width: 400px; height: 285px; border: 0;\" id=\"kaltura_player\" src=\"https:\/\/cdnapisec.kaltura.com\/p\/2159741\/embedPlaykitJs\/uiconf_id\/54272102?iframeembed=true&amp;entry_id=1_pjaksqw5&amp;config%5Bprovider%5D=%7B%22widgetId%22%3A%221_ds2ickxv%22%7D&amp;config%5Bplayback%5D=%7B%22startTime%22%3A0%7D\" allowfullscreen=\"allowfullscreen\" webkitallowfullscreen=\"webkitallowfullscreen\" mozallowfullscreen=\"mozallowfullscreen\" allow=\"autoplay *; fullscreen *; encrypted-media *\" sandbox=\"allow-downloads allow-forms allow-same-origin allow-scripts allow-top-navigation allow-pointer-lock allow-popups allow-modals allow-orientation-lock allow-popups-to-escape-sandbox allow-presentation allow-top-navigation-by-user-activation\" title=\"Generative AI Efficacy\"><\/iframe><\/p>\n<blockquote><p><span style=\"font-weight: 400;\">\u201cThis project sparked my imagination on pedagogical innovation. I began to see the power of generative AI in transforming pedagogical methodologies as well as classroom settings.\u201d \u2013Dongpeng Huang, doctoral student in the College of Communication<\/span><\/p><\/blockquote>\n<p><span style=\"font-weight: 400;\">ChatGPT and other generative artificial intelligence (GenAI) tools have emerged as potentially transformative factors in education, received with a mix of excitement and apprehension. Educators at BU are particularly interested in how this emerging advanced technology can be leveraged in the classroom to create enriching and engaging learning experiences.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">In this Future of Learning: AI Grant (FLAG) project, Dongpeng Huang, a doctoral candidate in the Emerging Media Studies program in the College of Communication, explored the potential of integrating ChatGPT into the teaching and learning process of her course COM CM321 Communication Research Method, with an enrollment of 25 students. This course focuses on enhancing students&#8217; understanding of abstract concepts, statistical analysis, and conducting group research projects to apply research methods in practice. By incorporating ChatGPT into various classroom activities, students had access to powerful academic assistance tools that supported and augmented their academic tasks, fostered their critical thinking skills, and promoted collaborative learning through group research projects. The project also enabled Huang to gather feedback from students, which will guide her in refining the integration of ChatGPT into future teaching pedagogies. <img loading=\"lazy\" src=\"\/excellence\/files\/2025\/01\/2e987f0d-ec4c-4845-b7b0-de33868fa98e-636x395.png\" alt=\"Percentage of students using traditional resources or ChatGPT across four assessments. In assessment #1: 39.9% of students used ChatGPT. In assessment #2, 30.43% of students used ChatGPT. In assessment #3, 47.09% of students used ChatGPT. In assessment #4, 43% of students used ChatGPT.\" width=\"588\" height=\"365\" class=\" wp-image-9706 alignright\" srcset=\"https:\/\/www.bu.edu\/excellence\/files\/2025\/01\/2e987f0d-ec4c-4845-b7b0-de33868fa98e-636x395.png 636w, https:\/\/www.bu.edu\/excellence\/files\/2025\/01\/2e987f0d-ec4c-4845-b7b0-de33868fa98e-1024x637.png 1024w, https:\/\/www.bu.edu\/excellence\/files\/2025\/01\/2e987f0d-ec4c-4845-b7b0-de33868fa98e-768x478.png 768w, https:\/\/www.bu.edu\/excellence\/files\/2025\/01\/2e987f0d-ec4c-4845-b7b0-de33868fa98e-500x311.png 500w, https:\/\/www.bu.edu\/excellence\/files\/2025\/01\/2e987f0d-ec4c-4845-b7b0-de33868fa98e-166x103.png 166w, https:\/\/www.bu.edu\/excellence\/files\/2025\/01\/2e987f0d-ec4c-4845-b7b0-de33868fa98e.png 1071w\" sizes=\"(max-width: 588px) 100vw, 588px\" \/><\/span><\/p>\n<p><span style=\"font-weight: 400;\">To accomplish this, Huang created three class activities designed to leverage the capabilities of ChatGPT while ensuring active student participation and academic growth:<\/span><\/p>\n<ol>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Individual formative e-assessments with ChatGPT to examine the impact of GenAI on student learning outcomes.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Group Project &#8211; Writing a Research Proposal with ChatGPT to facilitate collaborative learning and the development of critical thinking and research skills through group work.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Group Project &#8211; Data Analysis with ChatGPT to leverage ChatGPT&#8217;s capabilities in data analysis to enhance students&#8217; understanding of research findings and develop data-driven insights.<\/span><\/li>\n<\/ol>\n<p><span style=\"font-weight: 400;\">The AI-integrated activities enhanced student\u2019s learning experiences by improving their critical thinking and problem-solving skills and increasing academic collaboration and communication. The student-ChatGPT group project explored ways for human-AI collaboration, where students learned to effectively communicate their ideas and benefit from AI technology.\u00a0<\/span><\/p>\n<blockquote><p><span style=\"font-weight: 400;\">\u201cWhen working with RStudio for data analysis, ChatGPT provided step-by-step instructions which were much faster than traditional search methods,\u201d according to undergraduate student, Hanyun Deng. \u201cThis immediate assistance kept me more involved in the learning process and encouraged me to take on more complex tasks with more confidence.\u201d<\/span><\/p><\/blockquote>\n<p><span style=\"font-weight: 400;\">For the group collaboration, students were placed in groups of 3 or 4 and instructed to find a research topic and question. Students first brainstormed with group members and ChatGPT to find interesting issues to explore and then used ChatGPT to refine their project title or survey questions. The assignment prompts were designed to let students report their activities with GPT, where they were required to cite their work with GPT and explain what they completed vs. what ChatGPT completed. ChatGPT was also a useful tool for proofreading, logic, and clarity in the proposal development phase for non-native English speakers enrolled in the course.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Overall, students developed critical thinking skills by evaluating the information and perspectives that ChatGPT provided, and making their own evidence-based decisions. Huang employed Likert scales to assess trustworthiness of ChatGPT, social presence, usage intention, and student attitudes toward the technology. She also recorded student interaction with ChatGPT while they worked on assessment questions and their research proposal. In collaboration with Lisa Burgess, Huang conducted a student focus group within the class to analyze their perceptions of academic cheating with GenAI. She found that while students clearly recognized overt cheating, opinions varied regarding more subtle forms of dishonesty and the effectiveness of formal deterrents. Peer influence and personal ethics were identified as strong factors shaping cheating behaviors. Class policies enforced by instructors appeared to have a greater influence on student cheating behavior with generative AI compared to broader institutional policies. Moreover, student trustworthiness varied depending on the task, where students had lower trust toward ChatGPT for assessment than for group work. Overall, Huang believes that group collaboration is a scenario that will benefit from AI-incorporation for students and teaching applications.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The integration of ChatGPT into the research methods course has far-reaching implications beyond the immediate classroom transformation. Its inclusion as an educational tool establishes a precedent for innovative teaching methodologies in the Emerging Media Studies (EMS) program, and aligns with EMS&#8217;s objective of staying up-to-date with emerging technologies, which offers valuable insights into leveraging such technologies to enhance learning outcomes and student engagement. This, in turn, can foster a culture of innovation and promote the adoption of transformative teaching practices throughout the institution.<\/span><\/p>\n<blockquote><p><span style=\"font-weight: 400;\">\u201cAttitudes significantly predict usage intention of taking a course with generative AI as a teaching assistant,\u201d according to Huang\u2019s research. \u201cIntegrating AI in the classroom is inevitable. To prepare, we need to define and regulate the use of ChatGPT.\u201d<\/span><\/p><\/blockquote>\n<p><span style=\"font-weight: 400;\">For her future vision, Huang is considering using GenAI again in future courses with consideration for trying out more types of GenAI technology.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u201cThere\u2019s a huge innovation in the field right now, with image, text, video, text to video, and text to image,\u201d said Huang. \u201cI think there should be more research along this line in terms of how generative AI can help you achieve pedagogical goals and help with curriculum development.\u201d<\/span><\/p>\n<hr \/>\n<h3>Conferences, News &amp; Publications<\/h3>\n<ul style=\"font-weight: 400;\">\n<li>Huang, D., Huang, Y., &amp; Cummings, J. J. (2024). Exploring the integration and utilisation of generative AI in formative e-assessments: A case study in higher education. <em>Australasian Journal of Educational Technology<\/em>, <em>40<\/em> (4), 1\u201319. <a href=\"https:\/\/doi.org\/10.14742\/ajet.9467\">https:\/\/doi.org\/10.14742\/ajet.9467<\/a>.<\/li>\n<li>Huang, D., Hash, N., Cummings, J., and Prena, K. (2024, August) \u201cAcademic Cheating with Generative AI: Exploring a Moral Extension of the Theory of Planned Behavior.\u201d AEJMC2024: The 107th Annual Conference of the Association for Education in Journalism and Mass Communication, Philadelphia, Pennsylvania, USA.<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>The Generative AI Efficacy project leverages generative AI to improve student learning outcomes.<\/p>\n","protected":false},"author":22504,"featured_media":9162,"template":"","meta":[],"projects_status":[123],"projects_dates":[236],"projects_topics":[132],"projects_tags":[],"_links":{"self":[{"href":"https:\/\/www.bu.edu\/excellence\/wp-json\/wp\/v2\/projects\/9421"}],"collection":[{"href":"https:\/\/www.bu.edu\/excellence\/wp-json\/wp\/v2\/projects"}],"about":[{"href":"https:\/\/www.bu.edu\/excellence\/wp-json\/wp\/v2\/types\/projects"}],"author":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/excellence\/wp-json\/wp\/v2\/users\/22504"}],"version-history":[{"count":9,"href":"https:\/\/www.bu.edu\/excellence\/wp-json\/wp\/v2\/projects\/9421\/revisions"}],"predecessor-version":[{"id":13429,"href":"https:\/\/www.bu.edu\/excellence\/wp-json\/wp\/v2\/projects\/9421\/revisions\/13429"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/excellence\/wp-json\/wp\/v2\/media\/9162"}],"wp:attachment":[{"href":"https:\/\/www.bu.edu\/excellence\/wp-json\/wp\/v2\/media?parent=9421"}],"wp:term":[{"taxonomy":"projects_status","embeddable":true,"href":"https:\/\/www.bu.edu\/excellence\/wp-json\/wp\/v2\/projects_status?post=9421"},{"taxonomy":"projects_dates","embeddable":true,"href":"https:\/\/www.bu.edu\/excellence\/wp-json\/wp\/v2\/projects_dates?post=9421"},{"taxonomy":"projects_topics","embeddable":true,"href":"https:\/\/www.bu.edu\/excellence\/wp-json\/wp\/v2\/projects_topics?post=9421"},{"taxonomy":"projects_tags","embeddable":true,"href":"https:\/\/www.bu.edu\/excellence\/wp-json\/wp\/v2\/projects_tags?post=9421"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}