{"id":39142,"date":"2025-11-03T16:47:27","date_gmt":"2025-11-03T21:47:27","guid":{"rendered":"https:\/\/www.bu.edu\/hic\/?p=39142"},"modified":"2025-11-20T20:02:44","modified_gmt":"2025-11-21T01:02:44","slug":"eval-launches-to-bridge-the-gap-between-ai-edtech-tools-and-independent-validation","status":"publish","type":"post","link":"https:\/\/www.bu.edu\/hic\/2025\/11\/03\/eval-launches-to-bridge-the-gap-between-ai-edtech-tools-and-independent-validation\/","title":{"rendered":"EVAL Launches to Bridge the Gap Between AI EdTech Tools and Scientific Evidence"},"content":{"rendered":"<p><i><span style=\"font-weight: 400;\">The Evidence-Based AI in Learning (EVAL) Industry Collaborative invites EdTech companies to enter their competition for independent validation.<\/span><\/i><\/p>\n<p><em>By <a href=\"https:\/\/www.bu.edu\/hic\/profile\/maria-yaitanes\/\" target=\"_blank\" rel=\"noopener\">Maria Yaitanes<\/a><\/em><\/p>\n<p><span style=\"font-weight: 400;\">Each August, commercials sing the tunes of nursery rhymes while stores transform their spaces into homeroom-esque displays for back-to-school shopping. Students and families flock to the aisles to gather essential items. After perusing endless pencils, notebooks, crayons, and glue sticks, one last check is done before heading to the register. \u201cDo we have everything?\u201d No; there is one essential supply missing, but it\u2019s already waiting for students in the classroom: educational technology tools.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Today, most K-12 students use AI for school-related tasks, with nearly 50% using it weekly or daily. <\/span>However, there is very little evidence on how these tools impact student learning. Only about 10% of educational technology tools have been evaluated for efficacy, and the numbers are even smaller for AI-based tools<span style=\"font-weight: 400;\">\u00a0\u2014 a statistic <\/span><a href=\"https:\/\/www.bu.edu\/hic\/profile\/ola-ozernov-palchik\/\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">Ola Ozernov-Palchik<\/span><\/a><span style=\"font-weight: 400;\">, Research Assistant Professor (Wheelock) and an Associate Director of Translational Research of the Hariri Institute\u2019s <\/span><a href=\"https:\/\/www.bu.edu\/hic\/centers-initiatives-labs\/ai-and-education-initiative\/\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">AI &amp; Education Initiative<\/span><\/a><span style=\"font-weight: 400;\">, strives to change through the <\/span><a href=\"https:\/\/www.bu.edu\/hic\/centers-initiatives-labs\/eval\/\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">Evidence-Based AI in Learning (EVAL) Industry Collaborative<\/span><\/a><span style=\"font-weight: 400;\">.<\/span><\/p>\n<figure id=\"attachment38624\" aria-describedby=\"caption-attachment38624\" style=\"width: 205px\" class=\"wp-caption alignleft\"><img loading=\"lazy\" src=\"\/hic\/files\/2025\/09\/Ola.jpg\" alt=\"\" width=\"195\" height=\"195\" class=\"wp-image-38624\" srcset=\"https:\/\/www.bu.edu\/hic\/files\/2025\/09\/Ola.jpg 600w, https:\/\/www.bu.edu\/hic\/files\/2025\/09\/Ola-150x150.jpg 150w, https:\/\/www.bu.edu\/hic\/files\/2025\/09\/Ola-189x189.jpg 189w, https:\/\/www.bu.edu\/hic\/files\/2025\/09\/Ola-100x100.jpg 100w\" sizes=\"(max-width: 195px) 100vw, 195px\" \/><figcaption id=\"caption-attachment38624\" class=\"wp-caption-text\">Ola Ozernov-Palchik<\/figcaption><\/figure>\n<p><span style=\"font-weight: 400;\">Led by Ozernov-Palchik and Project Coordinator Mary Bready, EVAL launched in October with a mission of combining rigorous research, educational science, and advanced computational methods to ensure that AI technologies in education are effective, ethical, and equitable. EVAL conducts rigorous research to evaluate AI tools\u2019 impact on K-12 student learning outcomes.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">As part of the launch, EVAL announced their \u201cEdTech Research Challenge\u201d \u2014\u00a0a competition that provides the research infrastructure and expertise EdTech companies need to demonstrate impact, build trust, and accelerate adoption.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u201cWhen it comes to children\u2019s learning, good intentions and impressive technology are not enough,\u201d says Ozernov-Palchik. \u201cImagine walking into a doctor\u2019s office for critical treatment, not knowing whether the approach has been validated by science. Maybe the doctor prescribes an FDA-approved medication, or maybe they offer a self-made concoction. That uncertainty is exactly what we face in education today.\u201d<\/span><\/p>\n<p><b>EdTech Companies, Get Your AI Tool Certified Through the EVAL Challenge<\/b><\/p>\n<p><span style=\"font-weight: 400;\">The <\/span><a href=\"https:\/\/www.bu.edu\/hic\/eval-competition\/\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">EVAL EdTech Research Challenge<\/span><\/a><span style=\"font-weight: 400;\"> invites developers of innovative AI-powered K\u201312 learning tools to p<\/span>artner with BU researchers for a rigorous, independent study assessing the impact of their technology on student learning.<\/p>\n<p><span style=\"font-weight: 400;\">\u201cWe are building a network of incredible companies and organizations that share our mission,\u201d says Ozernov-Palchik. \u201cIt\u2019s exciting to see how different innovators are tackling urgent challenges in K\u201312 education and gaining a real sense of where and how new technologies are being used.\u201d<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The competition provides the winning company with a valuable prize package, including a rigorous, randomized control trial study valued at $150,000, marketing partnership rights, network access, follow-up support, and more.\u00a0<\/span><\/p>\n<p><a href=\"https:\/\/www.bu.edu\/hic\/eval-competition\/\"><img loading=\"lazy\" src=\"\/hic\/files\/2025\/10\/EVAL-EdTech-Evaluation-Challenge-Banner-3-636x358.png\" alt=\"\" width=\"389\" height=\"219\" class=\"alignright wp-image-39009\" srcset=\"https:\/\/www.bu.edu\/hic\/files\/2025\/10\/EVAL-EdTech-Evaluation-Challenge-Banner-3-636x358.png 636w, https:\/\/www.bu.edu\/hic\/files\/2025\/10\/EVAL-EdTech-Evaluation-Challenge-Banner-3-1024x576.png 1024w, https:\/\/www.bu.edu\/hic\/files\/2025\/10\/EVAL-EdTech-Evaluation-Challenge-Banner-3-768x432.png 768w, https:\/\/www.bu.edu\/hic\/files\/2025\/10\/EVAL-EdTech-Evaluation-Challenge-Banner-3-1536x864.png 1536w, https:\/\/www.bu.edu\/hic\/files\/2025\/10\/EVAL-EdTech-Evaluation-Challenge-Banner-3.png 1920w\" sizes=\"(max-width: 389px) 100vw, 389px\" \/><\/a><\/p>\n<p><a href=\"https:\/\/www.bu.edu\/hic\/eval-competition\/\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">Applications are open until November 17, 2025.\u00a0<\/span><\/a><\/p>\n<p><span style=\"font-weight: 400;\">\u201cWe will partner with a selected company, dive deep into their AI-based tool, and design a rigorous research study around it,\u201d says Ozernov-Palchik. \u201cThis is where our true <\/span>convergent expertise at BU<span style=\"font-weight: 400;\">\u00a0as researchers in education, cognitive science, and computer science comes into play. We then implement the study with real students and educators using the technology and examine what works, for whom, and under what conditions.\u201d<\/span><\/p>\n<p><b>Partnering for Impact\u00a0<\/b><\/p>\n<p><span style=\"font-weight: 400;\">EVAL<span> is situated at the AI and Education Initiative and supported by Wheelock College and the Hariri Institute. <\/span>Wheelock College provides deep expertise in educational research across literacy, mathematics and science education, special education, early childhood, social-emotional learning, and multilingual education, as well as strong partnerships with schools and policymakers. The Hariri Institute contributes cutting-edge computational and data science capabilities, fostering cross-disciplinary collaborations that apply AI to pressing societal challenges. The AI &amp; Education Initiative at the Hariri Institute bridges these strengths, advancing research at the intersection of AI, learning, and equity.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Other organizations at BU also supported EVAL\u2019s launch.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u201cNaomi Caselli, Director of AI and Education Initiative and Leslie Dietiker, Associate Dean of Research, provided key guidance and support from the very beginning,\u201d says Ozernov-Palchik. \u201cThe team in Industry Engagement also played an important role in helping us build partnerships and outreach strategies. We are especially grateful to Mary Bready, who has been the heart of EVAL\u2019s coordination, ensuring that all the moving pieces come together seamlessly.\u201d<\/span><\/p>\n<p><span style=\"font-weight: 400;\">EVAL plans to continue its collaborative spirit and expand its impact through thoughtful partnerships.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u201cOur shared vision is for EVAL to become a trusted framework and a stamp of approval that signals to schools, families, and funders that a tool has been rigorously tested and shown to make a real difference for students,\u201d says Ozernov-Palchik. \u201cBeyond the competition, we plan to build partnerships with companies and philanthropic organizations to create an ecosystem that promotes responsible innovation grounded in evidence, data, and transparency. Through this process, we aim to raise the standard of evidence for educational technology in K\u201312 learning.\u201d<\/span><\/p>\n<p><span style=\"font-weight: 400;\">In addition to industry and philanthropic partnerships, Ozernov-Palchik invites faculty and students to help review submissions, contribute content expertise in research design and implementation, and support in ways that excite them. Interested parties can reach out to Ozernov-Palchik\u00a0 directly at <\/span><a href=\"mailto:oozernov@bu.edu\"><span style=\"font-weight: 400;\">oozernov@bu.edu<\/span><\/a><span style=\"font-weight: 400;\">. EVAL also has an advisory board to guide the future trajectory of the collaborative.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u201cWe are fortunate to have an extraordinary advisory board of pioneering thinkers and practitioners who bridge science, education, and innovation, all united by a shared commitment to advancing equitable, evidence-based innovation to guide EVAL\u2019s mission to ensure AI serves all learners,\u201d says Ozernov-Palchik.<\/span><\/p>\n<p>EVAL is also assembling an Educator Advisory Board to help ensure that the tools and research they support remain grounded in classroom realities and aligned with the needs of both educators and students.<\/p>\n<p><span style=\"font-weight: 400;\">The Evidence-Based AI in Learning (EVAL) Industry Collaborative is anchored at Boston University, bringing together the strengths of the Wheelock College of Education &amp; Human Development, the Hariri Institute for Computing, and the AI &amp; Education Initiative. More information about the EVAL Challenge and EVAL\u2019s leadership, approach, and partnerships can be found on the <\/span><a href=\"https:\/\/www.bu.edu\/hic\/centers-initiatives-labs\/eval\/\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">EVAL website<\/span><\/a><span style=\"font-weight: 400;\">.<\/span><\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The Evidence-Based AI in Learning (EVAL) Industry Collaborative invites EdTech companies to enter their competition for independent validation. By Maria Yaitanes Each August, commercials sing the tunes of nursery rhymes while stores transform their spaces into homeroom-esque displays for back-to-school shopping. Students and families flock to the aisles to gather essential items. After perusing endless [&hellip;]<\/p>\n","protected":false},"author":16894,"featured_media":39185,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[11814,11716,1],"tags":[],"_links":{"self":[{"href":"https:\/\/www.bu.edu\/hic\/wp-json\/wp\/v2\/posts\/39142"}],"collection":[{"href":"https:\/\/www.bu.edu\/hic\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.bu.edu\/hic\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/hic\/wp-json\/wp\/v2\/users\/16894"}],"replies":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/hic\/wp-json\/wp\/v2\/comments?post=39142"}],"version-history":[{"count":10,"href":"https:\/\/www.bu.edu\/hic\/wp-json\/wp\/v2\/posts\/39142\/revisions"}],"predecessor-version":[{"id":39195,"href":"https:\/\/www.bu.edu\/hic\/wp-json\/wp\/v2\/posts\/39142\/revisions\/39195"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/hic\/wp-json\/wp\/v2\/media\/39185"}],"wp:attachment":[{"href":"https:\/\/www.bu.edu\/hic\/wp-json\/wp\/v2\/media?parent=39142"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.bu.edu\/hic\/wp-json\/wp\/v2\/categories?post=39142"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.bu.edu\/hic\/wp-json\/wp\/v2\/tags?post=39142"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}