{"id":895,"date":"2016-03-10T13:06:43","date_gmt":"2016-03-10T18:06:43","guid":{"rendered":"https:\/\/www.bu.edu\/ctsi\/?page_id=895"},"modified":"2025-07-25T16:33:18","modified_gmt":"2025-07-25T20:33:18","slug":"evaluation","status":"publish","type":"page","link":"https:\/\/www.bu.edu\/ctsi\/evaluation\/","title":{"rendered":"Program Evaluation"},"content":{"rendered":"<div style=\"font-family: Arial, sans-serif; max-width: 850px; margin: 40px auto; padding: 30px; background-color: #f9f9f9; border-radius: 12px; box-shadow: 0 4px 12px rgba(0,0,0,0.1);\">\n<h2 style=\"color: #8b0000; text-align: center;\">Evaluation and Continuous Improvement<\/h2>\n<p style=\"font-size: 16px; color: #333; line-height: 1.6;\">To ensure success of our institute, we implement Performance Monitoring and Evaluation Plans. The plans track and assess processes, outputs and outcomes to support continuous program improvement and demonstration of outcomes, impact and innovation. The institute\u2019s evaluation team uses a participatory evaluation approach to work with each program to design and implement individual program evaluation plans to assess the extent to which the implementation of strategies is achieving expected outcomes.<\/p>\n<p style=\"font-size: 16px; color: #333; line-height: 1.6;\">Our approach to evaluation and continuous quality improvement (CQI) draws on theories of CQI (e.g., Plan-Do-Study-ACT), team science, and the <span style=\"color: #993366;\"><a href=\"https:\/\/translationalsciencebenefits.wustl.edu\/\" target=\"_blank\" rel=\"noopener noreferrer\" style=\"color: #993366;\">Translational Science Benefits Model (TSBM) framework<\/a><\/span> to develop a theory-driven, evidence-based approach, known as <a href=\"https:\/\/www.frontiersin.org\/journals\/public-health\/articles\/10.3389\/fpubh.2025.1581205\/full\" target=\"_blank\" rel=\"noopener noreferrer\"><strong>W<\/strong>isdom-driven <strong>E<\/strong>valuation and <strong>C<\/strong>ontinuous <strong>Q<\/strong>uality <strong>I<\/strong>mprovement (WE-CQI)<\/a>.<\/p>\n<p style=\"font-size: 16px; color: #333; line-height: 1.6;\">Each program evaluation and CQI plan consists of a:<\/p>\n<div style=\"background-color: #e0f8f2; padding: 20px; border-left: 6px solid #f57c00; border-radius: 8px;\">\n<ul style=\"line-height: 1.8; font-size: 16px; color: #444; margin: 0;\">\n<li>Workplan that guides implementation of program strategies and activities linked to aims<\/li>\n<li>Logic Model that maps program activities, outputs and outcomes<\/li>\n<li>Evaluation Implementation Plan that outlines methods, metrics and timelines<\/li>\n<li>Dashboard of metrics linked to each program aim to document the extent to which aims are being attained<\/li>\n<li>Dissemination Plan for sharing and using the data with various audiences<\/li>\n<li>Action Plan for documenting findings and changes made to program strategies and activities to improve efforts over time<\/li>\n<\/ul>\n<\/div>\n<details style=\"margin-top: 30px; border: 1px solid #ccc; border-radius: 6px; background-color: #ffffff;\">\n<summary style=\"padding: 12px; font-size: 16px; font-weight: bold; color: #8b0000; cursor: pointer;\">Objectives of the BU CTSI&#8217;s Evaluation Plan<\/summary>\n<div style=\"padding: 10px 20px;\">\n<ol style=\"font-size: 16px; color: #333; line-height: 1.6;\">\n<li>Implement formative and summative evaluation activities using mixed methods that emphasize participatory approaches that actively involve audiences and stakeholder groups in the development of evaluation processes and interpretation of real-time data to guide operational and strategic management.<\/li>\n<li>Use well-defined metrics to measure success of individual programs and the overall institute.<\/li>\n<li>Conduct analyses of research productivity, influence and impact of investigators to demonstrate contributions.<\/li>\n<li>Implement utilization-focused evaluation methods that integrate the ongoing use of evaluation findings into the institute\u2019s governance structure for effective continuous improvement and identifying promising\/best practices.<\/li>\n<li>Conduct meta-evaluation to assess the quality of evaluation methods and its associated data using the national standards set by the Joint Committee on Standards for Evaluation (JCSSE) so that its practice is appropriately guided and audiences can examine its findings.<\/li>\n<li>Actively engage in national CTSA network evaluation activities to advance strong evaluation practices.<\/li>\n<\/ol>\n<\/div>\n<\/details>\n<details style=\"margin-top: 10px; border: 1px solid #ccc; border-radius: 6px; background-color: #ffffff;\">\n<summary style=\"padding: 12px; font-size: 16px; font-weight: bold; color: #8b0000; cursor: pointer;\">Joint Committee on Standards for Evaluation (JCSSE)<\/summary>\n<div style=\"padding: 10px 20px;\"><a href=\"https:\/\/jcsee.org\/program\/\" target=\"_blank\" rel=\"noopener noreferrer\">Visit the JCSEE program evaluation standards the BU CTSI evaluation team uses.<\/a><\/div>\n<\/details>\n<details style=\"margin-top: 10px; border: 1px solid #ccc; border-radius: 6px; background-color: #ffffff;\">\n<summary style=\"padding: 12px; font-size: 16px; font-weight: bold; color: #8b0000; cursor: pointer;\">American Evaluation Guiding Principles for Evaluator Practice<\/summary>\n<div style=\"padding: 10px 20px;\"><a href=\"https:\/\/www.eval.org\/About\/Guiding-Principles\" target=\"_blank\" rel=\"noopener noreferrer\">Visit the American Evaluation Association Guidelines for Principles for Evaluators<\/a><\/div>\n<\/details>\n<details style=\"margin-top: 10px; border: 1px solid #ccc; border-radius: 6px; background-color: #ffffff;\">\n<summary style=\"padding: 12px; font-size: 16px; font-weight: bold; color: #8b0000; cursor: pointer;\">Evaluation Guidelines for Clinical and Translational Science Awards<\/summary>\n<div style=\"padding: 10px 20px;\">\n<ul style=\"line-height: 1.8; font-size: 16px; color: #333;\">\n<li><a href=\"\/ctsi\/files\/2020\/10\/Evaluation-Guidelines-for-CTSA.pdf\" target=\"_blank\" rel=\"noopener noreferrer\">Evaluation Guidelines for CTSA<\/a><\/li>\n<li><a href=\"\/ctsi\/files\/2020\/10\/Opportunities-for-strengthening-CTSA-Evaluation.pdf\" target=\"_blank\" rel=\"noopener noreferrer\">Opportunities for strengthening CTSA Evaluation<\/a><\/li>\n<\/ul>\n<\/div>\n<\/details>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Evaluation and Continuous Improvement To ensure success of our institute, we implement Performance Monitoring and Evaluation Plans. The plans track and assess processes, outputs and outcomes to support continuous program improvement and demonstration of outcomes, impact and innovation. The institute\u2019s evaluation team uses a participatory evaluation approach to work with each program to design and [&hellip;]<\/p>\n","protected":false},"author":11612,"featured_media":0,"parent":0,"menu_order":54,"comment_status":"closed","ping_status":"closed","template":"","meta":[],"_links":{"self":[{"href":"https:\/\/www.bu.edu\/ctsi\/wp-json\/wp\/v2\/pages\/895"}],"collection":[{"href":"https:\/\/www.bu.edu\/ctsi\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.bu.edu\/ctsi\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/ctsi\/wp-json\/wp\/v2\/users\/11612"}],"replies":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/ctsi\/wp-json\/wp\/v2\/comments?post=895"}],"version-history":[{"count":52,"href":"https:\/\/www.bu.edu\/ctsi\/wp-json\/wp\/v2\/pages\/895\/revisions"}],"predecessor-version":[{"id":18152,"href":"https:\/\/www.bu.edu\/ctsi\/wp-json\/wp\/v2\/pages\/895\/revisions\/18152"}],"wp:attachment":[{"href":"https:\/\/www.bu.edu\/ctsi\/wp-json\/wp\/v2\/media?parent=895"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}