To ensure success of our institute, we implement a Performance Monitoring and Evaluation Plan. The plan tracks and assesses processes, outputs and outcomes to support continuous program improvement and demonstration of outcomes, impact and innovation. The institute’s evaluation team uses a participatory evaluation approach to work with each program to design and implement individual program evaluation plans to assess the extent to which the implementation of strategies are achieving expected outcomes. Each program evaluation plan consists of a:
(1) Workplan that guides implementation of program strategies and activities linked to aims;
(2) Logic Model that maps program activities, outputs and outcomes;
(3) Evaluation Implementation Plan that outlines methods, metrics and timelines;
(4) Dashboard of metrics linked to each program aim to document the extent to which aims are being attained;
(5) Dissemination Plan for sharing and using the data with various audiences;
(6) Action Plan for documenting findings and changes made to program strategies and activities to improve efforts over time.
Objectives of the BU CTSI's Evaluation Plan
The objectives of the institute’s evaluation plan are to:
- Implement formative and summative evaluation activities using mixed methods that emphasize participatory approaches that actively involve audiences and stakeholder groups in the development of evaluation processes and interpretation of real-time data to guide operational and strategic management.
- Use well-defined metrics to measure success of individual programs and the overall institute.
- Conduct analyses of research productivity, influence and impact of investigators to demonstrate contributions.
- Implement utilization-focused evaluation methods that integrate the ongoing use of evaluation findings into the institute’s governance structure for effective continuous improvement and identifying promising/best practices.
- Conduct meta-evaluation to assess the quality of evaluation methods and its associated data using the national standards set by the Joint Committee on Standards for Evaluation (JCSSE) so that its practice is appropriately guided and audiences can examine its findings.
- Actively engage in national CTSA network evaluation activities to advance strong evaluation practices and to support the Common Metrics Initiative led by the National Center for Advancing Translational Sciences.
- Support the Common Metrics Initiative led by the National Center for Advancing Translational Sciences.
Program Specific Workplans, Logic Models, Evaluation Plans, Dashboards and Metrics, Action Plans, Evaluation Data Dissemination, Evaluation Reports and Instruments
Adams – Clinical Informatics
Common Metrics Turn the Curve Plans and Reports
Our institute aims to transform how clinical and translational science is conducted across the country to impact the nation’s health. To know how well we are doing with accelerating our process of translating laboratory findings into needed treatments for patients, the BU CTSI program leaders and evaluators are working with other CTSA Hubs to use a set of standardized evaluation metrics to monitor and assess progress. To read more about this initiative led by the National Center for Advancing Translational Sciences, see: https://ncats.nih.gov/ctsa/projects/common-metrics
Research Analytics on Productivity, Influence and Impact
Dashboard for Consult Tracking
Dashboard for Training Tracking
BU CTSI Training Tracking Dashboard
Joint Committee on Standards for Evaluation (JCSSE)
American Evaluation Guiding Principles for Evaluator Practice
Evaluation Guidelines for Clinical and Translational Science Awards