Boston Medical Center
One Boston Medical Center Place
Boston, MA 02118
617.638.8000
Map
Evaluation Policy

Objectives:

Our multi-focal process provides useful formative and summative evaluation for residents throughout their residency, as well as a comprehensive system to demonstrate resident proficiency in the ACGME General Competencies

Methods of Evaluation:

  1. Global and 360-Degree Evaluation Instrument

  2. This form is completed by attending faculty who have interacted with the resident, peer residents, and a nurse. This instrument specifically evaluates the following competencies:
    1. Patient Care: caring and respectful behaviors, interviewing, develop and carry out patient management plans, counsel and educate patients, medical procedures, ability to work within a team
    2. Medical Knowledge: investigatory and analytic thinking, knowledge and application of basic sciences
    3. Practice-Based Learning and Improvement: analyze own practice for needed improvements, use of information technology, facilitate learning of others
    4. Interpersonal and Communication Skills: creation of therapeutic relationship with patients, listening skills
    5. Professionalism: respectful, altruistic, ethically sound practice, sensitive to cultural, age, gender, liability issues
    6. Systems-Based Practice: understand interaction of their practices with the larger systems, practice cost-effective care, advocate for patients within the health care system

  3. Patient Survey

  4. This evaluation is completed by patients in the resident’s continuity clinic. This information is collected twice a year. This instrument specifically evaluates the following required skills:
    1. Patient Care: caring and respectful behaviors, counsel and educate patients and family
    2. Practice-Based Learning and Improvement: analyze own practice for needed improvement
    3. Interpersonal and Communication Skills: creation of a therapeutic relationship with patients, listening skills
    4. Professionalism: respectful, altruistic, ethically sound practice, sensitive to cultural, age, gender disability issues
    5. Systems-Based Practice: advocate for patients within the health care system

  5. Record Review

  6. Residents log surgical cases and ambulatory experiences on the ACGME website. This case log is reviewed at regular intervals with the resident to identify areas of strengths as well as deficient experience. In addition, focused evaluation of certain surgical skills is tracked through New Innovations, which is the residency training tracking system. These instruments evaluate the following skills:
    1. Patient Care Medical procedures, preventive health services
    2. Practice-Based Learning and Improvement: use of information technology

  7. Written Exam

  8. The residents participate in the yearly CREOG examinations. This instrument evaluates the following required skills:
    1. Medical Knowledge: Knowledge of application of basic sciences
    2. Practice-Based Learning and Improvement: use of evidence from scientific studies, application of research and statistical methods.
    3. System-Based Practice: knowledge of practice and delivery systems

  9. Case Log

  10. The residents participate in the yearly CREOG examinations. This instrument evaluates the following required skills:
    1. Medical Knowledge: Knowledge of application of basic sciences
    2. Practice-Based Learning and Improvement: use of evidence from scientific studies, application of research and statistical methods.
    3. System-Based Practice: knowledge of practice and delivery systems

  11. Self Evaluation

  12. This form is completed by the residents every six months, and allows the resident an opportunity to assess her/his goals, strengths, and areas for improvement.
  13. Resident Portfolio

  14. This portfolio is a compilation of the resident’s accomplishments. It is started in internship and continued throughout the four years of residency. It has the following components:
    1. Case Conference Evaluations
      These evaluations are collected after presentation of cases that have been done by the resident. The resident presents an interesting medical case, reviews the literature and critiques the care provided as well as reviews the alternative options for management.
      Purpose: To evaluate competency in practice-based learning and improvement
    2. Journal Club Evaluations
      These evaluations are collected after presentation at Journal Club, at which time the assigned resident reviews a significant article in terms of statistics and relevance to current practice.
      Purpose: To evaluate competency in practice-based learning and improvement
    3. Self-Education
      The residents will complete the required Self-Education Modules, which will allow the resident to be exposed to non-traditional educational methods. The resident will complete an evaluation of the module, which will serve as documentation that the module was completed and will also allow revision of modules.

    The components of the Resident Portfolio evaluate the following competencies:
    1. Patient Care : caring and respectful behaviors, interviewing, develop and carry out patient management plans, counsel and educate patients, medical procedures, ability to work within a team
    2. Medical Knowledge: investigatory and analytic thinking, knowledge and application of basic sciences
    3. Practice-Based Learning and Improvement: analyze own practice for needed improvements, use of evidence from scientific study, application of research and statistical methods, use of information technology, facilitate learning of others
    4. Interpersonal and Communication Skills: creation of therapeutic relationship with patients, listening skills
    5. Professionalism: respectful, altruistic, ethically sound practice, sensitive to cultural, age, gender, liability issues
    6. Systems-Based Practice: understand interaction of their practices with the larger systems, practice cost-effective care, advocate for patients within the health care system, practice cost-effective care, knowledge of practice and delivery systems.

  15. Objective Standardized Clinical Examination (OSCE)

  16. The residents will participate twice yearly in the OSCE examination. The examination consists of clinical scenarios and focused evaluation of technical skills. This evaluation instrument evaluates the following competencies:
    1. Patient Care: Caring and respectful behavior, interviewing skills, informed decision-making, developing and carrying out patient management plans, counsel and educate patients, medical procedures, , performance of routine physical exam, preventive health services
    2. Medical Knowledge: Investigatory and analytic thinking, knowledge and application of basic sciences
    3. Interpersonal and Communication Skills: Creation of therapeutic relationship with patients, listening skills
    4. Professionalism: Respectful, altruistic, sensitivity to cultural, age gender and disability issues
    5. Systems-based Practice: Understand interaction of practice within larger system.

  17. Administrative compliance

  18. Residents are expected to be in compliance with departmental and hospital administrative requirements including, timely documentation of clinical care, statistics recording, duty hours, submission of evaluations for resident portfolio, completion of evaluations of rotations, re-certification requirements and attendance at required didactic lectures.

Timetable for formal evaluations

Residents will have formal performance evaluations every six months with either the Director of the Residency program or Associate Director. Interim evaluations will be scheduled if a need for formative evaluation is identified by the Program Director. An individualized learning plan will formulated together by the Program Director and the resident, with ongoing evaluation of progress. Each PGY class is assigned a faculty member to mentor that group of residents throughout the 4 years.