Solving the Longitudinal Assessment Across Multiple Competency Domains Problem

May 21, 2018 10:40 AM – 11:30 AM

Anthony Frisby, Thomas Jefferson University
Kathleen Day, Thomas Jefferson University
Dorothy Berenbrok, Thomas Jefferson University

Longitudinal assessment of medical student performance across competency domains is made more difficult by the variety of testing tools utilized. The Center for Teaching & Learning at Jefferson and Education Management Solutions (Exton PA) collaborated with the Sidney Kimmel Medical College at Jefferson to develop aggregating software that enables individual students as well as faculty and administration to monitor progress and areas for improvement. CompetencyAITM aka JeffCAT (Jefferson Competency Assessment Tool) is a flexible, expandable database designed to ingest questions, test scores, and descriptive data from multiple sources. Simple, role-based interfaces allow users to easily see strengths and deficiencies, from single assessment information to a longitudinal view of curricular progress. Descriptive categories are aligned with Jefferson specific, USMLE and AAMC standards, providing a multi-faceted view of student strengths and competency gaps as well as a high level overview of curriculum content. The project is structured around bi-weekly stakeholder meetings and twice weekly core working group meetings, and is now being rolled out to an expanded group of faculty leaders for review and suggestions. This presentation provides an overview of the JeffCAT product, challenges that have occurred during development, and a forward-looking view of what can be achieved with this tool.