Re-engineering the Resident Applicant Selection Process in Ophthalmology: A Literature Review and Recommendations for Improvement

Abstract

The current resident selection process for ophthalmology has undergone little change over the last several years and remains highly dependent on the traditional selection factors (i.e., grades, honors, letters of recommendation, and an interview). Unfortunately, these selection factors have not been shown to be consistently predictive of future resident performance. In addition, the Accreditation Council for Graduate Medical Education (ACGME) has mandated implementation of six new competencies in resident training in the USA and the current selection process does not directly recruit for these competencies. We propose an implementation strategy to re-engineer and improve the resident selection process in ophthalmology and potentially develop assessments that would be predictive of actual downstream resident performance that would encompass the ACGME related competencies. An intra-departmental Task Force for the ACGME Competencies reviewed a PubMed literature search regarding resident selection. A content expert (AGL) gleaned selected “good practices” from the literature review and summarized the results. Specific recommendations were reviewed for topicality to ophthalmology and where possible for feasibility, reliability, and validity. We summarize several good practices identified from the literature review and propose an implementation matrix for aligning the resident application process with the ACGME competencies that might include: using a standardized and consolidated academic score for the cognitive domains; converting the letter of recommendation format into a letter of evaluation; standardizing the letters of evaluation, including the “Dean's letter”; using behavior specific interview techniques with standardized questions; and developing a specialty based consensus for the selection of traits specific to ophthalmology that might predict success. The resident selection process for ophthalmology might be improved by implementation of specific good practices from the literature. Ophthalmology should strive to develop applicant selection tools that might be useful for predicting residency performance and that would align with the ACGME competency mandate for tools to predict future performance as a physician.