Session Design Submission Review

Yes

• CoSEF

In recent years, there has been a loss of traditional personnel-selection metrics for incoming surgical residents, with the transition away from graded clerkships, the removal of USMLE Step 2 CS, and the USMLE Step 1 becoming pass/fail. We are now facing a dearth of objective metrics by which to assess pre-residency competency; however, many of these metrics that were traditionally used for selection were used out of convenience. They were not all validated, evidence-based metrics that reliably predicted success in early residency training. Although their loss has created temporary challenges, it also uniquely positions our field to generate a new, better system for personnel selection from the ground up. 

While there have been existing methods to define medical student competence as a whole (ie, the dean’s letter,  letters of recommendation, OSCE, shelf exams, AAMC undergraduate EPAs, etc) these methods have not all been validated as a selection tool. They also may not precisely assess all of the skills our incoming surgical workforce needs in our modern era. In order to create an evidence-based and validated system of residency selection, it is critical to first define the skills, competencies, and traits we are selecting for. 

We are therefore using the following prompt in an interactive workshop designed for learners to take part in a modified Delphi Process, and become familiar with this research tool.

Prompt: “What specific and measurable competencies, traits, and skills should every incoming surgical resident possess?”

 A Delphi Process is a method of achieving consensus that is particularly useful in an area where knowledge is imprecise or incomplete, and where collective expert gestalt may play a more valuable role than individual opinions or literature review alone. This is a particularly useful tool in surgical education, where much of our evidence base is still being built. This research method builds on both qualitative and quantitative methods to create expert consensus on important issues. It is an integral part of a surgical educator and researcher’s toolbox- whether this process is used to inform local quality improvement or policy change at a learner’s institution, or even to build national guidelines. Being familiar with this process also helps surgeons better understand literature and guidelines that have been built using this method. 

We therefore offer this workshop so participants can experience a modified Delphi Process in real time as an immersive learning activity. The Delphi Process involves a diverse group of key stakeholders. We therefore invite and encourage participation from anyone who is interested, including trainees, medical students, non-physician educators,  advisors, and faculty. 

90-minute workshop

Yes

Yes

Participants will identify topics that are useful for study via a Delphi method.

Participants will apply principles and best practices for the Delphi method during the interactive learning experience.

Participants will recognize the importance of anonymity and psychological safety in the idea generation phase of the process.

Participants will help formulate discrete items from ideas generated.

Participants will interpret item rating in real time and differentiate items that have reached consensus from those that require additional iteration.