• Skip to primary navigation
  • Skip to main content
The Association for Surgical Education

The Association for Surgical Education

Impacting Surgical Education Globally

  • About
    • By-Laws
    • Contact the ASE
    • Leadership
    • Past Presidents
    • Standing Committees
    • Global Surgical Education-Journal of the ASE
    • ASE Strategic Plan 2023-2026
  • Join!
  • Meeting
    • Annual Meeting Information
    • ASE Fall Meeting & Courses
    • Call For Abstracts
      • Scientific Sessions
      • Candlelight Session
      • ASE Pre-Meeting Course Proposal
      • Shark Tank: Multi-Institutional Research Submissions
      • Thinking Out of the Box
      • Workshop and Panel Submissions
    • Industry
      • Exhibits
      • Commercial Promotional Opportunities
    • Institutional Members & Sponsors
    • Meetings Archives
    • Media Gallery
  • Awards
    • ASE/APDS: Collaborative Grant Initiative
    • ASE DEI Underrepresented in Medicine (URiM) Scholarship Application
    • Education Awards
    • Shark Tank: Multi-Institutional Research Grant
  • Programs
    • 2025-2026 Association for Surgical Education Curriculum in Education Innovation and Teaching (ASCENT)
    • Academy of Clerkship Directors
    • Academic Program Administrator Certification in Surgery
    • Ethics of Surgery Fellowship (EthoS)
    • Surgeon Empowerment Leadership Fellowship (SELF 2.0)
    • Surgical Education Research Fellowship (SERF)
      • Surgical Education Research Fellowship Graduates
  • Foundation
    • Donate Now!
    • Foundation Board
    • The ASE Foundation: Building for the Future – Donors
    • Deb DaRosa Scholarship Application
    • Dr. Debra DaRosa Career Development Scholarship – Donors
    • Patricia Numann, MD, FACS, Scholarship for LMIC Surgical Educators
    • CESERT Pyramid Grant Application
    • Spotlight on CESERT Pyramid Grant Awardees!
    • Newsletter
    • Annual Report
    • Review Committee
    • Grants Awarded
    • Corporate Partners
  • Resources
    • Policy for Conducting Survey Research of ASE Members
    • Surgical Education Research Webinar Series
    • Podcasts
    • ASE CoSEF Peer Engagement for Education Research Success Webinar Series
  • ATLAS
  • Donate
  • Login

2026 Session Design Submissions

← Go back

Trust in Summative Entrustment: How to use EPA Data and Evidentiary Reasoning

Session TypeWorkshop

Andy Krumm PhD
Email hidden; Javascript is required.
Trust in Summative Entrustment: How to use EPA Data and Evidentiary Reasoning
Is this submission from an ASE Committee, Task Force, or Working Group?

No

Are you a member of ASE?

Yes

Session Information

Session Description

Workshop Description:
As Entrustable Professional Activities (EPAs) become an integral part of workplace-based assessment in surgical specialties, faculty and clinical competency committee members increasingly face the challenge of synthesizing complex EPA data into transparent and fair entrustment decisions, both formative and summative. Traditional approaches often lack clear links between overall scores and decision-making. This interactive workshop will guide participants through a framework and associated tools in a grounded an approachable way, drawing on the latest scholarship in educational measurement and EPAs.

Workshop Structure:

  1. Foundations and Challenges:
    The session will begin with small-group icebreakers to surface participants’ current practices and pain points in translating EPA ratings into entrustment decisions. Using illustrative cases, the facilitators will highlight common pitfalls and outline the need for approaches that both synthesize and retain the evidentiary value of each assessment.
  2. Evidentiary Reasoning and Evidence Tables:
    The core didactic portion will break down complex concepts with accessible language and hands-on visuals. Participants will learn how evidence tables—populated by expert opinion, empirical data, or both—connect EPA performance levels to underlying entrustability claims. Facilitators will walk through step-by-step examples to translate multiple workplace-based EPA ratings into scores that communicate the likelihood a trainee can perform a clinical activity to a desired standard. Attendees will see how these methods make the logic behind entrustment decisions explicit and reproducible, enhancing both validity and transparency.
  3. Interactive Application:
    Small groups will work with example data sets, applying provided evidence tables to calculate probabilities and update entrustment estimates for a simulated trainee over multiple assessment encounters. Groups will discuss how rater stringency and case complexity can be incorporated into entrustment decisions. Participants will reflect on the difference between traditional summary statistics and interpretable, individualized profiles generated through evidence-based reasoning.
  4. Building Trust and Next Steps:
    The workshop will conclude with an open discussion on integrating probabilistic thinking into local assessment systems. Strategies will include how to communicate the meaning of summary scores to stakeholders and the importance of transparency and explainability (including how well the process supports the emerging use of AI in assessment). Participants will receive a practical toolkit with templates for evidence tables and step-by-step calculation guides.

Summary:
This workshop empowers clinical educators and CCC members to harness EPA data with modern probabilistic reasoning, supporting defensible, individualized summative entrustment and improved trust in assessment outcomes. Participants will leave ready to champion data-driven, transparent assessment practices in their programs.

Workshop Length

90-minute workshop

If a similar workshop is submitted, would you be willing to combine workshops into one session?

Yes

Would you be open to presenting a workshop of a different duration than selected above if needed?

Yes

Course Objective 1

Explain key challenges in synthesizing EPA ratings for entrustment decisions.

Course Objective 2

Describe how probability models clarify the link between observable EPA ratings and measures of entrustability.

Course Objective 3

Apply probability models to EPA data (one’s own or simulated) to generate meaningful, transparent entrustment claims.

Session Objective 4

Discuss practical strategies for implementing these approaches in local assessment systems.

Session Outline
Activity Order Title of Presentation or Activity Presenter/Faculty Name Presenter/Faculty Email Time allotted in minutes for activity

1

Foundations and Challenges

Andy Krumm

aekrumm@umich.edu

15

2

Evidentiary Reasoning and Evidence Tables

Andy Krumm

aekrumm@umich.edu

30

3

Interactive Application

Alyssa Pradarelli

mazureka@med.umich.edu

30

4

Building Trust and Next Steps

Alyssa Pradarelli

mazureka@med.umich.edu

15

Related