Defining Team Performance for Simulation-based Training: Methodology, Metrics, and Opportunities for Emergency Medicine

Authors
Shapiro, MJ ; Gardner, R ; Jay, GD ; Lindquist, DG ; Salisbury, ML ; Salas, E

Across health care, teamwork is a critical element for effective patient care. Yet, numerous well-intentioned programs may fail to achieve the desired outcomes in team performance. Hope for the improvement of teamwork in health care is provided by the success of the aviation and military communities in utilizing simulation-based (SBT) for training and evaluating teams. This consensus paper 1) proposes a scientifically based methodology for SBT design and , 2) reviews existing team performance metrics in health care along with recommendations, and 3) focuses on leadership as a target for SBT because it has a high likelihood to improve many team processes and ultimately performance. It is hoped that this discussion will assist those in medicine (EM) and the larger health care field in the design and delivery of SBT for training and evaluating teamwork.

Codebooks
SLR Criteria
Summary

REVIEW OF THE LITERATURE

Summary

Metrics Assessing Specialty-specific Team Work.Metrics Assessing Generic Team Work.LOSA, OTAS, ANTS,CATS (see p.1092 for details)

Summary

1) proposes a scientifically based methodology for SBT design and , 2) reviews existing team performance metrics in health care along with recommendations, and 3) focuses on leadership as a target for SBT because it has a high likelihood to improve many team processes and ultimately performance

SLR Criteria
Summary

GoalThis consensus paper: 1) proposes a scientifically based methodology for SBT design and , 2) reviews existing team performance metrics in health care along with recommendations, and 3) focuses on leadership as a target for SBT team , because it has a high likelihood to improve many team processes and ultimately performance.

Summary

Teamwork is dynamic and complex, requiring an strategy that is dynamic as well.More research is needed to develop high-performing metrics.

SLR Criteria
Summary

They describe 4 principles for developing simulation based .Principle 1: Establish the Team-based Competencies to be Assessed and Trained—The Learning Outcomes.Principle 2: Provide Opportunities for Guided Teamwork Practice—Carefully Craft ScenariosPrinciple 3: Measure Team Performance—Diagnose Teamwork Strengths and Weaknesses.Principle 4: Develop Robust Debriefing Protocols— Link Feedback to Learning Outcomes.Concerning team performance metrics:Generic teamwork skills:CATS- Communication and team skills – developed for healthcare professionalsSpecific: Description of a stepwise approach to develop specialty-specific team performance metrics (pg 1093, table 3).There is no one size fits all, criterion standard team performance metric in health care, but much research is being directed toward identifying those that are theoretically relevant and scientifically sound, capture competencies, focus on observable behaviors, and provide meaningful information that facilitates improved performance and outcomesHow well metrics currently in use assess team performancedepends on: 1) what is being measured and under what circumstances—during real clinical events or simulated scenarios; 2) instrument design and how well the captures the behavior in question; 3) the frequency of ; 4) the evaluator’s expertise in team performance and their understanding andfamiliarity with the instrument; and 5) the interpretation of the information gathered and the feedback providedto team members.SBT for leadershipHave clear teaching goals. Debriefing is importantCreating leadership scenario’s – SMARTER methodology provides a framework for scenario development.Include decisions in the scenarioTeamwork is dynamic and complex, requiring an strategy that is dynamic as well. While no criterion standard metric or measure exists, there is a solid methodology for developing tools designed to assessthe attributes sought.

SLR Criteria
Summary

The health care community is interested in improving teamwork. Yet, numerous well-intentioned programs may fail to achieve the desired outcomes in team performance. We address the for teamwork-focused SBT in EM and detail a process for its development.

eu Portfolio of Solutions web site has been initially developed in the scope of DRIVER+ project. Today, the service is managed by AIT Austrian Institute of Technology GmbH., for the benefit of the European Management. PoS is endorsed and supported by the Disaster Competence Network Austria (DCNA) as well as by the STAMINA and TeamAware H2020 projects.