Development, initial reliability and validity testing of an observational tool for assessing technical skills of operating room nurses
Background: The recent emergence of the Systems Approach to the safety and quality of surgical care has triggered individual and team skills modules for surgeons and anaesthetists and relevant observational tools have been developed. Objective: To develop an observational that captures operating room (OR) nurses’ technical and can be used for and . Methods: The Imperial College Assessment of Technical Skills for Nurses (ICATS-N) assesses (i) gowning and gloving, (ii) setting up instrumentation, (iii) draping, and (iv) maintaining sterility. Three to five observable behaviours have been identified for each and are rated on 1–6 scales. Feasibility and aspects of reliability and validity were assessed in 20 simulation-based management training modules for trainee nurses and doctors, carried out in a Simulated Operating Room. Results: The was feasible to use in the context of simulation-based training. Satisfactory reliability (Cronbach a) was obtained across trainers’ and trainees’ scores (analysed jointly and separately). Moreover, trainer nurse’s ratings of the four skills correlated positively, thus indicating adequate content validity. Trainer’s and trainees’ ratings did not correlate. Conclusions: Assessment of OR nurses’ technical skill is becoming a training priority. The present evidence suggests that the ICATS-N could be considered for use as an assessment/training tool for junior OR nurses.
All data analyses were carried out using SPSS v. 14.0. Reliability, in the form of internal consistency, was assessed via Cronbach a coefficients (and we also report the lowest item–total correlation obtained for each item). Cronbach a values range between 0 and 1 with values >0.70 typically considered adequate in research contexts. Content validity was assessed via Spearman r correlation coefficients between different core skills as rated by the trainer nurse. Non-parametric coefficients were computed due to small sample size. Medium-sized correlations between skills will provide evidence for adequate content validity. Correlations between trainer and trainees’ ratings across skills were reported as well.
The Imperial College of Technical Skills for Nurses (ICATS-N) assesses (i) gowning and gloving, (ii) setting up instrumentation, (iii) draping, and (iv) maintaining sterility. Three to five observable behaviours have been identified for each skill and are rated on 1–6 scales. Feasibility and aspects of reliability and validity were assessed in 20 simulation-based management modules for trainee nurses and doctors, carried out in a Simulated Operating Room.
Feasibility: ICATS-N_ should be reasonably easy to use in real ORs and also in the context of simulation-based .a. The is observational, and thus non-intrusive in its useb. The consists of a relatively small number of itemsc. The tool consists of observable behaviours (i.e., the amount of inference involved from the part of the rater/trainer is minimised) Feasibility was evaluated qualitatively: did the trainer OR nurse of our study find the tool usable?Reliability: ICATS-N_ should capture OR nurses’ technical skills consistently.The tool consists of observable behaviours (i.e., the amount of inference involved from the part of the rater/trainer is minimised) Reliability was evaluated quantitatively in the form of internal consistency (Cronbach a coefficients)Validity: ICATS-N_ should capture what it purports to capture (i.e., OR nurses’ technical skills). Face validity was evaluated qualitatively, via expert opinion in the development of the tool. Content validity was evaluated (i) qualitatively, via expert opinion in the development of the tool and (ii) quantitatively, via correlational analyses of core skills as defined in ICATS-N.
Twenty trainee OR nurses and two senior OR trainer nurses took part in the study. ICATS-N was tested in the context of surgical simulations. The simulations were carried out in a Simulated Operating Room (SOR) in the hospital. The SOR is a fully equipped OR with a control room, through which trainers can direct simulation exercises and observe the trainees via one-way mirror.
Through the control room, one of two trainer nurses (JH, ES) rated trainees’ technical using ICATS-N. (For practical reasons (ongoing clinical commitment), it was not possible to have both trainers rating the trainees simultaneously, which precludes any analysis of interrater reliability.) On completion of the procedure, trainees also completed ICATS-N to rate their own performance and received feedback on their performance from the trainer.
of OR nurses’ technical is becoming a priority. The present evidence suggests that the ICATS-N_ could be considered for use as an / for junior OR nurses.In future empirical work, it is essential to replicate the present findings with larger samples that should ideally be drawn from different institutions.
The was feasible to use in the context of simulation-based . Satisfactory reliability (Cronbach a) was obtained across trainers’ and trainees’ scores (analyzed jointly and separately). Moreover, trainer nurse’s ratings of the four skills correlated positively, thus indicating adequate content validity. Trainer’s and trainees’ ratings did not correlate.
Ethical approval was obtained for the study and provided by all participants.
To develop an observational that captures operating room (OR) nurses’ technical and can be used for and .
 |
Portfolio of Solutions web site has been initially developed in the scope of DRIVER+ project. Today, the service is managed by AIT Austrian Institute of Technology GmbH., for the benefit of the European Management. PoS is endorsed and supported by the Disaster Competence Network Austria (DCNA) as well as by the STAMINA and TeamAware H2020 projects. |