Home Volume: 1 , Issue: Supplement 1
32 Using a Simulation Environment to Assess the Usability of a Novel Medical Device During the Covid-19 Pandemic
32 Using a Simulation Environment to Assess the Usability of a Novel Medical Device During the Covid-19 Pandemic

Article Type: In Practice Article History

Table of Contents

Abstract

Background:

It was a recognized challenge of lack of ventilators needed to face COVID-19 worldwide. Although ventilators are sparse, self-inflating manual resuscitators are widely available in-hospital services, providing a rapid response to respiratory depression. Based on this, a device (PNEUMA) [1] was designed to be a temporary solution for emergency use, allowing positive pressure ventilation through a standard self-inflating manual resuscitator, without the need for healthcare personal manually operating the resuscitator. In the first stage, the device underwent functionality and performance testing, using a calibrated lung tester. In the second stage, the usability of the device was assessed, using a clinical simulation environment, an effective method to test usability [2].

Aim:

This work describes the use of a simulation environment to test the usability of a novel device to automate self-inflating manual resuscitators.

Method:

The usability study was divided into two parts: (1) participants followed a protocol with instructions for assembling and using the system in a non-clinical context (Figure 1, left panel) and (2) participants used the system in an immersive simulation environment with a clinical case scenario (Figure 1, right panel). Participants received information on how to assemble/use the system through a 4-page user manual. To monitor participants’ interaction with the system, both parts were video-recorded and questionnaires on key aspects of usability were filled out.

Usability testing. Left panel – assembly of the system (part I); right panel – use of the system in an immersive clinical simulation environment (part II).
Figure 1:
Usability testing. Left panel – assembly of the system (part I); right panel – use of the system in an immersive clinical simulation environment (part II).

Results:

A convenience sample (two MDs and six RNs) from an intensive care unit of a tertiary Portuguese hospital participated in the test. Usability testing showed that the system was easy and timely assembled, with low complexity of use (e.g. not requiring external help). The clinical scenario tested the transition between spontaneous and mechanical ventilation, and ventilatory parameters’ control, using PNEUMA. All participants reported that the controllable parameters (I:E, RR, Vol, PIP, Plat, and PEEP) were relevant and easy to change. Participants suggested the inclusion of patient parameters such as the tidal volume and lung compliance. Participants also suggested improvements, such as the inclusion of pressure alarms and a more user-friendly interface. All participants reported that they would be willing to use the device for emergency use.

Implications for practice:

The reported study resulted in recommendations and ameliorations of the device, before its use in real settings, in the context of the COVID-19 pandemic. The use of simulation environments for device/systems’ testing provides a timely and standardized approach, enabling a safer clinical practice.

References

1. 

Mendonça JM, Cruz N, Vasconcelos D, Sá-Couto C, Moreira AP, Costa P, Miranda V. Pneuma: entrepreneurial science in the fight against the COVID-19 pandemic – a tale of industrialisation and international cooperation. J Innovat Manage. 2020:8(4);325.

2. 

Kushniruk A, Senathirajah Y, Borycki E. Effective usability engineering in healthcare: a vision of usable and safer healthcare IT. In: MEDINFO 2017: Precision Healthcare through Informatics. 2017. (pp. 10661069). IOS Press.