Exposure to workplace aggression and violence (WAV) in healthcare settings is stressful for staff, and a big burden on budgets. A virtual reality (VR) enhanced training tool pioneered by researchers at Edith Cowan University in Western Australia could soon be set to change things.
The Simulation & Immersive Digital Technology Group (SIDTG) operating out of Edith Cowan University in Western Australia, together with the Department of Health WA, have created a I-VADE, a novel immersive virtual experience allowing both novice and experienced clinicians the opportunity to practice core de-escalation skills in a realistic, safe setting at a time that suits them.
Dr Brennen Mills, who leads the SIDTG, sees real potential given the scalable nature of the immersive VR training to impact workplace aggression and violence training, with traditional training options struggling to find priority in a busy healthcare landscape where finding isolated time for training can be a challenge. “I-VADE allows flexible training to be conducted at times that suit individuals and teams, minus the time drain commonly associated with co-ordinating staffing and resources,” says Dr Mills.
“For frontline healthcare workers, exposure to aggression and violence is an unfortunate reality. These incidents have long-lasting impacts that compromise the ability of the healthcare sector to retain experienced staff.”
Complex scenarios tackled in virtual settings
“Technologies like VR and AR give us a real opportunity to produce complex scenarios in virtual settings, to help mitigate risk. Situations and settings that are difficult to replicate or train for — because of the need for lots of resources — or because they are dangerous can be reproduced to provide training opportunities virtually.”
I-VADE is just one example of projects underway at the SIDTG to create high fidelity, human focused virtual simulations.
“We are also experimenting with AI-driven virtual avatars that would allow novel conversations to take place between users and the AI. This could be particularly meaningful for WAV de-escalation training where situations are often highly volatile,” Dr Mills adds.
De-escalating violence with I-VADE conversational AI
“Clinicians talk out loud to the virtual avatar ‘patient’ (named ‘Barry’) who is extremely frustrated and abusive — and he responds in near real-time.
His response to each verbal interaction is unique, even if users provide the same wording repeatedly. The training simulation incorporates emotive facial animations that align with real-time verbal responses, and Barry’s anger levels either escalate or de-escalate based on the empathy shown by the VR user.
The I-VADE VR program has been supported by the Department of Health WA, after identifying and acknowledging the growing problem of WAV exposure for healthcare workers and patients.
AI and LLMs helping to humanise Barry
The I-VADE – conversational AI project recently received a major upgrade, thanks to a $500,000 innovation grant from the Department of Health WA. The incorporation of AI and large language models (LLMs) have given Barry human-like gestures and mouth movements.
“These upgrades are bringing a new level of authenticity to Barry. He’s a much more sophisticated conversationalist.”
“Dialogue between the person interacting with Barry, and Barry himself feels far more realistic and natural. Powered by AI, he can vary his tone and expression and adapt his responses to the trainee.”
From single scenario prototype to near real-time conversation
After years of co-design and end-user evaluation, The I-VADE program has come a long way since starting life as a single scenario prototype in 2020.
“An enormous amount of forethought and effort went into our prototype scenario, ‘Derek’. We were able to use learnings from Derek to generate a great deal of support from our partners, which led to further investment. We are now well placed to attack this problem on numerous fronts, expanding our original prototype, as well as exploring additional novel AI integrations.”
And what lies ahead? SIDTG is working with the Department of Health WA and other health service providers to implement and rollout I-VADE at scale.
“We can really see this technology make a meaningful difference in the lives of healthcare workforce, empowering them to be safer at work.”
“We can’t wait to see where Barry’s evolution takes us. He is becoming more authentic by the day. Barry has immense potential to improve education and training across many sectors.”
Read more about Dr Brennen Mills’ work with the SITDG here.
Dr Brennen is Senior Lecturer, School of Medical & Health Sciences and Lead, Simulation & Immersive Digital Technology Group at Edith Cowan University.
Dr Brennen Mills is available to speak to schools about:
· How AI will influence virtual reality and gaming in the future
· Virtual reality and gaming for education
· How digital technology can be used to improve training and practice for healthcare and other professionals