XR4Healthcare – Mixed Reality in the Healthcare System – Research on Interaction-oriented Skills Acquisition

Stakeholders in the healthcare sector must confront the myriad challenges presented by continuous digitalization and adapt increasingly to evolving, digitalized learning, working, and interaction processes. To ensure that the prerequisite digital and job-specific skills are not just taught by rote, healthcare education staff sector must take a proactive approach to designing skills training. Throughout this process, they should emphasize interaction-based learning concepts and integration into everyday working situations to offer direct experience in relevant areas of activity.

The objective of the research project XR4Healthcare is to investigate the interaction-oriented acquisition of digital skills and the immersive (user) experiences among training staff in dealing with mixed reality (MR) by cataloging, nurturing and expanding their digital skill sets. Working in tandem with Prof. Dr. Thies Pfeiffer from the Emden/Leer University of Applied Sciences, two scenarios featuring mixed reality (MR) are being tested:

Using, testing and evaluating existing MR applications and authoring tools and
Using an MR authoring tool to design an MR scenario tailored to meet the specific needs and requirements of a professional field of activity or teaching course.

MR applications enable the simulation of complex sequences and realistic, situation-based learning that use multidimensional images of the physical environment and realistic interactions. This enables the repeated simulation of complex scenarios and allows users to become accustomed to situations that may not occur frequently in reality or could potentially pose risks. For the healthcare sector in particular, where errors can potentially have devastating consequences, there are numerous potential applications for this new form of learning and work design, such as in the training and further education of nursing staff or doctors.

Nevertheless, the systematic and purposeful implementation of mixed reality and the targeted design of mixed reality scenarios in healthcare also rely on the existing digital skills of the training staff and their confidence in their own digital, profession-specific capabilies. This underscores the need for enhancing digital skills and implementing tailored qualification concepts in instructor training for vocational education staff or teachers in the healthcare sector.

To achieve the research objectives, findings will be generated in the following areas: digital skills for handling MR, interactive and immersive user experiences, and acceptance of MR.

Additionally, the findings from the research project will be integrated into an interaction- and experience-oriented qualification concept tailored to the specific professional requirements.