4
remote. They can freely walk around and interact with the
environment using their tools (e.g., sound the roof) or col-
lected objects (e.g., hang curtains). The Director Module is
a desktop-based mode that allows trainers to facilitate train-
ing sessions. Trainers can select which scenarios to run, set
up player configurations, monitor trainees’ progress, and
make changes and additions in real-time (e.g., add objects,
change ventilation). Similarly, the Spectator Module is
run on a desktop. The Spectator Module gives observers a
birds-eye view of the simulation. This module is intended
for mine rescue judging and other observers. Lastly, the
Debrief Module enables playback of simulation sessions
using the generated log file for an after-action review. The
Debrief Module includes both a 2D and 3D view. The 2D
view displays all the users’ actions and movements, the
map man’s map, as well as the environmental conditions
throughout the session (e.g., air flow, gas concentrations).
The 3D perspective view depicts the trainee avatars, their
motions, and their interactions to capture how and what
they did. Both views can be played back continuously and
scrubbed through. See Bellanca et al. for additional techni-
cal details [1].
NIOSH researchers are currently finalizing the devel-
opment of VR-MRT through a multi-year evaluation effort
using the RE-AIM evaluation framework [44]. The parent
project of this study was conceptualized with the five dimen-
sions—Reach, Effectiveness, Adoption, Implementation,
Maintenance—to enhance the potential for successful
translation of findings into a practical solution. In this
case, researchers are using the VR-MRT platform to better
understand barriers and challenges to VR training adop-
tion and implementation in the mining industry, helping
to facilitate the use of this program and inform the future
design and implementation of other immersive applica-
tions for training. While RE-AIM can be useful during the
implementation planning and execution stages, it empha-
sizes the evaluation of the overall impact and sustainability
of the intervention. To better fit the current phase of the
development and implementation process, researchers are
utilizing a complimentary IS framework—the CFIR 2.0
[40]. Results of the first evaluation in this phase have cap-
tured the two antecedent assessments constructs “accept-
ability” and “appropriateness,” as recommended by Proctor
et al. [45, 46]. These constructs are defined as [47]:
• Acceptability: the extent to which an innovation is
perceived as agreeable, palatable, or satisfactory.
• Appropriateness: the perceived fit, relevance, or com-
patibility of the innovation and/or the perceived fit
of the innovation to address a problem or issue.
As described in Bellanca et al., surveyed mine rescue
team members were overwhelmingly positive and found
VR-MRT to be acceptable, usable, and immersive with
limited concerns about simulator sickness [1].
OBJECTIVE
The objective of this study was to complete a pre-imple-
mentation evaluation using the CFIR 2.0 framework. First,
researchers aim to assess the acceptability and appropri-
ateness of VR-MRT for mine rescue training. Secondly,
researchers aim to identify actionable barriers and facili-
tators to the adoption and implementation of VR safety
training more generally. These results are intended to allow
NIOSH researchers to preemptively eliminate or mitigate
identified challenges prior to larger effectiveness and imple-
mentation evaluations efforts of VR-MRT. These results
can also be used to inform stakeholders of potential strat-
egies that they can adopt to improve implementation of
any immersive trainings. This paper builds upon earlier pre-
implementation efforts conducted by NIOSH to gather
technical feedback from development partners such as the
Mine Safety and Health Administration (MSHA), as well
as end-user feedback evaluating VR-MRT’s acceptability,
feasibility, and usability [1].
METHODOLOGY
Data Collection
As a part of a larger evaluation effort to better understand
the barriers and challenges to implementing VR mine
safety and health training, researchers conducted a mixed
methods study including surveys with mine rescue teams
and two rounds of pre-implementation, semi-structured
interviews. The protocol was reviewed and approved by
the Centers for Disease Control and Prevention (CDC)
as exempt human subjects research* and reviewed for pub-
lic burden and cleared by the Office of Management and
Budget (OMB).
The surveys and first set of interviews were conducted
with mine rescue team members and trainers respectively—
would-be innovation recipients and deliverers—in August
and September of 2022 following a technical demonstra-
tion of the VR-MRT platform. Part of this data set was
previously published [1]. The second set of interviews was
conducted across all levels of a large organization that was
interested in adopting VR-MRT. These interviews were
conducted in November 2022. Again, all participants
*See [45] C.F.R. Part 46.104.
remote. They can freely walk around and interact with the
environment using their tools (e.g., sound the roof) or col-
lected objects (e.g., hang curtains). The Director Module is
a desktop-based mode that allows trainers to facilitate train-
ing sessions. Trainers can select which scenarios to run, set
up player configurations, monitor trainees’ progress, and
make changes and additions in real-time (e.g., add objects,
change ventilation). Similarly, the Spectator Module is
run on a desktop. The Spectator Module gives observers a
birds-eye view of the simulation. This module is intended
for mine rescue judging and other observers. Lastly, the
Debrief Module enables playback of simulation sessions
using the generated log file for an after-action review. The
Debrief Module includes both a 2D and 3D view. The 2D
view displays all the users’ actions and movements, the
map man’s map, as well as the environmental conditions
throughout the session (e.g., air flow, gas concentrations).
The 3D perspective view depicts the trainee avatars, their
motions, and their interactions to capture how and what
they did. Both views can be played back continuously and
scrubbed through. See Bellanca et al. for additional techni-
cal details [1].
NIOSH researchers are currently finalizing the devel-
opment of VR-MRT through a multi-year evaluation effort
using the RE-AIM evaluation framework [44]. The parent
project of this study was conceptualized with the five dimen-
sions—Reach, Effectiveness, Adoption, Implementation,
Maintenance—to enhance the potential for successful
translation of findings into a practical solution. In this
case, researchers are using the VR-MRT platform to better
understand barriers and challenges to VR training adop-
tion and implementation in the mining industry, helping
to facilitate the use of this program and inform the future
design and implementation of other immersive applica-
tions for training. While RE-AIM can be useful during the
implementation planning and execution stages, it empha-
sizes the evaluation of the overall impact and sustainability
of the intervention. To better fit the current phase of the
development and implementation process, researchers are
utilizing a complimentary IS framework—the CFIR 2.0
[40]. Results of the first evaluation in this phase have cap-
tured the two antecedent assessments constructs “accept-
ability” and “appropriateness,” as recommended by Proctor
et al. [45, 46]. These constructs are defined as [47]:
• Acceptability: the extent to which an innovation is
perceived as agreeable, palatable, or satisfactory.
• Appropriateness: the perceived fit, relevance, or com-
patibility of the innovation and/or the perceived fit
of the innovation to address a problem or issue.
As described in Bellanca et al., surveyed mine rescue
team members were overwhelmingly positive and found
VR-MRT to be acceptable, usable, and immersive with
limited concerns about simulator sickness [1].
OBJECTIVE
The objective of this study was to complete a pre-imple-
mentation evaluation using the CFIR 2.0 framework. First,
researchers aim to assess the acceptability and appropri-
ateness of VR-MRT for mine rescue training. Secondly,
researchers aim to identify actionable barriers and facili-
tators to the adoption and implementation of VR safety
training more generally. These results are intended to allow
NIOSH researchers to preemptively eliminate or mitigate
identified challenges prior to larger effectiveness and imple-
mentation evaluations efforts of VR-MRT. These results
can also be used to inform stakeholders of potential strat-
egies that they can adopt to improve implementation of
any immersive trainings. This paper builds upon earlier pre-
implementation efforts conducted by NIOSH to gather
technical feedback from development partners such as the
Mine Safety and Health Administration (MSHA), as well
as end-user feedback evaluating VR-MRT’s acceptability,
feasibility, and usability [1].
METHODOLOGY
Data Collection
As a part of a larger evaluation effort to better understand
the barriers and challenges to implementing VR mine
safety and health training, researchers conducted a mixed
methods study including surveys with mine rescue teams
and two rounds of pre-implementation, semi-structured
interviews. The protocol was reviewed and approved by
the Centers for Disease Control and Prevention (CDC)
as exempt human subjects research* and reviewed for pub-
lic burden and cleared by the Office of Management and
Budget (OMB).
The surveys and first set of interviews were conducted
with mine rescue team members and trainers respectively—
would-be innovation recipients and deliverers—in August
and September of 2022 following a technical demonstra-
tion of the VR-MRT platform. Part of this data set was
previously published [1]. The second set of interviews was
conducted across all levels of a large organization that was
interested in adopting VR-MRT. These interviews were
conducted in November 2022. Again, all participants
*See [45] C.F.R. Part 46.104.