1
24-090
Using Augmented Reality Assistance in Mine Rescue
Doga Cagdas Demirkan
Mechanical Engineering, Colorado School of Mines,
Golden, CO
Ava Segal
Mechanical Engineering, Colorado School of Mines,
Golden, CO
Abhidipta Mallik
Mechanical Engineering, Colorado School of Mines,
Golden, CO
Sebnem Duzgun
Mining Engineering, Colorado School of Mines,
Golden, CO
Andrew J Petruska
Mechanical Engineering, Colorado School of Mines,
Golden, CO
ABSTRACT
Search and rescue operations in mining heavily rely on
humans. In the context of emergency situations within
underground tunnels, the potential to utilize sensory tech-
nology for navigation assistance holds the promise of saving
human lives. Our research introduces a device configura-
tion designed to enhance the performance of search and
rescue teams. This setup integrates LIDAR and thermal
cameras with the Microsoft Hololens, facilitated by the
NUC computer and ROS Bridge. Performance assessment
involves quantifying the extent to which a user is willing
to venture into a light-deprived section of the mine prior
to necessitating supplementary illumination. The prelimi-
nary outcomes highlight the significant potential of aug-
mented reality assistance in offering indispensable aid to
first responders, thereby greatly augmenting the efficiency
of search and rescue missions conducted during critical
circumstances.
INTRODUCTION
=In the aftermath of natural or human-caused disasters,
saving lives becomes an urgent and time- sensitive task[1].
Search and rescue teams face environmental obstacles while
racing against time [2]. Underground spaces like tunnels,
mines, or caves pose challenges due to no GPS, low vis-
ibility, and uneven terrain [3]. Advanced indoor navigation
solutions are required due to the challenging nature of
underground mines, where devastating disasters often
occur [4]. In an emergency, mine rescue personnel face lim-
ited visibility due to dust and smoke, often reducing their
visual perception to 1–3 feet [5].
Traditional emergency guidance in underground
mines includes hand lines, pinwheels, and strobe lights
[6]. Using green laser beams can provide situational aware-
ness in smoky environments by penetrating the smoke [5].
Thermal imaging is another useful approach for smoke-
occluded situations, such as those encountered by firefight-
ers and military personnel. This technology can penetrate
dust and smoke to provide clear images [7]. Nevertheless,
restoring visual information to first responders in emer-
gency situations will enable them to search the environ-
ment more safely and efficiently, as they will be able to scan
an area for hazards and will provide personnel with better
situational awareness [8].
Given the need for visual awareness in underground
search and rescue missions, this work focuses on develop-
ing a hybrid human-machine system for solving situation
awareness problems in pitch-black and smoke-filled under-
ground mines.
In our previous study [9], we proposed a hardware
setup and explained its integration with utilized software.
The proposed methodology is to combine thermal imaging,
24-090
Using Augmented Reality Assistance in Mine Rescue
Doga Cagdas Demirkan
Mechanical Engineering, Colorado School of Mines,
Golden, CO
Ava Segal
Mechanical Engineering, Colorado School of Mines,
Golden, CO
Abhidipta Mallik
Mechanical Engineering, Colorado School of Mines,
Golden, CO
Sebnem Duzgun
Mining Engineering, Colorado School of Mines,
Golden, CO
Andrew J Petruska
Mechanical Engineering, Colorado School of Mines,
Golden, CO
ABSTRACT
Search and rescue operations in mining heavily rely on
humans. In the context of emergency situations within
underground tunnels, the potential to utilize sensory tech-
nology for navigation assistance holds the promise of saving
human lives. Our research introduces a device configura-
tion designed to enhance the performance of search and
rescue teams. This setup integrates LIDAR and thermal
cameras with the Microsoft Hololens, facilitated by the
NUC computer and ROS Bridge. Performance assessment
involves quantifying the extent to which a user is willing
to venture into a light-deprived section of the mine prior
to necessitating supplementary illumination. The prelimi-
nary outcomes highlight the significant potential of aug-
mented reality assistance in offering indispensable aid to
first responders, thereby greatly augmenting the efficiency
of search and rescue missions conducted during critical
circumstances.
INTRODUCTION
=In the aftermath of natural or human-caused disasters,
saving lives becomes an urgent and time- sensitive task[1].
Search and rescue teams face environmental obstacles while
racing against time [2]. Underground spaces like tunnels,
mines, or caves pose challenges due to no GPS, low vis-
ibility, and uneven terrain [3]. Advanced indoor navigation
solutions are required due to the challenging nature of
underground mines, where devastating disasters often
occur [4]. In an emergency, mine rescue personnel face lim-
ited visibility due to dust and smoke, often reducing their
visual perception to 1–3 feet [5].
Traditional emergency guidance in underground
mines includes hand lines, pinwheels, and strobe lights
[6]. Using green laser beams can provide situational aware-
ness in smoky environments by penetrating the smoke [5].
Thermal imaging is another useful approach for smoke-
occluded situations, such as those encountered by firefight-
ers and military personnel. This technology can penetrate
dust and smoke to provide clear images [7]. Nevertheless,
restoring visual information to first responders in emer-
gency situations will enable them to search the environ-
ment more safely and efficiently, as they will be able to scan
an area for hazards and will provide personnel with better
situational awareness [8].
Given the need for visual awareness in underground
search and rescue missions, this work focuses on develop-
ing a hybrid human-machine system for solving situation
awareness problems in pitch-black and smoke-filled under-
ground mines.
In our previous study [9], we proposed a hardware
setup and explained its integration with utilized software.
The proposed methodology is to combine thermal imaging,