Beruflich Dokumente
Kultur Dokumente
Abstract— This paper introduces a novel robotic platform for happened in August 2014 in Schleswig-Holstein, Germany,
aerial remote gas sensing. Spectroscopic measurement methods in which ten rescue workers were seriously injured in the
for remote sensing of selected gases lend themselves for use on aftermath of the incident.
mini-copters, which offer a number of advantages for inspection
and surveillance. No direct contact with the target gas is needed Gas-sensitive aerial robots, as the one proposed in this
and thus the influence of the aerial platform on the measured paper, are a powerful tool that can be deployed in the above
gas plume can be kept to a minimum. This allows to overcome described scenarios where gas source localization and gas
one of the major issues with gas-sensitive mini-copters. On distribution mapping tasks are critical [4]–[6]. Compared
the other hand, remote gas sensors, most prominently Tunable to their ground-based counterparts, aerial robots offer sev-
Diode Laser Absorption Spectroscopy (TDLAS) sensors have
been too bulky given the payload and energy restrictions of eral advantages such as their superior steering capabilities
mini-copters. Here, we introduce and present the Unmanned and fewer mobility restrictions in complex terrains [6]. A
Aerial Vehicle for Remote Gas Sensing (UAV-REGAS), which concrete example, where the applicability of ground-based
combines a novel lightweight TDLAS sensor with a 3-axis aerial robots is limited (e. g., of the Gasbot platform [2], [7]),
stabilization gimbal for aiming on a versatile hexacopter. The is the inspection of old, decommissioned landfills. In such
proposed system can be deployed in scenarios that cannot be
addressed by currently available robots and thus constitutes a scenarios, mobility is severely restricted by hollows and pits,
significant step forward for the field of Mobile Robot Olfaction caused by bacterial degradation and smoldering fires.
(MRO). It enables tomographic reconstruction of gas plumes Remote gas sensing technologies, such as Tunable Diode
and a localization of gas sources. We also present first results Laser Absorption Spectroscopy (TDLAS), emerged in the
showing the gas sensing and aiming capabilities under realistic ’90s and constitute an alternative to traditional in-situ gas
conditions.
sensors (such as, e. g., metal oxide sensors) [2]. Instead
I. INTRODUCTION of reporting point measurements, TDLAS sensors measure
concentrations remotely and report them as integral mea-
Methane (CH4 ) is a colorless, odorless gas that is ex-
surements over the entire path of the beam. TDLAS sensors
tremely flammable and may form explosive mixtures with
rely on well-known spectroscopic principles: Gas molecules
air at concentration levels from 4.4%vol to 16.5%vol . It is the
absorb energy in narrow bands around specific wavelengths
second most prevalent greenhouse gas after carbon dioxide
in the electromagnetic spectrum [8]. Outside these bands,
(CO2 ) that is released by human activity [1]. Examples of
there is basically no absorption [8]. Thus, the laser diode
sources emitting CH4 include fossil fuels, agriculture, and
of a TDLAS sensor is tuned to the absorption band of the
landfills. Landfills account for 2% of the total greenhouse gas
target gas (e. g., CH4 [8]) and modulated in a way that the
emissions (mostly CH4 and CO2 ) [2]. Therefore, a landfill
emitted laser beam is driven on and off of the wavelength of
operator must ensure that this gas is collected, treated, and
interest [2]. During this process, the power of the received
used; residual gas must be flared [3]. Monthly emission
laser beam is measured continuously and, by comparing the
reports need to be issued and usually, gas measurements are
measurements when the beam is on the target wavelength
performed manually at a few predefined locations only (e. g.,
against the measurements when the beam is off, it is possible
bore holes). This spatial and temporal measurement sparsity
to determine with high degree of selectivity to a specific gas,
complicates the leak detection process and causes, in this
whether the emitted laser beam has traversed a concentration
way, a waste of resources in form of emitting gases [2].
patch or not [2]. More recently, smaller and lighter TDLAS
CH4 is also the principal component of liquefied (LPG,
sensors emerged allowing their usage as payload for mini
LNG) or gaseous hydrocarbons (CNG) that are used for
Unmanned Aerial Vehicles (UAVs).
alternative fuel vehicles. If such a vehicle is involved in an
The key contributions of this paper are the introduction
accident, a tank failure may occur. According to the accident
and validation of a novel aerial robotic platform equipped
severity, leaking fuel – that is gaseous under ambient con-
with a 3-axis gimbal mounted TDLAS sensor that has a
ditions – could form an explosive gas cloud. The relevance
number of important applications, ranging from emission
of this scenario can be emphasized by an accident which
monitoring at industrial facilities, to contingency support
1 Patrick P. Neumann, Harald Kohlhoff, Dino Hüllmann, and where hazardous gas leaks might have occurred. By com-
Martin Kluge are with Bundesanstalt für Materialforschung und bining different sensing modalities, the platform enables the
-prüfung (BAM), Unter den Eichen 87, DE-12205 Berlin, Germany. aerial-based remote sensing of gas clouds, the tomographic
patrick.neumann@bam.de
2 Achim J. Lilienthal is with the AASS Research Centre, Örebro Univer- reconstruction of gas plumes, and the localization of gas
sity, SE-70182 Örebro, Sweden. sources. Gas tomography [7] is based on measuring a gas
3911
ARM Cortex-M4 @ 96 MHz (Teensy 3.1, interfaced via I2 C)
is used to decode the incoming messages on-line.
As wireless radio link, we use an 433 MHz open source
radio platform named SiK Telemetry Radio (formerly known
as 3DR Radio). The very small and lightweight module
(approximately 4 g without antenna) features air data rates up
to 250 kbps, Frequency Hopping Spread Spectrum (FHSS),
adaptive Time Division Multiplexing (TDM), and built-in
error correcting code, which can correct up to 25% data bit
errors, to name but a few.
B. Sensor Integration
To measure CH4 concentrations, the aerial robotic plat-
form was equipped with an open-path gas detector (Laser Fig. 3. Detailed view of the open-path gas detector installed on the 3-axis
Methane mini-G (SA3C50A), in the following referred to aerial stabilization gimbal.
as LMm-G) manufactured by Anritsu and distributed by
Tokyo Gas Engineering. The LMm-G belongs to the family
of TDLAS gas sensors, i. e., in comparison to traditional
gas sensing modalities these sensors do not require a di- and a wide angle camera (GoPro Hero 4), that allows
rect interaction between the sensor’s surface and the target creating CH4 scans and documentation of the exploration
compound [2]. Instead, the LMm-G measures concentrations area. The payload is well balanced in the center of the three
remotely and reports them as integral measurements in ppm· gimbal axes. The gimbal allows rotation angles of ±360◦
m. However, the LMm-G does not provide any information (yaw), +50◦ /−140◦ (pitch), and ±40◦ (roll) with a control
regarding the distance traveled by its beam. The measuring precision of ±0.01◦ . This allows to counteract even small
principle of the LMm-G is shown in Fig. 2. The LMm- compensation movements by the UAV caused by wind gusts,
G has a dimension of 70 (W) × 179 (D) × 42 (H) mm3 for example. In addition, by rotating the sensor, the advantage
and weighs approximately 530 g (including the battery). is that a large area can be scanned without the need to pilot a
According to the manufacturer’s data sheet [16], it is able new waypoint. A 16-channel 12-bit PWM servo driver board
to measure CH4 concentrations in the range from 1 ppm · m with I2 C interface in combination with an additional 10 DoF
to 50,000 ppm · m. It offers fast response (0.1 s) and high IMU board, that consists of a 3-axis accelerometer, a 3-axis
sensitivity. The detection distance ranges from 0.5 m to 30 m gyroscope, a 3-axis magnetometer, and a barometric pressure
and could be further extended to 100 m when using optional sensor, was used to generate control signals for the gimbal. A
reflection sheets. The beam has a cone shape with an opening Kalman filter estimates the gimbal’s attitude (roll and pitch)
angle of φLMm−G = 8.5 mrad ≈ 0.5◦ or less, which means during operation and supervises its exact positioning. While
that always a volume is measured (the projected area of the being positioned, the rotating gimbal induces a torque that
beam has a diameter of 0.17 m at 20 m). A built-in standard has to be compensated by the flight controller. There was
gas cell allows an auto-calibration and self-check during start no impact on the flight stability observable while the gimbal
up of the device that will automatically repeated in case of performed the rather small compensating motions during the
wavelength stability errors. To interface with the LMm-G, the measurements. This might be different, however, if smaller
built-in bluetooth module was replaced with a custom built carrier platforms were used. The laser module LDS30M
circuit board that enables a serial communication via UART. weighs 50 g and has a measurement range from 0.2 m to
Fig. 3 shows the payload comprising of a modified 3- 30 m for target reflectances of ≥ 10%. The LDS30M has a
axis aerial gimbal (DJI Zenmuse Z15-A7) for stabilizing and resolution of 10 mm with a measuring accuracy of ±50 mm
orienting the payload, the open-path gas detector LMm-G, a and offers sampling rates of up to 30 kHz. The purpose
laser module for distance measurements (Astech LDS30M), of the laser distance measurement system mounted next
to the LMm-G is to collect range information. A small
microcontroller unit (MCU) located on the gimbal collects all
relevant data from these sensors and transfers it via I2 C to a
main MCU located on the mini UAV, which logs the received
data on a SD card, transfers it to the ground station via the
433 MHz wireless radio link (see Sec. III-A), and moreover
controls the gimbal’s attitude by sending I2 C commands
to the PWM servo driver board. The payload can perform
Fig. 2. Measurement principle of the LMm-G. Here, the device reports automatic scans of the area of interest or may be controlled
an integral concentration measurement of 280 ppm · m with the infra-red
beams traveling a 10 m path, in which a background concentration level
manually from the ground station using an Xbox controller.
of 10 ppm and a CH4 patch of 200 ppm are present (10 ppm × 8 m + The manual control of this payload is rather simple for an
100 ppm × 2 m = 280 ppm · m). experienced teleoperator.
3912
and its payload were remotely operated to perform gas
measurements in different altitudes (approximately 5, 10, 15,
and 22 m) while trying to aim at the glass cube using the
real-time video link. Note that, in all experimental setups, no
artificial reflective surfaces were installed – ground reflection
alone was sufficient for the TDLAS sensor.
V. EXPERIMENTAL RESULTS
Fig. 5 and Tab. I show the results of experiment #1
(earth wall barrier experiments). The values in Tab. I are
given as confidence intervals with 95% confidence level
(a) (b) for the mean (assuming normally distributed data), where
non-valid data (see Tab. I for more details) were excluded
Fig. 4. Experimental scenarios: (a) on ground and (b) in flight. from the calculation. Trial #1 refers to a measurement of
the CH4 background concentration, trial #2 is the actual
measurement of the CH4 , and trial #3 is the reference
IV. EXPERIMENTAL SCENARIO measurement against a white reflecting sheet. The mea-
The mini UAV was tested outdoors on the BAM Test Site surements are reproducible and the mean concentrations lie
’Technical Safety‘ (BAM TTS). For the first scenario, we mostly within the claimed measurement accuracy of ±10%
investigated for a maximum allowed payload pitch angle θ of the TDLAS sensor [16]. An exception constitutes trial
of −60◦ / −120◦ in scanning mode (the payload is oriented #2 performed on dark sand at 20 m that has a significantly
downwards, when θ = −90◦ ), the reflectivity properties of higher variance in the measurements and an average accuracy
different surfaces typical for landfills (bright sand, dark sand, of approximately 13%, and trial #2 performed on vegetation
and vegetation) at different measuring distances (10, 15, and at 20 m, where only 45.3% of the measurements were valid
20 m). For this purpose, gas measurements with the mini (the remaining measurements were marked with the error
UAV on the ground were performed against an earth wall code for not enough reflection by the TDLAS sensor). Based
that has a slope angle of approximately 30◦ (see Fig. 4(a)). on these observations it can be assumed that the TDLAS
The measurements were recorded at a sampling frequency sensor requires at least 2% intensity of the reflected laser
of 2 Hz and for each trial, data was collected over a period beam to work properly. Of course, the level of reflectivity
of 40 s. As gas source, we used a small, sealed glass cube
(edge length of 0.2 m) filled with 2.5%vol CH4 that was TABLE I
placed in front of the TDLAS sensor in an angle of 45◦ R ESULTS OF THE EARTH WALL EXPERIMENTS .
to avoid interreflection inside the cube. This means that Measuring Distance CH4 Concentration Intensity
Surface Trial #
we expect the TDLAS sensor to measure concentrations of (m) (ppm · m) (%)
1 10.40 ± 0.004 55.2 ± 3.1 10.0 ± 0.0
around 5,000 ppm · m (2.5%vol × 0.2 m) assuming a neg- 2 10.57 ± 0.004 4241.5 ± 25.2 4.2 ± 0.1
ligible background concentration. Each time the glass cube 3 0.41 ± 0.003 3862.6 ± 13.0 67.4 ± 0.5
Bright Sand
evaluation repeatable conditions were required and it can be 1 14.36 ± 0.005 49.1 ± 2.6 6.9 ± 0.1
2 14.31 ± 0.140 3707.7 ± 19.4 3.9 ± 0.0
assumed that the concentration levels remain fairly the same 3 0.45 ± 0.004 3377.0 ± 12.1 24.7 ± 1.6
during the different trials. 1 20.48 ± 0.006 58.7 ± 5.1 4.0 ± 0.0
2 20.51 ± 0.2561 4275.3 ± 47.0 2.0 ± 0.0
In the second scenario, the performance of the mini UAV 3 0.44 ± 0.0401 3795.1 ± 17.4 12.7 ± 0.1
system in automatic scanning mode while hovering was 1 10.30 ± 0.005 29.2 ± 2.6 9.5 ± 0.1
investigated. For this, the mini UAV was deployed in GPS 2 10.31 ± 0.005 4194.0 ± 22.2 5.0 ± 0.0
3 0.42 ± 0.003 3815.6 ± 14.8 13.4 ± 0.1
Vegetation
attitude mode, where it tries to keep the attitude stable and to 1 14.19 ± 0.005 46.1 ± 4.2 6.0 ± 0.0
lock the aircraft position accurately. The experiment started 2 14.22 ± 0.006 3624.8 ± 25.7 3.2 ± 0.1
3 0.46 ± 0.007 3277.0 ± 9.6 37.3 ± 2.3
after the mini UAV reached the target position in an altitude 1 20.33 ± 0.199 70.9 ± 7.02 3.9 ± 0.0
of approximately 16 m. Data was collected during the whole 2 20.51 ± 0.027 3661.8 ± 46.33 2.0 ± 0.0
3 0.44 ± 0.005 3994.5 ± 8.0 15.1 ± 0.2
time span of the experiment (200 s). 1
5%, 20%, and 1% (in the order of appearance) of the distance measurements were
For the third scenario, we simulated a leakage (for ex- not valid (LDS30M sensor reported the error code for no aim).
2
ample, from a broken pipeline underneath an asphalt street) 18.9% of the gas measurements were not valid (TDLAS sensor reported an unknown
error code).
at a known position. As gas source, we used the above 3
54.7% of the gas measurements were not valid (TDLAS sensor reported the error
described CH4 filled glass cube (Fig. 4(b)). The mini UAV code for not enough reflection).
3913
(a) Bright sand
3914
This means that the robot can operate much easier in real
scenarios, and is less constrained by a limited mobility than
previous gas-sensitive mobile and aerial robots [4], [17]
We tested our platform outdoors on the BAM TTS in three
different scenarios to estimate the performance of the system.
Although we only used a CH4 filled glass cube as gas source,
the results demonstrate that our platform can contribute to the
task of monitoring, e. g., landfills and pipelines. Furthermore,
the platform constitutes a powerful and robust tool for rescue
units, fire fighters etc. in order to assess the severity of
incidents involving leaking gas.
For future work, we plan to develop algorithms for the
tomographic reconstruction of gas plumes and a precise
localization of its source that will be validated in the field.
Fig. 7. Comparison of the scanning mode trials: the blue, red, and black The experiments will be supported by a distributed array of
curves represent the target pitch angle, the pitch angle while the mini UAV up to 10 pressure-capsulated, highly dynamical infrared gas
was on the ground, and the pitch angle while the mini UAV was airborne,
respectively. transmitters with a response time of t90 = 1 s to allow for
a rudimentary quantitative or ground truth evaluation. This
very short response time also allows resolving the temporal
dimension of gas distribution processes.
The main challenges of reconstructing gas plumes from
integral measurements is the development of algorithms that
cope with,i. e., the highly dynamic nature of gas dispersion
(that is based on airflow advection and turbulence [7]),
the sparsity of the measurements (the number of optical
paths rarely exceeds 100 [18]), the measurement geometry
(measurement positions and orientations may affect the re-
construction quality [19]), and parameter selection (e. g., the
cell size for grid-based approaches).
Furthermore, we plan to equip the mini UAV with an in-
situ gas sensor for CH4 (or even a sensor array to detect other
compounds of interest, e. g., other combustible gases). This
Fig. 8. Results of the leakage experiments: the black and blue curve show sensing payload can bring several advantages: For example,
the altitude of the mini UAV and the measuring distance obtained from the in case of a high concentration reading, the robot can decide
laser module, respectively. The orange areas denote approximately the time whether it is located in a potentially explosive atmosphere
needed for aiming the payload at the glass cube. The glass cube is defined
to be detected, if the measured concentration is > 200 ppm · m (red line). or not and initiate an appropriate evasion strategy. While
the TDLAS sensor provides remote measurements of the
gas concentration, and thus enables to efficiently inspect
while aiming on potential gas leaks. large areas, the in-situ sensor could provide absolute con-
centration measurements close to a potential leak using
VI. CONCLUSIONS AND FUTURE WORK calibrated chemical sensors [2]. The in-situ sensor could be
additionally used to verify the resolved integral concentration
In this work, we introduce a prototype of an aerial measurements.
robotic platform called UAV-REGAS aimed at gas source Future work should also aim at an improvement of the
localization and gas distribution mapping tasks by using its localization and attitude estimation of the mini UAV and its
remote sensing capabilities. In contrast to an UAV equipped payload in outdoor environments. Errors that occur here are
with traditional in-situ chemical sensors (such as metal oxide particularly severe when a TDLAS sensor is used, as the
sensors), our proposed approach offers: resulting misalignments of the TDLAS beams have a big
• highly selective measurements of the target gas, influence [2].
• remote gas measurements, i. e., no direct contact with
the gas plume is needed and thus, the plume propagation ACKNOWLEDGMENT
is not influenced by the propulsion system, We would like to thank all participating colleagues
• integral measurements over the path of the laser beam and BAM for funding this interdisciplinary in-house R&D
enables tomographic reconstruction of gas plumes and project. Furthermore, the authors would like to express their
a localization of their source, and gratitude to the German Federal Ministry for Economic
• potential reduction of exploration time due to remote Affairs and Energy (BMWi) for funding a related project
sensing. (grant number KF2201091HM4) within the ZIM program.
3915
R EFERENCES sites using open-path optical remote sensing method,” Journal of
Environmental Science and Health, Part A, vol. 44, no. 10, pp. 1011–
[1] P. Forster, V. Ramaswamy et al., “Changes in Atmospheric Con- 1018, 2009.
stituents and in Radiative Forcing,” Climate Change 2007: The Phys- [11] A. Grinham, M. Dunbabin, D. Gale, and J. Udy, “Quantification of
ical Science Basis. Contribution of Working Group I to the Fourth ebullitive and diffusive methane release to atmosphere from a water
Assessment Report of the Intergovernmental Panel on Climate Change, storage,” Atmospheric Environment, vol. 45, no. 39, pp. 7166 – 7173,
pp. 129–234, 2007. 2011.
[2] V. Hernandez Bennetts, A. Lilienthal, A. A. Khaliq, V. Pomareda Sese, [12] S. Soldan, G. Bonow, and A. Kroll, “1st IFAC Workshop on Automatic
and M. Trincavelli, “Towards Real-World Gas Distribution Mapping Control in Offshore Oil and Gas Production RoboGasInspector - A
and Leak Localization Using a Mobile Robot with 3D and Remote Mobile Robotic System for Remote Leak Sensing and Localization
Gas Sensing Capabilities,” in Proceedings of the IEEE International in Large Industrial Environments: Overview and First Results,” IFAC
Conference on Robotics and Automation (ICRA), Karlsruhe, Germany, Proceedings Volumes, vol. 45, no. 8, pp. 33 – 38, 2012.
2013. [13] G. Bonow and A. Kroll, “Gas leak localization in industrial envi-
[3] Global Methane Initiative, “European Commission Global Methane ronments using a TDLAS-based remote gas sensor and autonomous
Reduction Actions Ref. Ares(2013)2843722 - 06/08/2013,” mobile robot with the Tri-Max method,” in IEEE International Confer-
2013, visited on 2016-06-23. [Online]. Available: https: ence on Robotics and Automation (ICRA), Karlsruhe, Germany, 2013.
//www.globalmethane.org/documents/EC GMI reduction actions.pdf [14] DJI, “Spreading Wings S900, User Manual V1.4,” January 2016,
[4] G. Kowadlo and R. A. Russell, “Robot Odor Localization: A Tax- visited on 2016-07-01. [Online]. Available: http://dl.djicdn.com/
onomy and Survey,” The International Journal of Robotics Research, downloads/s900/en/S900 User Manual en v1.4.pdf
vol. 27, no. 8, pp. 869 – 894, 2008. [15] Pawelsky, “A2 CAN decoder public beta,” visited on 2016-06-10.
[5] P. Neumann, S. Asadi, A. J. Lilienthal, M. Bartholmai, and J. Schiller, [Online]. Available: http://www.rcgroups.com/forums/showpost.php?
“Autonomous Gas-Sensitive Microdrone: Wind Vector Estimation and p=30774154&postcount=549
Gas Distribution Mapping,” IEEE Robotics and Automation Magazine, [16] Tokyo Gas Engineering Co., Ltd., “SA3C50A, LaserMethane
vol. 19, no. 1, pp. 50 – 61, 2012. mini-G, Operation Manual,” April 2013, visited on 2016-07-01.
[6] P. P. Neumann, V. Hernandez Bennetts, A. J. Lilienthal, M. Bartholmai, [Online]. Available: https://www.crowcon.com/product/download/640/
and J. H. Schiller, “Gas source localization with a micro-drone using SA3C50A+Manual.pdf
bio-inspired and particle filter-based algorithms,” Advanced Robotics, [17] P. P. Neumann, V. H. Bennetts, A. J. Lilienthal, and M. Bartholmai,
vol. 27, no. 9, pp. 1–14, 2013. From Insects to Micro Air Vehicles—A Comparison of Reactive Plume
[7] V. H. Bennetts, E. Schaffernicht, T. Stoyanov, A. J. Lilienthal, and Tracking Strategies. Cham: Springer International Publishing, 2016,
M. Trincavelli, “Online Robot Assisted Gas Tomography - Localizing pp. 1533–1548.
Methane Leaks in Outdoor Environments,” in Proceedings of the IEEE [18] W. Verkruysse and L. A. Todd, “Novel algorithm for tomographic re-
International Conference on Robotics and Automation (ICRA), Hong construction of atmospheric chemicals with sparse sampling.” Environ.
Kong, China, 2014. Sci. Technol., vol. 39, no. 7, pp. 2247–2254, April 2005.
[8] M. B. Frish, R. T. Wainner, B. D. Green, M. C. Laderer, and [19] A. Hartl, B. Song, and I. Pundt, “2-d reconstruction of atmospheric
M. G. Allen, “Standoff gas leak detectors based on tunable diode concentration peaks from horizontal long path doas tomographic mea-
laser absorption spectroscopy,” Infrared to Terahertz Technologies for surements: Parametrisation and geometry within a discrete approach.”
Health and the Environment, vol. 6010, November 2005. Atmospheric Chemistry and Physics, vol. 6, no. 3, pp. 847–861, 2006.
[9] M. B. Frish, R. T. Wainner, M. C. Laderer, M. G. Allen, J. Rutherford,
P. Wehnert, S. Dey, J. Gilchrist, R. Corbi, D. Picciaia, P. Andreussi,
and D. Furry, “Low-cost lightweight airborne laser-based sensors for
pipeline leak detection and reporting,” Proc. SPIE, vol. 8726, pp.
87 260C–87 260C–9, 2013.
[10] K. S. Ro, M. H. Johnson, R. M. Varma, R. A. Hashmonay, and
P. Hunt, “Measurement of greenhouse gas emissions from agricultural
3916