LVIO-Fusion:Tightly-Coupled LiDAR-Visual-Inertial Odometry and Mapping in Degenerate Environments

(a) Process of projecting map points onto the image. (b) Green points are the projected points. (c) 3D map of the challenging scenarios that contain illumination change, altitude change, and scale change. (d)The details of the 3D map.

Abstract

In this letter, we present an innovative, tightly-coupled LiDAR-Visual-Inertial Odometry and Mapping framework, termed LVIO-Fusion, which achives robust and precise state estimation and map construction in environments characterized by LiDAR-degenerated and texture-less. The LVIO-Fusion is comprised of two subsystems:a LiDAR-inertial odometry (LIO) and visual-inertial odometry (VIO). The LIO subsystem employs a dynamic voxel mapping method by utilizing a Hash table and octrees for building and updating point cloud map directly and efficiently. The map points are directly projected to images to build the optical flow matching, which couples LiDAR and camera measurements in a deeper level. Then, the VIO subsystem proposes a coarse-to-fine state estimation that minimizes the frame-to-frame reprojection errors and photometric errors to align images. Furthermore, the VIO subsystem leverages online photometric calibration to acquire the true radiometric information from the environment, consequently refining the precision of the system. We extensively evaluate our method in challenge environments. The results validate the high accuracy and robustness of our method when compared to other state-of-the-art methods in LiDAR-degenerated and texture-less scenarios.

Publication
IEEE Robotics and Automation Letters
杜亮
杜亮
讲师

讲师,机器人技术,自动化装备

鲍晟
鲍晟
讲师

讲师,机电技术

袁建军
袁建军
教授

机器人技术,自动化装备