We propose a novel RGB-D camera tracking system that robustly reconstructs hand-held RGB-D camera sequences. The robustness of our system is achieved by two independent features of our method: adaptive visual odometry (VO) and integer programming-based key-frame selection. Our VO method adaptively interpolates the camera motion results of the direct VO (DVO) and the iterative closed point (ICP) to yield more optimal results than existing methods such as Elastic-Fusion. Moreover, our key-frame selection method locates globally optimum key-frames using a comprehensive objective function in a deterministic manner rather than heuristic or experience-based rules that prior methods mostly rely on. As a result, our method can complete reconstruction even if the camera fails to be tracked due to discontinuous camera motions, such as kidnap events, when conventional systems need to backtrack the scene.
Bibliographical noteFunding Information:
Manuscript received March 10, 2020; accepted July 9, 2020. Date of publication September 25, 2020; date of current version October 7, 2020. This letter was recommended for publication by Associate Editor L. Paull and Editor S. Behnke upon evaluation of the Reviewers’ comments. This work was supported in part by the ITRC/IITP Program (IITP-2020-0-01460), and in part by the NRF (2018R1A6A3A11049832 and 2017R1A2B3012701) in South Korea. (Corresponding author: Young J. Kim.) The authors are with the Department of Computer Science and Engineering, Ewha Womans University, Seoul 03760, South Korea (e-mail: email@example.com; firstname.lastname@example.org).
© 2016 IEEE.
- RGB-D Perception
- and SLAM