Noise-resilient reconstruction of panoramas and 3D scenes using robot-mounted unsynchronized commodity RGB-D cameras

Yang, Sheng, Li, Beichen, Cao, Yan-Pei, Fu, Hongbo, Lai, Yu-kun ORCID: https://orcid.org/0000-0002-2094-5680, Kobbelt, Leif and Hu, Shi-Min ORCID: https://orcid.org/0000-0001-7507-6542 2020. Noise-resilient reconstruction of panoramas and 3D scenes using robot-mounted unsynchronized commodity RGB-D cameras. ACM Transactions on Graphics 39 (5) , 152. 10.1145/3389412

Preview

PDF - Accepted Post-Print Version Download (10MB) | Preview

Abstract

We present a two-stage approach to first constructing 3D panoramas and then stitching them for noise-resilient reconstruction of large-scale indoor scenes. Our approach requires multiple unsynchronized RGB-D cameras, mounted on a robot platform, which can perform in-place rotations at different locations in a scene. Such cameras rotate on a common (but unknown) axis, which provides a novel perspective for coping with unsynchronized cameras, without requiring sufficient overlap of their Field-of-View (FoV). Based on this key observation, we propose novel algorithms to track these cameras simultaneously. Furthermore, during the integration of raw frames onto an equirectangular panorama, we derive uncertainty estimates from multiple measurements assigned to the same pixels. This enables us to appropriately model the sensing noise and consider its influence, so as to achieve better noise resilience, and improve the geometric quality of each panorama and the accuracy of global inter-panorama registration. We evaluate and demonstrate the performance of our proposed method for enhancing the geometric quality of scene reconstruction from both real-world and synthetic scans.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Computer Science & Informatics
Publisher:	Association for Computing Machinery (ACM)
ISSN:	0730-0301
Date of First Compliant Deposit:	30 March 2020
Date of Acceptance:	4 March 2020
Last Modified:	07 Nov 2023 03:37
URI:	https://orca.cardiff.ac.uk/id/eprint/130657

Citation Data

Cited 5 times in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item