Please use this identifier to cite or link to this item:
Scopus Web of Science® Altmetric
Type: Journal article
Title: Auto-Rectify Network for Unsupervised Indoor Depth Estimation
Author: Bian, J.W.
Zhan, H.
Wang, N.
Chin, T.J.
Shen, C.
Reid, I.
Citation: IEEE Transactions on Pattern Analysis and Machine Intelligence, 2021; 44(12)
Publisher: Institute of Electrical and Electronics Engineers (IEEE)
Issue Date: 2021
ISSN: 0162-8828
Statement of
Jia-Wang Bian, Huangying Zhan, Naiyan Wang, Tat-Jun Chin, Chunhua Shen, and Ian Reid
Abstract: Single-View depth estimation using the CNNs trained from unlabelled videos has shown significant promise. However, excellent results have mostly been obtained in street-scene driving scenarios, and such methods often fail in other settings, particularly indoor videos taken by handheld devices. In this work,we establish that the complex ego-motions exhibited in handheld settings are a critical obstacle for learning depth. Our fundamental analysis suggests that the rotation behaves as noise during training, as opposed to the translation (baseline) which provides supervision signals. To address the challenge, we propose a data pre-processing method that rectifies training images by removing their relative rotations for effective learning. The significantly improved performance validates our motivation. Towards end-to-end learning without requiring pre-processing, we propose an Auto-Rectify Network with novel loss functions, which can automatically learn to rectify images during training. Consequently, our results out perform the previous unsupervised SOTA method by a large margin on the challenging NYUv2 dataset.We also demonstrate the generalization of our trained model in ScanNet and Make3D, and the universality of our proposed learning method on 7-Scenes and KITTI datasets.
Keywords: Single-view depth estimation; unsupervised learning; image rectification
Rights: © 2021 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.
DOI: 10.1109/TPAMI.2021.3136220
Grant ID:
Appears in Collections:Computer Science publications

Files in This Item:
There are no files associated with this item.

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.