Light Field Depth Estimation for Non-Lambertian Objects via Adaptive Cross Operator

Zhenglong Cui, Hao Sheng, Da Yang, Sizhe Wang, Rongshan Chen, Wei Ke

研究成果: Article同行評審

13 引文 斯高帕斯(Scopus)

摘要

Light field (LF) depth estimation is a crucial basis for LF-related applications. Most existing methods are based on the Lambertian assumption and cannot deal with non-Lambertian surfaces represented by transparent objects and mirrors. In this paper, we propose a novel Adaptive-Cross-Operator-based(ACO) depth estimation algorithm for non-Lambertian LF. By analyzing the imaging characteristics of non-Lambertian regions, it is found that the difficulty of depth estimation lies in the photo inconsistency of the center view. Combining with the two-branch structure, we propose ACO with an inter-branch cooperation strategy to adaptively separate depth information with different reflectance coefficients. We discover that the bimodal distribution feature of the operator filtering results can assist in the separation of multi-layer scene information. The first detection branch filters the EPI and implicitly records the severity of multi-layer scene aliasing. According to the identification of bimodal distribution features, the non-Lambertian regions are marked out and the depth of the foreground is estimated. The second branch receives guidance from the first to dynamically adjust the inner weight and infer the background's depth after weakening the interference from the foreground. Finally, the depth information separation of multi-layer scenes is achieved by extracting the unique X-shaped linear structure. Without the reflection coefficients of the non-Lambertian object, the proposed method can produce high-quality depth estimation under the transparency of 90% to 20%. Experimental results show that the proposed ACO outperforms state-of-the-art LF depth estimation methods in terms of accuracy and robustness.

原文English
頁(從 - 到)1199-1211
頁數13
期刊IEEE Transactions on Circuits and Systems for Video Technology
34
發行號2
DOIs
出版狀態Published - 1 2月 2024

指紋

深入研究「Light Field Depth Estimation for Non-Lambertian Objects via Adaptive Cross Operator」主題。共同形成了獨特的指紋。

引用此