Mitigating Object Dependencies: Improving Point Cloud Self-Supervised Learning Through Object Exchange

Yanhao Wu, Tong Zhang, Wei Ke, Congpei Qiu, Sabine Susstrunk, Mathieu Salzmann

研究成果: Conference contribution同行評審

2 引文 斯高帕斯(Scopus)

摘要

In the realm of point cloud scene understanding, particularly in indoor scenes, objects are arranged following human habits, resulting in objects of certain semantics being closely positioned and displaying notable inter-object cor-relations. This can create a tendency for neural networks to exploit these strong dependencies, bypassing the individ-ual object patterns. To address this challenge, we introduce a novel self-supervised learning (SSL) strategy. Our approach leverages both object patterns and contextual cues to produce robust features. It begins with the formulation of an object-exchanging strategy, where pairs of objects with comparable sizes are exchanged across different scenes, effectively disentangling the strong contextual dependencies. Subsequently, we introduce a context-aware feature learning strategy, which encodes object patterns without relying on their specific context by aggregating object features across various scenes. Our extensive experiments demonstrate the superiority of our method over existing SSL techniques, further showing its better robustness to environmental changes. Moreover, we showcase the applicability of our approach by transferring pre-trained models to diverse point cloud datasets.Our code is available at https:/lgithub.com/YanhaoWu/OESSL

原文English
主出版物標題Proceedings - 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2024
發行者IEEE Computer Society
頁面23052-23061
頁數10
ISBN(電子)9798350353006
DOIs
出版狀態Published - 2024
對外發佈
事件2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2024 - Seattle, United States
持續時間: 16 6月 202422 6月 2024

出版系列

名字Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
ISSN(列印)1063-6919

Conference

Conference2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2024
國家/地區United States
城市Seattle
期間16/06/2422/06/24

指紋

深入研究「Mitigating Object Dependencies: Improving Point Cloud Self-Supervised Learning Through Object Exchange」主題。共同形成了獨特的指紋。

引用此