Scene Transformer: Automatic Transformation from Real Scene to Virtual Scene

Runze Fan, Lili Wang, Chan Tong Lam, Wei Ke

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Given a real scene and a virtual scene, the indoor scene transformation problem is defined as transforming the layout of the input virtual scene. The transformed layout preserves as much as possible the relationship between the furniture in the input virtual scene, and the input real scene provides the user with as much passive haptic as possible when exploring the virtual scene. We propose a real-scene-constrained deep scene transformer to solve this problem. First, we introduce the deep scene matching network to predict the matching relationship between real furniture and virtual furniture. Then we introduce a layout refinement algorithm based on the refinement parameter network to arrange the matched virtual furniture into the new virtual scene. At last, we introduce a deep scene generating network to arrange the unmatched virtual furniture into the new virtual scene.

Original languageEnglish
Title of host publicationProceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages885-886
Number of pages2
ISBN (Electronic)9798350348392
DOIs
Publication statusPublished - 2023
Event2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023 - Shanghai, China
Duration: 25 Mar 202329 Mar 2023

Publication series

NameProceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023

Conference

Conference2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023
Country/TerritoryChina
CityShanghai
Period25/03/2329/03/23

Keywords

  • Computer graphics
  • Computing methodologies
  • Graphics systems and interfaces
  • Mixed / augmented reality

Fingerprint

Dive into the research topics of 'Scene Transformer: Automatic Transformation from Real Scene to Virtual Scene'. Together they form a unique fingerprint.

Cite this