TY - JOUR
T1 - Manipulable cone based bare hand object selection in high occlusion virtual environment
AU - Zhou, Jiaqi
AU - Wu, Jian
AU - Im, Sio Kei
AU - Fan, Runze
AU - Wang, Lili
N1 - Publisher Copyright:
© 2024 Elsevier Ltd
PY - 2025/2
Y1 - 2025/2
N2 - We propose a manipulable cone based bare hand object selection method in a high occlusion virtual environment. First, a new concept of the manipulable cone is introduced, which can be used to control the manipulable cone to remove the occlusion before the target object. Next, we propose its construction and manipulation methods. It includes initialization and manipulation of its motion using the bare hand. Finally, a bare hand interaction design based on manipulable cones for object selection is proposed. The user does not need a handheld device and can realize the task of object selection using only his/her hands. During the selection process, three gestures, and five states are defined, allowing the user to use the three gestures to smoothly switch between the five states and complete the selection task. We designed two user studies to evaluate the efficiency, utility, and adaptability of our method. The results proved that our method significantly reduces task completion time, total rotations, total translations, error rate, task load, and Simulator Sickness Questionnaire (SSQ) scores in high occlusion environments compared to existing state-of-the-art (SOTA) bare hand methods, and also significantly improves the User Experience Questionnaire (UEQ) score and performance ranking.
AB - We propose a manipulable cone based bare hand object selection method in a high occlusion virtual environment. First, a new concept of the manipulable cone is introduced, which can be used to control the manipulable cone to remove the occlusion before the target object. Next, we propose its construction and manipulation methods. It includes initialization and manipulation of its motion using the bare hand. Finally, a bare hand interaction design based on manipulable cones for object selection is proposed. The user does not need a handheld device and can realize the task of object selection using only his/her hands. During the selection process, three gestures, and five states are defined, allowing the user to use the three gestures to smoothly switch between the five states and complete the selection task. We designed two user studies to evaluate the efficiency, utility, and adaptability of our method. The results proved that our method significantly reduces task completion time, total rotations, total translations, error rate, task load, and Simulator Sickness Questionnaire (SSQ) scores in high occlusion environments compared to existing state-of-the-art (SOTA) bare hand methods, and also significantly improves the User Experience Questionnaire (UEQ) score and performance ranking.
KW - Bare hand
KW - High occlusion scene
KW - Interaction design
KW - Object selection
KW - Virtual reality
UR - http://www.scopus.com/inward/record.url?scp=85212417632&partnerID=8YFLogxK
U2 - 10.1016/j.ijhcs.2024.103432
DO - 10.1016/j.ijhcs.2024.103432
M3 - Article
AN - SCOPUS:85212417632
SN - 1071-5819
VL - 196
JO - International Journal of Human Computer Studies
JF - International Journal of Human Computer Studies
M1 - 103432
ER -