View interpolation for video see-through head-mounted display

Chun Jui Lai; Ping Hsuan Han; Yi Ping Hung

doi:10.1145/2945078.2945135

View interpolation for video see-through head-mounted display

Chun Jui Lai
, Ping Hsuan Han
, Yi Ping Hung

Department of Interaction Design

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

2 Scopus citations

Abstract

By using the head-mounted display (HMD), we can have an immersive virtual reality experience. But the user cannot see any information from the real world. To solve the problem, video seethrough HMD can acquire images from real environment, and present into the HMD, then, we could build a mixed reality (MR) or augmented reality (AR) system. However, how to append and calibrate cameras on HMD for recovering real environment is still a research issue. HTC VIVE has a single camera in front of its device. [Steptoe et al. 2014] and OVRVISION Pro proposed to append dual cameras to capture left and right images. Due to the difference of viewpoint, images captured by cameras are different to what human eyes see (figure 2). Although we could recover true 3D information with a depth map, there are still some occlusion areas that we cannot recover by single camera. Therefore, multiple cameras with different positions could complement each other for reducing occlusion areas. In this work, four configurations are simulated with a synthesized scene.

Original language	English
Title of host publication	SIGGRAPH 2016 - ACM SIGGRAPH 2016 Posters
Publisher	Association for Computing Machinery, Inc
ISBN (Electronic)	9781450343718
DOIs	https://doi.org/10.1145/2945078.2945135
State	Published - 24 Jul 2016
Event	ACM International Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 2016 - Anaheim, United States Duration: 24 Jul 2016 → 28 Jul 2016

Publication series

Name	SIGGRAPH 2016 - ACM SIGGRAPH 2016 Posters

Conference

Conference	ACM International Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 2016
Country/Territory	United States
City	Anaheim
Period	24/07/16 → 28/07/16

Bibliographical note

Funding Information:
This work was supported in part by the Ministry of Science and Technology, National Taiwan University, and Intel Corporation under Grants MOST 105-2633-E-002-001 and NTU-105R104045, and by the Ministry of Science and Technology under Grants MOST 104-2627-E-002-001.

Keywords

Depth image-based rendering (DIBR)
Video see-through
View interpolation

Access to Document

10.1145/2945078.2945135

Cite this

@inproceedings{8445e7ddb6434287ba1fd06e29130fa6,

title = "View interpolation for video see-through head-mounted display",

abstract = "By using the head-mounted display (HMD), we can have an immersive virtual reality experience. But the user cannot see any information from the real world. To solve the problem, video seethrough HMD can acquire images from real environment, and present into the HMD, then, we could build a mixed reality (MR) or augmented reality (AR) system. However, how to append and calibrate cameras on HMD for recovering real environment is still a research issue. HTC VIVE has a single camera in front of its device. [Steptoe et al. 2014] and OVRVISION Pro proposed to append dual cameras to capture left and right images. Due to the difference of viewpoint, images captured by cameras are different to what human eyes see (figure 2). Although we could recover true 3D information with a depth map, there are still some occlusion areas that we cannot recover by single camera. Therefore, multiple cameras with different positions could complement each other for reducing occlusion areas. In this work, four configurations are simulated with a synthesized scene.",

keywords = "Depth image-based rendering (DIBR), Video see-through, View interpolation",

author = "Lai, \{Chun Jui\} and Han, \{Ping Hsuan\} and Hung, \{Yi Ping\}",

note = "Funding Information: This work was supported in part by the Ministry of Science and Technology, National Taiwan University, and Intel Corporation under Grants MOST 105-2633-E-002-001 and NTU-105R104045, and by the Ministry of Science and Technology under Grants MOST 104-2627-E-002-001.; ACM International Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 2016 ; Conference date: 24-07-2016 Through 28-07-2016",

year = "2016",

month = jul,

day = "24",

doi = "10.1145/2945078.2945135",

language = "???core.languages.en\_GB???",

series = "SIGGRAPH 2016 - ACM SIGGRAPH 2016 Posters",

publisher = "Association for Computing Machinery, Inc",

booktitle = "SIGGRAPH 2016 - ACM SIGGRAPH 2016 Posters",

}

Lai, CJ, Han, PH & Hung, YP 2016, View interpolation for video see-through head-mounted display. in SIGGRAPH 2016 - ACM SIGGRAPH 2016 Posters., a57, SIGGRAPH 2016 - ACM SIGGRAPH 2016 Posters, Association for Computing Machinery, Inc, ACM International Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 2016, Anaheim, United States, 24/07/16. https://doi.org/10.1145/2945078.2945135

TY - GEN

T1 - View interpolation for video see-through head-mounted display

AU - Lai, Chun Jui

AU - Han, Ping Hsuan

AU - Hung, Yi Ping

N1 - Funding Information: This work was supported in part by the Ministry of Science and Technology, National Taiwan University, and Intel Corporation under Grants MOST 105-2633-E-002-001 and NTU-105R104045, and by the Ministry of Science and Technology under Grants MOST 104-2627-E-002-001.

PY - 2016/7/24

Y1 - 2016/7/24

N2 - By using the head-mounted display (HMD), we can have an immersive virtual reality experience. But the user cannot see any information from the real world. To solve the problem, video seethrough HMD can acquire images from real environment, and present into the HMD, then, we could build a mixed reality (MR) or augmented reality (AR) system. However, how to append and calibrate cameras on HMD for recovering real environment is still a research issue. HTC VIVE has a single camera in front of its device. [Steptoe et al. 2014] and OVRVISION Pro proposed to append dual cameras to capture left and right images. Due to the difference of viewpoint, images captured by cameras are different to what human eyes see (figure 2). Although we could recover true 3D information with a depth map, there are still some occlusion areas that we cannot recover by single camera. Therefore, multiple cameras with different positions could complement each other for reducing occlusion areas. In this work, four configurations are simulated with a synthesized scene.

AB - By using the head-mounted display (HMD), we can have an immersive virtual reality experience. But the user cannot see any information from the real world. To solve the problem, video seethrough HMD can acquire images from real environment, and present into the HMD, then, we could build a mixed reality (MR) or augmented reality (AR) system. However, how to append and calibrate cameras on HMD for recovering real environment is still a research issue. HTC VIVE has a single camera in front of its device. [Steptoe et al. 2014] and OVRVISION Pro proposed to append dual cameras to capture left and right images. Due to the difference of viewpoint, images captured by cameras are different to what human eyes see (figure 2). Although we could recover true 3D information with a depth map, there are still some occlusion areas that we cannot recover by single camera. Therefore, multiple cameras with different positions could complement each other for reducing occlusion areas. In this work, four configurations are simulated with a synthesized scene.

KW - Depth image-based rendering (DIBR)

KW - Video see-through

KW - View interpolation

UR - https://www.scopus.com/pages/publications/84985905193

U2 - 10.1145/2945078.2945135

DO - 10.1145/2945078.2945135

M3 - ???researchoutput.researchoutputtypes.contributiontobookanthology.conference???

AN - SCOPUS:84985905193

T3 - SIGGRAPH 2016 - ACM SIGGRAPH 2016 Posters

BT - SIGGRAPH 2016 - ACM SIGGRAPH 2016 Posters

PB - Association for Computing Machinery, Inc

T2 - ACM International Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 2016

Y2 - 24 July 2016 through 28 July 2016

ER -

View interpolation for video see-through head-mounted display

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this