A Virtual TV System Using Head-mounted Display with Stereo Camera
Authors: Ryo HARASHIMA, Yue BAO
Number of views: 213
This paper propose a system to provide 3D display with unlimited parallax and display virtual TV as if real TV is put by HMD. By this system, the user is able to watch TV naturally by preventing which the moving of the virtual TV follows in the moving of head.
In addition, motion parallax depending on movement is expressed without visual area restriction. The system is comprised of HMD and two Web cameras. Two Web cameras are attached to get surrounding scene. At first, an observer determines a characteristic point in the 3D image from the two cameras to set the virtual TV. The screen size of the virtual TV is set in the distance to the point calculated by triangulation using two cameras. The point is tracked by the phase correlation about anteroposterior consecutive frames.
Parallax pictures are made to correspond to right side image and left side image with a size suitable for the distance. The virtual TV is displayed at the point in the input image. Two experiments were conducted to evaluate the performance of the proposal system. The experiment 1 is a experiment to evaluate image showed by virtual TV by subjects. In the experiment 2, the subjects observed two virtual cubes to confirm motion parallax. As a result, virtual TV position was fixed to the real space like the real TV and expression of the natural motion parallax was enabled by proposal system.
Keywords- Head-Mounted Display; Phase Only Correlation; Virtual TV; Mixed Reality; Motion Parallax; Stereo Camera.