Multi-view Generation using High Resolution Stereoscopic Cameras and a Low Resolution Time-of-Flight Camera 


Vol. 37,  No. 4, pp. 239-249, Apr.  2012


PDF
  Abstract

Recently, the virtual view generation method using depth data is employed to support the advanced stereoscopic and auto-stereoscopic displays. Although depth data is invisible to user at 3D video rendering, its accuracy is very important since it determines the quality of generated virtual view image. Many works are related to such depth enhancement exploiting a time-of-flight (TOF) camera. In this paper, we propose a fast 3D scene capturing system using one TOF camera at center and two high-resolution cameras at both sides. Since we need two depth data for both color cameras, we obtain two views’ depth data from the center using the 3D warping technique. Holes in warped depth maps are filled by referring to the surrounded background depth values. In order to reduce mismatches of object boundaries between the depth and color images, we used the joint bilateral filter on the warped depth data. Finally, using two color images and depth maps, we generated 10 additional intermediate images. To realize fast capturing system, we implemented the proposed system using multi-threading technique. Experimental results show that the proposed capturing system captured two viewpoints’ color and depth videos in real-time and generated 10 additional views at 7 fps.

  Statistics
Cumulative Counts from November, 2022
Multiple requests among the same browser session are counted as one view. If you mouse over a chart, the values of data points will be shown.


  Cite this article

[IEEE Style]

C. Lee, H. Song, B. Choi, Y. Ho, "Multi-view Generation using High Resolution Stereoscopic Cameras and a Low Resolution Time-of-Flight Camera," The Journal of Korean Institute of Communications and Information Sciences, vol. 37, no. 4, pp. 239-249, 2012. DOI: .

[ACM Style]

Cheon Lee, Hyok Song, Byeongho Choi, and Yo-Sung Ho. 2012. Multi-view Generation using High Resolution Stereoscopic Cameras and a Low Resolution Time-of-Flight Camera. The Journal of Korean Institute of Communications and Information Sciences, 37, 4, (2012), 239-249. DOI: .

[KICS Style]

Cheon Lee, Hyok Song, Byeongho Choi, Yo-Sung Ho, "Multi-view Generation using High Resolution Stereoscopic Cameras and a Low Resolution Time-of-Flight Camera," The Journal of Korean Institute of Communications and Information Sciences, vol. 37, no. 4, pp. 239-249, 4. 2012.