Joint Subspace Stabilization for Stereoscopic Video

Feng Liu1, Yuzhen Niu1,2,and Hailin Jin3

1Computer Science Department, Portland State University
 2Computer Sciences Department, Fuzhou University
3Adobe Systems Inc.
Abstract

Shaky stereoscopic video is not only unpleasant to watch but may also cause 3D fatigue. Stabilizing the left and right view of a stereoscopic video separately using a monocular stabilization method tends to both introduce undesirable vertical disparities and damage horizontal disparities, which may destroy the stereoscopic viewing experience. In this paper, we present a joint subspace stabilization method for stereoscopic video. We prove that the low-rank subspace constraint for monocular video [10] also holds for stereoscopic video. Particularly, the feature trajectories from the left and right video share the same subspace. Based on this proof, we develop a stereo subspace stabilization method that jointly computes a common subspace from the left and right video and uses it to stabilize the two videos simultaneously. Our method meets the stereoscopic constraints without 3D reconstruction or explicit left-right correspondence. We test our method on a variety of stereoscopic videos with different scene content and camera motion. The experiments show that our method achieves high-quality stabilization for stereoscopic video in a robust and efficient way.

Paper
Feng Liu, Yuzhen Niu and Hailin Jin. Joint Subspace Stabilization for Stereoscopic Video
IEEE ICCV 2013. PDF  
Related Projects
Chengzhou Tang, Oliver Wang, Feng Liu, Ping Tan. Joint Direction and Stabilization for 360° Videos.
ACM Transactions on Graphics, 2019.  PDF
Feng Liu, Michael Gleicher, Jue Wang, Hailin Jin and Aseem Agarwala. Subspace Video Stabilization
ACM Transactions on Graphics (presented at SIGGRAPH 2011). Vol. 30, Issue 1, 2011: 4:1-4:10.  PDF  Website
Feng Liu, Michael Gleicher, Hailin Jin and Aseem Agarwala. Content-Preserving Warps for 3D Video Stabilization. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2009), 2009. PDF Website
Yu-Shuen Wang, Feng Liu, Pu-Sheng Hsu, and Tong-Yee Lee. Spatially and Temporally Optimized Video Stabilization.
IEEE Transactions on Visualization and Computer Graphics, 2013. Video Website
Michael Gleicher and Feng Liu. Re-cinematography: Improving the Camerawork of Casual Video. ACM Transactions on Multimedia Computing, Communications, and Applications. Vol. 5, Issue 1, Oct. 2008:1-28. PDF Website
Demo Video 

Supplementary Videos
Acknowledgment
The video "It's a Small World" is used from Youtube user lelandv1969 under a Creative Commons license. This work was supported in part by NSF grants IIS-1321119, CNS-1218589, and CNS-1205746. This video was narrated by Will Landecker.