Direct Manipulation Video Navigation in 3D
1Cuong Nguyen, 1,2Yuzhen Niu, and 1Feng Liu
1Computer Science Department, Portland State University
2Computer Science Department, Fuzhou University
Abstract

Direct Manipulation Video Navigation (DMVN) systems allow a user to navigate a video by dragging an object along its motion trajectory. These systems have been shown effective for space-centric video browsing. Their performance, however, is often limited by temporal ambiguities in a video with complex motion, such as recurring motion, self-intersecting motion, and pauses. The ambiguities come from reducing the 3D spatial-temporal motion (x, y, t) to the 2D spatial motion (x, y) in visualizing the motion and dragging the object. In this paper, we present a 3D DMVN system that maps the spatial-temporal motion (x, y, t) to 3D space (x, y, z) by mapping time t to depth z, visualizes the motion and video frame in 3D, and allows to navigate the video by spatial-temporally manipulating the object in 3D.We show that since our 3D DMVN system preserves all the motion information, it resolves the temporal ambiguities and supports intuitive video navigation on challenging videos with complex motion.

Paper
Cuong Nguyen, Yuzhen Niu, and Feng Liu. Direct Manipulation Video Navigation in 3D
ACM CHI 2013. PDF  (Best Paper Honorable Mention Award)

Related project

Cuong Nguyen and Feng Liu. Gaze-based Notetaking for Learning from Lecture Videos
ACM CHI 2016. PDF

Cuong Nguyen, Wu-chi Feng, and Feng Liu. Hotspot: Making Computer Vision More Effective for Human Video Surveillance
Information Visualization, 2016. PDF  

Cuong Nguyen and Feng Liu. Making Software Tutorial Video Responsive
ACM CHI 2015. PDF (Best Paper Honorable Mention Award)

Cuong Nguyen, Yuzhen Niu, and Feng Liu. Direct Manipulation Video Navigation on Touch Screens
ACM MobileHCI 2014. PDF  

Cuong Nguyen, Yuzhen Niu, and Feng Liu. Video Summagator: An Interface for Video Summarization and Navigation
ACM CHI 2012. PDF  
Demo Video 
Acknowledgment
The videos from YouTube users, including willkempartschool, depro9, SwingStepTv, mahj, MSPDawgs, purefixcycles, and  TheTtianT1 are used under a Creative Commons license. This video was narrated by James Moran. This work was supported by NSF CNS-1205746 and CNS-1218589.