Vremiere: In-headset Virtual Reality Video Editing
Cuong Nguyen1, Stephen DiVerdi2, Aaron Hertzmann2, and Feng Liu1
1Computer Science Department, Portland State University
2Adobe Research
Abstract

Creative professionals are creating Virtual Reality (VR) experiences today by capturing spherical videos, but video editing is still done primarily in traditional 2D desktop GUI applications such as Premiere. These interfaces provide limited capabilities for previewing content in a VR headset or for directly manipulating the spherical video in an intuitive way. As a result, editors must alternate between editing on the desktop and previewing in the headset, which is tedious and interrupts the creative process. We demonstrate an application that enables a user to directly edit spherical video while fully immersed in a VR headset. We first interviewed professional VR filmmakers to understand current practice and derived a suitable workflow for in-headset VR video editing. We then developed a prototype system implementing this new workflow. Our system is built upon a familiar timeline design, but is enhanced with custom widgets to enable intuitive editing of spherical video inside the headset. We conducted an expert review study and found that with our prototype, experts were able to edit videos entirely within the headset. Experts also found our interface and widgets useful, providing intuitive controls for their editing needs.

Paper
Cuong Nguyen, Stephen DiVerdi, Aaron Hertzmann, and Feng Liu. Vremiere: In-headset Virtual Reality Video Editing
ACM CHI 2017. PDF  (best paper honorable mention award)

Project CloverVR is based on this work. Watch live demo at Adobe Max 2016.
Incorporated into Immersive 360° editing in Adobe Creative Cloud
Demo Video 
Acknowledgment
This video uses images from Youtube users TOYO TIRE JAPAN, KarmaComaStudio, and AB Smith under a Creative Common license. This work was supported in part by NSF IIS-1321119.
Related projects
Cuong Nguyen and Feng Liu. Gaze-based Notetaking for Learning from Lecture Videos
ACM CHI 2016. PDF  

Cuong Nguyen, Wu-chi Feng, and Feng Liu. Hotspot: Making Computer Vision More Effective for Human Video Surveillance
Information Visualization, 2016. PDF  

Cuong Nguyen and Feng Liu. Making Software Tutorial Video Responsive
ACM CHI 2015. PDF  (Best Paper Honorable Mention Award)

Cuong Nguyen, Yuzhen Niu, and Feng Liu. Direct Manipulation Video Navigation on Touch Screens
ACM MobileHCI 2014. PDF  

Cuong Nguyen, Yuzhen Niu, and Feng Liu. Direct Manipulation Video Navigation in 3D
ACM CHI 2013. PDF  (Best Paper Honorable Mention Award)

Cuong Nguyen, Yuzhen Niu, and Feng Liu. Video Summagator: An Interface for Video Summarization and Navigation
ACM CHI 2012. PDF