Analyzing the Subspace Structure of Related Images: Concurrent Segmentation of Image Sets

Lopamudra Mukherjee Vikas Singh     Jia Xu     Maxwell D. Collins

University of Wisconsin-Whitewater

University of Wisconsin-Madison

6600.jpg 1600.jpg 3500.jpg
6600_label.jpg 1600_label.jpg 3500_label.jpg


We develop new algorithms to analyze and exploit the joint subspace structure of a set of related images to facilitate the process of concurrent segmentation of a large set of images. Most existing approaches for this problem are either limited to extracting a single similar object across the given image set or do not scale well to a large number of images containing multiple objects varying at different scales. One of the goals of this paper is to show that various desirable properties of such an algorithm (ability to handle multiple images with multiple objects showing arbitary scale variations) can be cast elegantly using simple constructs from linear algebra: this significantly extends the operating range of such methods. While intuitive, this formulation leads to a hard optimization problem where one must perform the image segmentation task together with appropriate constraints which enforce desired algebraic regularity (e.g., common subspace structure). We propose efficient iterative algorithms (with small computational requirements) whose key steps reduce to objective functions solvable by max-flow and/or nearly closed form identities. We study the qualitative, theoretical, and empirical properties of the method, and present results on benchmark datasets.


  • Lopamudra Mukherjee, Vikas Singh, Jia Xu, Maxwell D. Collins. Analyzing the Subspace Structure of Related Images: Concurrent Segmentation of Image Sets. In European Conference on Computer Vision (ECCV), October 2012. PDF, Poster, Bibtex.

  • Acknowledgments

    This work is supported via NIH R21AG034315, NSF RI 1116584, NSF CGV 1219016, UW-ICTR and W-ADRC. M.D.C. was supported by the UW CIBM Program.