Random Walks based Multi-Image Segmentation: Quasiconvexity Results and GPU-based Solutions
Maxwell D. Collins, Jia Xu, Leo Grady, Vikas Singh, "Random Walks based Multi-Image Segmentation: Quasiconvexity Results and GPU-based Solutions", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2012.
- Matlab/CPLEX implementation
- boxopt: Box-constrained optimization with CUDA
- Android Demo: "Gamified" demo of RWCoseg. Written to run on the ASUS TF101 Tablet, may not work well on other devices.
We recast the Cosegmentation problem using Random Walker (RW) segmentation as the core segmentation algorithm, rather than the traditional MRF approach adopted in the literature so far. Our formulation is similar to previous approaches in the sense that it also permits Cosegmentation constraints (which impose consistency between the extracted objects from ≥ 2 images) using a nonparametric model. However, several previous nonparametric cosegmentation methods have the serious limitation that they require adding one auxiliary node (or variable) for every pair of pixels that are similar (which effectively limits such methods to describing only those objects that have high entropy appearance models). In contrast, our proposed model completely eliminates this restrictive dependence — the resulting improvements are quite significant. Our model further allows an optimization scheme exploiting quasiconvexity for model-based segmentation with no dependence on the scale of the segmented foreground. Finally, we show that the optimization can be expressed in terms of linear algebra operations on sparse matrices which are easily mapped to GPU architecture. We provide a highly specialized CUDA library for Cosegmentation exploiting this special structure, and report experimental results showing these advantages.
- Funding: NIH 5R21AG034315-02, NSF 1116584, UW ICTR 1UL1RR025011, NIH CTSA 1UL1RR02501, NIH 5P50AG033514 via W-ADRC, NLM 5T15LM007359 via CIBM