G. Kunapuli & J. Shavlik (2012).
Mirror Descent for Metric Learning: A Unified Approach. Proceedings of the European Conference on Machine Learning (ECML).
Poster (PDF). Slides (PDF).

This publication is contained in the following 3 PDF files
File 1, File 2, File 3.

Abstract:

Most metric learning methods are characterized by diverse loss functions and projection methods, which naturally begs the question: is there a wider framework that can generalize many of these methods? In addition, ever persistent issues are those of scalability to large data sets and the question of kernelizability. We propose a unified approach to Mahalanobis metric learning: an online regularized metric learning algorithm based on the ideas of composite objective mirror descent (comid). The metric learning problem is formulated as a regularized positive semidefinite matrix learning problem, whose update rules can be derived using the comid framework. This approach aims to be scalable, kernelizable, and admissible to many different types of Bregman and loss functions, which allows for the tailoring of several different classes of algorithms. The most novel contribution is the use of the trace norm, which yields a sparse metric in its eigenspectrum, thus simultaneously performing feature selection along with metric learning.

Return to the publications of the Univ. of Wisconsin Machine Learning Research Group.