R. Maclin, J. Shavlik, T. Walker & L. Torrey (2006).
A Simple and Effective Method for Incorporating Advice into Kernel Methods. Proceedings of the Twenty-First National Conference on Artificial Intelligence (AAAI'06), Boston, MA.
Slides (PPT).

This publication is available in PDF.

The slides for this publication are available in Microsoft PowerPoint.

Abstract:

We propose a simple mechanism for incorporating advice (prior knowledge), in the form of simple rules, into support-vector methods for both classification and regression. Our approach is based on introducing inequality constraints associated with datapoints that match the advice. These constrained datapoints can be standard examples in the training set, but can also be unlabeled data in a semi-supervised, advice-taking approach. Our new approach is simpler to implement and more efficiently solved than the knowledge-based support vector classification methods of Fung, Mangasarian and Shavlik (2002; 2003) and the knowledge-based support vector regression method of Mangasarian, Shavlik, and Wild (2004), while performing approximately as well as these more complex approaches. Experiments using our new approach on a synthetic task and a reinforcementlearning problem within the RoboCup soccer simulator show that our advice-taking method can significantly outperform a method without advice and perform similarly to prior advice-taking, support-vector machines.

Return to the publications of the Univ. of Wisconsin Machine Learning Research Group.