G. Kunapuli, K.P. Bennett, A. Shabbeer, R. Maclin & J. Shavlik (2010).
Online Knowledge-Based Support Vector Machines. Proceedings of the European Conference on Machine Learning (ECML 2010), Barcelona, Spain.
Slides (PDF).

This publication is contained in the following 2 PDF files
File 1, File 2
.

The slides for this publication are available in Microsoft PowerPoint.

Abstract:

Prior knowledge, in the form of simple advice rules, can greatly speed up convergence in learning algorithms. Online learning methods predict the label of the current point and then receive the correct label (and learn from that information). The goal of this work is to update the hypothesis taking into account not just the label feedback, but also the prior knowledge, in the form of soft polyhedral advice, so as to make increasingly accurate predictions on subsequent examples. Advice helps speed up and bias learning so that generalization can be obtained with less data. Our passive-aggressive approach updates the hypothesis using a hybrid loss that takes into account the margins of both the hypothesis and the advice on the current point. Encouraging computational results and loss bounds are provided.

Return to the publications of the Univ. of Wisconsin Machine Learning Research Group.