L. Torrey, J. Shavlik, T. Walker & R. Maclin (2006).
Skill Acquisition via Transfer Learning and Advice Taking. Proceedings of the Seventeenth European Conference on Machine Learning (ECML'06), pp. 425-436, Berlin, Germany.
Slides (PPT). Code.

This publication is available in PDF.

The slides for this publication are available in Microsoft PowerPoint.

The software associated with this publication is available online.

Abstract:

We describe a reinforcement learning system that transfers skills from a previously learned source task to a related target task. The system uses inductive logic programming to analyze experience in the source task, and transfers rules for when to take actions. The target task learner accepts these rules through an advice-taking algorithm, which allows learners to benefit from outside guidance that may be imperfect. Our system accepts a human-provided mapping, which specifies the similarities between the source and target tasks and may also include advice about the differences between them. Using three tasks in the RoboCup simulated soccer domain, we demonstrate that this system can speed up reinforcement learning substantially.

Return to the publications of the Univ. of Wisconsin Machine Learning Research Group.