T. Walker, J. Shavlik & R. Maclin (2004).
Relational Reinforcement Learning via Sampling the Space of First-Order Conjunctive Features. Proceedings of the ICML Workshop on Relational Reinforcement Learning, Banff, Canada.

This publication is available in PDF and available in Microsoft Word.

Abstract:

We propose a novel method for reinforcement learning in domains that are best described using relational (first-order) features. Our approach is to rapidly sample a large space of such features, selecting a good subset to use as the basis for our Q-function. Our Q-function is created via a regression model that combines the collection of first-order features into a single prediction. To control the effect of the random predictions we use an ensemble approach for our predictions, generating multiple Q-function models and then combining the results of these models into a single prediction. Experiments with our technique on an interesting reinforcement learning problem, the Keep-Away subtask of RoboCup, suggest that our method can learn to effectively predict Q-values for a challenging reinforcement-learning task.

Return to the publications of the Univ. of Wisconsin Machine Learning Research Group.