ZCS and TCS learning classifier system controllers on real robots

Hurst, J., Bull, L. and Melhuish, C. (2002) ZCS and TCS learning classifier system controllers on real robots. UWE Learning Classifier Systems Group Technical Report 02 (2). Available from: http://eprints.uwe.ac.uk/20749

Full text not available from this repository

Publisher's URL: http://www.cems.uwe.ac.uk

Abstract/Description

To date there has only been one implementation of Holland's Learning Classifier System (LCS) on real robots. In this paper the use of Wilson's ZCS system is described for an obstacle avoidance task. Although the task is simple it does present some advances and change of emphasis over the previous LCS robotic implementation. The controller model is "event" based. Instead of the robot being assigned fixed length actions, continuous actions are taken. These actions are taken until an "event" occurs. An event can be thought of as a change of state. This division of the world into states is usually part of the problem description, and to do this automatically is currently one of the challenges facing machine learning. The paper then introduces TCS, a form of ZCS that attempts to address this issue. LCS have the ability to generalise over the state action-space. In TCS this generalisation ability can also be used to determine the extent of this space. TCS also implements components from SMDP reinforcement learning theory to weight the influence of time on the reward functions of the LCS. A simple light-seeking task on the robot platform using TCS is presented which demonstrates desirable adaptive characteristics for the use of LCS on real robots.

Item Type:Article
Uncontrolled Keywords:ZCS, TCS, learning classifier, system controllers, robotics, real robots
Faculty/Department:Faculty of Environment and Technology > Department of Computer Science and Creative Technologies
ID Code:20749
Deposited By: M. Clarke
Deposited On:12 Jul 2013 10:54
Last Modified:12 Apr 2016 13:07

Request a change to this item