Department of Systems and Computer Engineering
Ottawa, Canada

Dr. Howard Schwartz: Publication Abstract

Publication: Sidney N. Givigi Jr.,  Howard M. Schwartz and Xiaosong Lu   "A Reinforcement Learning Adaptive Fuzzy Controller for Differential Games"
Abstract: In this paper we develop a reinforcement fuzzy learning scheme for robots playing a differential game. Differential games are games played in continuous time, with continuous states and actions. Fuzzy controllers are used to approximate the calculation of future reinforcements of the game due to actions taken at a specific time. If an immediate reinforcement reward function is defined, we may use a fuzzy system to tell what is the predicted reinforcement in a specified time ahead. This reinforcement is then used to adapt a fuzzy controller that stores the experience accumulated by the player. Simulations of a modified two car game are provided in order to show the potentiality of the technique. Experimental results are done in order to validate the method. Finally, it should be noted that although the game used as an example involves only two players, the technique may be also used in a multi-player game environment. PDF
Keywords: Adaptive Control, Robot Control, Nonlinear Output Feedback Control.