欢迎访问中国科学院大学学报,今天是
综述

一种基于强化学习的在线神经模糊控制系统

  • 李佳宁 ,
  • 易建强 ,
  • 赵冬斌 ,
  • 西广成
展开
  • 中国科学院自动化研究所复杂系统与智能科学实验室, 北京 100080

收稿日期: 2004-10-20

  修回日期: 2004-11-22

  网络出版日期: 2005-09-15

基金资助

国家973项目(2003CB517106);科技部国际科技合作重点项目(2004DFB02100)资助

Reinforcement-Learning-Based On-Line Neural-Fuzzy Control System

  • LI Jia-Ning ,
  • YI Jian-Qiang ,
  • ZHAO Dong-Bin ,
  • XI Guang-Cheng
Expand
  • Lab of Complex Systems and Intelligence Science, Institute of Automation, Chinese Academy of Sciences, Beijing 100080, China

Received date: 2004-10-20

  Revised date: 2004-11-22

  Online published: 2005-09-15

摘要

为了实现基于非训练数据的神经模糊控制器的在线学习,提出了一种基于强化学习的神经模糊控制系统和相应的学习算法.该控制系统由神经模糊预测器和神经模糊控制器两部分组成,其中,神经模糊控制器采用基于确定度的模糊规则模型作为知识表示形式的扩展型神经模糊网络.在学习算法的设计中,尝试了利用强化信号得到输入状态的“期望输出”,进而将强化学习转化为基于训练数据学习的解决思路.仿真实验验证了所提出的控制系统结构和学习算法的合理性和可行性.

本文引用格式

李佳宁 , 易建强 , 赵冬斌 , 西广成 . 一种基于强化学习的在线神经模糊控制系统[J]. 中国科学院大学学报, 2005 , 22(5) : 631 -638 . DOI: 10.7523/j.issn.2095-6134.2005.5.013

Abstract

To solve non-training data based on-line learning for neural-fuzzy controller, this paper proposes a reinforcement learning-based neural-fuzzy control system and the corresponding learning algorithm. This control system consists of a neural-fuzzy predictor and a neural-fuzzy controller. Based on fuzzy if then rules with certainty grades,the extended neural-fuzzy network proposed is used as the structure of the neural-fuzzy controller. In learning process of the control system, by using reinforcement signal to estimate the desired output of an input state, reinforcement learning is treated and solved according to training data-based learning algorithm. Computer simulations illustrate the rationality and applicability of the proposed control system and the learning algorithm.

参考文献

[1] Yan PF.Reinforcement learning —theory,algorithms and applications in intelligent control.Information and Control,1996,25 (1) :28~34 (inChinese with English abstract)

[2] Lin CT,Lee CSG.Reinforcement structurePparameter learning for neural2network2based fuzzy logic control systems.IEEE Transaction on Fuzzy Systems,1994,2 (1) : 46~63

[3] Lin CT,Kan MC.Adaptive fuzzy command acquisition with reinforcement learning.IEEE Transaction on Fuzzy Systems,1998,6 (1) : 102~121

[4] Ye C,Yung NHC,Wang DW.A fuzzy controller with supervised learning assisted reinforcement learning algorithm for obstacle avoidance.IEEETransaction on Systems,Man and Cybernetics2Part B,2003,33 (1) : 17~27

[5] Barto AG,Sutton RS,Anderson CW.Neuronlike adaptive elements that can solve difficult learning control problems.IEEE Transaction on Systems, Man and Cybernetics,1983,13 (5) : 834~846

[6] Ishibuchi H,Nozaki K,Tanaka H.Distributed representation of fuzzy rules and its applications to pattern classification.Fuzzy Sets and Systems,1992,52 (1) : 21~32

[7] Li JN,Yi JQ,Zhao DB.On2line rule generation for robotic behavior controller based on a neural2fuzzy inference network.IEEE InternationalConference on Machine Learning and Cybernetics,2004 : 558~563

[8] Lin CJ,Lin CT.Reinforcement learning for an ART2based fuzzy adaptive learning control network.IEEE Transaction on Neural Network,1996,7(3) : 709~731

[9] Brooks R.A robust layered control systems for a mobile robot.IEEE Transactions on Robotics and Automation,1986,2 (1) : 14~23

[1] 阎平凡.再励学习———原理、算法及其在智能控制中的应用.信息与控制,1996,25 (1) : 28~34

文章导航

/