題目：Adaptive Dynamic Programming - A New Tool for Learning Control
時間：2008年10月8日(周三)下午3：00
地點：新主樓E706
報告人：Derong Liu(劉德榮)
IEEE Fellow, "海外傑出青年基金"獲得者, 中國科學院"百人計劃"入選者，教授
Department of Electrical and Computer Engineering
University of Illinois at Chicago
Email: dliu@ece.uic.edu
Adaptive Dynamic Programming (ADP) has received increasing attention recently. ADP scheme is a design that approximates dynamic programming in the general case, i.e., approximates optimal control over time in noisy, nonlinear environments. There are many engineering problems in practice which can be formulated as cost maximization or minimization problems. Dynamic programming is a very useful tool in solving these problems. However, it is often computationally untenable to run dynamic programming due to the backward numerical process required for its solutions. Over the years, progress has been made to provide approximate solutions to dynamic programming. The idea is to approximate dynamic programming solutions by using neural networks to approximate the cost function. The methodology is a very useful tool for building intelligent agents/controllers in almost any environment.
This speech will review the theorectical development of ADP. Details about the training of the neural networks used in the present design will also be presented. The pole balancing (inverted pendulum) problem will be used as the benchmark in this presentation to show the applicability of ADP.
劉德榮：IEEE Fellow, 現為依利諾斯大學電機與計算機工程系和計算機科學系的終身職正教授。1994年從美國聖母大學(University of Notre Dame)畢業并獲電機工程博士學位。從1993年至1995年，在美國通用汽車公司研究開發中心工作。從1995年至1999年，在斯蒂文斯理工學院電機與計算機工程系任助教授。從1999年開始，在依利諾斯大學芝加哥分校電機與計算機工程系工作，先後任該校助教授、終身職副教授、電機與計算機工程系和計算機科學系的終身職正教授。2005年，因在非線性動态系統和遞歸神經網絡方面作出的貢獻被選為IEEE Fellow。2008年，入選中國科學院"百人計劃"在自動化研究所任研究員。
劉德榮在聖母大學讀書期間，獲該校麥克爾-博克研究基金的資助(1990-1991年)。在斯蒂文斯理工學院任教期間，獲該校哈維-戴維斯傑出教學獎(1997年)。在依利諾斯大學任教期間，獲該校大學學者獎(2006-2009年)。1999年，獲得了美國國家科學基金會教授早期事業發展獎。2008年，獲得了中國國家自然科學基金委"海外傑出青年基金"。他于1995年至2000年任IEEE控制系統學會會議編輯委員會成員、于1997年至1999年任IEEE電路與系統彙刊編委、于2001年至2003年任IEEE信号處理彙刊編委、于2006年至2008年任IEEE神經網絡快報編輯。他現任Automatica的編委、IEEE神經網絡彙刊編委、IEEE智能計算雜志編委、IEEE電路與系統雜志編委、IEEE智能計算學會電子快報編輯。他于2005年當選為IEEE智能計算學會的理事。
劉德榮目前主要從事智能控制理論及應用、人工神經網絡、模糊系統、生物信息學、電力系統運行與控制、無線通訊與無線網絡方面的研究工作。自1992年起, 共發表了60多篇國際學術雜志論文、110多篇國際會議論文、同他人合作共出版過八本書。
Derong Liu received the Ph.D. degree in electrical engineering from the University of Notre Dame, Notre Dame, IN, in 1994. From 1993 to 1995, he was a Staff Fellow with General Motors Research and Development Center, Warren, MI. From 1995 to 1999, he was an Assistant Professor in the Department of Electrical and Computer Engineering, Stevens Institute of Technology, Hoboken, NJ. He joined the University of Illinois at Chicago in 1999, where he is now a Full Professor of electrical and computer engineering and of computer science. Since 2005, he has been Director of Graduate Studies in the Department of Electrical and Computer Engineering, University of Illinois at Chicago. He has published seven books (four research monographs and three edited volumes). He is currently the Editor of the IEEE Computational Intelligence Societys Electronic Letter, an Associate Editor of the IEEE Transactions on Neural Networks, an Associate Editor of the IEEE Computational Intelligence Magazine, an Associate Editor of the IEEE Circuits and Systems Magazine, and an Associate Editor of Automatica. He is an elected AdCom member of the IEEE Computational Intelligence Society (2006-2008). He received the Faculty Early Career Development (CAREER) award from the National Science Foundation (1999) and the University Scholar Award from University of Illinois (2006-2009). He is a Fellow of the IEEE.
