1. Robust Reinforcement Learning Control Chuck Anderson, Matt Kretchmar, Department of Computer Science, Peter Young, Department of Electrical and Computer Engineering Douglas Hittle, Department of Mechanical Engineering Colorado State University, Fort Collins, CO

2. Motivation Robust control theory Guarantees stability Results in less aggressive controllers Reinforcement learning Optimizes the performance of a controller No guarantee of stability while learning

3. Reinforcement Learning Agent in Parallel with Controller

4. Fundings National Science Foundation, ECS-0245291, 5/1/03--4/30/06, $399,999, D. Hittle, P. Young, and C. Anderson, Robust Learning Control for Building Energy Systems.Robust Learning Control for Building Energy Systems National Science Foundation, CMS-9804747, 9/15/98--9/14/01, $746,717, D. Hittle, P. Young, and C. Anderson, Robust Learning Control for Heating, Ventilating, and Air-Conditioning Systems.Robust Learning Control for Heating, Ventilating, and Air-Conditioning Systems National Science Foundation, CMS-9732986, 5/98 - 4/02, $200,000, Peter M. Young, Robust Learning Control with Application to Intelligent Building Systems.Robust Learning Control with Application to Intelligent Building Systems National Science Foundation, CMS-9401249, 1/95--12/96, $133,196, D. Hittle and C. Anderson, Neural Networks for Control of Heating and Air-Conditioning Systems.Neural Networks for Control of Heating and Air-Conditioning Systems