1 Autonomous Controller Design for Unmanned Aerial Vehicles using Multi-objective Genetic Programming Choong K. Oh and Gregory J. Barlow U.S. Naval Research.

Slides:



Advertisements
Similar presentations
Lindsey Bleimes Charlie Garrod Adam Meyerson
Advertisements

A Hierarchical Multiple Target Tracking Algorithm for Sensor Networks Songhwai Oh and Shankar Sastry EECS, Berkeley Nest Retreat, Jan
MOEAs University of Missouri - Rolla Dr. T’s Course in Evolutionary Computation Matt D. Johnson November 6, 2006.
Autonomic Systems Justin Moles, Winter 2006 Enabling autonomic behavior in systems software with hot swapping Paper by: J. Appavoo, et al. Presentation.
Constructing Complex NPC Behavior via Multi- Objective Neuroevolution Jacob Schrum – Risto Miikkulainen –
GRASP University of Pennsylvania NRL logo? Autonomous Network of Aerial and Ground Vehicles Vijay Kumar GRASP Laboratory University of Pennsylvania Ron.
ODS3F –Observation and Detection Systems For Forest Fire Monitoring
Presentation by: Drew Wichmann Paper by: Samer Hanoun and Saeid Nahavandi 1.
The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL Reciprocal Velocity Obstacles for Real-Time Multi-Agent Navigation Jur van den Berg Ming Lin Dinesh Manocha.
Automatic Synthesis Using Genetic Programming of Improved PID Tuning Rules Matthew J. Streeter Genetic Programming, Inc. Mountain View, California
DAN SHMIDT ITAY BITTAN Advanced Topics in Evolutionary Algorithms.
Brent Dingle Marco A. Morales Texas A&M University, Spring 2002
1 Incremental Evolution of Autonomous Controllers for Unmanned Aerial Vehicles using Multi-objective Genetic Programming Gregory J. Barlow, Choong K. Oh,
SENSOR FUSION LABORATORY Thad Roppel, Associate Professor AU Electrical and Computer Engineering Dept. EXAMPLES Distributed networks.
Genetic Algorithms in Materials Processing N. Chakraborti Department of Metallurgical & Materials Engineering Indian Institute of Technology Kharagpur.
Integrating POMDP and RL for a Two Layer Simulated Robot Architecture Presented by Alp Sardağ.
Design of Autonomous Navigation Controllers for Unmanned Aerial Vehicles using Multi-objective Genetic Programming Gregory J. Barlow March 19, 2004.
1 Autonomous Controller Design for Unmanned Aerial Vehicles using Multi-objective Genetic Programming Gregory J. Barlow North Carolina State University.
Introduction to mobile robots Slides modified from Maja Mataric’s CSCI445, USC.
Evolutionary Computation Application Peter Andras peter.andras/lectures.
1 Robustness Analysis of Genetic Programming Controllers for Unmanned Aerial Vehicles Gregory J. Barlow 1,2 and Choong K. Oh 2 1 The Robotics Institute,
PRESENTATION BY ATIF DAR ULTRASONIC SENSORS.. CONTENTS PAGE Page 1 – Homepage Page 3 – Description of Ultrasonic Sensor. Page 4 – How the Ultrasonic Sensor.
Chuang-Hue Moh Spring Embodied Intelligence: Final Project.
Coordinative Behavior in Evolutionary Multi-agent System by Genetic Algorithm Chuan-Kang Ting – Page: 1 International Graduate School of Dynamic Intelligent.
Kalman filter and SLAM problem
Abstract Design Considerations and Future Plans In this project we focus on integrating sensors into a small electrical vehicle to enable it to navigate.
Evolving Multi-modal Behavior in NPCs Jacob Schrum – Risto Miikkulainen –
Project Partners AUVSI North America 10 th - 14 th August 2009 Mr Reece Clothier Prof. Rodney Walker The Smart Skies Project.
Leiden University. The university to discover. Enhancing Search Space Diversity in Multi-Objective Evolutionary Drug Molecule Design using Niching 1. Leiden.
Adapting Convergent Scheduling Using Machine Learning Diego Puppin*, Mark Stephenson †, Una-May O’Reilly †, Martin Martin †, and Saman Amarasinghe † *
Computational Mechanics and Robotics The University of New South Wales
Tracking with Unreliable Node Sequences Ziguo Zhong, Ting Zhu, Dan Wang and Tian He Computer Science and Engineering, University of Minnesota Infocom 2009.
Study on Genetic Network Programming (GNP) with Learning and Evolution Hirasawa laboratory, Artificial Intelligence section Information architecture field.
Patch Based Mobile Sink Movement By Salman Saeed Khan Omar Oreifej.
Evaluation of Non-Uniqueness in Contaminant Source Characterization based on Sensors with Event Detection Methods Jitendra Kumar 1, E. M. Zechman 1, E.
Optimization of the ESRF upgrade lattice lifetime and dynamic aperture using genetic algorithms Nicola Carmignani 11/03/2015.
Mobile Robot Navigation Using Fuzzy logic Controller
COBXXXX EXPERIMENTAL FRAMEWORK FOR EVALUATION OF GUIDANCE AND CONTROL ALGORITHMS FOR UAVS Sérgio Ronaldo Barros dos Santos,
BioRobots, LLC Richard Bachmann, President Cleveland, OH Incorporated in 2002 Goal: Commercialize technology developed by Roger Quinn et al. in biologically.
Evolutionary Computation Dean F. Hougen w/ contributions from Pedro Diaz-Gomez & Brent Eskridge Robotics, Evolution, Adaptation, and Learning Laboratory.
UAV Navigation by Expert System for Contaminant Mapping George S. Young Yuki Kuroki, Sue Ellen Haupt.
Evolutionary conditions for the emergence of communication in robots Dario Floreano, Sara Mitri, Stephane Magnenat, and Laurent Keller Current Biology,
Evolutionary Robotics The Italian Approach The Khepera robot (1996) Developed at EPFL Lausanne, Switzerland(!) by Francesco Mondada Diameter: 55 mm Could.
Probabilistic Coverage in Wireless Sensor Networks Authors : Nadeem Ahmed, Salil S. Kanhere, Sanjay Jha Presenter : Hyeon, Seung-Il.
Evolving the goal priorities of autonomous agents Adam Campbell* Advisor: Dr. Annie S. Wu* Collaborator: Dr. Randall Shumaker** School of Electrical Engineering.
Towards Establishing and Maintaining Autonomous Quadrotor Formations Audrow J. Nash William Lee College of Engineering University of North Carolina at.
Kanpur Genetic Algorithms Laboratory IIT Kanpur 25, July 2006 (11:00 AM) Multi-Objective Dynamic Optimization using Evolutionary Algorithms by Udaya Bhaskara.
DIVERSITY PRESERVING EVOLUTIONARY MULTI-OBJECTIVE SEARCH Brian Piper1, Hana Chmielewski2, Ranji Ranjithan1,2 1Operations Research 2Civil Engineering.
Aeronautics & Astronautics Autonomous Flight Systems Laboratory All slides and material copyright of University of Washington Autonomous Flight Systems.
2/29/20121 Optimizing LCLS2 taper profile with genetic algorithms: preliminary results X. Huang, J. Wu, T. Raubenhaimer, Y. Jiao, S. Spampinati, A. Mandlekar,
Evolving Multimodal Networks for Multitask Games
Using IR For Maze Navigation Kyle W. Lawton and Liz Shrecengost.
Riza Erdem Jappie Klooster Dirk Meulenbelt EVOLVING MULTI-MODAL BEHAVIOR IN NPC S.
Problem Description: One line explanation of the problem to be solved Problem Description: One line explanation of the problem to be solved Proposed Solution:
On Mobile Sink Node for Target Tracking in Wireless Sensor Networks Thanh Hai Trinh and Hee Yong Youn Pervasive Computing and Communications Workshops(PerComW'07)
Computer Systems Lab TJHSST Current Projects In-House, pt 2.
Robot Intelligence Technology Lab. 10. Complex Hardware Morphologies: Walking Machines Presented by In-Won Park
ArrayTrack : A Fine-Grained Indoor Location System Jie Xiong, Kyle Jamieson USENIX NSDI ‘ Jungmin Yoo *some slides.
Guarding Against Premature Convergence while Accelerating Evolutionary Search July 9, 2010 Josh C. Bongard Morphology, Evolutionary and Cognition Laboratory.
Robot Intelligence Technology Lab. Evolutionary Robotics Chapter 3. How to Evolve Robots Chi-Ho Lee.
Robot Intelligence Technology Lab. Evolution of simple navigation Chapter 4 of Evolutionary Robotics Jan. 12, 2007 YongDuk Kim.
FlySpy Patent Liabilities Analysis
Signal and Image Processing Lab
Bag-of-Visual-Words Based Feature Extraction
UAV Vision Landing Motivation Data Gathered Research Plan Background
What is Droid? A small robotic machine which comes in various shapes and sizes following commands & doing the tasks according to commands is called as.
A NEW PATH-TRACKING ALGORITHM:
Networks of Autonomous Unmanned Vehicles
Distributed Sensing, Control, and Uncertainty
PURE Learning Plan Student: Kiarash Akhlaghi Feizasar
Presentation transcript:

1 Autonomous Controller Design for Unmanned Aerial Vehicles using Multi-objective Genetic Programming Choong K. Oh and Gregory J. Barlow U.S. Naval Research Laboratory North Carolina State University

2 Overview Problem Unmanned Aerial Vehicle Simulation Multi-objective Genetic Programming Fitness Functions Experiments and Results Conclusions Future Work

3 Problem Evolve unmanned aerial vehicle (UAV) navigation controllers able to: Fly to a target radar based only on sensor measurements Circle closely around the radar Maintain a stable and efficient flight path throughout flight

4 Controller Requirements Autonomous flight controllers for UAV navigation Reactive control with no internal world model Able to handle multiple radar types including mobile radars and intermittently emitting radars Robust enough to transfer to real UAVs

5 Simulation To test the fitness of a controller, the UAV is simulated for 4 hours of flight time in a 100 by 100 square nmi area The initial starting positions of the UAV and the radar are randomly set for each simulation trial

6 Sensors UAVs can sense the angle of arrival (AoA) and amplitude of incoming radar signals

7 UAV Control Evolved Controller Autopilot UAV Flight Sensors Roll angle

8 Transference These controllers should be transferable to real UAVs. To encourage this: Only the sidelobes of the radar were modeled Noise is added to the modeled radar emissions The angle of arrival value from the sensor is only accurate within ±10°

9 Multi-objective GP We had four desired behaviors which often conflicted, so we used NSGA-II (Deb et al., 2002) with genetic programming to evolve controllers Each fitness evaluation ran 30 trials Each evolutionary run had a population size of 500 and ran for 600 generations Computations were done on a Beowulf cluster with 92 processors (2.4 GHz)

10 Functions and Terminals Turns Hard Left, Hard Right, Shallow Left, Shallow Right, Wings Level, No Change Sensors Amplitude > 0, Amplitude Slope 0, AoA Functions IfThen, IfThenElse, And, Or, Not,, >=, > 0, < 0, =, +, -, *, /

11 Fitness Functions Normalized distance UAV’s flight to vicinity of the radar Circling distance Distance from UAV to radar when in-range Level time Time with a roll angle of zero Turn cost Changes in roll angle greater than 10°

12 Normalized Distance

13 Circling Distance

14 Level Time

15 Turn Cost

16 Performance of Evolution Multi-objective genetic programming produces a Pareto front of solutions, not a single best solution. To gauge the performance of evolution, fitness values for each fitness measure were selected for a minimally successful controller.

17 Baseline Values Normalized Distance≤0.15 Determined empirically Circling Distance≤4 Average distance less than 2 nmi Level Time≥1000 ~50% of time (not in-range) with roll angle = 0 Turn Cost≤0.05 Turn sharply less than 0.5% of the time

18 Experiments Continuously emitting, stationary radar Simplest radar case Intermittently emitting, stationary radar Period of 10 minutes, duration of 5 minutes Continuously emitting, mobile radar States: move, setup, deployed, tear down In deployed over an hour before moving again

19 Results Radar Type RunsControllers TotalSucc.RateTotalAvg.Max. Continuously emitting, stationary radar %3, Intermittently emitting, stationary radar %1, Continuously emitting, mobile radar %2,

20 Continuously emitting, stationary radar

21 Circling Behavior

22 Intermittently emitting, stationary radar

23 Continuously emitting, mobile radar

24 Conclusions Autonomous navigation controllers were evolved to fly to a radar and then circle around it while maintaining stable and efficient flight dynamics Multi-objective genetic programming was used to evolve controllers Controllers were evolved for three radar types

25 Future Work Accomplished Incremental evolution was used to aid in the evolution of controllers for more complex radar types and controllers able to handle all radar types Controllers were successfully tested on a wheeled mobile robot equipped with an acoustic array tracking a speaker

26 Future Work In Progress Distributed multi-agent controllers will be evolved to deploy multiple UAVs to multiple radars Controllers will be tested on physical UAVs for several radar types in field tests next year

27 Acknowledgements This work was done at North Carolina State University and the U.S. Naval Research Laboratory Financial support was provided by the Office of Naval Research Computational resources were provided by the U.S. Naval Research Laboratory