1. Control and Robotics Lab Electrical Engineering Department, Technion Search of targets by multiple UAVs using a probability map By Alexander Strizhiver Michael Shamis Supervised by Mark Moulin

2. Presentation outline Definition of probability map Case #1: Single target search using single UAV (STSU problem) Greedy and K-Shortest path algorithms Variation of K-Shortest path algorithm for STSU. Case #2 : Single target search using multiple UAVs (STMU problem) – using STSU case solution. Case #3 : Multiple target search using multiple UAVs (MTMU problem) – using STMU case solution.

3. Definition of probability map A given map of an area can be divided into hexagons For each hexagon assigned a probability to find target in it. Why hexagon ?

4. Case #1: Single target search using single UAV (STSU problem) Definitions: P – probability map ( probability function ). - Location of UAV base - Location of target drawn according to P. F - size of UAV fuel tank. - Legal search path, that is an ordered set of point on probability map which satisfy following properties:

5. Case #1: Single target search using single UAV (STSU problem) Legal sub path Essential sub path length: STSU problem can then be defined as:

6. Case #1: Single target search using single UAV (STSU problem) STSU problem is a very hard problem (seems to be NP-hard problem ). The optimal solution for NP hard problems is computational heavy, and not used for real problems. STSU problem should be solved by approximate solutions.

7. Redefinition of STSU problem Alternative definition of STSU problem ( simplified – not equivalent ): This problem is still hard problem, but have good approximate solutions. All the solutions will try to find.

8. Representation of probability map as non directed graph Each hexagon in the probability map becomes a vertex on a graph There is an edge (V,U) iff the hexagons U and V on probability map are neighbors.

9. Solving STSU problem using greedy algorithm Greedy algorithm: C=B clear collectedPath while |collectedPath|<F { S = all closest neighbors C’ of C with non zero probability, for which F-|collectedPath|-dist(C,C’)-dist(C’,B)>=0 C’ = coordinate with largest probability in S add path form C to C’ to collectedPath C = C’ } output collectedPath.

10. Greedy algorithm advantages and disadvantages Advantages: –Computationally light. –Gives good results when the probability distribution close to uniform. –Covers well areas around the base. Disadvantages: –Can go on “wrong path” when probabilities are slightly larger than the surrounding. –Does not work well when large probabilities concentrated far from base

11. K-Shortest path algorithm Given: G – Graph. V - Vertex in graph G K – number of edges Goal: Find weight of “lightest” (shortest) path from V to all the vertices in graph G with K edges exactly. Lightest path here means – that sum of all the weights is smallest. K-Longest path algorithm - algorithm that finds heaviest ( longest ) path instead of lightest path.

12. K-Longest path algorithm Here is a version of K-longest path that matches our needs better (find longest path with K or less edges) : For each vertex u Path(0,u) = -infinity Path(0,V) = 0 For k=1 to max_k { for each vertex v path(k,v) = path(k-1,v) } for each vertex v for each u neighbor of v path(k,u) = max(path(k,u),path(k-1,v)+cost(u)) }

13. K-Longest path algorithm: example

14. K-Longest path algorithm K-Longest path algorithm has major drawback – the path it finds can get stuck on local maxima. The variation we use solves this problem by “remembering” all the vertices which were visited on heaviest path to each vertex.

15. Case #2 : Single target search using multiple UAVs (STMU) – using STSU solution. Non formal definition of the STMU problem: Given: Same inputs as for STSU problem N – Number of UAVs Goal: Find path for each UAV, so that the mean sum of distances all UAVs pass until finding the target islowest. Our solution to STSU problem concentrated on finding subsets of : The extension for multiple UAVs is trivial – UAVs run on those subsets in parallel.

16. Case #3 : Multiple target search using multiple UAVs (MTMU) – using STMU solution. Non formal definition of the MTMU problem: Given: Same inputs as for STMU problem P(T2|T1) - conditional probability function for second target location given first target location. Goals: Find path for each UAV, such that the mean sum of distances all UAVs pass until finding one of the targets is lowest. When one of the targets is found then find a path for each UAV, such that the mean sum of distances all UAVs pass until finding the second target is lowest.

17. Case #3 : Multiple target search using multiple UAVs (MTMU) – using STMU solution. Using Bayes formulas we can build new probability map: Then normalize P’, and supply it as a legal probability map input to the STMU algorithms.

18. Case #3 : Multiple target search using multiple UAVs (MTMU) – using STMU solution. MTMU problem solved in 2 steps: 1) Run STMU algorithms on P’. 2.a) If target #1 found - run STMU algorithms again with probability map P(T2|T1) 2.b) If target #2 found – run STMU algorithms again with probability map P(T1|T2) which is given by:

19. Conclusions In this project we have reviewed different solutions for the problem of finding targets, given their probabilities map. K-Longest path approach in most of the cases gives better results than greedy algorithms ( it finds targets earlier ). There is still place for improvement of the solution of the original problem since the problems we solved are far from the “ideal solution” for the problems we looked for. It seems to be possible to adjust the K-Longest path algorithm for dynamic targets Hybrid of K-Longest path and greedy algorithms can be used to try solving the problem better.