1. WEEK 8: WEB-ASSISTED OBJECT DETECTION ALEJANDRO TORROELLA & AMIR R. ZAMIR

2. GEOMETRY METHOD PROCEDURE For each query image we manually set orientation, angle of view, range of view, and location of camera. : Camera location : Object locations : Field of vision

3. GEOMETRY METHOD PROCEDURE Using the obtained FOV, select only the objects that are within the FOV Calculate the degrees from the left limit of the FOV and store in a vector specific to the object’s class

4. GEOMETRY METHOD PROCEDURE We then run our DPM detectors for the classes in question on the query image. Below are results for Street Lights (green) and Traffic Signals (red).

5. GEOMETRY METHOD PROCEDURE We sift through the detections that completely disagree with the “true” GIS layout.

6. GEOMETRY METHOD PROCEDURE We then sift through the detections again by size of bounding boxes (too large or too small)

7. GEOMETRY METHOD PROCEDURE

8. Once we’ve traversed through all the possible combinations, we display the detections that resulted in the minimum of the cost function.

9. GEOMETRY METHOD RESULTS: BEFORE

10. GEOMETRY METHOD RESULTS: AFTER GIS SIFT

11. GEOMETRY METHOD RESULTS: AFTER SIZE SIFT

12. GEOMETRY METHOD RESULTS: AFTER FUSION (ABS)

13. GEOMETRY METHOD RESULTS: AFTER FUSION (STD)

14. GEOMETRY METHOD RESULTS: BEFORE

15. GEOMETRY METHOD RESULTS: AFTER GIS SIFT

16. GEOMETRY METHOD RESULTS: AFTER SIZE SIFT

17. GEOMETRY METHOD RESULTS: AFTER FUSION (ABS)

18. GEOMETRY METHOD RESULTS: AFTER FUSION (STD)

19. GEOMETRY METHOD RESULTS: BEFORE

20. GEOMETRY METHOD RESULTS: AFTER GIS SIFT

21. GEOMETRY METHOD RESULTS: AFTER SIZE SIFT

22. GEOMETRY METHOD RESULTS: AFTER FUSION (ABS)

23. GEOMETRY METHOD RESULTS: AFTER FUSION (STD)

24. GEOMETRY METHOD RESULTS: BEFORE

25. GEOMETRY METHOD RESULTS: AFTER GIS SIFT

26. GEOMETRY METHOD RESULTS: AFTER SIZE SIFT

27. GEOMETRY METHOD RESULTS: AFTER FUSION (ABS)

28. GEOMETRY METHOD RESULTS: AFTER FUSION (STD)

29. GEOMETRY METHOD RESULTS: BEFORE

30. GEOMETRY METHOD RESULTS: AFTER GIS SIFT

31. GEOMETRY METHOD RESULTS: AFTER SIZE SIFT

32. GEOMETRY METHOD RESULTS: AFTER FUSION (ABS)

33. GEOMETRY METHOD RESULTS: AFTER FUSION (STD)

34. GEOMETRY METHOD RESULTS: BEFORE

35. GEOMETRY METHOD RESULTS: AFTER GIS SIFT

36. GEOMETRY METHOD RESULTS: AFTER SIZE SIFT

37. GEOMETRY METHOD RESULTS: AFTER FUSION (ABS)

38. GEOMETRY METHOD RESULTS: AFTER FUSION (STD)

39. GEOMETRY METHOD RESULTS: BEFORE

40. GEOMETRY METHOD RESULTS: AFTER GIS SIFT

41. GEOMETRY METHOD RESULTS: AFTER SIZE SIFT

42. GEOMETRY METHOD RESULTS: AFTER FUSION (ABS)

43. GEOMETRY METHOD RESULTS: AFTER FUSION (STD)

44. GEOMETRY METHOD RESULTS: BEFORE

45. GEOMETRY METHOD RESULTS: AFTER GIS SIFT

46. GEOMETRY METHOD RESULTS: AFTER SIZE SIFT

47. GEOMETRY METHOD RESULTS: AFTER FUSION (ABS)

48. GEOMETRY METHOD RESULTS: AFTER FUSION (STD)

49. GEOMETRY METHOD CONCLUSIONS Using the Standard deviation cost function resulted in better results compared to the Absolute value function on average. A more advanced cost function would probably result in even better results Results look promising considering we haven’t implemented a robust sensor model for creating the “true” GIS layout

50. GOALS FOR NEXT WEEK Implement a robust sensor model Look into more advanced cost functions Instead of crudely sifting through the bounding boxes by size using a threshold based on the size of the image, use the distances of the objects from the camera to estimate how large the bounding box should be.

51. THANK YOU FIN.