1. WEEK IX Malcolm Collins-Sibley Mentor: Shervin Ardeshir

2. PROJECT Use information from map and satellite images to project data such as addresses and streets on to the screen that the user is observing Use semantic segmentation to over lay this information in a meaningful way

3. FRAMEWORK SO FAR

4. STEPS SO FAR Starting Image

5. STEPS SO FAR Initial Projections from GIS Data

6. STEPS SO FAR GIS Projections with the addition of horizon calculations

7. STEPS SO FAR Full visualization of projections, also labeling the center of each building

8. STEPS SO FAR Initial Segmentation results

9. STEPS SO FAR After 7 iterations of the Projection Segmentation fusion code

10. STEPS SO FAR After thresholding the fusion results

11. STEPS SO FAR Address for each building in the frame

12. STEPS SO FAR Projecting the names of near by streets

13. THIS WEEK

14. GOALS FROM LAST WEEK Generate new dense grid for the whole data set Generate binary maps for streets in the whole data set Fusion between segmentation, and street projection only Solving fusion optimization between segmentation, building projection, and street projection jointly

15. DENSE GRID To save computing time, we only looked at grid points within a radius around each test image

16. BINARY MAPS

17. STREET FUSION (Initial results)

18. STREET FUSION (Initial results)

19. BINARY MAPS

20. STREET FUSION (Initial results)

21. STREET FUSION (Initial results)

22. STREET FUSION (Initial results) Shadow breaks up the street into extra pixels Cracks in the street create extra pixels

23. STREET FUSION (Initial results)

24. STREET FUSION (Initial results)

25. STREET FUSION (Initial results) Cross walk interrupts street Person and cars interrupts street

26. JOINT OPTIMIZATION

28. WAYS TO IMPROVE Two main thins need to be updated: Create more precise binary maps Currently each map is an out line of the outermost points of both streets causing it to include more points than wanted New system of fusion between binary maps and segmentation Handling outlier segments in the optimization