1. VISUAL MONITORING OF RAILROAD GRADE CROSSING AND RAILROAD TRACKS University of Central Florida

2. Phase I Visual Monitoring of Railroad Grade Crossing

3. Objectives  Monitor railroad grade crossing for hazardous behavior.  Issue a audio/visual alert.  Self-contained portable system

4. System Overview  The main processing pipeline of the system: Object Detection Tracking Object Classification Activity Recognition Trigger Alarm

5. Computer Vision Laboratory University of Central Florida The Portable System Batteries Main Processing Unit Carrying Unit Solar Panels Camera

6. Computer Vision Laboratory University of Central Florida Website Interface  Each site contains  Live image  Latest log file data Trains detected Train title Date Time Objects detected Object ID Date/Time

7. Computer Vision Laboratory University of Central Florida Email Alerts  Email alerts are triggered on activities  Alert frequency can be changed by user parameters  Each email contains  Site source location  Message about activity  Image of object involved in activity

8. Performance Evaluation  Detected Violators P421 Mount Dora New Smyrna Beach P127 P135 03-01-2005, 11:32:33 03-01-2005, 11:32:19 03-08-2005, 13:18:23 02-22-2005, 11:01:42 03-02-2005, 12:42:57 03-11-2005, 15:17:53

9. Visual Inspection of Railroad Tracks Phase II

10. Mobile Platform Design Basler A400 High speed firewire

11. Mobile Platform  The main factors driving the design of the mobile platform are:  Portability  Image Stability  Uniformity of Illumination conditions

12. Mobile platform

13. Video obtained from mobile platform Example rail video obtained from mobile platform

14. Defect detection

15. Engine Burn Defects  A condition in which the rail has been scarred by the heat created by locomotive.  Appearance in track. Round or oval rough spots or holes on the surface of the rail. Burn area 1 1 Railroad Track Standards, Departments of the Army (TM 5-628)

16. Processing Pipeline Input video frame Smooth with a Gaussian Mean shift segmentation Compute region properties CircularityColor momentsWaveletsHeterogeneity SVM

17. Results = Detection= Confidence

18. Results

19. Potential burn regions

20. Rail Crack Defects

21. Rail Cracks  Stress caused by the wheels of the train can lead to cracks on the rail head. Rail Stress

22. Processing Pipeline

23. Current work

24. Rail Gauge Verification  Objective:  Verify that the distance between rails is within a safe margin. Synchronized high speed cameras Rail Gauge

25. Missing Fasteners  Detect missing fasteners Steel Clips or Fasteners Missing fasteners

26. Thank you