1. George Campbell David HawesCarleton Jillson Joseph KalinowskiKeith Pray CUE The Pool Critic

2. Project Description The goal of our project was to build a system which would model a live pool game. It would then analyze the model to critique each shot.

3. Project Design Table State Look Image Video InGet Status Status Video Source Movie Vision Analyzer User Interface

4. Project Design User Interface Analysis Transformation Vision

5. Project Design User Interface Analysis Transformation Vision

6. User Interface Designed using MFC Multi-Document Application Easy to use for the novice and expert Intended to have minimal back-end communication

7. User Interface

8. Project Design User Interface Analysis Transformation Vision

9. Analysis The analysis is responsible for building and interpreting the model of the live pool game. Model Parts –Table State –Events –Shot

10. Analysis Vision User Interface Table States Events Called Shot Result

11. Project Design User Interface Analysis Transformation Vision

12. Transformation Using vanishing points, a video image of the table is divided into regions which are mapped to relative regions of a table model. Perspective issues: –Room constraints –Program more robust Perspective issues: –Room constraints –Program more robust

13. Transformation

18. Project Design User Interface Analysis Transformation Vision

19. Acquiring Video Vision can accept any of the following formats –Live Video –AVI Files –Directory of static images

20. Vision Issues Vision uses the vast majority of the process time –In order to have acceptable detail, large numbers of pixels must be processed –Very efficient algorithms needed to produce accurate results without slowing down CUE to a crawl

21. Noise needs to be compensated for: –Reflectivity of balls –Shadows –Camera Noise Vision Issues

22. How Does Vision Work? Calibration Processing each Image

23. Calibration Using one image from the image source Find the edges of the image Find the key lines (bumpers) of the table Map the four corners of the table to model space using lookup table module

24. Calibration Image

25. Processing Images Find the edges of the image Find the circles on the table Identify balls based on color matching Set the table state with ball locations Return the table state for analysis

26. Sample Edge Image Sample Processed Image Processed Images

27. Demo

33. Future Projects Incorporate AI Aspects –Learns physics/rules of pool by watching games in play –Uses strategy to critique and recommend shots Robotic Implementation –Learns by trial and error –Carries out recommended shots in a real game

34. Special Thanks To... Professor Michael Gennert Spencer Billiards John Chaillet Lisa Cocozzella Worcester Telegram & Gazette Thank You

35. George Campbell David HawesCarleton Jillson Joseph KalinowskiKeith Pray CUE The Pool Critic