1. FISH IDENTIFICATION SYSTEM
Diego Mushfieldt
Supervisors: Mehrdad Ghaziasgar, James Connan

2. (UWC) Department of Computer Science
A Quick Reminder...
Background
Aquarium hosts many people
Variety of fish on display
Visitors not able to get instant
information
Proposed solution
An easy-to-use interactive system that
provides instant information on specific fish
Proposed solution: Also explain how this solution is useful
17/09/2018
(UWC) Department of Computer Science

3. Implementation Overview
Design Decisions
System Modifications
User Interface Specification (UIS)
High Level Design (HLD)
Low Level Design (LLD)
Code Organisation and Implementation Approach
System Demonstration
Mention what is not expected of the system
17/09/2018
(UWC) Department of Computer Science

4. (UWC) Department of Computer Science
Implementation
Design Decisions
System Modifications
User Interface Specification (UIS)
High Level Design (HLD)
Low Level Design (LLD)
Code Organisation and Implementation Approach
System Demonstration
Mention what is not expected of the system
17/09/2018
(UWC) Department of Computer Science

5. (UWC) Department of Computer Science
Design Decisions
Previous System
Segmentation
Locate Position of fish – Mouse click
Determine Border around fish – Manually Drawn on image
Determine Shape of fish - Thresholding
Determine Colour distribution of fish – 1D Histogram
Classification
Support Vector Machine (SVM)
Mention that switching from pre-recorded to live video is just a matter of changing one line of code
17/09/2018
(UWC) Department of Computer Science

6. Design Decisions continued...
Current System
Segmentation
Locate Position of fish – Mouse click
Determine Border around fish – Tracking Algorithm
Determine Shape of fish – Background Subtraction Algorithm
Determine Colour distribution of fish – 2D Histogram
Classification
Support Vector Machine (SVM)
Mention that switching from pre-recorded to live video is just a matter of changing one line of code
17/09/2018
(UWC) Department of Computer Science

7. (UWC) Department of Computer Science
Implementation
Design Decisions
System Modifications
User Interface Specification (UIS)
High Level Design (HLD)
Low Level Design (LLD)
Code Organisation and Implementation Approach
System Demonstration
Mention what is not expected of the system
17/09/2018
(UWC) Department of Computer Science

8. User Interface Specification (UIS)
The User Interface as seen by the user
Mention what is not expected of the system
17/09/2018
(UWC) Department of Computer Science

9. User Interface Specification (UIS)
How the user interacts with the system
Mouse click
How the User Interface behaves
Mention that switching from pre-recorded to live video is just a matter of changing one line of code
17/09/2018
(UWC) Department of Computer Science

10. High Level Design(HLD)
Diagram showing different subsystems
Input
Video feed
Capture Images
Capture mouse clicks
Image Processing
Image Segmentation
Tracking Algorithm
Background Subtraction Algorithm
2D Histogram
Classification
Support Vector Machine (SVM)
Output
Display Text in Window
Mention what is not expected of the system
17/09/2018
(UWC) Department of Computer Science

11. (UWC) Department of Computer Science
Low Level Design (LLD)
Locate position of Fish
User Clicks on Fish
cvSetMouseCallback ( );
Mention that switching from pre-recorded to live video is just a matter of changing one line of code
17/09/2018
(UWC) Department of Computer Science

12. (UWC) Department of Computer Science
Low Level Design (LLD)
Segmentation
Convert from RGB colour space to HSV colour space.
cvCvtColor(CV_RGB2HSV)
Mention that switching from pre-recorded to live video is just a matter of changing one line of code
17/09/2018
(UWC) Department of Computer Science

13. (UWC) Department of Computer Science
Low Level Design (LLD)
Segmentation
Split HSV into individual components
cvSplit (HSV, HUE, SATURATION, VALUE)
Mention that switching from pre-recorded to live video is just a matter of changing one line of code
17/09/2018
(UWC) Department of Computer Science

14. (UWC) Department of Computer Science
Low Level Design (LLD)
Segmentation
Threshold the HUE
cvAdaptiveThresh (HUE)
Mention what is not expected of the system
17/09/2018
(UWC) Department of Computer Science

15. cvSetImageROI (BinaryImage)
Low Level Design (LLD)
Segmentation
Determine the border around the fish
Crop the image
cvSetImageROI (BinaryImage)
Mention that switching from pre-recorded to live video is just a matter of changing one line of code
17/09/2018
(UWC) Department of Computer Science

16. (UWC) Department of Computer Science
Low Level Design (LLD)
Segmentation
Find Contours
cvFindContours (BinaryImage)
Mention what is not expected of the system
17/09/2018
(UWC) Department of Computer Science

17. (UWC) Department of Computer Science
Low Level Design (LLD)
Segmentation
Find the Largest Contour (remove noise!)
Mention that switching from pre-recorded to live video is just a matter of changing one line of code
17/09/2018
(UWC) Department of Computer Science

18. (UWC) Department of Computer Science
Low Level Design (LLD)
Segmentation
Fill the Largest Contour at (x,y)
cvFloodFill (Contour, cvPoint(x,y))
Mention what is not expected of the system
17/09/2018
(UWC) Department of Computer Science

19. (UWC) Department of Computer Science
Low Level Design (LLD)
Colour Distribution
1D Histogram
Mention that switching from pre-recorded to live video is just a matter of changing one line of code
17/09/2018
(UWC) Department of Computer Science

20. (UWC) Department of Computer Science
Low Level Design (LLD)
Classification
- Send Shape and Colour data to SVM
SVM
Mention what is not expected of the system
17/09/2018
(UWC) Department of Computer Science

21. Low Level Design (LLD) changes
Current System Design Decisions
Tracking Algorithm (CAMShift)
2D HISTOGRAM
HUE
SATURATION
Mention that switching from pre-recorded to live video is just a matter of changing one line of code
17/09/2018
(UWC) Department of Computer Science

22. Low Level Design (LLD) changes continued...
Background Subtraction Algorithm
- Gaussian Mixture Model (GMM)
Frame Differencing
GMM
Mention what is not expected of the system
17/09/2018
(UWC) Department of Computer Science

23. (UWC) Department of Computer Science
Implementation
Design Decisions
System Modifications
User Interface Specification (UIS)
High Level Design (HLD)
Low Level Design (LLD)
Code Organisation and Implementation Approach
System Demonstration
Mention what is not expected of the system
17/09/2018
(UWC) Department of Computer Science

24. Code Organisation and Implementation Approach
Tools Used
Operating System -> Ubuntu 10.04
Programming Language -> C/C++
SoftLibrary -> Open Computer Vision (OpenCV)
Ffmpeg (Video manipulation)
Mention that switching from pre-recorded to live video is just a matter of changing one line of code
17/09/2018
(UWC) Department of Computer Science

25. (UWC) Department of Computer Science
References
Bradski, Kaebler – “Learning OpenCV”
en.wikipedia.org/wiki/Computer_vision
en.wikipedia.org/wiki/Image_processing
17/09/2018
(UWC) Department of Computer Science

26. Project Plan Goal Due date
Learn to use OpenCV functions/tools to manipulate images and videos
Completed
Design and Development
Implementation (Programmer’s point of view)
Testing and Evaluating
19 September 2011 – 08 November 2011
17/09/2018
(UWC) Department of Computer Science

27. (UWC) Department of Computer Science
Implementation
Design Decisions
System Modifications
User Interface Specification (UIS)
High Level Design (HLD)
Low Level Design (LLD)
Code Organisation and Implementation Approach
System Demonstration
Mention what is not expected of the system
17/09/2018
(UWC) Department of Computer Science