Multimedia Information Retrieval and Multimedia Data Mining Chengcui Zhang Assistant Professor Dept. of Computer and Information Science University of Alabama at Birmingham
General Content-Based Image Retrieval (CBIR)
Object-Based Image Retrieval Example – Query by two objects Techniques used: Image segmentation Neural network Multiple instance learning …
Research Issues … Multiple object retrieval for image databases Learning of composite model Information fusion Apply the developed techniques to other applications such as drug activity discovery, pattern recognition for medical image analysis, etc.
Video Data Mining Example: Locate the interesting events (goals, corner kicks, etc.) in a large amount of raw, unprocessed soccer videos Facilitate automatic annotation and indexing of the high-level structures of soccer videos Soccer videos …… Corner kick eventGoal event ……
Research Issues … Video event mining: Detect other types of soccer events like free kicks, referees, and fouls, etc. Discover the underlying associations among different events/subevents Develop a scalable soccer video database system and a flexible user query interface Apply to other types of videos (TV news, Basketball, etc.)
A Soccer Video Retrieval System Using Temporal Relationships
Video Surveillance for Intelligent Transportation Systems (ITS) Frame 132 Frame 138 Frame 142
Video Surveillance for Intelligent Transportation Systems (ITS) Vehicle tracking sequence …
Research Issues … Handle vehicle object overlapping Vehicle classification (car, SUV, truck, etc.) Spatio-temporal modeling of vehicle trajectories to enable efficient query of traffic surveillance data and to support modeling and analysis of behavior- based traffic phenomena such as car-truck interaction.
Other Research Projects Microarray image analysis …