Event Tactic Analysis Based on Broadcast Sports Video Guangyu Zhu, Changsheng Xu, Senior Member, IEEE, Qingming Huang, Member, IEEE, Yong Rui, Senior Member, IEEE, Shuqiang Jiang, Member, IEEE, Wen Gao, Fellow, IEEE, and Hongxun Yao, Member, IEEE IEEE Transactions on multimedia volume 11, issue 1, pp

Outline Introduction Math attack event extraction from broadcast soccer video Tactic information extraction and representation Tactic pattern analysis Summary Experimental results Conclusion 2

Introduction Math attack event extraction from broadcast soccer video Tactic information extraction and representation Tactic pattern analysis Summary Experimental results Conclusion 3

Introduction 4

Side attack Center attack Coarse patternFine patternDescription Cooperative attack Unhindered-attackNo ball intercepted by defenders in the attack process. Interceptive-attackBall intercepted by one or more defenders in the attack process. Individual attack Direct-attackNo ball dribbling in the attack event. Dribbling-attackBall dribbling by attacker in the attack process. 5

Introduction Math attack event extraction from broadcast soccer video Tactic information extraction and representation Tactic pattern analysis Summary Experimental results Conclusion 6

Math attack event extraction from broadcast soccer video Web-casting text analysis Game time recognition Text/video alignment 7

Math attack event extraction from broadcast soccer video Web-casting text analysis Game time recognition Text/video alignment 8

Web-casting text analysis The web-casting text serves as text broadcasting for sports games. In the web-casting text, each type of event features one or several unique nouns. We define these nouns as event keywords and use software dtSearch to detect them.dtSearch Keyword table Text event 9

Math attack event extraction from broadcast soccer video Web-casting text analysis Game time recognition Text/video alignment 10

Game time recognition In broadcast soccer videos, a video clock is usually used to indicate the game lapsed time. Our algorithm first locates the static overlaid region by static region detection. Overlaid video clock 11

Math attack event extraction from broadcast soccer video Web-casting text analysis Game time recognition Text/video alignment 12

Text/video alignment The duration of the most events in broadcast soccer video lasts between 20 to 60 s. We define a temporal range[f-60,f+120] For every sequence 13

Introduction Math attack event extraction from broadcast soccer video Tactic information extraction and representation Tactic pattern analysis Summary Experimental results Conclusion 14

Tactic information extraction and representation Multi-object trajectories acquisition Aggregate trajectory computation Play region sequence generation 15

Tactic information extraction and representation Multi-object trajectories acquisition Aggregate trajectory computation Play region sequence generation 16

Multi-object trajectories acquisition Player detection 17

Tactic information extraction and representation Ball detection 18

Tactic information extraction and representation Multi-object trajectories acquisition Aggregate trajectory computation Play region sequence generation 19

Aggregate trajectory computation Mosaic trajectory computation Global motion estimation(GME) is used to establish the mapping between the spatial coordinates in two successive video frames. 20

Aggregate trajectory computation Temporal and spatial interaction analysis 21

Tactic information extraction and representation Multi-object trajectories acquisition Aggregate trajectory computation Play region sequence generation 22

Play region sequence generation 23

Introduction Math attack event extraction from broadcast soccer video Tactic information extraction and representation Tactic pattern analysis Summary Experimental results Conclusion 24

Tactic pattern analysis Route pattern recognition Interaction pattern recognition 25

Tactic pattern analysis Route pattern recognition Interaction pattern recognition 26

Route pattern recognition Given the video sequence An attack event G Play region sequence is 27

Tactic pattern analysis Route pattern recognition Interaction pattern recognition 28

Interaction pattern recognition Given the aggregate trajectory 29

Interaction pattern recognition Given the aggregate trajectory AT of a cooperative attack, the subset Whereis the Kronecker delta function 30

Interaction pattern recognition Recognition for individual attack Thres is a predefined error threshold 31

Introduction Math attack event extraction from broadcast soccer video Tactic information extraction and representation Tactic pattern analysis Summary Experimental results Conclusion 32

Summary Time stamp for event occurrence which is obtained from the web-casting text analysis. Team labels in terms of offensive and defensive which is extracted from web-casting text. Trajectories of the ball, offensive players and defensive players respectively which are extracted by multi-object detection and tracking. 33

Summary Route pattern(side- or center-) which is recognized by route pattern recognition. Interaction pattern (two categories at coarse and fine levels respectively) which is classified by interaction pattern recognition. 34

Introduction Math attack event extraction from broadcast soccer video Tactic information extraction and representation Tactic pattern analysis Summary Experimental results Conclusion 35

Experimental results We conducted the experiments on the video data of FIFA World Cup Tdb: automatically Tmb: manually 36

Experimental results 37

Experimental results nc: correctly nm: miss nf false 38

Introduction Math attack event extraction from broadcast soccer video Tactic information extraction and representation Tactic pattern analysis Summary Experimental results Conclusion 39

Conclusion We have presented a novel approach to discover the tactic patterns from the attack events in broadcast soccer video. In future work, the proposed tactic representation and temporal-spatial interaction analysis will be applied to mining more tactic patterns in soccer games. 40