Week 9 Fatemeh Yazdiananari

Accomplished Tasks  Fixed the issues with classifiers  We retrained SVMs with the new UCF101 histograms  On temporally untrimmed videos:  Three test scenarios: A) Temporal trimming of validation videos (baseline) B) Whole-video histogram C) Sliding window: uniform windows, regardless of the content D) Sliding window: uniform windows, aligned with the content E) Max pooling on sliding windows

Accomplished Tasks  Fixed the issues with classifiers  We retrained SVMs with the new UCF101 histograms  On temporally untrimmed videos:  Three test scenarios: A) Temporal trimming of validation videos (baseline) B) Whole-video histogram C) Sliding window: uniform windows, regardless of the content D) Sliding window: uniform windows, aligned with the content E) Max pooling on sliding windows ✔ ✔ ✔ ✔

Sliding Window (Overlapping) Trimmed (full) Trimmed (10 sec) Whole Video Sliding Window (10 sec) Sliding Window – Overlapping Instance by Instance Accuracy 47.61%58.33%42.85%44.7%45.32% Weighted 50%64.28%N/A64.28% Max pooling 50%64.28%N/A64.28%

RESULTS Trimmed (full clip) Video #GT Class Max Pooling Classification Weighted Classification Accuracy by Instance # of Instance 1Hand Stand PushupsApply Lipstick 02 2Juggling Balls Typing Body Weight SquatsBlow Dry Hair 01 5Rope ClimbingBlow Dry Hair 03 6Baseball PitchIce Dancing 01 7Playing Violin Playing Guitar Push UpsBlow Dry Hair 01 10Juggling Balls Clean And Jerk Jump RopePommel Horse 01 13Swing Golf SwingBlow Dry HairPlaying Piano02

RESULTS Trimmed (10 sec long) Video #GT Class Max Pooling Classification Weighted Classification Accuracy by Instance # of Instance 1Hand Stand PushupsApply Lipstick 02 2Juggling Balls 502 3Typing Body Weight Squats Rope ClimbingBlow Dry Hair 03 6Baseball PitchIce Dancing 01 7Playing Violin Playing Guitar Push Ups Juggling Balls Clean And Jerk Jump RopeTrampoline Jumping 01 13Swing Golf SwingBlow Dry HairPlaying Piano02

RESULTS Whole Video Video #GT ClassClassificationAccuracy 1Hand Stand PushupsHaircut0 2Juggling Balls 100 3Typing 100 4Body Weight SquatsBlow Dry Hair0 5Rope ClimbingBlow Dry Hair0 6Baseball PitchPole Vault0 7Playing ViolinHaircut0 8Playing Guitar 100 9Push UpsBlow Dry Hair0 10Juggling Balls Clean And Jerk Jump RopePommel Horse0 13Swing Golf SwingSoccer Juggling0

RESULTS Sliding Window (10 sec long) Video #GT Class Max Pooling Classification Weighted Classification Accuracy by Window # of Windows 1Hand Stand PushupsApply LipstickGolf Swing08 2Juggling Balls Typing Body Weight Squats Rope ClimbingBlow Dry Hair 017 6Baseball PitchPole Vault 06 7Playing ViolinHair cut 010 8Playing Guitar Push Ups Juggling Balls Clean And Jerk Jump RopePommel HorseMopping Floor08 13Swing Golf Swing 33.39

RESULTS Overlapping Sliding Window (10 sec long) Video #GT Class Max Pooling Classification Weighted Classification Accuracy by Window # of Windows 1Hand Stand PushupsGolf Swing Juggling Balls Typing Body Weight Squats Rope ClimbingBlow Dry Hair Baseball PitchPole VaultField Hockey Penalty Playing ViolinHaircut Playing Guitar Push Ups Juggling Balls Clean And Jerk Jump RopePommel HorseMopping Floor Swing Golf Swing

Comments on Overlapping Window and Weighted Classification  Video #18 (rope climbing) have 1.45% accuracy in overlapping sliding window  These correctly identified windows did not have high probability values for this reason weighted classification wasn’t able to predict the correct class of the video.  Same goes for Video #31 (playing violin)