1. Large-Scale, Real-World Face Recognition in Movie Trailers Alan Wright

2. Plan of Attack Extract Facial Tracks from videos Extract the features from the facial tracks. Build framework to load and test data. Begin with baseline testing (Sparse, min, mean, etc) Algorithm development…

3. Dataset 2010 Movie Trailers o 305 videos o Avg. of 625 faces per trailer o Avg. of 23 face trackers per trailer PubFig o 58,787 photos o 200 people o Avg. of 295 photos per person.

4. Dataset Facetrack:Dictionary:

5. Face Tracks We have: Instead of:

6. Linear Combination Approach + x 2 + x 3 + x 4 + x 5 + x 6 + x 7 + x 8 + x 9 Test Image = x1x1 Training Images

7. Linear Combination Approach y Testing A = = Training x Coefficients

8. Linear Combination & Face Tracks

14. Linear Combination & Face tracks

15. Linear Combination & Face Tracks

17. Sylvester Stallone

18. Variations Blurry images within face tracks Unknowns Facial Expressions

19. Variations Pose Occlusions

20. Preliminary Testing Ran SRC facial recognition on extracted facial tracks from Date Night. Choose the name that has the most votes in the track. Looking strictly at Steve Carell and Tina Fey tracks…

21. Results Correctly assessed 15 out of 34 face tracks correctly (44.12% accuracy). 6 out of 18 Tina Fey face tracks (33.33% accuracy). 9 out of 16 Steve Carell face tracks (56.25% accuracy).

22. Correct Result Track 7- IDed CORRECTLY as: Tina Fey o Alyssa Milano had 2 votes o Drew Barrymore had 4 votes o Jennifer Love Hewitt had 1 votes o Salma Hayek had 3 votes o Tina Fey had 22 votes 32 frames in this track 68.75% identified as Tina Fey

23. Correct Result

24. Good facial crop. Many frames. Good lighting Non blurry Generally straightforward pose

25. Incorrect Result (1) Track 9- IDed as: Gael Garcia Bernal o Clive Owen had 2 votes o Cristiano Ronaldo had 1 votes o Gael Garcia Bernal had 3 votes o Steve Carell had 2 votes

26. Incorrect Result (1)

27. Blurry Not a great crop Only 7 frames

28. Incorrect Result (2) Track 26 - IDed as: Nicole Kidman o David Duchovny had 2 votes o Lucy Liu had 1 votes o Michael Bloomberg had 1 votes o Nicole Kidman had 3 votes o Salma Hayek had 1 votes

29. Incorrect Result (2)

30. Profile view Poor crop Only 8 frames.

31. Incorrect Result (3) track 40 - IDed as: Keira Knightley o Adriana Lima had 6 votes o Cindy Crawford had 8 votes o Eliot Spitzer had 1 votes o Eva Mendes had 1 votes o Gillian Anderson had 1 votes o Keira Knightley had 18 votes o Meg Ryan had 3 votes o Minnie Driver had 1 votes o Salma Hayek had 3 votes o Tina Fey had 15 votes

32. Incorrect Result (3)

33. Dark lighting Pose variation Motion blur toward the end 57 frames

34. Whats next? Continue to look at the coefficient vector. Look into confidence of each choice (SCI and residual error) Apply different facial recognition algorithms. Best way to choose a name for each track? (Mode, strongest confidence, etc.)