CRCV REU 2019 Week 5.

Slides:



Advertisements
Similar presentations
Y A S O O B A L I b o r n o n 1 9 t h F e b r u a r y i n K a n p u r d i s t r i c t o f U t t a r P r a d e s h. H e s t a r t e d s i n g i.
Advertisements

Insert Category 1 $100 $200 $300 $400 $500 $ 500$500 Insert Category 2 Insert Category 3 Insert Category 4 Insert Category 5.
Logos Module 4: Working with Images LESSON 2. Module 4: Working with Images LESSON 2 In this lesson, we will:  Investigate different logo types and their.
Today we will be learning: different ways of making totals using odd and even numbers to investigate a general statement.
WEEK 1 You have 10 seconds to name…
THE WONDERFUL WORLD OF WHALES Miss Brady Science & Language Arts First Grade.
Observation vs. Inferences The Local Environment.
Category Category Category Category Category
Image from
Analyzing the Behavior of Deep Models Dhruv Batra Devi Parikh Aishwarya Agrawal (EMNLP 2016)
BUS 475 Week 3 DQ 2 What is corporate governance? What role does corporate governance play in strategic planning? Why is it important? Explain your answer.
What is Physical Science?
Hierarchical Question-Image Co-Attention for Visual Question Answering
CS 4501: Introduction to Computer Vision Computer Vision + Natural Language Connelly Barnes Some slides from Fei-Fei Li / Andrej Karpathy / Justin Johnson.
LESSON 2 Module 4: Working with Images Logos.
Literary Jeopardy!.
Instructional Strategies
Directions Use a separate sheet of paper to answer the questions. Turn it into the box when complete. For each question predict what will happen and include.
Professional Networking
VQA: Visual Question Answering
Chapter 1: What is Physics?
GCSE Psychology Topic C Do TV and video games affect young people’s behaviour? Social Learning Theory (SLT)
Complete the missing numbers using the inverse.
Harnessing Human Energy
Visual Rhetoric.
Year 6 – Science Investigation.
סדר דין פלילי – חקיקה ומהות ההליך הפלילי
Practical Work for Learning
منهج البحث العلمي ( Scientific Research Method )
Tina Jiang. , Vivek Natarajan. , Xinlei Chen
The method scientists use to find answers to questions
Does this always work? - Why?

Announcements Exams handed back in lab this week.
Romanesque or Gothic You are going to look at six different images, and will be asked to guess if it is the Romanesque or Gothic style of architecture,
My Core Sample by (Your Name).
Do you know the difference?
What if We Wonder Mona Lisa.
Angles of elevation and depression.
Year 2 Autumn Term Week 9 Lesson 2
Category 1 Category 2 Category 3 Category 4 Category
Year 2 Spring Term Week 8 Lesson 5
1. Write all that you can about this image around the outside
CATEGORY ONE Enter category name on this slide..
You must show all steps of your working out.
Year 2 Autumn Term Week 9 Lesson 2
Question 1.
Self-Knowledge (Sophomore Year) Lesson Five
Scientific Method page 9
Your Business Proposal
Good Morning ! Here’s your warm up..
Year 2 Spring Term Week 8 Lesson 5
Video Notes Organizer What did I learn today?.
Add Main Topic Here Created by Educational Technology Network
Command(s):_______________ Focus:_________________
How Should You Participate in this Course?
What is it?.
Kensington Primary School
I have the question But what next?.
SCATTERPLOTS.
Visual Question Answering Aaron Honculada, Aisha Urooj Khan, Dr
CRCV REU 2019 Week 8 Aaron Honculada.
A CASE FOR CHANGE.
Additional text exploring the video clip.
Polynomial investigation
REU Report Meeting Week 9
CRCV REU 2019 Week 4.
7 pt 7 pt 7 pt 7 pt 7 pt 14 pt 14 pt 14 pt 14 pt 14 pt 21 pt 21 pt
Self-Supervised Cross-View Action Synthesis
10x + y What do you notice? x = 2 and y = 1? x = 4 and y = 5?
Presentation transcript:

CRCV REU 2019 Week 5

Current Approach Last Week: LSTM Investigate What LSTM misses Question + Answers vs Question + Answers with Video

Literature Review Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering Devi Parikh, CVPR 2017 Higher entropy in P(A|Q) such that image I must assist to determine A Explanation modality: counter-examples, close to but not belonging to category predicted by model

Results Total Q Total Q + V 6214 6221

Results Total Q Total Q + V Exclusive Q Exclusive Q + V 6214 6221 966 973

Results Total Q Total Q + V Exclusive Q Exclusive Q + V Both Missed 6214 6221 966 973 1442

Results Total Q Total Q + V Exclusive Q Exclusive Q + V Both Missed 6214 6221 966 973 1442 Who Total Q 647 Total Q + V 606

Results Total Q Total Q + V Exclusive Q Exclusive Q + V Both Missed 6214 6221 966 973 1442 Who Total Q 647 Total Q + V 606 Exclusive Q 164 Exclusive Q + V 124 Both Missed 286

Results Total Q Total Q + V Exclusive Q Exclusive Q + V Both Missed 6214 6221 966 973 1442 Who Where Total Q 647 721 Total Q + V 606 746 Exclusive Q 164 103 Exclusive Q + V 124 128 Both Missed 286 160

Results Total Q Total Q + V Exclusive Q Exclusive Q + V Both Missed 6214 6221 966 973 1442 Who Where What Total Q 647 721 3568 Total Q + V 606 746 3579 Exclusive Q 164 103 514 Exclusive Q + V 124 128 525 Both Missed 286 160 731

Results Total Q Total Q + V Exclusive Q Exclusive Q + V Both Missed 6214 6221 966 973 1442 Who Where What How Total Q 647 721 3568 566 Total Q + V 606 746 3579 580 Exclusive Q 164 103 514 70 Exclusive Q + V 124 128 525 84 Both Missed 286 160 731 136

Results Total Q Total Q + V Exclusive Q Exclusive Q + V Both Missed 6214 6221 966 973 1442 Who Where What How Why Total Q 647 721 3568 566 712 Total Q + V 606 746 3579 580 710 Exclusive Q 164 103 514 70 114 Exclusive Q + V 124 128 525 84 112 Both Missed 286 160 731 136 129

Next Steps Add Modules to the Baseline LSTM Further Explore the predictions