1. Visual Attributes in Video
Marielle Morris
Update Week 2
June 2, 2017

2. Follow-Up Last week: suggestion to use action attributes
Papers (cited by)
Jingen Liu, et al. “Recognizing human actions by attributes.” CVPR, 2011.
J. Carreira and A. Zisserman. “Quo vadis, action recognition? New models and the kinetics dataset.” IEEE CVPR, 2017.
Y. Zhou, et al., “Interaction Part Mining: A Mid-Level Approach for Fine-Grained Action Recognition,” IEEE CVPR, 2015
Attribute list for animal and human from YT-BB
Comparison chart

3. Attribute Comparisons
Animal (YT-BB)
Human (YT-BB)
Action Attributes (Jingen Liu)
Action Recognition
Fine-Grained Actions
curious
talking
box
laughing
jogging
standing
dancing
clap
punching
running
looking
performing
crawl
hugging
boxing
eating
jumping jack
kissing face
hand waving
walking
excited
jog
shaking hands
hand clapping
following
jump forward
opening presents
bending
docile
singing
jump sideways
mowing lawn
annoyed
sitting
dance
washing dishes
jumping forward
trotting
holding
push-up
swimming
jumping in place
sniffing
raise hand
drawing sword
waving one hand
biting
gesturing
run
wave hands
galloping sideways
hungry
smiling
side
clap hands
answering phone
sit to stand
carrying
dialing phone

4. Preliminary Attributes
playful
curious
calm
docile
obedient
happy
excited
nervous
alone/lonely
cozy
eating
hungry
sniffing
swimming
grooming
biting
leading
following
turning
sitting
standing
walking
trotting
running
talking
gesturing
fast
slow
annoyed
alert

5. Adding Bounding Boxes

6. Amazon Mechanical Turk

7. Next Week Find and make modifications to cocottributes repo
GUI for reel layout
Update MS-COCO dataset to YT-BB frames
Attribute annotation method
Set up AMT Sandbox and AWS account
Finalize attribute list