Done this week Improve sentence emotion classifier Convert movie dataset to sentence emotion dataset Movie image, description Sentibank: classify emotion of image Description and emotion to train sentence emotion classifier
Implementing Sentibank Need emotion from image Sentibank: ANPs from image Sentibank’s web interface: emotion from ANP Image Sentibank ANP scores for image (1200x1) Sentibank’s web interface ANPs (1200) Emotion scores for ANPs (1200x24) Top 10 ANP scores (10x1) Emotion scores for top 10 ANPs (10x24) Emotion scores for image(1x24)
Image emotion classifier Top ANPs Calm lake Peaceful boat Awesome view Incredible view Golden bay
Image emotion classifier Top ANPs Shy smile Smooth skin Innocent smile Cute smile Cute baby
Image emotion classifier Top ANPs Sweet puppy Smiling dog Hungry puppy Adorable dog Silly face
Image emotion classifier Top ANPs Creepy tree Dead tree Slender trees Dry tree Sunny trees
Future Work Classify emotions of movie dataset Retrain sentence emotion classifier on movie dataset Learning to map descriptive to expressive sentences