Using Social Media to Enhance Emergency Situation Awareness

Slides:



Advertisements
Similar presentations
Introduction to Information Retrieval
Advertisements

Sentiment Analysis on Twitter Data
Farag Saad i-KNOW 2014 Graz- Austria,
Tweet Classification for Political Sentiment Analysis Micol Marchetti-Bowick.
Towards Twitter Context Summarization with User Influence Models Yi Chang et al. WSDM 2013 Hyewon Lim 21 June 2013.
Distant Supervision for Emotion Classification in Twitter posts 1/17.
Presenter: Liu, Ya Tian, Yujia Pham, Anh TwitterMonitor: Trend Detection over the Twitter Stream EvenTweet: Online Localized Event Detection from Twitter.
Supervised Learning Techniques over Twitter Data Kleisarchaki Sofia.
Comparing Twitter Summarization Algorithms for Multiple Post Summaries David Inouye and Jugal K. Kalita SocialCom May 10 Hyewon Lim.
Introduction to Automatic Classification Shih-Wen (George) Ke 7 th Dec 2005.
Mobile Crowdsourcing in the Gulf of Mexico Oil Spill Considerations for Integration with Professional GIS Robert Laudati Trimble Navigation Ltd. November.
5/30/2006EE 148, Spring Visual Categorization with Bags of Keypoints Gabriella Csurka Christopher R. Dance Lixin Fan Jutta Willamowski Cedric Bray.
Redaction: redaction: PANAKOS ANDREAS. An Interactive Tool for Color Segmentation. An Interactive Tool for Color Segmentation. What is color segmentation?
Scalable Text Mining with Sparse Generative Models
Finding Advertising Keywords on Web Pages Scott Wen-tau YihJoshua Goodman Microsoft Research Vitor R. Carvalho Carnegie Mellon University.
Forecasting with Twitter data Presented by : Thusitha Chandrapala MARTA ARIAS, ARGIMIRO ARRATIA, and RAMON XURIGUERA.
Emergency Situation Awareness from Twitter for Crisis Management WWW 2012 Workshop on Social Web for Disaster Management CSIRO ICT CENTRE Mark Cameron,
Temporal Event Map Construction For Event Search Qing Li Department of Computer Science City University of Hong Kong.
Tag-based Social Interest Discovery
Attention and Event Detection Identifying, attributing and describing spatial bursts Early online identification of attention items in social media Louis.
Automatically Identifying Localizable Queries Center for E-Business Technology Seoul National University Seoul, Korea Nam, Kwang-hyun Intelligent Database.
 What is social media? ◦ Twitter ◦ Facebook  Why should we care? ◦ Served Agencies ◦ Real-time information ◦ Situational Awareness ◦ Organization 
Beyond Co-occurrence: Discovering and Visualizing Tag Relationships from Geo-spatial and Temporal Similarities Date : 2012/8/6 Resource : WSDM’12 Advisor.
Multimodal Alignment of Scholarly Documents and Their Presentations Bamdad Bahrani JCDL 2013 Submission Feb 2013.
Exploring Online Social Activities for Adaptive Search Personalization CIKM’10 Advisor : Jia Ling, Koh Speaker : SHENG HONG, CHUNG.
 Text Representation & Text Classification for Intelligent Information Retrieval Ning Yu School of Library and Information Science Indiana University.
Wei Feng , Jiawei Han, Jianyong Wang , Charu Aggarwal , Jianbin Huang
Automatic Detection of Social Tag Spams Using a Text Mining Approach Hsin-Chang Yang Associate Professor Department of Information Management National.
Visual Analytics with Linked Open Data and Social Media for e- Governance Vitaveska Lanfranchi Suvodeep Mazumdar Tomi Kauppinen Anna Lisa Gentile Updated.
Bursty Event Detection from Text Streams for Disaster Management Sungjun Lee, Sangjin Lee, Kwanho Kim, and Jonghun Park Information.
By Gianluca Stringhini, Christopher Kruegel and Giovanni Vigna Presented By Awrad Mohammed Ali 1.
CISC Machine Learning for Solving Systems Problems Presented by: Ashwani Rao Dept of Computer & Information Sciences University of Delaware Learning.
TEXT ANALYTICS - LABS Maha Althobaiti Udo Kruschwitz Massimo Poesio.
Competence Centre on Information Extraction and Image Understanding for Earth Observation 29th March 2007 Category - based Semantic Search Engine 1 Mihai.
Xintao Wu Jan 18, 2013 Retweeting Behavior and Spectral Graph Analysis in Social Media.
Enquiring Minds: Early Detection of Rumors in Social Media from Enquiry Posts Zhe Zhao Paul Resnick Qiaozhu Mei Presentation Group 2.
Linking Organizational Social Networking Profiles PROJECT ID: H JEROME CHENG ZHI KAI (A H ) 1.
Automatic Video Tagging using Content Redundancy Stefan Siersdorfer 1, Jose San Pedro 2, Mark Sanderson 2 1 L3S Research Center, Germany 2 University of.
1 Clarifying Sensor Anomalies using Social Network feeds * University of Illinois at Urbana Champaign + U.S. Army Research Lab ++ IBM Research, USA Prasanna.
Digital Libraries1 David Rashty. Digital Libraries2 “A library is an arsenal of liberty” Anonymous.
Geoscience Australia (GA) Support for Emergency Management Annual Preparedness Briefs 2015/2016 Monica Osuchowski - Emergency Management Coordinator.
Jointly Modeling Topics, Events and User Interests on Twitter Qiming DiaoJing Jiang School of Information Systems Singapore Management University.
Text Based Similarity Metrics and Delta for Semantic Web Graphs Krishnamurthy Koduvayur Viswanathan Monday, June 28,
Managing Situational Awareness using Web Feeds and Social Media During Emergency Events CSIRO Robert Power, Ryan Fraser | 7 November 2013.
An Effective Statistical Approach to Blog Post Opinion Retrieval Ben He, Craig Macdonald, Jiyin He, Iadh Ounis (CIKM 2008)
SOFTWARE TESTING TRAINING TOOLS SUPPORT FOR SOFTWARE TESTING Chapter 6 immaculateres 1.
Information Retrieval in Practice
Grow organise main features and benefits communicate.
A Simple Approach for Author Profiling in MapReduce
Learning to Detect and Classify Malicious Executables in the Wild by J
POLYGRAPH: Automatically Generating Signatures for Polymorphic Worms
Communications Director
When to engage in interaction – and how
Instantiation of the Concept in GAMMA Prototypes
MID-SEM REVIEW.
Federal Land Manager Environmental Database (FED)
DDoS Attack Detection under SDN Context
Medhavy Thankappan and Lan-Wei Wang
Analyzing and Visualizing Disaster Phases from Social Media Streams
Improving DevOps and QA efficiency using machine learning and NLP methods Omer Sagi May 2018.
iSRD Spam Review Detection with Imbalanced Data Distributions
Introduction A variety of situations may create the need to evacuate a University building including fires, natural disasters, and alarm activations.
Predicting Prevalence of Influenza-Like Illness From Geo-Tagged Tweets
Authors: Wai Lam and Kon Fan Low Announcer: Kyu-Baek Hwang
Air Traffic Control the Netherlands
Developing Vehicular Data Cloud Services in the IoT Environment
Best Twitter Tools To Embed Twitter Feed On Websites.
Stance Classification of Ideological Debates
Introduction A variety of situations may create the need to evacuate a University building including fires, natural disasters, and alarm activations.
Presentation transcript:

Using Social Media to Enhance Emergency Situation Awareness Jie Yin, Andrew Lampert, Mark Cameron, Bella Robinson and Robert Power

Motivation Situation Awareness Social Media CCC: Perception, comprehension and projection. Critical part of making effective decisions for emergency response Social Media Twitter Source of information and rapid communication Record real-world events CCC: Australian government’s Crisis Coordination Centre Response to national security and natural disaster incidents Hazard monitoring and situation awareness Situation awareness: “ The perception of elements in the environment within a volume of time and space, the comprehension of their meaning and the projection of their status in the near future.

Natural Disaster: ChristChurch in new Zealand

Twitter Traffic ChristChurch new Zealand earthquakes.2011. M is the magnitude of the earthquake.

Introduction A system that extracts situation awareness information from Twitter messages generated during various disasters and crises. Data sources are high-speed text streams retrieved from Twitter during natural disasters and crises

Introduction System Overview

Data Capture Component that gathers raw Twitter messages and forwards to other component. Location: Australia, New Zealand 66 millions distinct Tweets from 2.51 million distinct Twitter profiles Covers: tropical cyclone Ului (March 2010) the Brisbane storms (June 2010) the gunman in Melbourne (June 2010) the Christchurch earthquake (September 2010) the Qantas A380 incident (November 2010)

Burst Detection Continuously monitors a Twitter feed and raises an alert for immediate attention when it detects an unexpected incident with real-time efficiency For word f_j in time window W_i, the probability that the number of tweets will contain f_j is binomial distribution:

Burst Detection Determine whether a word f_j is bursty by comparing the actual probability that the word f_j occurs in the time window W_i against the expected probability P_j that this word occurs in a random window(L is the number of time windows containing f_j) : vs

Burst Detection Evaluation Training: 30 millions tweets between June-September 2010 Testing: annotated 2400 features as actual burst. Result: Detection rate(Correct labled/ total burst) False-Alarm(False labled /total nonburst) 72.13 1.4

Text Classification Automatically identify tweets containing information about the infrastructure status(including road,bridges,railways,hospitals…...) Naive Bayes and support vector machines(SVM) Features: Word unigrams Word bigrams Word length …...

Text Classification Naive Bayes SVM 86.2 87.5 Training : 450 tweets during 2011 Christchurch earthquake Manually labeled 10-fold-cross-validation Result(Unigram baseline 60%): Naive Bayes SVM 86.2 87.5

Online Clustering Automatically groups similar tweets into topic clusters so that each cluster corresponds to an event-specific topic. Scalable TF-IDF represents text Cluster is represented by a centroid feature(burst detection filtered). Similarity measurement(t is the time of posting this tweet): New sim takes time in conderation

Online Clustering Jaccard Sim(T_i,T_j) Cosine Sim(T_i,T_j) 0.42 0.34 Training: 3500 tweets during 2011 Christchurch earthquake. Measure: Silhouette score that describe the ratio between cluster coherence and separation Result: Jaccard Sim(T_i,T_j) Cosine Sim(T_i,T_j) 0.42 0.34 Jaccard sim(T1,T2) = |v1 ^ v2|/|v1 v v2|, cosine sim = |v1 * v2|/||v1|x |v2||

Geotagging Displays the content of a tweet at its geographic location on a map Using the geographic tags that if tweets have or the location of user profile.

Visualization Visualization interfaces for exploring and interacting with the information the system generated as well as the raw data extracted from Twitter. ChristChurch Equathquake

Visualization Qantas A380 incident : landing in singapore’s changi airport in 2010

Conclusion The System clearly provides useful situation awareness information Use NLP Tightly integrated components Enhance timely situation awareness across a range of crisis types Future we test on the overall performance on the whole system Personal opinion: In the future using social media to enhance situation awareness is useful and promising. More similar applications or systems could be came out.

Reference Yin, Jie, et al. "Using social media to enhance emergency situation awareness." IEEE Intelligent Systems 27.6 (2012): 52-59.

Questions?