Automatic mapping and modeling of human networks ALEX (SANDY) PENTLAND THE MEDIA LABORATORY CAMBRIDGE PHYSIC A: STATISTICAL MECHANICS AND ITS APPLICATIONS.

Slides:



Advertisements
Similar presentations
The Sociometer: A Wearable Device for Understanding Human Networks Tanzeem Choudhury and Alex Pentland MIT Media Laboratory.
Advertisements

By Venkata Sai Pulluri ( ) Narendra Muppavarapu ( )
Principal Component Analysis Based on L1-Norm Maximization Nojun Kwak IEEE Transactions on Pattern Analysis and Machine Intelligence, 2008.
Pattern Recognition Ku-Yaw Chang
Pervasive Computing 通訊所 鄭筱親. Outline  Introduction  Context Awareness  Recent Research  Future and Conclusion.
Pattern Analysis Prof. Bennett Math Model of Learning and Discovery 2/14/05 Based on Chapter 1 of Shawe-Taylor and Cristianini.
Modelling and Analyzing Multimodal Dyadic Interactions Using Social Networks Sergio Escalera, Petia Radeva, Jordi Vitrià, Xavier Barò and Bogdan Raducanu.
On the Dimensionality of Face Space Marsha Meytlis and Lawrence Sirovich IEEE Transactions on PAMI, JULY 2007.
Proposed concepts illustrated well on sets of face images extracted from video: Face texture and surface are smooth, constraining them to a manifold Recognition.
An RG theory of cultural evolution Gábor Fáth Hungarian Academy of Sciences Budapest, Hungary in collaboration with Miklos Sarvary - INSEAD, Fontainebleau,
Chapter 2 Random Vectors 與他們之間的性質 (Random vectors and their properties)
Prénom Nom Document Analysis: Parameter Estimation for Pattern Recognition Prof. Rolf Ingold, University of Fribourg Master course, spring semester 2008.
Report on Intrusion Detection and Data Fusion By Ganesh Godavari.
P2P Network for Very Large Virtual Environment Proceedings of the ACM symposium on virtual reality software and technology VRST '06.
Chapter 12 - Forecasting Forecasting is important in the business decision-making process in which a current choice or decision has future implications:
CONTENT BASED FACE RECOGNITION Ankur Jain 01D05007 Pranshu Sharma Prashant Baronia 01D05005 Swapnil Zarekar 01D05001 Under the guidance of Prof.
Prénom Nom Document Analysis: Data Analysis and Clustering Prof. Rolf Ingold, University of Fribourg Master course, spring semester 2008.
Face Recognition Using Eigenfaces
CS335 Principles of Multimedia Systems Multimedia and Human Computer Interfaces Hao Jiang Computer Science Department Boston College Nov. 20, 2007.
Organizational Engineering using Sociometric Badges Benjamin N. Waber, Daniel Olguín Olguín, Taemie Kim, Akshay Mohan, Koji Ara, and Alex (Sandy) Pentland.
Chapter 5 Data mining : A Closer Look.
Sharena Paripatyadar.  What are the differences?
Statistical Natural Language Processing. What is NLP?  Natural Language Processing (NLP), or Computational Linguistics, is concerned with theoretical.
報告日期 :2012/03/07 指導教授 : 蔡亮宙 報 告 者 : 吳烱華 自製率 :100%.
Database Construction for Speech to Lip-readable Animation Conversion Gyorgy Takacs, Attila Tihanyi, Tamas Bardi, Gergo Feldhoffer, Balint Srancsik Peter.
Face Recognition Using EigenFaces Presentation by: Zia Ahmed Shaikh (P/IT/2K15/07) Authors: Matthew A. Turk and Alex P. Pentland Vision and Modeling Group,
Eigenfaces for Recognition Student: Yikun Jiang Professor: Brendan Morris.
Personalized Medicine Research at the University of Rochester Henry Kautz Department of Computer Science.
© 2006 MIT Media Lab Social Network Technology to Evaluate and Facilitate Collaboration MIT Media Lab Human Dynamics Group Prof. Alex (Sandy) Pentland.
6 am 11 am 5 pm Fig. 5: Population density estimates using the aggregated Markov chains. Colour scale represents people per km. Population Activity Estimation.
Chapter 8 Prediction Algorithms for Smart Environments
Spatial Statistics and Spatial Knowledge Discovery First law of geography [Tobler]: Everything is related to everything, but nearby things are more related.
U NIVERSITY OF M ASSACHUSETTS A MHERST Department of Computer Science 2011 Predicting Solar Generation from Weather Forecasts Using Machine Learning Navin.
SESSION IV. M I S MIS refers broadly to a computer-based system that provides managers with the tools for organizing, evaluating and efficiently running.
Model-View-Controller Ku-Yaw Chang Assistant Professor, Department of Computer Science and Information Engineering Da-Yeh University.
Element 2: Discuss basic computational intelligence methods.
Towards Cognitive Robotics Biointelligence Laboratory School of Computer Science and Engineering Seoul National University Christian.
EMIS 8381 – Spring Netflix and Your Next Movie Night Nonlinear Programming Ron Andrews EMIS 8381.
1 ENTROPY-BASED CONCEPT SHIFT DETECTION PETER VORBURGER, ABRAHAM BERNSTEIN IEEE ICDM 2006 Speaker: Li HueiJyun Advisor: Koh JiaLing Date:2007/11/6 1.
Intelligent Database Systems Lab Advisor : Dr. Hsu Graduate : Keng-Wei Chang Author : Javier Contreras Rosario Espinola Francisco J. Nogales Antonio J.
Report on Intrusion Detection and Data Fusion By Ganesh Godavari.
Behavioral Entropy of a Cellular Phone User Santi Phithakkitnukoon Husain Husna Ram Dantu (Presenter) Computer Science & Engineering University of North.
Biostatistics Class 1 1/25/2000 Introduction Descriptive Statistics.
17 May 2007RSS Kent Local Group1 Quantifying uncertainty in the UK carbon flux Tony O’Hagan CTCD, Sheffield.
Chapter Outline 2.1 Estimation Confidence Interval Estimates for Population Mean Confidence Interval Estimates for the Difference Between Two Population.
The Second Life of a Sensor: Integrating Real-World Experience in Virtual Worlds using Mobile Phones Mirco Musolesi, Emiliano Miluzzo, Nicholas D. Lane,
1 Terrorists Face recognition of suspicious and (in most cases) evil homo-sapiens.
Correlational Research Designs. 2 Correlational Research Refers to studies in which the purpose is to discover relationships between variables through.
Designing multiple biometric systems: Measure of ensemble effectiveness Allen Tang NTUIM.
ECE 8443 – Pattern Recognition LECTURE 08: DIMENSIONALITY, PRINCIPAL COMPONENTS ANALYSIS Objectives: Data Considerations Computational Complexity Overfitting.
CSE 185 Introduction to Computer Vision Face Recognition.
The Sociometer: A Wearable Device for Understanding Human Networks
Chapter 3: Maximum-Likelihood Parameter Estimation l Introduction l Maximum-Likelihood Estimation l Multivariate Case: unknown , known  l Univariate.
Optimal Component Analysis Optimal Linear Representations of Images for Object Recognition X. Liu, A. Srivastava, and Kyle Gallivan, “Optimal linear representations.
PhD Candidate: Tao Ma Advised by: Dr. Joseph Picone Institute for Signal and Information Processing (ISIP) Mississippi State University Linear Dynamic.
Design of PCA and SVM based face recognition system for intelligent robots Department of Electrical Engineering, Southern Taiwan University, Tainan County,
Performance Comparison of Speaker and Emotion Recognition
1 Module One: Measurements and Uncertainties No measurement can perfectly determine the value of the quantity being measured. The uncertainty of a measurement.
Big traffic data processing framework for intelligent monitoring and recording systems 學生 : 賴弘偉 教授 : 許毅然 作者 : Yingjie Xia a, JinlongChen a,b,n, XindaiLu.
Face detection and recognition Many slides adapted from K. Grauman and D. Lowe.
Statistical Concepts Basic Principles An Overview of Today’s Class What: Inductive inference on characterizing a population Why : How will doing this allow.
Data Summit 2016 H104: Building Hadoop Applications Abhik Roy Database Technologies - Experian LinkedIn Profile:
Stats 242.3(02) Statistical Theory and Methodology.
Chapter 6 Activity Recognition from Trajectory Data Yin Zhu, Vincent Zheng and Qiang Yang HKUST November 2011.
Descriptive Statistics The means for all but the C 3 features exhibit a significant difference between both classes. On the other hand, the variances for.
CSE 4705 Artificial Intelligence
University of Ioannina
Nathan Eagle Sandy Pentland
Face Recognition and Detection Using Eigenfaces
Speaking patterns -MAS.662J, Fall 2004
Presentation transcript:

Automatic mapping and modeling of human networks ALEX (SANDY) PENTLAND THE MEDIA LABORATORY CAMBRIDGE PHYSIC A: STATISTICAL MECHANICS AND ITS APPLICATIONS 2007

1. Introduction 2. Socioscopes 3. Reality mining 4. Social signals 5. Practical concerns 6. Conclusions Comments Outline 2

Studies on office interactions [1]  35–80% of work time in conversation,  14–93% of work time in communication  7–82% of work time in meetings The properties of human networks :  Location context: work, home, etc.  Social context: with friends, co-workers, boss, family, etc.  Social interaction: are you displaying interest, boredom etc. To obtain solid, dynamic estimates of the users’ group membership and the character of their social relationships. 1. Introduction (1/2) 3 [1] T. Allen, Architecture and Communication Among Product Development Engineers, MIT Press, Cambridge, MA, 1997, pp. 1–35.

Using this data to model individual behavior as a stochastic process  allows prediction of future activity. The key to automatic inference of information network parameters is the recognition Standard methods, surveys  subjectivity and memory effects, out-of-date.  Even information is available, need to validate or correct by automatic method we present statistical learning methods  wearable sensor data to estimates user’s interaction 1. Introduction (2/2) 4

mapping and modeling human networks  the conceptual framework used in biological observation,  such as apes in natural surroundings  natural experiments  such as twin studies, but replacing expensive and unreliable human observations with automated, computer- mediated observations.  accurately and continuously track the behavior  recording with near perfect accuracy. 2. Socioscopes 5

Using mobile telephones, electronic badges, and PDAs  Tracking the behavior of 94 people in two divisions of MIT  the business school and the Media Laboratory  between 23 and 39 years of age  the business school students a decade older than the Media Lab students.  2/3 male and 1/3 female  half were raised in America. Imaginary Socioscope 6

The first part: ‘smart’ phones  to observe gross behavior (location, proximity) continuously over months  330,000 h of data, the behavior of 94 people, 35 years The second part: electronic badges  record the location, audio, and upper body movement  to observe for fine-grained behavior (location, proximity, body motion) over one-day periods The third part: a microphone and software  to analyze vocalization statistics with an accuracy of tenths of seconds Three main parts of the Socioscope 7

Four main types of analysis:  characterization of individual and group distribution and variability  using an Eigenvector or principal components analysis  conditional probability relationships between individual behaviors known as ‘influence modeling’  accuracy with which behavior can be predicted  with equal types I and II error rates  comparison of these behavioral measures to standard human network parameters. 2. Socioscopes (4/5) 8

Eigenbehaviors provide an efficient method for learning and classifying user behavior [9]. Given behaviors Γ 1, Γ 2,...,Γ m for a group of M people,  the average behavior of the group can be defined by To deviate an individual’s behavior from the mean.  A set of M vectors, Φ = Γ i - Ψ, 3. Reality mining 9 [9] N. Eagle, A. Pentland, Eigenbehaviors: Identifying Structure in Routine, October 2005, see TR 601 hhttp://hd.media.mit.edui.

Γ i (x,y), 2-D location information  a low-dimensional ‘behavior space’,  spanned by their Eigenbehaviors Fig. 1 10

Principle Components Analysis, PCA  a set M orthonormal vectors, u n, which best describes the distribution of the set of behavior data when linearly combined with their respective scalar values, λ n.  Covariance matrix of Φ  Where  The Eigenbehaviors can be ranked by the total amount of variance in the data for which they account, the largest associated Eigenvalues Eigenbehavior modeling 11

The main daily pattern, observed  subjects leaving their sleeping place to spend time in a small set of locations during the daylight hours  breaking into small clusters to move to one of a few other buildings during the early night hours and weekends  then back to their sleeping place. Over 85% of the variance in the behavior of low entropy subjects can be accounted for by the mean vector alone Human Eigenbehaviors (1/2) 12

the top three Eigen behavior components  the weekend pattern,  the working late pattern, and  the socializing pattern. The ability to accurately characterize peoples’ behavior with a low-dimensional model means  automatically classify the users’ location context  the system to request that the user label locations  can achieve very high accuracies with limited user input Human Eigenbehaviors (2/2) 13

Behavioral structure  Conditional probability to predict the behavior  Two main sub-networks  during the day  in the evening Critical requirement for automatic mapping and modeling of human networks  to learn and categorize user behavior  accurately capture the dynamics of the network Learning influence (1/2) 14

Coupled Hidden Markov Models, CHMMs [10-12]  to describe interactions between two people  the interaction parameters  limited to the inner products of the individual Markov chains. The graphical model for influence model  behavior has the same first-order Eigen structure  it possible to analyze global behavior 3.3. Learning influence (2/2) 15 [10] A. Pentland, T. Choudhury, N. Eagle, S. Push, Human Dynamics: Computation for Organizations, Pattern Recognition, vol. 26, 2005, pp. 503–511, see TR 589 hhttp://hd.media.mit.edui. [11] W. Dong, A. Pentland, Multi-sensor data fusion using the influence model, IEEE Body Sensor Networks, April, Boston, MA, 2006, see TR 597 hhttp://hd.media.mit.edui. [12] C. Asavathiratham, The influence model: a tractable representation for the dynamics of networked Markov chains, in: Department of EECS, 2000, MIT, Cambridge.

Using the influence model to analyze the proximity data from our cell phone experiment we find that Clustering the daytime influence relationships  96% accuracy at identifying workgroup affiliation  92% accuracy at identifying self-reported ‘close’ friendships. Similar findings, using the badge platform.  the combination of influence and proximity predicted whether or not two people were affiliated with the same company with 93% accuracy [6] Influence modeling 16

People are able to ‘size up’ other people from a very short period of observation [13, 14].  linguistic information from observation,  to accurately judge prospects for friendship, work relationship, negotiation, marital prospects we developed methods for automatically measuring some of the more important types of social signaling [7].  Excitement, freeze, determined and accommodating. 4. Social signals 17

Can predict human behavior?  without listening to words or knowing about the people involved. By linear combinations of social signal features to accurately predict human behaviors.  who would exchange business cards at a meeting;  which couples would exchange phone numbers at a bar;  who would come out ahead in a negotiation;  who was a connector within their work group; 18 Predict human behavior

Continuous analysis interactions within an organization may seem reasonable and if misused, could be potentially dangerous. Conversation postings:  the data should be shared, private, or permanently deleted.  Decided by individuals. Demanding environments:  the environmental demands may supersede privacy concerns. 5. Practical concerns 19

human behavior is predictable than is generally thought, and especially predictable from others. This suggests that  humans are best thought of social intelligences rather than independent actors. As a consequence  can analyze behavior using statistical learning tools  such as Eigenvector analysis and influence modeling,  to infer social relationships without to understand the detailed linguistic or cognitive structures surrounding social interactions. 6. Conclusions 20

經由 human network 找出人與人間的關係及其建立 model 的作法 在我們的運用是找出 criminal 及找 criminal 的同伙 瞭解將行動電話及不同的 sensor 等如何運用在 human network Human network 對 prediction 的幫助為何 ? Comments 21