LINK PREDICTION IN CO-AUTHORSHIP NETWORK Le Nhat Minh ( A N) Supervisor: Dongyuan Lu Aobo Tao Chen 1

Introduction Co-authorship network A network of collaborations among researchers, scientists, academic writers Link prediction Introduce future connections within the network scope 2 Problem Background Related Work MethodExperiment Feature Analysis Result Analysis

Problem Background What connect researchers together ? Given an instance of co-authorship network: A researcher connect to another if they collaborated on at least one paper. 3 Paper X (2001)Paper Y (2004) X X XYXY Co-author A, B,C Co-author B and C A B C Problem Background Related Work MethodExperiment Feature Analysis Result Analysis

4 A snapshot of co-authorship network Problem Background Related Work MethodExperiment Feature Analysis Result Analysis

Graph Description Co-authorship graph: Undirected graph G (V, E) Node or Vertex ( Author ) Author ID Author Name Link or Edge (Co-authorship) Pair of author ID List of publication year followed by paper title (Ex: 2004 :”Introduction to …” ) 5 Problem Background Related Work MethodExperiment Feature Analysis Result Analysis

Problem Background How to predict the link? Based on criteria: Co-authorship network topology Researcher’s personal information Researcher’s papers Boost up link predictions performance Recommend link should be really relevant to the interest of the authors or at least possible for researcher to collaborate. 6 Problem Background Related Work MethodExperiment Feature Analysis Result Analysis

Related Work Three mainstream approaches for link prediction: Similarity based estimation Liben ‐ Nowell, D., & Kleinberg, J., 2007 Maximum likelihood estimation Murata, T., & Moriyasu, S., 2008 Guimerà, R., & Sales-Pardo, M., 2009 Supervised Learning model Pavlov, M., & Ichise, R., 2007 Al Hasan, M., Chaoji, V., Salem, S., & Zaki, M., Problem Background Related Work MethodExperiment Feature Analysis Result Analysis

Summary Similarity based estimation Not quite well-perform Maximum likelihood Depend on particular network Work best for block-based networks and hierarchy network. Supervised learning model Perform better than similarity based estimation 8 Problem Background Related Work MethodExperiment Feature Analysis Result Analysis

Method 9 Classifier ModelFeatures Set Problem Background Related Work MethodExperiment Feature Analysis Result Analysis

Compare performance with other related papers. Baseline 1: Link Prediction using Supervised Learning (2006) by Al Hasan, M., Chaoji, V., Salem, S., & Zaki, M. Baseline 2: Finding experts by link prediction in Coauthorship network(2007) by Pavlov, M., & Ichise, R. 10 Method Problem Background Related Work MethodExperiment Feature Analysis Result Analysis

Baseline 1 DBLP dataset training testing 1,564,617 authors 540,459 papers Features Set: Shortest Distance Sum of Paper Count Sum of Neighbors Count Second Shortest Distance 11 Link Prediction using Supervised Learning (2006).pdf Problem Background Related Work MethodExperiment Feature Analysis Result Analysis

Baseline 2 12 Finding experts by link prediction in co authorship networks (2007).pdf Institute of Electronics Information and Communication Engineers (IEICE) database training testing 1,380 authors 1,620 links training testing 3,603 authors 7,512 links Problem Background Related Work MethodExperiment Feature Analysis Result Analysis Features set: Shortest Distance Common Neighbors Jaccard’s coefficient Adamic/Adar Preferential attachment Katz PageRank (min) PageRank (max) SimRank

My feature set From baseline 1 Shortest Path Total Number of paper From baseline 2 PageRank Adamic/Adar Preferential Attachment My additional features Common 3 rd Neighbor ( replace for Common Neighbor) Productivity Affiliations (university / faculty) Keywords (extract from title) Address of author Institute Conference 13 Problem Background Related Work MethodExperiment Feature Analysis Result Analysis

14 Training ( )Testing ( ) No of node104,265 No of link413,69135,558 Experiments set up Training data With 104,265 nodes, we have ~5 x 10 9 links (Hugh !!!) Positive link: 413,691 links Negative link: 413,691 links (choose randomly from the rest) Testing data Positive link: 35,558 links Negative link: 35,558 links Problem Background Related Work MethodExperiment Feature Analysis Result Analysis

Common 3 rd Neighbor ( replace for Common Neighbor) Productivity Affiliations (university / faculty) Keywords (extract from title) Address of author Institute Conference 15 Extracting features Problem Background Related Work MethodExperiment Feature Analysis Result Analysis

Common 3 rd Neighbor Instead of looking at the common neighbor, we look at a larger network of the authors. The reason is simple : Neighbors within the 1 st neighborhood often connected to each others already. Few links can be predicted, hence the recall is low. 16 Problem Background Related Work MethodExperiment Feature Analysis Result Analysis

Affiliation and Address the Institute These two features capture geography location of the authors. Hopefully they can increase the hit rate of the prediction. 17 Problem Background Related Work MethodExperiment Feature Analysis Result Analysis

Key words and Conference Key words are extracted from all the paper titles. Hopefully can prefer to the authors 'interests, fields of research. Conference are refers to the conference names that those papers are published. 18 Problem Background Related Work MethodExperiment Feature Analysis Result Analysis

Productivity Observe the “publication history” of an author For example, at a particular node A: 19 T 2 = 2005T 0 = 2000T 1 = 2004T 3 = 2006 i=0i=1i=2i=3 n=3 m=1 n=4 m=2 n=6 m=2 n=7 m=3 n : No. of shared paper m: No. of collaborators Problem Background Related Work MethodExperiment Feature Analysis Result Analysis

Productivity 20 α : a constant to assign the weight of each time period Productivity of the authors Observe the “history” of an author The “productivity” of node A: Problem Background Related Work MethodExperiment Feature Analysis Result Analysis

Baseline implementation: 21 Baseline 1 Shortest Distance Sum of Paper Count Sum of Neighbors Count Baseline 2 Shortest Distance Common Neighbors Jaccard’s coefficient Adamic/Adar Preferential attachment Katz PageRank (min) PageRank (max) Using my data structure and classifiers. Problem Background Related Work MethodExperiment Feature Analysis Result Analysis

Baseline 1 22 Problem Background Related Work MethodExperiment Feature Analysis Result Analysis

Baseline 2 23 Problem Background Related Work MethodExperiment Feature Analysis Result Analysis

My feature set From baseline 1 Shortest Path Total Number of paper From baseline 2 PageRank Adamic/Adar Preferential Attachment My additional features Common 3 rd Neighbor ( replace for Common Neighbor) Productivity Affiliations (university / faculty) Keywords (extract from title) Address of author Institute Conference 24 Problem Background Related Work MethodExperiment Feature Analysis Result Analysis

Compare with the baselines 25 Decision Tree Problem Background Related Work MethodExperiment Feature Analysis Result Analysis

Compare with the baselines 26 SVM Problem Background Related Work MethodExperiment Feature Analysis Result Analysis

Testing Training Why poor decision tree learning result from the features such as Keywords. Key Words Problem Background Related Work MethodExperiment Feature Analysis Result Analysis

Testing Training Shortest Path Problem Background Related Work MethodExperiment Feature Analysis Result Analysis

Research Plan Implement completely the baselines features set. Observe the data and analyze the “false positive” result Consider choosing randomly data for training and testing more carefully 29 Thank you Problem Background Related Work MethodExperiment Feature Analysis Result Analysis

References Adamic, L. A., & Adar, E. (2003). Friends and neighbors on the web. Social networks, 25(3), Al Hasan, M., Chaoji, V., Salem, S., & Zaki, M. (2006). Link prediction using supervised learning. In SDM’06: Workshop on Link Analysis, Counter-terrorism and Security. Liben ‐ Nowell, D., & Kleinberg, J. (2007). The link ‐ prediction problem for social networks. Journal of the American society for information science and technology, 58(7), Pavlov, M., & Ichise, R. (2007). Finding Experts by Link Prediction in Co- authorship Networks. FEWS, 290, Murata, T., & Moriyasu, S. (2008). Link prediction based on structural properties of online social networks. New Generation Computing, 26(3), Guimerà, R., & Sales-Pardo, M. (2009). Missing and spurious interactions and the reconstruction of complex networks. Proceedings of the National Academy of Sciences, 106(52), Bliss, C. A., Frank, M. R., Danforth, C. M., & Dodds, P. S. (2013). An Evolutionary Algorithm Approach to Link Prediction in Dynamic Social Networks. arXiv preprint arXiv: Cohen, S., & Ebel, L. (2013). Recommending collaborators using keywords. In Proceedings of the 22nd international conference on World Wide Web companion

Back up slides 31

Potential applications Recommend experts or group of researchers for individual researcher. 32

Similarity Based Estimation Use metrics to estimate proximities of pairs of researchers Based on those proximities to rank pairs of researchers The top pairs of researchers will likely to be the recommendations. 33

Maximum Likelihood Estimation Predefine specific rules of a network Required a prior knowledge of the network The likelihood of any non-connected link is calculated according to those rules. 34

Stochastic Block Model X Y The reliability of an individual link is:

Supervised Learning Model Construct dimensional feature vectors Fetch these vectors to classifiers to optimize a target function (training model) Link prediction becomes a binary classification 36

Link per year of training set is greater than link per year of testing set: In testing period, only consider “new” collaborations. Any collaborations between researchers that already has a link will be disregarded No of node937 No of link309357

Results with different classifiers Classifier Precision (Positive Predictive Value) (%) Recall (Hit rate) (%) F1 (Harmonic mean) (%) Decision Tree SMO Bagging Naive Bayes Multilayer Perceptron

Proposed Feature The reason for proposing this feature: Keep track of the researcher tendency Give “bonus” to researcher who tend to collaborate with “new” colleagues rather than “old” ones Also give high score for prolific researchers (based on number of published paper) 39

Stochastic Block Model Guimerà, R., & Sales-Pardo, M., Problem Background Related Work WorkflowConclusion

Related Work Link prediction problems in Social network Liben ‐ Nowell, D., & Kleinberg, J., 2007 Bliss, C. A., Frank, M. R., Danforth, C. M., & Dodds, P. S., 2013 In social network, interactions among users are very dynamic with: Creation of new link within a few days Deletion or replacement of the existent links Different features present by the two networks Characteristics of individual researcher : citations, affiliations, institutions,... Characteristics of person : marriage status, ages, working places, … 41 Problem Background Related Work WorkflowConclusion

Related Work Link prediction problems in Social network Liben ‐ Nowell, D., & Kleinberg, J., 2007 Bliss, C. A., Frank, M. R., Danforth, C. M., & Dodds, P. S., 2013 In social network, interactions among users are very dynamic with: Creation of new link within a few days Deletion or replacement of the existent links Different features present by the two networks Characteristics of individual researcher : citations, affiliations, institutions,... Characteristics of person : marriage status, ages, working places, … 42 Problem Background Related Work WorkflowConclusion

Experimental Results Measurement of performance Precision: Recall: Harmonic mean: 43 New links to predict: 57 links Prediction True LinkFalse Link True Link2631 False Link5,588429,778

Result Analysis Possible reasons Features Small set of data – sampling problem Instances of the negative links used for training 44 Problem Background Related Work WorkflowConclusion

Similarity Based Estimation 45 Adamic/Adar: X Y Z Problem Background Related Work WorkflowConclusion

Similarity Based Estimation Network structure based measurement 46 Some conventions: Problem Background Related Work Experiment Feature Analysis

Similarity Based Estimation Common Neighbor: 47 X Y Problem Background Related Work Experiment Feature Analysis

Similarity Based Estimation Jaccard’s coefficient: 48 X Y Problem Background Related Work Experiment Feature Analysis

Similarity Based Estimation Preferential Attachment: 49 X Y Problem Background Related Work WorkflowConclusion

Similarity Based Estimation 50 Adamic/Adar: X Y Z Problem Background Related Work Experiment Feature Analysis

Similarity Based Estimation 51 Shortest Path: X Y Z Problem Background Related Work Experiment Feature Analysis

Similarity Based Estimation 52 PageRank: A random walk on the graph assigning the probability that a node could be reach. The proximity between a pair of node can be determined by the sum of the node PageRank. Problem Background Related Work Experiment Feature Analysis

Classify 3 kinds of features: 53