integrating Data for Analysis, Anonymization, and SHaring Supported by the NIH Grant U54HL to the University of California, San Diego Shuang Wang, 1 Xiaoqian Jiang, 1 Yuan Wu, 1 Lijuan Cui, 2 and Samuel Cheng 2, Lucila Ohno-Machado 1 EXpectation Propagation LOgistic REgRession (EXPLORER): distributed privacy-preserving online model learning 1 Division of Biomedical Informatics, University of California–San Diego, La Jolla, California, USA 2 School of Electrical and Computer Engineering, University of Oklahoma, Tulsa, Oklahoma, USA Introduction EXPLORER framework Summary of Conclusions It has been shown in last decade that data privacy cannot be maintained by simply removing patient identities. Thus, training data in one institute cannot be exchanged or shared with other institutions directly for the purposes of global logistic regression model learning. To address such a challenge, numerous privacy-preserving distributed frequentist regression models for horizontally partitioned data have been studied, among which Grid LOgistic RE- gression (GLORE) model [1] and the Secure Pooled Analysis acRoss K-site (SPARK) protocol [2] are the closest work for the method presented here. Despite its simplicity and interpretability, the distributed frequentist logistic regression approach has limitations as shown in Table 1. Table 1: Comparing EXPLORER with GLORE and SPARK References [1] Wu, Y., Jiang, X., Kim, J., Ohno-Machado, L. (2012). Grid Binary LOgistic REgression (GLORE): building shared models without sharing data. JAMIA, 19(5), [2] El Emam, K., Samet, S., Arbuckle, L., Tamblyn, R., Earle, C., & Kantarcioglu, M. (2013). A secure distributed logistic regression protocol for the detection of rare adverse drug events. JAMIA, 20(3), [3] Wang, S., Jiang, X., Wu, Y., Cui, L., Cheng, S., & Ohno-Machado, L. (2013). EXpectation Propagation LOgistic REgRession (EXPLORER): Distributed privacy-preserving online model learning. JBI, 46(3), In summary, EXPLORER offers an alternative tool for privacy-preserving distributed statistical learning. We showed empirically on multiple data sets that the results are very similar to those of ordinary logistic regression. These promising results warrant further validation in larger data sets and further refinement of the methodology. Inability to openly share (i.e., transmit) patient data without onerous processes involving pair-wise agreements between institutions may significantly slow down analyses that could produce important results for healthcare improvement and biomedical research advances. EXPLORER provides a means to mitigate this problem by relying on multiparty computation without need for extensive re-training of models, nor reliance on synchronous communications among sites. Privacy protection Asynchronous communication Online learning GLORE or SPARK ✔ EXPLORER ✔✔✔ We developed an EXpectation Propagation LOgistic REgRession (EXPLORER) model for distributed privacy-preserving online learning [3]. The proposed framework provides a high level guarantee for protecting sensitive information, since the information exchanged between the server and the client is the encrypted posterior distribution of coefficients. Through experimental results, EXPLORER shows the same performance as the traditional frequentist logistic regression model, but provides more flexibility in model updating. That is, EXPLORER can be updated one point at a time rather than having to retrain the entire data set when new observations are recorded. The proposed EXPLORER supports asynchronized communication, which relieves the participants from coordinating with one another, and prevents service breakdown from the absence of participants or interrupted communications Experimental Results Methodology Secured Intermediate iNformation Exchange (SINE) protocol DatasetDataset description# of covariates# of samples 1Simulated i.i.d. data5500 2Simulated correlated data6500 3Simulated binary data Myocardial infarction91253 Table 2: Summary of datasets used in our experiments Ordinary LREXPLORERtwo-sample Z-test β Prob. Test statistic p-value β β β β β Table 3: Distributed forward feature selection on data set 1 over 30 trials Table 4: Comparisons of H-L tests and AUCs for simulated dataset 2 with/without interaction using Ordinary LR and 4-site EXPLORER With interactionWithout interaction Ordinary LR EXPLORER H-L testtest statistics p-value AUC Averaged value Standard deviation Z-test statistics Z-test p-value The convergence speed of all 10 coefficients of the data set 4 for an asynchronous 8- site EXPLORE setup β Ordinary LREXPLORERtwo-sample Z test value std. Test statistic p-value β β β β β β β β β β β β β β β β Table 5: Learned model parameter β of dataset 3 using Ordinary LR and 2-site EXPLORER