Center for Science of Information 2016 NSF Site Visit: Overview December 6-7, 2016 National Science Foundation/Science & Technology Centers Program

Outline Science of Information CSoI Team & History Research Plan Research Thrusts Overview of Research Plan Legacy & Value Added Education and Diversity & Knowledge Transfer Sustainability Plan Management Budget

What is Science of Information? Claude Shannon laid the foundation of information theory, demonstrating that problems of data transmission and compression (i.e., reliably reproducing data) can be precisely modeled formulated, and analyzed. SCIENCE OF INFORMATION builds on Shannon’s principles to address key challenges in understanding information that nowadays is not only communicated but also acquired, curated, organized, aggregated, managed, processed, suitably abstracted and represented, analyzed, inferred, valued, secured, and used in various scientific, engineering, and socio-economic processes. CSoI MISSION: Advance science and technology through a new quantitative understanding of the representation, communication and processing of information in biological, physical, social and engineering systems.

Center’s Goals Extend Information Theory to meet new challenges in biology, economics, data & social sciences, and physical distributed systems. Understand new aspects of information (embedded) in structure, time, space, semantics, dynamic information, limited resources, complexity, representation invariant information, and cooperation & dependency.

Outline Science of Information CSoI Team & History Research Plan Research Thrusts Overview of Research Plan Legacy & Value Added Education and Diversity & Knowledge Transfer Sustainability Plan Management Budget

STC Team Bryn Mawr College: D. Kumar Howard University: R. Rwebangira MIT: P. Shor (co-PI) Purdue University (lead): W. Szpankowski (PI) Princeton University: S. Verdu (co-PI) Stanford University: A. Goldsmith (co-PI) Texas A&M: P.R. Kumar University of California, Berkeley: Bin Yu (co-PI) University of California, San Diego: S. Subramaniam UIUC: O. Milenkovic University of Hawaii: P. Santhanam Wojciech Szpankowski, Purdue Andrea Goldsmith, Stanford Peter Shor, MIT Sergio Verdú, Princeton R. Aguilar, M. Atallah, S. Datta, A. Grama, J. Neville, D. Ramkrishna, L. Si, V. Rego, M. Ward, D. Xu, C. Liu, L. Burge, N. Lynch, R. Rivest, M. Sudan,Y. Polyanskiy, W. Bialek, S. Kulkarni, C. Sims, T. Cover, A. Ozgur, T. Weissman, V. Anantharam, J. Gallant, T. Courtade, M. Mahoney, D. Tse, T. Coleman, Y. Baryshnikov, M. Raginsky, E. Abbe. Bin Yu, U.C. Berkeley

Center Participant Awards Nobel Prize (Economics): Sims National Academies: NAS – Bialek, Rivest, Shor, Sims, Verdu, Yu NAE – Datta, Lynch, Kumar, Ramkrishan, Rice, Rivest, Verdu Turing Award – Rivest Shannon Award – Verdu, Tse (Cover) Nevanlinna Prize – Sudan and Shor Richard W. Hamming Medal – Cover and Verdu Humboldt Research Award, A. Bement Jr. Award – Szpankowski Swartz Prize in Neuroscience – Bialek IEEE Field Award for Control Systems – Kumar Edwin Howard Armstrong Achievement Award – Goldsmith

STC Staff Director – Wojciech Szpankowski Managing Director – Bob Brown Education Director – Brent Ladd Diversity Director – Kelly Andronicos Multimedia Specialist – Mike Atwell Administrative Asst. – Kiya Smith Bob Brown Managing Director Brent Ladd Education Director Kelly Andronicos Diversity Director Mike Atwell Multimedia Specialist Kiya Smith Administrative Asst.

How did we arrive here? 2015-2016 2014 RENEWAL! 2007-2008 2008-2009 Dear Wojciech, It is my pleasure to inform you that we are recommending an award for your STC proposal.  Congratulations! I am snowed in and technically, the office is "closed" today, but I thought you would want to get the word.  Joan M. Frye, PhD Senior Staff Associate NSF 2007-2008 2008-2009 Feb 9, 2010 2006 Covers' coordination capacity Verdu's finte blocklength Organizational workshop May 2010 2010 How did we arrive here? IT of Advanced Data Structure Novel Approach Privacy Temporal Info & Biology Data-driven Convergence Polyanskiy&Wu information non-conservation law Milenkovic/Weissman work biological database compression Grama/Subramaniam temporal/structural motifs in biology Kumar's security Weissman's rate distortion with delay Rivest's zero-knowledge proofs Szpankowski's structural information Tse’s work on DNA assembly Courtade/Weissman multiterminal source coding Sudan's semantics Goldsmith's sampling Bialek's information flow in biology 2015-2016 New EAB Shannon Awards for D. Tse Shannon 100th Birthday Bialek, Verdu, Yu NAS Paris Meeting 2017 RENEWAL! 2014 International Partnerships (LINCS, ETH, HIIT) Symposium on SoI Challenges, Irvine 2013 IT&CSoI summer school Center Fellow (Wang) Bell Lab meeting SoI Day, Berkeley 2012 Grand Challenges CSoI Fellows Channels Program 2011 Sims Nobel Prize, First Summer School Kick-off Workshop

Outline Science of Information CSoI Team & History Research Plan Research Thrusts Overview of Research Plan Legacy & Value Added Education and Diversity & Knowledge Transfer Sustainability Plan Management Budget

Mission and Research Thrusts RESEARCH MISSION: Create a shared intellectual space, integral to the Center’s activities, providing a collaborative research environment that crosses disciplinary and institutional boundaries. David Tse T. Weissman P. Santhanam J. Neville RESEARCH THRUSTS: 1. Information & Communication 2. Knowledge Extraction (Data Science) 3. Life Sciences S. Subramaniam A. Grama

Research Presentations Ananth Grama: “Big data in life sciences: From genomes to connectomes ” (Life Sciences and Data Sciences) Olgica Milenkovic: “Macromolecular data storage - from coding to synthetic biology” (Information/Communication and Life Sciences) Prasad Santhanam “Data derived foundations for statistical problems” (Information/Communication and Data Sciences)

Center’s Theme & Vision Information Knowledge (Decision) Data Framing the Foundation Practice inspires Theory Theory guides Practice

Research Plan for Next Five Years Information: Core Principle Structural Information Temporal Information Value of Information Communication & Control: Fundamental Limit Flow of Information in Dynamic/Cooperative Networks Provable Security Data: Framing the Foundations Information-Theoretic Models Precise Complexity (Small Data) Structural Insights into Data Modeling and Analysis: Life Sciences Sequence Analysis Network Inferences, Modeling, and Analysis Information Flow in Human Brain From Energetics to Sequence and Conformations

Figure 3 renewal proposal

Outline Science of Information CSoI Team & History Research Plan Research Thrusts Overview of Research Plan Legacy & Value Added Education and Diversity & Knowledge Transfer Sustainability Plan Management Budget

Value-Added & Legacy in Research Legacy of new collaboration between different disciplines: Example: Metabolic Phenomena (Ramkrishna, Subramaniam, Raginsky, Aguilar) Aging Process (Grama, Subramaniam, students)’ Molecular Timing Channel (Goldsmith, students) Legacy of new collaboration within the same discipline Examples: Genomic Compression (Milenkovic, Weissman, Lynch, Wang), Multiterminal Source Coding (Courtade, Verdu, Weissman) Legacy of educating new crops of researchers (Courtade,Grover,Kostina,Oshman,Polyanskiy,Ochoa) Example: Conservation of Information? (Polyanskiy, Raginsky) Legacy of new research directions - information theory in life sciences (e.g., Tse, Goldsmith, Coleman, Subramaniam, Bialek) - information theory in data modeling (e.g., Courtade, Wiessman, Szpankowski) - community detection (Abbe, Santhanam, Milenkovic) Legacy of formulating new foundations: - security (Kumar) - structure (e.g., Szpankowski, Grama, Subramaniam, Courtade, Neville) - temporal information (e.g., Verdu, Goldsmith, Polyanskiy, Kumar) - value of information (e.g., Sims, Raginsky, Szpankowski) - spatial information (Bialek, Tse, Courtade, Kumar)

Sample of Past Accomplishments Cover’s coordination capacity Verdu’s finite delay blocklength capacity Sudan’s semantic analysis and goal-oriented communication Goldsmith’s capacity of sampled Gaussian channel Szpankowski’s structural information & symmetry Tse’s information theory of DNA assembly Courtade/Weismann multiterminal source coding Kumar’s foundation of security Rivest’s zero knowledge proofs Polyanskiy’s information non-conversation law Grama’s aging process and temporal motifs in biology Coleman’s modeling of neuronal spiking response

Cross Center Collaborations CSoI Fellow: T. Courtade (Verdu & Weissman); now faculty at UC, Berkeley CSoI Fellow: R. Ma (Coleman & Anantharam & Gallant); now Sr. Scientist at Dexcom CSoI Fellow: Z. Wang (Weissman, Milenkovic & Lynch) : now UC Irvine CSoi Fellows: S. Kamath (Verdu & Szpankowski), A. Javanmard (Courtade & Tse) CSoI Fellows: A. Padakandla (Kumar, Santhanam); A. Magner (Baryshnikov, Grama), Y. Shkel (Raginsky, Verdu), I. Shomorony (Courtade, Tse) Ramkrishna , Subramaniam & Raginsky: (Purdue, Berkeley, UIUC, and UCSD team) Neville, Yu, Kulkarni, Courtade (Purdue-Berkeley): machine learning & social networks Polyanskiy, Kostina, & Verdu (MIT-Caltech--Princeton): temporal capacity Grama, Subramaniam, Szpankowski (Purdue-UCSD): biological networks Kumar & Lynch (Texas –MIT): distributed systems and temporal information D. Kumar, Ward, Ladd, Nelson (Bryn Mawr –Purdue): faculty development (NSF TUES) D. Kumar, Ward, Ladd, Grover, Ma (CMU,Texas, MIT, OHSU, UCSD): SoI modules D. Kumar, Rwebangria, Ward, Ladd, Grover (BMC, Purdue, Howard, CMU,..): SoI course Szpankowski & Baryshnikov (Purdue-UIUC): structural information Kulkarni, Szpankowski & Imielinski (Princeton-Purdue-Rutgers): big data Anantharam, Szpankowski &Santhanam (Berkeley, Purdue, Hawaii): models for big data Tse, Sudan, Weissman (Berkeley, MIT, Stanford): semantics and communication

Interdisciplinary Student projects “Understanding Information-Energy Interactions” Post-doc PI & Advisor: Pulkit Grover (Carnegie Mellon), Student PI: Karthik Ganesan (EECS, UC Berkeley, advsior: Jan Rabaey), Student PI: George Alexandrov (EE, Stanford, advsior: Andrea Goldsmith). “A Fresh Look at Boolean Functions” Post-doc PI/advsior: Thomas Courtade (EE, Stanford/Princeton University), Post-doc PI/advisor: Pulkit Grover (EE, Stanford University & Carnegie Mellon University), Student PI: Madars Virza (EE & CS, MIT, advisor: R. Rivest). “Investigation of Metabolic Phenomena Using Information Theory” Student PI: Frank DeVilbiss (ChemEng, Purdue University, advisor: D. Ramkrishna), Student PI: Pablo Robles-Granda (CS, Purdue University, advisor: Jennifer Neville), Student PI: Mohan Gopaladesikan (STAT, Purdue University, advisor: Mark Daniel Ward), Faculty Advisor: D. Ramkrishna, Chem Eng Purdue University, Faculty Advisor: Maxim Raginsky, ECE, UIUC. “Graph Inference Based on Random Walks” Post-doc PI/advisor: Thomas Courtade (EE, Stanford/Princeton University), Student PI: Victoria Kostina (EE, Princeton University, advisor: Sergio Verdu), Student PI: Suvidha Kancharla (CS, Purdue University, advisor: Jennifer Neville), Faculty advisor: Jennifer Neville (CS & STAT, Purdue University). “Analysis of Information Content of Biological Imaging” Madhivanan (Purdue, advisor: Aguilar), Venkatasubramani (Texas A & M, advisor Dutta), Veikur, Postdoc (John Hopkins, advisor: Shields), Zhang (Purdue, advisor: Ward) “Improving Cancer Therapeutics through Medical Data Analysis’’ Chowdhurry (Stanford, advisor: Goldsmith), DeVilbiss (Purdue, advisor: Ramkrishna), Francisco- Sanchez (Purdue, advisor: Ward) “Quantitative Analysis of Cargo Trafficking and Compartmental Integrity in Lowe Syndrome’’ Ramadesikan (Purdue, advisor: Aguilar), Center Postdoc, Shomorony (Berkeley, advisors: Courtade, Tse) “Development of an Automatic Qunatification Algorithm for Determining Fluorescence Distribution in Yeast Cells’’ Wen-Chieh Hsieh (Purdue, advisor: Aguilar), Leqi Liu (Bryn Mawr, advisor Jia Tao & D. Kumar) “Quantitative Analysis of Yeast Cell Morphology Defects Induced by Gene De-Regulation” McKeith Pearson II (Aguilar), Felix Fancisco-Sanchez (Ward) “Genetics Analysis of Substance Abuse – “Identification of pathology-related single nucleotide polymorphisms in a heterogeneous substance- abusing population” Ariel Ketcherside (UT Dallas), Milind Rao (Stanford), Shika Prashad (UT Dallas, Bryn Mawr). 11. “Defending Large-Scale Distributed Machine Learning Against Adversarial Attacks” Lili Su (UIUC), Seyyed Fatemi (U-Hawaii),Rehana Mahfuz (Purdue), Vidyasagar Sadhu (Rutgers)

Research Workshops 24. SoI Day in Princeton, September 2015, Kickoff Workshop – Chicago, IL – October 6-7, 2010 (28 STC participants and students) 1. Allerton Workshop, IL – September 28, 2010 2. Stanford Workshop – Palo Alto, CA – January 24, 2011 (Princeton – Stanford –Berkeley) 3. UC San Diego Workshop – February 11, 2011 (Berkeley – UCSD) 4. Princeton Workshop – May 2011 (Princeton – Purdue) 5. Purdue Workshop – September 9, 2011 (Berkeley – UCSD – Purdue) 6. Allerton Workshop – September 27, 2011 (Purdue –UIUC) 7. UCSD Workshop on Neuroscience, February 2012 (UCSD – Berkeley) 8. Princeton Grand & Petit Challenges Workshop, March 2012 (Center-wide) 9. Maui Workshop (ICC), (Industrial Round-Table), May 2012 (Center-wide) 10. MIT Workshop, July 2012 (Center-wide) 11. Students workshop, July 2012 (Center-wide for students) 12. All hands meeting for students, December 2012. 14. Big Data Workshop, March 2013. 15. Bell Lab & CSoI Workshop, Princeton, September 2013. 16. Industrial Workshop, Chicago, September 2013. 17. CSoI Day at Berkeley, November 2013, Purdue, October 2013. 18. All Hands Meeting, Purdue, December 2013. 19. Science of Information Evening, San Diego, ITA, February 2014. 20. CSoI Day at MIT, UIUC, Texas A&M, Howard, April, 2014. 21. Graduate Student workshop, Purdue, Biology and Information, July 2014. 22. Summer School, San Diego, August 2014. 23. Challenges & Opportunities SoI: A Symposium, NAE, Irvine, August 2014. 24. SoI Day in Princeton, September 2015, 25. SoI Day and Industrial Day, Stanford, February 18-19, 2016. 26 Summer School, Duke, 2016 27 Bits & Bio, Workshop in NYU, New York, April 2017 28. WITMSE Workshop sposored by CSoI, ETH, LINCS, and HIIT, September 2017.

Collaborative Graph 2015

Outline Science of Information CSoI Team & History Research Plan Research Thrusts Overview of Research Plan Legacy & Value Added Education and Diversity & Knowledge Transfer Sustainability Plan Management Budget

Education and Diversity Integrate cutting-edge, multidisciplinary research and education efforts across the center to advance the training and diversity of the work force Summer Schools & Workshops (116 universities, 2,700 participants) Center Wide Fellows (Courtade, Ma, Wang, Kamath, Javanmard, Padakandla, Shkel, Magner, Shomorony) CSoI has graduated 240 total students (postdocs, grad and undergrad) Information Frontiers Curriculum & Learning HUB (15,000+ students) (data information knowledge) Intro to Science Information (BMC, Howard, Purdue, GWU, EAFIT, online) Student Research Teams (11) & Workshops 2012-2016 NSF TUES Grant and Teaching Workshop 2012-2014 Channels Scholars Program (Undergrad Mentoring) Supplement REU and Professional Development 10. Retention Efforts & Recruitment of Underrepresented and US Citizens 11. Feature Articles on Diversity in STEM D. Kumar M. Ward K. Andronicos B. Ladd

Frontiers of Education Program

Knowledge Transfer CSoI members brought $1M funding from industry Develop effective mechanism for interactions between the center and external stakeholder to support the exchange of knowledge, data, and application of new technology. CSoI members brought $1M funding from industry CSoI & Bell Labs Workshop, September 2013 Industrial Workshop, Chicago, 2013 International collaborations (LINCS, ETH, Helsinki HIIT) SoiHub.org refined with wiki to enhance communication Brown Bag and research seminars, Prestige Lecture Series Special issue in Proceedings of IEEE on SoI, 2017 Special Session on SoI – CISS’ 12 Princeton, ITA 2014 SoI Day (Berkeley, Texas A&M, UIUC, MIT, Howard, 2014) Challenges & Opportunities SoI: A Symposium, NAE, Irvine, 2014 Article about CSoI activities in IT News Joint workshop with our International Partners, September 2017

Prestige Lecture Series

Shannon Centenary

Outline Science of Information CSoI Team & History Research Plan Research Thrusts Overview of Research Plan Legacy & Value Added Education and Diversity & Knowledge Transfer Sustainability Plan Management Budget

Sustainability Plans Purdue Center for Science of Information ($350K/year) Visitors Program in Science of Information Proposals to Funding Agencies: - Federal: NSF, MURI, NIH, ARO, … - Private Foundations: Simons, Templeton, Kavli, … - Industry: Bell Labs, Qualcomm, Google, … International Partnerships (LINCS, ETH, HIIT) Learning from Existing Centers (IMA, IPAM, DIMACS) Open ExC meeting on Wednesday December 7 to discuss Center’s sustainability plans

A Vision for the Future Consolidate and lead efforts in broad areas of data analysis and its applications. Address critical problems in data privacy and security, while working closely with CERIAS, and provide campus-wide leadership Develop critical enabling technologies for life sciences thrusts, including genomic, interactomic, imaging, neural connectomic, immunologic, and clinical data. Establish a pilot undergraduate education curriculum in the science of information. [Possible Action Item: Institute for Data and Information Sciences]

International Partnership International Partnerships with: Laboratory of Information, Networking, and Communication Science (LINCS), Paris, France ETH, Zurich, Switzerland Helsinki Institute for Information Technology (HIIT), Helsinki, Finland Joint Conference WITMSE LINCS, Paris, September 11-12, 2017

Data Science Center NSF new program (TRIPODS): Transdisciplinary Research in Principles of Data Science: aims to bring together the statistics, mathematics, and theoretical computer sciences to develop foundation of data science. Our unique view to data sciences is through the lens of Sciences of Information! Phase I: Putting small teams together (2017-2020) Phase II: Creating Center for Data Sciences

Outline Science of Information CSoI Team & History Research Plan Research Thrusts Overview of Research Plan Legacy & Value Added Education and Diversity & Knowledge Transfer Sustainability Plan Management Budget

Management Objectives Research: To provide mechanisms for synergistic research and development of foundational principles, methods, and applications of science of information. Education: To educate and train the next generation of practitioners. Diversity: To deeply engage students, researchers, and affiliated personnel from underrepresented groups in all aspects of the project. Knowledge Transfer: To facilitate seamless transfer of knowledge to the broader academic and commercial world.

Project Management Projects within the Center are managed by the Center Director, Manager , and Executive Committee via management, solicitation, and assessment: Track progress of each project Terminate projects no longer relevant or demonstrating insufficient progress through new mechanism of competitive funding Evaluate the success of collaborative investigations. Metrics (annual evaluation during the seed fund competition) Publication of quality peer-reviewed papers Development of software, industry outreach, intellectual property, etc Collaborations between investigators, e.g., joint publications and grants Development of educational material that illustrate fundamental developments in the domain Assessment of progress reports within the Center

Executive Committee Composition: Advisory to the Center’s Director Center leadership (Director and Manager ex officio) Chair of the Executive Committee: P. R. Kumar Members: Anantharam, Goldsmith, Grama, D. Kumar, Shor, Subramaniam, Verdu. Coordination: Regular meetings conducted through telephone and/or video conference Senior personnel from projects attend by invitation as needed. Manage new and ongoing projects; deal with issues that have arisen, and discuss possible future directions (fiscal and intellectual) Action items from meeting are distributed promptly Distribution of funds with an eye on impact and fairness

External Advisory Committee High Level Goal: To enhance the long-term impact and research agenda of the Center. Members of EAB: Robert Calderbank (Duke, chair), Arden Bement, Shuki Bruck (Caltech), Tony Ephremides (Maryland), Mike Luby (Qualcomm), Emina Soljanin (Bell and Rutgers), Iraj Saniee (Bell Labs), J. Gibbson (UCSB). Sustainability: With guaranteed support from Purdue University, the Center is well-positioned to thrive well beyond the next five-year funding period. However, an important goal of the Center leadership is to find ways to bring sustained funding from goverment agencies, private foundations, and industry to build on the Center's agenda.

External Advisory Board Specific objectives for the EAC: - Help identify new funding mechanisms for Center-related research to complement existing funding and maintain aspects of the program after NSF funding ends. - Help identify Center-related research ripe for tech transfer, and facilitate such transfer - Forge and/or strengthen connections between industry and the Center - Help establish connections between the Center and other research organizations with overlapping interests.

Outline Science of Information CSoI Team & History Research Plan Research Thrusts Overview of Research Plan Legacy & Value Added Education and Diversity & Knowledge Transfer Sustainability Plan Management Budget

Budget Summary $5M/year: Student Support (115+77) Post Docs (28+13) Faculty Support (30+) Visitors & Collaborators Education Director Diversity Director Managing Director Administrative Assistance Travel Workshops Advisory Committee Visitors, Speakers, etc Summer School Competitive Fund

Breakout of NSF Funding

Budgeted Faculty, Staff, and Students

THANK YOU, JOHN!