State of CyberGIS State of CyberGIS Shaowen Wang CyberInfrastructure and Geospatial Information Laboratory (CIGI) Department of Geography and Geographic.

Slides:



Advertisements
Similar presentations
CCIRN Meeting Douglas Gatchell US NSF/CISE/SCI July 3, 2004.
Advertisements

Spatial Ontology Community of Practice Workshop, USGS, Dec.2, Using Knowledge to Facilitate Better Data Discovery, Access, and Utilization for CloudGIS.
Computing in the Humanities, Arts, and Social Sciences Marshall Scott Poole Director Kevin Franklin Executive Director.
Data Conservancy and the US NSF DataNet Initiative 2010 JISC/CNI Conference July 1, 2010 Sayeed Choudhury Johns Hopkins University.
High-Resolution National Elevation Dataset: CyberGIS Challenges and Opportunities for Scalable Spatial Data Access and Analytics Yan Liu1,3,5, Babak Behzad1,2,
Maines Sustainability Solutions Initiative (SSI) Focuses on research of the coupled dynamics of social- ecological systems (SES) and the translation of.
Xsede eXtreme Science and Engineering Discovery Environment Ron Perrott University of Oxford 1.
Supporting Research on Campus - Using Cyberinfrastructure (CI) Public research use of ICT has rapidly increased in the past decade, requiring high performance.
Joint CASC/CCI Workshop Report Strategic and Tactical Recommendations EDUCAUSE Campus Cyberinfrastructure Working Group Coalition for Academic Scientific.
1 Challenges and New Trends in Data Intensive Science Panel at Data-aware Distributed Computing (DADC) Workshop HPDC Boston June Geoffrey Fox Community.
SACNAS, Sept 29-Oct 1, 2005, Denver, CO What is Cyberinfrastructure? The Computer Science Perspective Dr. Chaitan Baru Project Director, The Geosciences.
SAN DIEGO SUPERCOMPUTER CENTER The Integration of 2 Science Gateways: CyberGIS + OpenTopography Choonhan Youn, Nancy Wilkins-Diehr, SDSC Christopher Crosby,
SAN DIEGO SUPERCOMPUTER CENTER Choonhan Youn Viswanath Nandigam, Nancy Wilkins-Diehr, Chaitan Baru San Diego Supercomputer Center, University of California,
A CyberGIS Environment for Near-Real-Time Spatial Analysis of Social Media Data Shaowen Wang CyberInfrastructure and Geospatial Information Laboratory.
Spatial Decisions INNOVATING GEOSPATIAL INTELLIGENCE PLENARY II 17 September GIS Asia. Hanoi Kapil Chaudhery Spatial Decisions.
1 Cyberinfrastructure Framework for 21st Century Science & Engineering (CIF21) NSF-wide Cyberinfrastructure Vision People, Sustainability, Innovation,
Science of Science and Innovation Policy (SciSIP) Presentation to: SBE Advisory Committee By: Dr. Kaye Husbands Fealing National Science Foundation November.
1 Cyberinfrastructure Framework for 21st Century Science & Engineering (CF21) IRNC Kick-Off Workshop July 13,
NSF and Environmental Cyberinfrastructure Margaret Leinen Environmental Cyberinfrastructure Workshop, NCAR 2002.
1 从信息化基础设施角度展望 下一代地理信息系统 王少文 What is Cyberinfrastructure? It was six men of Indostan To learning much inclined, Who went to see the elephant.
Knowledge Environments for Science: Representative Projects Ian Foster Argonne National Laboratory University of Chicago
Geospatial Analytics for Government Agencies and the General Public: The CyberGIS Toolkit as an Enabler U.S. Department of the Interior U.S. Geological.
NSF Vision and Strategy for Advanced Computational Infrastructure Vision: NSF Leadership in creating and deploying a comprehensive portfolio…to facilitate.
Small-Scale Raster Map Projection using the Compute Unified Device Architecture (CUDA) U.S. Department of the Interior U.S. Geological Survey Michael P.
NSF OCI Software Program Gabrielle Allen Program Director National Science Foundation Office of Cyberinfrastructure
1 Building National Cyberinfrastructure Alan Blatecky Office of Cyberinfrastructure EPSCoR Meeting May 21,
Computing in Atmospheric Sciences Workshop: 2003 Challenges of Cyberinfrastructure Alan Blatecky Executive Director San Diego Supercomputer Center.
Scientific Data Infrastructure in CAS Dr. Jianhui Scientific Data Center Computer Network Information Center Chinese Academy of Sciences.
CyberGIS Toolkit: A Software Toolbox Built for Scalable cyberGIS Spatial Analysis and Modeling Yan Liu 1,2, Michael Finn 4, Hao Hu 1, Jay Laura 3, David.
1 Babak Behzad, Yan Liu 1,2,4, Eric Shook 1,2, Michael P. Finn 5, David M. Mattli 5 and Shaowen Wang 1,2,3,4 Babak Behzad 1,3, Yan Liu 1,2,4, Eric Shook.
A High-Throughput Computational Approach to Environmental Health Study Based on CyberGIS Xun Shi 1, Anand Padmanabhan 2, and Shaowen Wang 2 1 Department.
CyberGIS in Action CyberGIS in Action Shaowen Wang CyberInfrastructure and Geospatial Information Laboratory (CIGI) Department of Geography and Geographic.
1 GISolve – TeraGrid GIScience Gateway Shaowen Wang Department of Geography and Grid Research & educatiOn ioWa (GROW) The University of Iowa May.
Linked-data and the Internet of Things Payam Barnaghi Centre for Communication Systems Research University of Surrey March 2012.
ESIP Federation: Connecting Communities for Advancing Data, Systems, Human & Organizational Interoperability November 22, 2013 Carol Meyer Executive Director.
Small-Scale Raster Map Projection Transformation Using a Virtual System to Interactively Share Computing Resources and Data U.S. Department of the Interior.
Gateway Round Table Update Nancy Wilkins-Diehr TeraGrid Round Table, February 11, 2010.
DOE 2000, March 8, 1999 The IT 2 Initiative and NSF Stephen Elbert program director NSF/CISE/ACIR/PACI.
The Saguaro Digital Library for Natural Asset Management Dr. Sudha RamSudha Ram Advanced Database Research Group Dept. of MIS The University of Arizona.
Realizing CyberGIS Vision through Software Integration Anand Padmanabhan, Yan Liu, Shaowen Wang CyberGIS Center for Advanced Digital and Spatial Studies.
Office of Science Office of Biological and Environmental Research DOE Workshop on Community Modeling and Long-term Predictions of the Integrated Water.
Pascucci-1 Valerio Pascucci Director, CEDMAV Professor, SCI Institute & School of Computing Laboratory Fellow, PNNL Massive Data Management, Analysis,
Hassan A. Karimi Geoinformatics Laboratory School of Information Sciences University of Pittsburgh 3/27/20121.
National Center for Supercomputing Applications Barbara S. Minsker, Ph.D. Associate Professor National Center for Supercomputing Applications and Department.
Guofeng Cao CyberInfrastructure and Geospatial Information Laboratory Department of Geography National Center for Supercomputing Applications (NCSA) University.
Cyberinfrastructure What is it? Russ Hobby Internet2 Joint Techs, 18 July 2007.
Breakout # 1 – Data Collecting and Making It Available Data definition “ Any information that [environmental] researchers need to accomplish their tasks”
1 NSF/TeraGrid Science Advisory Board Meeting July 19-20, San Diego, CA Brief TeraGrid Overview and Expectations of Science Advisory Board John Towns TeraGrid.
26/05/2005 Research Infrastructures - 'eInfrastructure: Grid initiatives‘ FP INFRASTRUCTURES-71 DIMMI Project a DI gital M ulti M edia I nfrastructure.
7. Grid Computing Systems and Resource Management
Chaitan Baru Senior Advisor for Data Science CISE Directorate National Science Foundation NIEHS Webinar October 27, 2015 Image Credit: Exploratorium. Integrating.
Cyberinfrastructure: Many Things to Many People Russ Hobby Program Manager Internet2.
National Center for Supercomputing Applications University of Illinois at Urbana–Champaign Visualization Support for XSEDE and Blue Waters DOE Graphics.
1 Kalev Leetaru, Eric Shook, and Shaowen Wang CyberInfrastructure and Geospatial Information Laboratory (CIGI) Department of Geography and Geographic Information.
Digital Data Collections ARL, CNI, CLIR, and DLF Forum October 28, 2005 Washington DC Chris Greer Program Director National Science Foundation.
NICS Update Bruce Loftis 16 December National Institute for Computational Sciences University of Tennessee and ORNL partnership  NICS is the 2.
Toward a common data and command representation for quantum chemistry Malcolm Atkinson Director 5 th April 2004.
GEOSPATIAL CYBERINFRASTRUCTURE. WHAT IS CYBERINFRASTRUCTURE(CI)?  A combination of data resources, network protocols, computing platforms, and computational.
Petascale Computing Resource Allocations PRAC – NSF Ed Walker, NSF CISE/ACI March 3,
1 Open Science Grid: Project Statement & Vision Transform compute and data intensive science through a cross- domain self-managed national distributed.
Introduction Professor Wenwen Li GeoDa, SGSUP Arizona State University
CyberGIS Prof. Wenwen Li School of Geographical Sciences and Urban Planning 5644 Coor Hall
Black and White Introduction to Cyberinfrastructure Eric Shook Department of Geography Kent State University.
INTRODUCTION TO XSEDE. INTRODUCTION  Extreme Science and Engineering Discovery Environment (XSEDE)  “most advanced, powerful, and robust collection.
South Big Data Innovation Hub
Performance Technology for Scalable Parallel Systems
Shaowen Wang1, 2, Yan Liu1, 2, Nancy Wilkins-Diehr3, Stuart Martin4,5
Principles of GIS Fundamental database concepts Shaowen Wang
PRasterBlaster: High-Performance Small-Scale Raster Map Projection Transformation Using the Extreme Science and Engineering Discovery Environment  Michael.
Tom Savel, MD Lead – Grid Technologies Medical Officer NCPHI, CDC
Presentation transcript:

State of CyberGIS State of CyberGIS Shaowen Wang CyberInfrastructure and Geospatial Information Laboratory (CIGI) Department of Geography and Geographic Information Science Department of Computer Science Department of Urban and Regional Planning National Center for Supercomputing Applications (NCSA) University of Illinois at Urbana-Champaign Seattle, WA, USA September 16, 2013

NSF SI2-SSI: CyberGIS Project Team Principal Investigator –Shaowen Wang Project Staff –ASU: Wenwen Li and Rob Pahle –ORNL: Ranga Raju Vatsavai –SDSC: Choonhan Youn –UIUC: Yan Liu and Anand Padmanabhan –Graduate and undergraduate students Industrial Partner: Esri –Steve Kopp and Dawn Wright 2 Co-Principal Investigators – Luc Anselin – Budhendra Bhaduri – Timothy Nyerges – Nancy Wilkins-Diehr Senior Personnel –Michael Goodchild –Sergio Rey –Xuan Shi –Marc Snir –E. Lynn Usery Project Manager –Anand Padmanabhan Chair of the Science Advisory Committee –Michael Goodchild

Discoveries Questions Predictions Killer Problems? 3

Big Spatial Data 4

Big Spatial Simulation Image created by Eric Shook 5

Complex Spatial Decision Making 6

Collaborative Knowledge Discovery 8

Geodesign 9 Image source:

CyberGIS for What and Whom? CyberGIS Gateway CyberGIS Toolkit Middleware 10

11

12

Big Spatial Data Big Spatial Simulation Complex Spatial Decision Making Collaborative Knowledge Discovery Geo- Design CyberGIS Gateway Yes Maybe Yes Maybe Yes Maybe Yes Maybe Yes Maybe CyberGIS Toolkit Yes Maybe Yes Maybe Yes Maybe Yes Maybe Yes Maybe GISolve Middleware Yes Maybe Yes Maybe Yes Maybe Yes Maybe Yes Maybe 13

14

Heterogeneous Syntactic Semantic Dynamic Spatial and temporal E.g. social media Massive Produced by individuals Accessible to individuals 15 Large-scale Global coverage Fine granularity Individual-level High-resolution Distributed access Interoperability Privacy Security Theory + Experiment + Computation + Big Data

Digital Environments Parallel o Used to be regarded as a way for speeding up GIS functions and spatial analysis o Now becoming a must for GIS and spatial analysis to be built on Multi- and many-core GPU (graphics processing unit) Heterogeneous architecture Mobile Distributed o Service-oriented o Clouds 16 Extreme-scale computing, information, and communication systems

Computing Profile Total Peak Performance PF Total System Memory PB XE Compute Cabinets 237 XE Peak Performance 7.1 PF XE Compute Nodes 22,640 XE Bulldozer Cores 362,240 XE System Memory PB XK Compute Cabinets 32 XK Peak Performance (CPU+GPU) 4.51 PF XK Compute Nodes 3072 XK Bulldozer Cores (CPU) 24,576 XK Kepler Accelerators (GPU) 3072 XK System Memory (CPU) 96 TB XK Accelerator Memory (GPU) 18 TB Online Storage Total Usable Storage 26.4 PB Aggregate I/O Bandwidth > 1 TB/s Near-line Storage Aggregate Bandwidth to tape 58 GB/s 5-year capacity 380 PB 17

Image source: via Mike Goodchildhttp://gigaom.com/2010/12/14/facebook-draws-a-map-of-the-connected-world/

Spatial Computational Domain Sufficiently coarse to ensure that the derivation and decomposition of the spatial computational domain is computationally inexpensive Sufficiently fine to allow domain decomposition to produce a large number of sub-domains that are executed concurrently to improve computational performance 19 Wang, S., and Armstrong, M. P “A Theoretical Approach to the Use of Cyberinfrastructure in Geographical Analysis.” International Journal of Geographical Information Science, 23 (2):

A Hierarchical Computational Framework for Agent-based Modeling Tang, W. and Wang, S “HPABM: A Hierarchical Parallel Simulation Framework for Spatially-Explicit Agent-Based Models.” Transactions in GIS, 13 (3):

Computational Intensity Question What is the nature of computational intensity of geographic analysis? o Why spatial is special? Comparable to o “What is the nature of computational complexity of an algorithm?” 21

Spatial Computational Principles/Theories Spatial Distribution Dependence Integration Representation Uncertainty Etc. Computational Complexity vs. intensity Uncertainty vs. validity Performance vs. reliability Etc. SCALE 22

Scalability 23

Usability 24

Interoperability 25

Reliability 27

Reproducibility 28

Understanding of Scientific Processes 29

Education and Workforce Development CyberGIS Gateway used by hundreds of undergraduate and graduate students on multiple campusesCyberGIS Gateway used by hundreds of undergraduate and graduate students on multiple campuses Graduated 6 graduate students and trained 4 postdoctoral fellowsGraduated 6 graduate students and trained 4 postdoctoral fellows CyberGIS’12 ( The First International Conference on Space, Time, and CyberGISCyberGIS’12 ( The First International Conference on Space, Time, and CyberGIShttp:// CyberGIS Symposium at the 2013 Annual Meeting of the Association of American Geographers – 17 sessionsCyberGIS Symposium at the 2013 Annual Meeting of the Association of American Geographers – 17 sessions TutorialsTutorials CyberGIS, GIScience, SC, TeraGrid/XSEDECyberGIS, GIScience, SC, TeraGrid/XSEDE

Curriculum and pedagogy Partnerships Open ecosystems 31

CyberGIS Discovery and Innovation Advanced Technologies Wang, S “CyberGIS: Blueprint for Integrated and Scalable Geospatial Software Ecosystems.” International Journal of Geographical Information Science, 27 (11), in press Infrastructure Middleware Portal Gateway Platform Service Toolkit Apps Cloud Grid 32

11/09/what-is-cloud- computing.html Integrated Digital and Spatial Sciences CyberGI S Gateway CyberGIS Toolkit Space-Time Integration & Synthesis GISolve Middleware 33

Sustainability Intellectual frontiers Financial o Science challenges are long term and multidisciplinary o Reward mechanisms Accelerate scientific discoveries Reusability Open o Standards o Technologies Social and organizational o Community engagement o Partnerships Department of Energy Oak Ridge National Laboratory Industry US Geological Survey 34

CyberGIS Center for Advanced Digital and Spatial Studies CyberGIS Geospatial Sciences and Technologies Advanced Cyberinfrastructure Data-Intensive Applications and Sciences Arts, Emergency Management, Energy, Health, Sustainability, etc. GISolve Spatial Computational Theories / Methods Extreme-Scale Computing, NSF XSEDE, Open Science Grid Spatial Thinking Digital Thinking Integration and Synthesis 35

Acknowledgments Federal Agencies US Geological Survey Department of Energy’s Office of Science National Science Foundation –BCS –EAR –OCI –PHY –PHY –TeraGrid/XSEDE SES US Geological Survey Industry Environmental Systems Research Institute (Esri) Silicon Graphics, Inc. (SGI) 36

Acknowledgments – CIGI 37

Thanks! Comments / Questions? 38