1 从信息化基础设施角度展望 下一代地理信息系统 王少文 2008.10. 2 What is Cyberinfrastructure? It was six men of Indostan To learning much inclined, Who went to see the elephant.

Slides:



Advertisements
Similar presentations
State of CyberGIS State of CyberGIS Shaowen Wang CyberInfrastructure and Geospatial Information Laboratory (CIGI) Department of Geography and Geographic.
Advertisements

SACNAS, Sept 29-Oct 1, 2005, Denver, CO What is Cyberinfrastructure? The Computer Science Perspective Dr. Chaitan Baru Project Director, The Geosciences.
SAN DIEGO SUPERCOMPUTER CENTER The Integration of 2 Science Gateways: CyberGIS + OpenTopography Choonhan Youn, Nancy Wilkins-Diehr, SDSC Christopher Crosby,
A CyberGIS Environment for Near-Real-Time Spatial Analysis of Social Media Data Shaowen Wang CyberInfrastructure and Geospatial Information Laboratory.
1 Cyberinfrastructure Framework for 21st Century Science & Engineering (CIF21) NSF-wide Cyberinfrastructure Vision People, Sustainability, Innovation,
1 Cyberinfrastructure Framework for 21st Century Science & Engineering (CF21) IRNC Kick-Off Workshop July 13,
Venkatesh Merwade, Purdue University
NSF and Environmental Cyberinfrastructure Margaret Leinen Environmental Cyberinfrastructure Workshop, NCAR 2002.
Graphic Vision of Environment Threat in New Orleans Area after Katrina Student: Ke Yang Mentors: Dr. Wendy Zhang, Dr. Ju Chou COMPUTER SCIENCE, COLLEGE.
A Parallel Structured Ecological Model for High End Shared Memory Computers Dali Wang Department of Computer Science, University of Tennessee, Knoxville.
1 CYBERINFRASTRUCTURE FOR THE GEOSCIENCES Global Earth Observation Grid Workshop, Bangkok, Thailand, March Integration Platform.
SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.
Knowledge Environments for Science: Representative Projects Ian Foster Argonne National Laboratory University of Chicago
April 2009 OSG Grid School - RDU 1 Open Science Grid John McGee – Renaissance Computing Institute University of North Carolina, Chapel.
UNIVERSITY of MARYLAND GLOBAL LAND COVER FACILITY High Performance Computing in Support of Geospatial Information Discovery and Mining Joseph JaJa Institute.
Scientific Data Infrastructure in CAS Dr. Jianhui Scientific Data Center Computer Network Information Center Chinese Academy of Sciences.
Cartography Teaching and GIS Software Development in Nanjing University MA Jingsong Dept. of Geographic Information Science School of Geographic & Oceanographic.
CyberGIS Toolkit: A Software Toolbox Built for Scalable cyberGIS Spatial Analysis and Modeling Yan Liu 1,2, Michael Finn 4, Hao Hu 1, Jay Laura 3, David.
Distributed Web Security for Science Gateways Jim Basney In collaboration with: Rion Dooley Jeff Gaynor
TACC’s Scientific Computing Curriculum Texas Advanced Computing Center.
A High-Throughput Computational Approach to Environmental Health Study Based on CyberGIS Xun Shi 1, Anand Padmanabhan 2, and Shaowen Wang 2 1 Department.
National Center for Supercomputing Applications The Computational Chemistry Grid: Production Cyberinfrastructure for Computational Chemistry PI: John Connolly.
Advancing Scientific Discovery through TeraGrid Scott Lathrop TeraGrid Director of Education, Outreach and Training University of Chicago and Argonne National.
SAN DIEGO SUPERCOMPUTER CENTER NUCRI Advisory Board Meeting November 9, 2006 Science Gateways on the TeraGrid Nancy Wilkins-Diehr TeraGrid Area Director.
material assembled from the web pages at
CyberGIS in Action CyberGIS in Action Shaowen Wang CyberInfrastructure and Geospatial Information Laboratory (CIGI) Department of Geography and Geographic.
1 GISolve – TeraGrid GIScience Gateway Shaowen Wang Department of Geography and Grid Research & educatiOn ioWa (GROW) The University of Iowa May.
2005 Materials Computation Center External Board Meeting The Materials Computation Center Duane D. Johnson and Richard M. Martin (PIs) Funded by NSF DMR.
Peter Bajcsy, Rob Kooper, Luigi Marini, Barbara Minsker and Jim Myers National Center for Supercomputing Applications (NCSA) University of Illinois at.
IPlant cyberifrastructure to support ecological modeling Presented at the Species Distribution Modeling Group at the American Museum of Natural History.
What is Cyberinfrastructure? Russ Hobby, Internet2 Clemson University CI Days 20 May 2008.
Small-Scale Raster Map Projection Transformation Using a Virtual System to Interactively Share Computing Resources and Data U.S. Department of the Interior.
The Grid System Design Liu Xiangrui Beijing Institute of Technology.
DOE 2000, March 8, 1999 The IT 2 Initiative and NSF Stephen Elbert program director NSF/CISE/ACIR/PACI.
Realizing CyberGIS Vision through Software Integration Anand Padmanabhan, Yan Liu, Shaowen Wang CyberGIS Center for Advanced Digital and Spatial Studies.
Service - Oriented Middleware for Distributed Data Mining on the Grid ,劉妘鑏 Antonio C., Domenico T., and Paolo T. Journal of Parallel and Distributed.
Pascucci-1 Valerio Pascucci Director, CEDMAV Professor, SCI Institute & School of Computing Laboratory Fellow, PNNL Massive Data Management, Analysis,
Interoperability Grids, Clouds and Collaboratories Ruth Pordes Executive Director Open Science Grid, Fermilab.
Geosciences - Observations (Bob Wilhelmson) The geosciences in NSF’s world consists of atmospheric science, ocean science, and earth science Many of the.
National Center for Supercomputing Applications Barbara S. Minsker, Ph.D. Associate Professor National Center for Supercomputing Applications and Department.
Commodity Grid Kits Gregor von Laszewski (ANL), Keith Jackson (LBL) Many state-of-the-art scientific applications, such as climate modeling, astrophysics,
Finding Partners, Creating Impact Rusty Low Poles Together Workshop NOAA Boulder, CO July 20-22, 2005.
ICCS WSES BOF Discussion. Possible Topics Scientific workflows and Grid infrastructure Utilization of computing resources in scientific workflows; Virtual.
Sponsored by the National Science Foundation A New Approach for Using Web Services, Grids and Virtual Organizations in Mesoscale Meteorology.
Cyberinfrastructure What is it? Russ Hobby Internet2 Joint Techs, 18 July 2007.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.
GEOSCIENCE NEEDS & CHALLENGES Dogan Seber San Diego Supercomputer Center University of California, San Diego, USA.
©2012 LIESMARS Wuhan University Building Integrated Cyberinfrastructure for GIScience through Geospatial Service Web Jianya Gong, Tong Zhang, Huayi Wu.
Cyberinfrastructure: Many Things to Many People Russ Hobby Program Manager Internet2.
December 10, 2003Slide 1 International Networking and Cyberinfrastructure Douglas Gatchell Program Director International Networking National Science Foundation,
1 Kalev Leetaru, Eric Shook, and Shaowen Wang CyberInfrastructure and Geospatial Information Laboratory (CIGI) Department of Geography and Geographic Information.
U.S. Grid Projects and Involvement in EGEE Ian Foster Argonne National Laboratory University of Chicago EGEE-LHC Town Meeting,
Euro-Par, HASTE: An Adaptive Middleware for Supporting Time-Critical Event Handling in Distributed Environments ICAC 2008 Conference June 2 nd,
GEOSPATIAL CYBERINFRASTRUCTURE. WHAT IS CYBERINFRASTRUCTURE(CI)?  A combination of data resources, network protocols, computing platforms, and computational.
All Hands Meeting 2005 BIRN-CC: Building, Maintaining and Maturing a National Information Infrastructure to Enable and Advance Biomedical Research.
Northwest Indiana Computational Grid Preston Smith Rosen Center for Advanced Computing Purdue University - West Lafayette West Lafayette Calumet.
Using Cyberinfrastructure to Study the Earth’s Climate and Air Quality Don Wuebbles Department of Atmospheric Sciences University of Illinois, Urbana-Champaign.
CyberGIS Prof. Wenwen Li School of Geographical Sciences and Urban Planning 5644 Coor Hall
Black and White Introduction to Cyberinfrastructure Eric Shook Department of Geography Kent State University.
INTRODUCTION TO XSEDE. INTRODUCTION  Extreme Science and Engineering Discovery Environment (XSEDE)  “most advanced, powerful, and robust collection.
Shaowen Wang 1, 2, Yan Liu 1, 2, Nancy Wilkins-Diehr 3, Stuart Martin 4,5 1. CyberInfrastructure and Geospatial Information Laboratory (CIGI) Department.
©Copyright 2007 Adaptive Computing Systems Laboratory 1 Adaptive Cyberinfrastructure: “Toward Reliable and Sustained Performance” August, 2007 Jeffrey.
Tools and Services Workshop
Joslynn Lee – Data Science Educator
Shaowen Wang1, 2, Yan Liu1, 2, Nancy Wilkins-Diehr3, Stuart Martin4,5
Principles of GIS Fundamental database concepts Shaowen Wang
Cyberinfrastructure for the Life Sciences
Department of Computer Science, University of Tennessee, Knoxville
Resource Allocation for Distributed Streaming Applications
Presentation transcript:

1 从信息化基础设施角度展望 下一代地理信息系统 王少文

2 What is Cyberinfrastructure? It was six men of Indostan To learning much inclined, Who went to see the elephant (Though all of them were blind), That each by observation Might satisfy his mind It’s Network! It’s Grid! It’s HPC! And more!: -Applications -Data -E-community -Instruments -Virtual Organization -Etc. It’s Sharing It’s Storage It’s middle ware After Charlie Catlett

3 Supercomputer Centers PACI Terascale | | | | | | Cyberinfrastructure NSF Networking After Deborah L. Crawford Cyberinfrastructure Evolution

4 Integration – Holism  "The whole is more than the sum of its parts. “ By Aristotle in the Metaphysics Borromean rings, after Daniel E. Atkins Image source:

5 Motivation – What ’ s Beyond/Next? Google Earth: ESRI ArcGIS: Microsoft Virtual Earth:

6 Challenges  Problems User interface – not intuitive  Based on window, icon, menu, pointing device windowiconmenupointing device Single user  Desktop-based  Hard to collaborate Low performance  How much data can we analyze?

7 Purpose  Illustrate how GISolve – a cyberinfrastructure-based GIS is developed to help advance research and education of GIScience and cyberinfrastructure  Demonstrate science impact of GISolve and the use of GISolve as an education tool Background Design Demo Implementation Education Conclusions Purpose

8 Background  Geographic information quantity Ever increasing  Application driven GPS, location based services, remote sensing  Computationally intensive geographic information analysis Heuristics and optimization Simulation Spatial statistical methods  Cyberinfrastructure (CI) High-performance computing Virtual organization  Grid computing, middleware Data, visualization, and knowledge Education and workforce development Background Design Demo Implementation Education Conclusions Purpose

9 Review  CI-based geographic analysis Wang et al. 2008, Wang and Armstrong 2008, Wang and Zhu, 2008, Wang and Armstrong 2003  Domain-specific CI activities GEON (Geosciences Network) LEAD (Linked Environments for Atmospheric Discovery) NEON (National Ecological Observatory Network) WATERS (WATer and Environmental Research Systems) Network  Internet/Web-based GIS Tsou 2004, Wang et al. 2005, Yang et al  Ontology-driven GIS Fonseca et al Background Design Demo Implementation Education Conclusions Purpose

10 CI Complexity  Cyberinfrastructure Is evolving Has many sophisticated components Has NOT been developed to directly focus on the requirements of domain- specific problem solving Background Design Demo Implementation Education Conclusions Purpose

11 Managing CI Complexity  Science and engineering gateway Rooted in CI  Problem solving environments Rooted in domain science and engineering Background Design Demo Implementation Education Conclusions Purpose

12 Wang and Zhu (2008) GISolve – Integrating CI Capabilities and GIS

13 GISolve Middleware Spatial computational domain Domain decomposition Task scheduling Information broker and resource discovery Data access module Problem solving environments implemented using Web 2.0 technologies Monitoring servicesProtocols and services for data access on the Grid, such as the Globus GridFTP Middleware such as the Globus Toolkit and Condor Resource management

14 Computational Intensity = Wattage?! For CI-based geographic problem solving, computational intensity metrics are critically important! Background Design Demo Implementation Education Conclusions Purpose

15 Spatial Computational Domain  Wang, S., and Armstrong, M. P “ A Theoretical Approach to the Use of Cyberinfrastructure in Geographical Analysis. ” International Journal of Geographical Information Science, DOI: / Background Design Demo Implementation Education Conclusions Purpose

16 Information Broker and Resource Discovery  Self-Organized Grouping method for Grid resource discovery Padmanabhan, A., Wang, S., Ghosh, S., and Briggs, R “ A Self-Organized Grouping (SOG) Method for Efficient Grid Resource Discovery. ” In: Proceedings of the Grid 2005 Workshop, Seattle, WA, November , 2005, IEEE Press, pp  Modular Information Provider to support interoperable information brokering Wang, S., Shook, E., Padmanabhan, A., Briggs, R., Pearlman, L “ Developing a Modular Information Provider to Support Interoperable Grid Information Services. ” In: Proceedings of Grid and Cooperative Computing - GCC 2006: The Fifth International Conference, IEEE Computer Society, pp Background Design Demo Implementation Education Conclusions Purpose

17 Domain Decomposition and Task Scheduling 1, 1 0, 02, 4 4, 25, 3 11, 13 14, 1415, 15 3, 5 6, 67, 7 8, 89, 910, 12 12, 1013, 11 1, 1 0, 02, 4 4, 25, 3 11, 13 14, 1415, 15 3, 5 6, 67, 7 8, 89, 910, 12 12, 1013, 11 1, 1 0, 02, 4 4, 25, 3 11, 13 14, 1415, 15 3, 5 6, 67, 7 8, 89, 910, 12 12, 1013, 11 1, 1 0, 02, 4 4, 25, 3 11, 13 14, 1415, 15 3, 5 6, 67, 7 8, 89, 910, 12 12, 1013, 11 Small Capacity Large Capacity Medium Capacity Background Design Demo Implementation Education Conclusions Purpose

18 GISolve Workflow Background Design Demo Implementation Education Conclusions Purpose

19 TeraGrid GIScience Gateway Based on GISolve ( Background Design Demo Implementation Education Conclusions Purpose

20 TeraGrid Image source:

21 Open Science Grid Image source:

22 GISolve Services  Security  Decomposition and task scheduling  Geographic data access  Information broker and resource discovery  Workflow Background Design Demo Implementation Education Conclusions Purpose

23 Service- oriented approach Background Design Demo Implementation Education Conclusions Purpose

24 Spatio-Temporal Data Handling and Visualization Bioenergy data portal Background Design Demo Implementation Education Conclusions Purpose

25 Bayesian Geostatistical Modeling – Markov chain Monte Carlo  Communication topology management Help split processors into groups The processors of each group belong to the same computer Each group runs a single chain Cross-cluster communication cost is minimal Node 1 Node 3 Node 2 Node 4 Node 5 Node 7 Node 6 Node 8 Node 9 Node 11 Node 10 Node 12 Chain 1Chain 2 Chain 3 Supercomputer B Supercomputer A Background Design Demo Implementation Education Conclusions Purpose

26

27 Analyses Supported by the Gateway  Bayesian geostatistical modeling Yan, J., Cowles, M. K., Wang, S., and Armstrong, M. P. (2007) Parallelizing MCMC for Bayesian spatiotemporal geostatistical models. Statistics and Computing, 17 (4):  Detection of local spatial clustering Wang, S., Cowles, M. K., and Armstrong, M. P. (2008) Grid computing of spatial statistics: using the TeraGrid for G i *(d) analysis. Concurrency and Computation: Practice and Experience, forthcoming  Spatial interpolation Wang, S., and Armstrong, M. P. (2003) A quadtree approach to domain decomposition for spatial interpolation in Grid computing environments. Parallel Computing, 29 (10):  Under development ABM (Agent-Based Modeling) Spatial Genetic Algorithms Background Design Demo Implementation Education Conclusions Purpose

28 Integrated CI-based Workbench for Geospatial Scientists Background Design Demo Implementation Education Conclusions Purpose

29 Education and Outreach  In classrooms The University of Iowa, 2006, 2007  Foundations of Geographic Information Systems (undergraduate)  Principles of Geographic Information Systems (undergraduate and graduate)  Bayesian Statistics (undergraduate and graduate)  Computing in Statistics (undergraduate and graduate) The University of Illinois at Urbana-Champaign, 2007, 2008  Advanced Geographic Information Systems (undergraduate and graduate)  Introduction to Geographic Information Systems (undergraduate)  TeraGrid07 student competition High-school students  Supercomputing 2007 education program High-school and college teachers Background Design Demo Implementation Education Conclusions Purpose

30 Conclusions  GISolve principles Integrated Collaborative Distributed High-performance Service-oriented  GISolve is effective to teach CI GIScience CI-based GIS Background Design Demo Implementation Education Conclusions Purpose

31 CIGI – CyberInfrastructure and Geospatial Information Laboratory / Virtual-Organization High-Performance, Distributed and Collaborative GIS Geospatial Analysis and Modeling Base Cyberinfrastructure Applications Energy, Environment, Public Health GISolve Computational Intensity Open Science Grid, TeraGrid Application Driven Computational Thinking Multidisciplinary Interactions

32 Disciplines Involved in the CIGI VO  Biology  Computer Science  Geography  GIScience  Environmental engineering  History  Hydrology  Statistics

33 Global Malaria Risk

34 From James D. Myers

35 Ongoing R&D  Interoperability of GISolve services  Spatiotemporal computational domain  Adaptive domain decomposition services  Visualization services  Evaluation of GISolve performance  Extension of the types of geographic information analysis  Provenance management

36 Acknowledgments  CyberInfrastructure and Geospatial Information Laboratory (CIGI)  National Center for Supercomputing Applications (NCSA) Faculty Fellowship  Department of Energy Open Science Grid  National Science Foundation ITR: iVDGL (International Virtual Data Grid Laboratory) OCI Open Science Grid TeraGrid SES060004N TeraGrid SES070004N  Colleagues Dr. Marc P. Armstrong (Geography, UIowa) Dr. David A. Bennett (Geography, UIowa) Mr. Tim Cockerill (NCSA, UIUC) Dr. Mary Kathryn Cowles (Statistics, UIowa) Mr. Yan Liu (CIGI/NCSA, UIUC) Mr. Doru Marcusiu (NCSA, UIUC) Dr. James D. Myers (NCSA, UIUC) Dr. Anand Padmanabhan (CIGI/NCSA, UIUC) Ms. Ruth Pordes (Open Science Grid) Dr. Brian J. Smith (Biostatistics, UIowa) Mr. Eric Shook (Geography, UIUC) Dr. Wenwu Tang (CIGI/NCSA, UIUC) Mr. John W. Towns (NCSA, UIUC) Dr. Edward Walker (TACC, UT-Austin) Ms. Nancy Wilkins-Diehr (SDSC/TeraGrid) Dr. Jun Yan (Statistics, UConn) Dr. Xin-Guang Zhu (Biology, UIUC)

37 谢谢 !  Comments and/or questions?