1 GISolve – TeraGrid GIScience Gateway Shaowen Wang Department of Geography and Grid Research & educatiOn ioWa (GROW) The University of Iowa May.

Slides:



Advertisements
Similar presentations
State of CyberGIS State of CyberGIS Shaowen Wang CyberInfrastructure and Geospatial Information Laboratory (CIGI) Department of Geography and Geographic.
Advertisements

Spatial Cloud Computing
Working Outside One’s Domain of Understandin g Ophir Frieder Department of Computer Science Georgetown University & Department of BioStatistics, BioInformatics,
SAN DIEGO SUPERCOMPUTER CENTER The Integration of 2 Science Gateways: CyberGIS + OpenTopography Choonhan Youn, Nancy Wilkins-Diehr, SDSC Christopher Crosby,
A CyberGIS Environment for Near-Real-Time Spatial Analysis of Social Media Data Shaowen Wang CyberInfrastructure and Geospatial Information Laboratory.
Education and Outreach Within the Modeling Environment for Atmospheric Discovery (MEAD) Project Daniel J. Bramer University Of Illinois at Urbana-Champaign.
This work was carried out in the context of the Virtual Laboratory for e-Science project. This project is supported by a BSIK grant from the Dutch Ministry.
2. Point Cloud x, y, z, … Complete LiDAR Workflow 1. Survey 4. Analyze / “Do Science” 3. Interpolate / Grid USGS Coastal & Marine.
Office of Science U.S. Department of Energy Grids and Portals at NERSC Presented by Steve Chan.
1 从信息化基础设施角度展望 下一代地理信息系统 王少文 What is Cyberinfrastructure? It was six men of Indostan To learning much inclined, Who went to see the elephant.
A Parallel Structured Ecological Model for High End Shared Memory Computers Dali Wang Department of Computer Science, University of Tennessee, Knoxville.
Knowledge Environments for Science: Representative Projects Ian Foster Argonne National Laboratory University of Chicago
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
PILOT STUDY ON THE USE OF LANDSCAPE SCIENCES FOR ENVIRONMENTAL ASSESSMENT A Science Framework for International Cooperation Committee on the Challenges.
Iterative computation is a kernel function to many data mining and data analysis algorithms. Missing in current MapReduce frameworks is collective communication,
1 Building National Cyberinfrastructure Alan Blatecky Office of Cyberinfrastructure EPSCoR Meeting May 21,
Cyber-Infrastructure for Agro-Threats Steve Goddard Computer Science & Engineering University of Nebraska-Lincoln.
CyberGIS Toolkit: A Software Toolbox Built for Scalable cyberGIS Spatial Analysis and Modeling Yan Liu 1,2, Michael Finn 4, Hao Hu 1, Jay Laura 3, David.
4.x Performance Technology drivers – Exascale systems will consist of complex configurations with a huge number of potentially heterogeneous components.
TACC’s Scientific Computing Curriculum Texas Advanced Computing Center.
INFSO-SSA International Collaboration to Extend and Advance Grid Education ICEAGE Forum Meeting at EGEE Conference, Geneva Malcolm Atkinson & David.
A High-Throughput Computational Approach to Environmental Health Study Based on CyberGIS Xun Shi 1, Anand Padmanabhan 2, and Shaowen Wang 2 1 Department.
Cartographic Modeling Language Approach for CyberGIS: A Demonstration with Flux Footprint Modeling Michael E. Hodgson, April Hiscox, Shaowen Wang, Babak.
Long Term Ecological Research Network Information System LTER Grid Pilot Study LTER Information Manager’s Meeting Montreal, Canada 4-7 August 2005 Mark.
Definition of Computational Science Computational Science for NRM D. Wang Computational science is a rapidly growing multidisciplinary field that uses.
Appraisal and Data Mining of Large Size Complex Documents Rob Kooper, William McFadden and Peter Bajcsy National Center for Supercomputing Applications.
Man-Sze Li IC Focus Enterprise Interoperability Research Roadmap SME aspects.
CyberGIS in Action CyberGIS in Action Shaowen Wang CyberInfrastructure and Geospatial Information Laboratory (CIGI) Department of Geography and Geographic.
U.S. Department of the Interior U.S. Geological Survey CDI Webinar Sept. 5, 2012 Kevin T. Gallagher and Linda C. Gundersen September 5, 2012 CDI Science.
Mehdi Ghayoumi Kent State University Computer Science Department Summer 2015 Exposition on Cyber Infrastructure and Big Data.
Through the development of advanced middleware, Grid computing has evolved to a mature technology in which scientists and researchers can leverage to gain.
Grid Workload Management & Condor Massimo Sgaravatto INFN Padova.
Dr. Michael P. Bishop Professor and Haynes Chair in Geosciences Department of Geography.
Peter Bajcsy, Rob Kooper, Luigi Marini, Barbara Minsker and Jim Myers National Center for Supercomputing Applications (NCSA) University of Illinois at.
1 520 Student Presentation GridSim – Grid Modeling and Simulation Toolkit.
Jarek Nabrzyski, Ariel Oleksiak Comparison of Grid Middleware in European Grid Projects Jarek Nabrzyski, Ariel Oleksiak Poznań Supercomputing and Networking.
Small-Scale Raster Map Projection Transformation Using a Virtual System to Interactively Share Computing Resources and Data U.S. Department of the Interior.
Transforming Agricultural Ecosystem Management with Web 2.0 Technology Doug Miller Center for Environmental Informatics Earth and Environmental Systems.
The Grid System Design Liu Xiangrui Beijing Institute of Technology.
KNOWLEDGE GRIDS Akshat Mishra GRID SEMINAR WINTER 2008 Feb 2008.
Realizing CyberGIS Vision through Software Integration Anand Padmanabhan, Yan Liu, Shaowen Wang CyberGIS Center for Advanced Digital and Spatial Studies.
USCMS Grid Infrastructure Troubleshooting Shaowen Wang USCMS & GROW OSG Operations & Support Centers Workshop May 16, 2006.
Where to find LiDAR: Online Data Resources.
Service - Oriented Middleware for Distributed Data Mining on the Grid ,劉妘鑏 Antonio C., Domenico T., and Paolo T. Journal of Parallel and Distributed.
AN ADAPTIVE CYBERINFRASTRUCTURE FOR THREAT MANAGEMENT IN URBAN WATER DISTRIBUTION SYSTEMS Kumar Mahinthakumar North Carolina State University DDDAS Workshop,
Spectrum of Support for Data Movement and Analysis in Big Data Science Network Management and Control E-Center & ESCPS Network Management and Control E-Center.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Sarat Sreepathi North Carolina State University Internet2 – SURAgrid Demo Dec 6, 2006.
Nora Sabelli, NSF What could data mining and retrieval contribute to the study of education?
Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.
©2012 LIESMARS Wuhan University Building Integrated Cyberinfrastructure for GIScience through Geospatial Service Web Jianya Gong, Tong Zhang, Huayi Wu.
Computational Science & Engineering meeting national needs Steven F. Ashby SIAG-CSE Chair March 24, 2003.
Real-time Scheduling for Grid Computing Anwar Mamat.
1 Kalev Leetaru, Eric Shook, and Shaowen Wang CyberInfrastructure and Geospatial Information Laboratory (CIGI) Department of Geography and Geographic Information.
Securing the Grid & other Middleware Challenges Ian Foster Mathematics and Computer Science Division Argonne National Laboratory and Department of Computer.
GriPhyN Project Paul Avery, University of Florida, Ian Foster, University of Chicago NSF Grant ITR Research Objectives Significant Results Approach.
Forging the eXtremeDigital (XD) Program Barry I. Schneider Program Director, Office of CyberInfrastructure January 20, 2011.
Realizing the Promise of Grid Computing Ian Foster Mathematics and Computer Science Division Argonne National Laboratory and Department of Computer Science.
GEOSPATIAL CYBERINFRASTRUCTURE. WHAT IS CYBERINFRASTRUCTURE(CI)?  A combination of data resources, network protocols, computing platforms, and computational.
The AGILE Research Agenda 7th EC-GI & GIS Workshop Potsdam June 15, 2001 Max Craglia, University of Sheffield Mike Gould, Universitat Jaume I, Castellón.
ACGT Architecture and Grid Infrastructure Juliusz Pukacki ‏ EGEE Conference Budapest, 4 October 2007.
CyberGIS Prof. Wenwen Li School of Geographical Sciences and Urban Planning 5644 Coor Hall
Black and White Introduction to Cyberinfrastructure Eric Shook Department of Geography Kent State University.
INTRODUCTION TO XSEDE. INTRODUCTION  Extreme Science and Engineering Discovery Environment (XSEDE)  “most advanced, powerful, and robust collection.
Shaowen Wang 1, 2, Yan Liu 1, 2, Nancy Wilkins-Diehr 3, Stuart Martin 4,5 1. CyberInfrastructure and Geospatial Information Laboratory (CIGI) Department.
Globus —— Toolkits for Grid Computing
Shaowen Wang1, 2, Yan Liu1, 2, Nancy Wilkins-Diehr3, Stuart Martin4,5
OGCE Portal Applications for Grid Computing
Department of Computer Science, University of Tennessee, Knoxville
Defining the Grid Fabrizio Gagliardi EMEA Director Technical Computing
Presentation transcript:

1 GISolve – TeraGrid GIScience Gateway Shaowen Wang Department of Geography and Grid Research & educatiOn ioWa (GROW) The University of Iowa May 24, 2007

2 Purpose Present how cyberinfrastructure-based Geographic Information Systems (GIS) function Present how cyberinfrastructure-based Geographic Information Systems (GIS) function Illustrate how GISolve is developed to help advance GIScience using cyberinfrastructure Illustrate how GISolve is developed to help advance GIScience using cyberinfrastructure Demonstrate science impact of GISolve Demonstrate science impact of GISolve Background Design Science Implementation E&O Conclusions Purpose

3 Background Geographic information quantity Geographic information quantity –Ever increasing Application driven Application driven –GPS, LBS, RS Computationally intensive geographic analysis Computationally intensive geographic analysis –Heuristic search –Simulation –Optimization –Statistical methods Cyberinfrastructure Cyberinfrastructure –Grid computing and virtual organization Open Grid Service Architecture (OGSA) Open Grid Service Architecture (OGSA) –Problem solving environments Grid portals Grid portals –TeraGrid Science Gateway Background Design Science Implementation E&O Conclusions Purpose

4 GISolve Architecture Computational domain modeling Domain decomposition Task scheduling Information broker and resource discovery Data access module Problem solving environments implemented using Grid portal technologies Monitoring servicesProtocols and services for data access on the Grid, such as the Globus GridFTP Grid Middleware such as Globus and Condor Resource management

5 Spatial Computational Domain Theory Wang, S., and Armstrong, M. P “A Theory of the Spatial Computational Domain.” In: Proceedings of GeoComputation 2005 (CDROM), Ann Arbor, MI, August 1-3, 2005 Wang, S., and Armstrong, M. P “A Theory of the Spatial Computational Domain.” In: Proceedings of GeoComputation 2005 (CDROM), Ann Arbor, MI, August 1-3, 2005 Background Design Science Implementation E&O Conclusions Purpose

6 Information Broker and Resource Discovery Self-Organized Grouping method for Grid resource discovery Self-Organized Grouping method for Grid resource discovery –Padmanabhan, A., Wang, S., Ghosh, S., and Briggs, R “A Self-Organized Grouping (SOG) Method for Efficient Grid Resource Discovery.” In: Proceedings of the Grid 2005 Workshop, Seattle, WA, November 13-14, 2005, IEEE Press, pp Modular Information Provider to support interoperable information brokering Modular Information Provider to support interoperable information brokering –Wang, S., Shook, E., Padmanabhan, A., Briggs, R., Pearlman, L “Developing a Modular Information Provider to Support Interoperable Grid Information Services.” In: Proceedings of Grid and Cooperative Computing - GCC 2006: The Fifth International Conference, IEEE Computer Society, pp Background Design Science Implementation E&O Conclusions Purpose

7 GISolve Workflow

8 A Diagrammatic Example of Task Scheduling 1, 1 0, 02, 4 4, 25, 3 11, 13 14, 1415, 15 3, 5 6, 67, 7 8, 89, 910, 12 12, 1013, 11 1, 1 0, 02, 4 4, 25, 3 11, 13 14, 1415, 15 3, 5 6, 67, 7 8, 89, 910, 12 12, 1013, 11 1, 1 0, 02, 4 4, 25, 3 11, 13 14, 1415, 15 3, 5 6, 67, 7 8, 89, 910, 12 12, 1013, 11 1, 1 0, 02, 4 4, 25, 3 11, 13 14, 1415, 15 3, 5 6, 67, 7 8, 89, 910, 12 12, 1013, 11 Small Capacity Large Capacity Medium Capacity Background Design Science Implementation E&O Conclusions Purpose

9 GISolve Portal Background Design Science Implementation E&O Conclusions Purpose

10 Domain Decomposition Portlet Background Design Science Implementation E&O Conclusions Purpose

11 Scientific Analyses Supported by GISolve Bayesian geostatistical modeling Bayesian geostatistical modeling –Yan, J., Cowles, M. K., Wang, S., and Armstrong, M. P. (2007). Parallelizing MCMC for Bayesian spatiotemporal geostatistical models. Statistics and Computing, in press Detection of local spatial clustering Detection of local spatial clustering –Wang, S., Cowles, M. K., and Armstrong, M. P. (2006) Grid computing of spatial statistics: using the TeraGrid for G*(d) analysis. Concurrency and Computation: Practice and Experience, under revision –Wang, S., Cowles, M. K., and Armstrong, M. P. (2006) Grid computing of spatial statistics: using the TeraGrid for G i *(d) analysis. Concurrency and Computation: Practice and Experience, under revision Inverse distance weighted interpolation Inverse distance weighted interpolation –Wang, S., and Armstrong, M. P. (2003) A quadtree approach to domain decomposition for spatial interpolation in Grid computing environments. Parallel Computing, 29 (10): Background Design Science Implementation E&O Conclusions Purpose

12 Bayesian Geostatistical Modeling Bayesian geostatistical models based on Markov chain Monte Carlo (MCMC) Bayesian geostatistical models based on Markov chain Monte Carlo (MCMC) – –Large-scale spatial-temporal data mining and inference – –Using geostatistical models to characterize the spatial distributions of environmental processes or disease-related outcomes Challenges – –Computationally intensive Background Design Science Implementation E&O Conclusions Purpose

13 Science Impact – A Lung Cancer Risk Study Based on Residential Radon Concentrations Iowa Radon MeasurementsPredicted Radon Concentrations Brian J. Smith From Dr. Brian J. Smith Background Design Science Implementation E&O Conclusions Purpose

14 Science Impact – Social Complexity and the Management of Ecosystems A Study on Yellowstone’s Northern Elk Herd From Dr. David A. Bennett

15 Big Picture – GISolve as an Integrated GIScience Workbench Background Design Science Implementation E&O Conclusions Purpose

16 Education and Outreach Modules Modules –SpatialGen A tool to generate simulated datasets with configurable geographic distributions A tool to generate simulated datasets with configurable geographic distributions –Kriging Spatial prediction Spatial prediction In classrooms In classrooms –The University of Iowa, 2007 Foundations of Geographic Information Systems (undergraduate) Foundations of Geographic Information Systems (undergraduate) Principles of Geographic Information Systems (undergraduate and graduate) Principles of Geographic Information Systems (undergraduate and graduate) Bayesian Statistics (undergraduate and graduate) Bayesian Statistics (undergraduate and graduate) Computing in Statistics (undergraduate and graduate) Computing in Statistics (undergraduate and graduate) –The University of Illinois at Urbana-Champaign, 2007 Geographic information Science (undergraduate and graduate) Geographic information Science (undergraduate and graduate) Upcoming TeraGrid07 student competition Upcoming TeraGrid07 student competition Background Design Science Implementation E&O Conclusions Purpose

17 Conclusions GISolve demonstrates how cyberinfrastructure can benefit research on computationally intensive geographic information analyses GISolve demonstrates how cyberinfrastructure can benefit research on computationally intensive geographic information analyses GISolve integrates OGSA-based Web services to support the computational aspects of GIServices GISolve integrates OGSA-based Web services to support the computational aspects of GIServices Background Design Science Implementation E&O Conclusions Purpose

18 Ongoing Work Extension of the types of geographic information analyses GISolve supports Extension of the types of geographic information analyses GISolve supports –Science impact Interoperability of GISolve services Interoperability of GISolve services Adaptive domain decomposition services Adaptive domain decomposition services Visualization services Visualization services Evaluation of GISolve performance Evaluation of GISolve performance Education and outreach Education and outreach

19 Acknowledgments The University of Iowa The University of Iowa –The Office of Vice President for Research –The Office of Provost The NSF TeraGrid The NSF TeraGrid The NSF ITR: iVDGL project The NSF ITR: iVDGL project The Open Science Grid The Open Science Grid My colleagues My colleagues Dr. Marc P. Armstrong (UIowa, GIScience) Dr. David A. Bennett (UIowa, GIScience) Mary Kathryn Cowles Dr. Mary Kathryn Cowles (UIowa, Statistics) Mr. Thomas Hansen (UIowa, CS) Ms. Wenli He (UIowa, CS) Mr. Peter Likarish (UIowa, CS) Mr. Yan Liu (UIowa, CS & GIScience) Dr. Brian J. Smith (UIowa, Biostatistics) Edward Walker Mr. Eric Shook (UIowa, GIScience) Dr. Edward Walker (UT-Austin/TACC, CS) Dr. Jun Yan (UIowa, Statistics) Mr. Junfeng Zheng (UIowa, CS)