GEON PI Meeting, March 21-23 h, 2004, Blacksburg, VA C YBERINFRASTRUCTURE FOR THE G EOSCIENCES GEON IT Update PI Meeting, Blacksburg, VA March 21-23, 2004.

Slides:



Advertisements
Similar presentations
LEAD Portal: a TeraGrid Gateway and Application Service Architecture Marcus Christie and Suresh Marru Indiana University LEAD Project (
Advertisements

TeraGrid Deployment Test of Grid Software JP Navarro TeraGrid Software Integration University of Chicago OGF 21 October 19, 2007.
Prentice Hall, Database Systems Week 1 Introduction By Zekrullah Popal.
A Computation Management Agent for Multi-Institutional Grids
MTA SZTAKI Hungarian Academy of Sciences Grid Computing Course Porto, January Introduction to Grid portals Gergely Sipos
GIS in GEON Cyberinfrastructure Presented by Ashraf Memon Presented by Ashraf Memon.
Office of Science U.S. Department of Energy Grids and Portals at NERSC Presented by Steve Chan.
Data Grids: Globus vs SRB. Maturity SRB  Older code base  Widely accepted across multiple communities  Core components are tightly integrated Globus.
PAWN: A Novel Ingestion Workflow Technology for Digital Preservation
1 CYBERINFRASTRUCTURE FOR THE GEOSCIENCES Global Earth Observation Grid Workshop, Bangkok, Thailand, March Integration Platform.
SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.
Persistent Digital Archives and Library System (PeDALS) A Guide for Wisconsin State Agencies.
CYBERINFRASTRUCTURE FOR THE GEOSCIENCES WMS Map Integration - Improved Ghulam Memon Ashraf Memon.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
System Design/Implementation and Support for Build 2 PDS Management Council Face-to-Face Mountain View, CA Nov 30 - Dec 1, 2011 Sean Hardman.
GEON: The User Perspective Choonhan Youn Dogan Seber, Chaitan Baru, Ashraf Memon San Diego Supercomputer Center, University of California at San Diego.
Tools for e-Research Mat Wyatt. 2 e-Research Sensor nets data compute… Models/ software/ workflows colleagues instruments.
QCDgrid Technology James Perry, George Beckett, Lorna Smith EPCC, The University Of Edinburgh.
January, 23, 2006 Ilkay Altintas
CCSM Portal/ESG/ESGC Integration (a PY5 GIG project) Lan Zhao, Carol X. Song Rosen Center for Advanced Computing Purdue University With contributions by:
TeraGrid Information Services December 1, 2006 JP Navarro GIG Software Integration.
4-1 INTERNET DATABASE CONNECTOR Colorado Technical University IT420 Tim Peterson.
GEON Science Application Demos
1 Distributed Database Concepts 8:30-10:00AM Thursday, July 21 st 2005 CSIG05 Chaitan Baru.
Digital Object Architecture
M i SMob i S Mob i Store - Mobile i nternet File Storage Platform Chetna Kaur.
Database System Concepts and Architecture
SeLeNe - Architecture George Samaras Kyriakos Karenos Larnaca – April 2003 THE UNIVERSITY OF CYPRUS.
GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.
Grids and Portals for VLAB Marlon Pierce Community Grids Lab Indiana University.
Grid Resource Allocation and Management (GRAM) Execution management Execution management –Deployment, scheduling and monitoring Community Scheduler Framework.
Investigators: Chaitan Baru, Randy Keller, Dogan Seber, Krishna Sinha, Ramon Arrowsmith, Boyan Brodaric, Karl Flessa, Eric Frost, Ann Gates, Mark Gahegan,
QCDGrid Progress James Perry, Andrew Jackson, Stephen Booth, Lorna Smith EPCC, The University Of Edinburgh.
CBEO Portal Presentation 2/6/2008, 4:30pm EST SDSC Or link from
1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.
CYBERINFRASTRUCTURE FOR THE GEOSCIENCES Data Replication Service Sandeep Chandra GEON Systems Group San Diego Supercomputer Center.
Crystal25 Hunter Valley, Australia, 11 April 2007 Crystal25 Hunter Valley, Australia, 11 April 2007 JAINIS (JCU and Indiana Instrument Services): A Grid.
Fall AGU Meeting, December, 2005 GEON Developments for Searching, Accessing, Integrating, and Visualizing Distributed Data Charles Meertens UNAVCO Dogan.
CYBERINFRASTRUCTURE FOR THE GEOSCIENCES GEON Systems Report Karan Bhatia San Diego Supercomputer Center Friday Aug
The Replica Location Service The Globus Project™ And The DataGrid Project Copyright (c) 2002 University of Chicago and The University of Southern California.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
AgINFRA science gateway for workflows and integrated services 07/02/2012 Robert Lovas MTA SZTAKI.
GO-ESSP Workshop, LLNL, Livermore, CA, Jun 19-21, 2006, Center for ATmosphere sciences and Earthquake Researches Construction of e-science Environment.
State Key Laboratory of Resources and Environmental Information System China Integration of Grid Service and Web Processing Service Gao Ang State Key Laboratory.
MTA SZTAKI Hungarian Academy of Sciences Introduction to Grid portals Gergely Sipos
GEON2 and OpenEarth Framework (OEF) Bradley Wallet School of Geology and Geophysics, University of Oklahoma
Mercury – A Service Oriented Web-based system for finding and retrieving Biogeochemical, Ecological and other land- based data National Aeronautics and.
FRANEC and BaSTI grid integration Massimo Sponza INAF - Osservatorio Astronomico di Trieste.
CYBERINFRASTRUCTURE FOR THE GEOSCIENCES GEON IT Advances: Overview Chaitan Baru San Diego Supercomputer Center.
Internet2 AdvCollab Apps 1 Access Grid Vision To create virtual spaces where distributed people can work together. Challenges:
System/SDWG Update Management Council Face-to-Face Flagstaff, AZ August 22-23, 2011 Sean Hardman.
WebFlow High-Level Programming Environment and Visual Authoring Toolkit for HPDC (desktop access to remote resources) Tomasz Haupt Northeast Parallel Architectures.
Biomedical Informatics Research Network The Storage Resource Broker & Integration with NMI Middleware Arcot Rajasekar, BIRN-CC SDSC October 9th 2002 BIRN.
GridChem Architecture Overview Rion Dooley. Presentation Outline Computational Chemistry Grid (CCG) Current Architectural Overview CCG Future Architectural.
GEONSearch: From Searching to Recommending GeoInformatics 2006 May 10-12, Reston, Virginia Ullas Nambiar, Bertram Ludaescher Dept. of Computer Science.
Partnerships in Innovation: Serving a Networked Nation Grid Technologies: Foundations for Preservation Environments Portals for managing user interactions.
Glossary WMS – OGC Web Mapping Services WFS – OGC Web Feature Services XML- Extensible Markup Language OGC – Open GIS Consortium ADN –
Experiments in Utility Computing: Hadoop and Condor Sameer Paranjpye Y! Web Search.
SAN DIEGO SUPERCOMPUTER CENTER Welcome to the 2nd Inca Workshop Sponsored by the NSF September 4 & 5, 2008 Presenters: Shava Smallen
PROGRESS: GEW'2003 Using Resources of Multiple Grids with the Grid Service Provider Michał Kosiedowski.
A Use Case for GEON 1 A user request of the form: “For a given region (i.e. lat/long extent, plus depth), return a 3D structural model with accompanying.
Holding slide prior to starting show. Lessons Learned from the GECEM Portal David Walker Cardiff University
September 2003, 7 th EDG Conference, Heidelberg – Roberta Faggian, CERN/IT CERN – European Organization for Nuclear Research The GRACE Project GRid enabled.
ACGT Architecture and Grid Infrastructure Juliusz Pukacki ‏ EGEE Conference Budapest, 4 October 2007.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Services for Distributed e-Infrastructure Access Tiziana Ferrari on behalf.
GEON IT Solutions: Products and Demos Chaitan Baru San Diego Supercomputer Center.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
Grid Services for Digital Archive Tao-Sheng Chen Academia Sinica Computing Centre
Presentation transcript:

GEON PI Meeting, March h, 2004, Blacksburg, VA C YBERINFRASTRUCTURE FOR THE G EOSCIENCES GEON IT Update PI Meeting, Blacksburg, VA March 21-23, 2004

GEON PI Meeting, March h, 2004, Blacksburg, VA C YBERINFRASTRUCTURE FOR THE G EOSCIENCES Outline Update on state of IT activities GEON Software Architecture and project high-level goals Update on activities at SDSC (since last meeting) The GEON Portal Knowledge representation Development of knowledge structures Schemas (metadata is implicit in this), Controlled vocabularies, Ontology structures…

GEON PI Meeting, March h, 2004, Blacksburg, VA C YBERINFRASTRUCTURE FOR THE G EOSCIENCES Components of the GEONgrid Architecture GEONgrid Physical Implementation Core Grid Services Registry, authentication, access control, monitoring, replication, distributed filesystem, collection management (SRB), job submission, e.g. launch job to TeraGrid “Higher-Order” Services Registration: data and metadata, schema, ontology, services Data Integration: spatial data integration, data systems integration, schema integration 2D Visualization, including GIS Workflow 3D Viz, Augmented Reality Portal Portlet-based design. User space, GeonSearch, GeoWorkbench.

GEON PI Meeting, March h, 2004, Blacksburg, VA C YBERINFRASTRUCTURE FOR THE G EOSCIENCES GEON Software Architecture activities Architecture “Retreat” at SDSC, Jan Architecture document in preparation Established GEON software development areas with Coordinator and Chief Programmers for each Each group meets once a week. Chief programmers meet once a week, on Monday Would like to develop a schedule of visits of GEON PI’s to SDSC To attend Monday meetings GEONgrid software Plans for 6 month, 1 year, 2 years Release 1 by Dec. 2004

GEON PI Meeting, March h, 2004, Blacksburg, VA C YBERINFRASTRUCTURE FOR THE G EOSCIENCES GEON Software Development Areas Development AreaCoordinatorChief Programmer 1. Core Grid ServicesKaran BhatiaSandeep Chandra 2. PortalDogan SeberChoonhan Youn 3. Data RegistrationBertram LudaescherKai Lin 4. MappingIlya ZaslavskyAshraf Memon 5. MediationPavel Velikhov 6. WorkflowBertram LudaescherEfrat Jaeger Also, Jane Park, Doug Greer, LJ Ding, and others …

GEON PI Meeting, March h, 2004, Blacksburg, VA C YBERINFRASTRUCTURE FOR THE G EOSCIENCES GEONgrid Physical Implementation PoP Nodes only VaTech, Bryn Mawr, Penn State, Rice, Utah EGI, Utah, DLESE, UNAVCO PoP nodes + Data Nodes Idaho, Arizona State, SDSC PoP nodes + Compute Nodes Missouri, UTEP, SDSC

GEON PI Meeting, March h, 2004, Blacksburg, VA C YBERINFRASTRUCTURE FOR THE G EOSCIENCES GEON Nodes Compute nodes Want to create at least a few nodes as a TeraGrid “sandbox” GEONgrid is currently based on Redhat Linux, OGSI and Globus Toolkit Version 3 (GT3) TeraGrid is currently based on SuSE Linux, GT2.4 Sandbox allows GEON PI’s to develop debug software in GEONgrid prior to sending jobs to TeraGrid GEON has a TeraGrid allocation (30,000hours) Need to keep in mind GEONgrid heterogeneity Windows and other platforms

GEON PI Meeting, March h, 2004, Blacksburg, VA C YBERINFRASTRUCTURE FOR THE G EOSCIENCES GEON Services “Hosted” vs “non-hosted” services Hosted: service is implemented within the physical GEONgrid environment (i.e. on one of the systems). The implementation can benefit from core capabilities provided in GEONgrid, e.g. replication, load-balancing Need at least a PoP node to host a service Hosted databases will be stored at Data Nodes, but may be replicated at one or more PoP nodes Data nodes Require Internet2 connectivity Will be backed up to SDSC (figuring out details) Will be replicated among themselves (need to figure out details)

GEON PI Meeting, March h, 2004, Blacksburg, VA C YBERINFRASTRUCTURE FOR THE G EOSCIENCES Core Grid Services Registry: a place to register and find basic Web services. But also, all services (e.g. PGAP, Gravity Database, Seismic Simulation Tool, …) Authentication: using GEON Certificate Authority and Grid certificates Initially (I.e. in 2004), use certificates only at the portal. Very few, if any, services may actually validate to Grid certificates Access control: investigating various systems for policy-based access to services Data replication: initial target is IBM GMR software for replicating files as well as databases Support for various data systems: e.g., SDSC Storage Resource Broker (SRB) and OpenDAP Perhaps implement servers at Data Nodes Job submission, e.g. launch job to TeraGrid. Leverage NMI funding. New proposal under NMI.

GEON PI Meeting, March h, 2004, Blacksburg, VA C YBERINFRASTRUCTURE FOR THE G EOSCIENCES Higher-Order Grid Services Registration Data and metadata, schema, ontology, services Important in order to support search functionality Data Integration Defining “views” across multiple sources Multiple database schemas, e.g. in Chronos (Paleostrat, Neptune, Paleobiology), PAST?, Geochemisry (Navdat, PetDB, …) Multiple maps and map layers GIS and 2D Viz Integrating map layers. “Simple” mapping service. SVG-based data access and visualization tools Workflow Iconic representation of databases and tools Ability to link together tools and data to specify computations Based on Kepler system

GEON PI Meeting, March h, 2004, Blacksburg, VA C YBERINFRASTRUCTURE FOR THE G EOSCIENCES GEON Portal Exact “look and feel” and core functionality is a work in progress Portal components for: GeonSearch, GeoWorkbench, Rocky Mountain Testbed, Mid-Atlantic Testbed, GEONSystems, GEON Docs, EOT Portlet-based design is meant to make it easier to create customized portals (“building blocks” approach) E.g. Rocky Mountain and Mid-Atlantic are examples of customized portlets Portal software is distributed to each PoP node. Can be customized at each PoP node.

GEON PI Meeting, March h, 2004, Blacksburg, VA C YBERINFRASTRUCTURE FOR THE G EOSCIENCES GeonSearch Ad hoc search versus querying of pre- established “views” Ad hoc Search Search/discover information on data, services, experiments, “other” (e.g., people, organizations) Display results via map interfaces, semantic graphs View-based querying E.g., use ad hoc search to find a set of databases, map layers of interest; define a specific way of combining data across these various sources Need good use cases

GEON PI Meeting, March h, 2004, Blacksburg, VA C YBERINFRASTRUCTURE FOR THE G EOSCIENCES GeoWorkbench Workbench “capabilities” Data and service registration Create spatial, temporal, concept-based indexes as part of registration process Ability to define views, e.g. using GeonSearch to find data, services, etc. Run analysis routines, e.g. via workflow specifications, using Kepler Visualize output, save output, feed output to other services Need good use cases Current portal is very much a work in progress Figuring out functional components Which function goes under what part of the portal, etc.

GEON PI Meeting, March h, 2004, Blacksburg, VA C YBERINFRASTRUCTURE FOR THE G EOSCIENCES Knowledge Representation