InSAR Working Group Meeting, Oxnard, Oct IT discussion Day 1 afternoon breakout session
InSAR Working Group Meeting, Oxnard, Oct GDS Data Flow Update Catalog Data FTP Stanford University CaltechMITNSIDCHoward University SDSC Long Term Archive 5 years near-line EDC Permanent Archive University of Miami Alaska SAR Facility (ASF) Mission Control Center (MCC) DLR-GSOC Ground Station Weilheim (WHM) Short Term Archive1 year on-line Catalog Science Team Archive Manager Collection requests, acquisition requests, data requests Acquisition plan, status, holdings, software, ancillary data Catalog redirects user to appropriate FTP address for L0 data retrieval L1 Data Internet - 2 User Internet - 2 Internet and Internet-2 Network Transfer Subsystem (NTS) Stanford University & NSIDC Archive Manager Caltech User Catalog Archive Manager User NSIDC User NSIDCStanford University SDSC Long Term Archive 5 years near-line Archive Manager Alaska SAR Facility (ASF) JPL Mission Ops 300 Mb/sec downlink Populate ST Archive Catalog Archive Manager User Redirect Populate LT Archive In Background User NSIDC Catalog MITEDC Permanent Archive SIO Science Planning Bd. User Acq. Request Catalog SIO Science Planning Bd. JPL Mission Ops Mission Control Center (MCC) DLR-GSOC Ground Station Weilheim (WHM) Mission Control Center (MCC) JPL Mission Ops Status to User Catalog Network Transfer Subsystem (NTS) Stanford University & NSIDC Archive Manager User Data. Request Transfer to NTS Populate Permanent Archive in Background
InSAR Working Group Meeting, Oxnard, Oct Solid Earth Research Virtual Observatory (SERVO) Tier2 Center Archive SERVO … GoddardJPLAmes Institute Fully functional problem solving environment Plug and play composing of parallel programs from algorithmic modules On-demand downloads of 100 GB in 5 minutes 10 6 volume elements rendering in real-time Program-to-program communication in milliseconds Approximately 100 model codes Data cache ~TBytes/day Tier2 Center Tier 0 +1 Tier 1 Tier 3 Tier 4 Tier2 Center 1 PB per year data rate in 2010 Distributed Heterogeneous Real-Time Datasets Observations Archive Downlink Archive Downlink … … … … … … … 100 TeraFLOPs sustained Tier 2 Workstations, other portals Mbits/sec
InSAR Working Group Meeting, Oxnard, Oct National Lambda Rail (NLR) Terminal, Regen or OADM site Fiber route NLR Coming Up Now Initially 4 10G Wavelengths Full Footprint Ops by 3Q or 4Q04 Internet2 HOPI Initiative (w/HEP) To 40 10G Waves in Future Transition beginning now to optical, multi-wavelength Community owned or leased fiber networks for R&E PIT POR FRE RAL WAL NAS PHO OLG ATL CHI CLE KAN OGD SAC BOS NYC WDC STR DAL DEN LAX SVL SEA SDG JAC Regional Dark Fiber Initiatives in 18 U.S. States
InSAR Working Group Meeting, Oxnard, Oct Solution: Move to Internet Protocol Over Dedicated Optical Lightpaths NASA Goddard IT Pathfinder Working Group Earth and Climate Scientists- Creating a Virtual Collaboratory Between Goddard and SIO (UCSD ) Coupling NASA Centers to NSF OptIPuter
InSAR Working Group Meeting, Oxnard, Oct Database Analysis and Visualization Portal Repositories Federated Databases Data Filter Services Field Trip Data Streaming Data Sensors ? Discovery Services SERVOGrid Research Simulations ResearchEducation Customization Services From Research to Education Education Grid Computer Farm Geoscience Research and Education Grids GIS Grid Sensor Grid Database Grid Compute Grid
InSAR Working Group Meeting, Oxnard, Oct Basic System Architecture
InSAR Working Group Meeting, Oxnard, Oct Schematic of a Typical Ontology Manager
InSAR Working Group Meeting, Oxnard, Oct What will be needed as technology for: Access to data through data bases and the web Software for data mining and data exploration Software for simulating, interpreting, visualizing data
InSAR Working Group Meeting, Oxnard, Oct Who are the End Users outside the InSAR Research Community? Engineering Education Government/Policy decision makers Operational/Hazards Commercial
InSAR Working Group Meeting, Oxnard, Oct Issues Associated with Access to data through databases Standards for domestic and international missions Security Quality and Validation Bandwidth Interoperability – XML & GML Content addressable storage Near real time or real time –Rapid response tasking of satellite
InSAR Working Group Meeting, Oxnard, Oct S/w and H/w Data exploration and analysis –Higher level functionality is desirable –Portal architecture –Peer to peer –Collaborative –Error quantification –Graduated authentication S/w development –Curation –Reliability and robustness –Fusion
InSAR Working Group Meeting, Oxnard, Oct Simulating, interpreting, and visualizing data Large scale simulation & modeling capability is needed & should be part of mission plan Centralized and Grid computing resources Code sharing (open source) Code validation and curation Reliability and robustness
InSAR Working Group Meeting, Oxnard, Oct Remaining questions Commercial component? Operational versus Science mission?