DFDs Data and Information Management System a Brief Introduction Joint WGISS Subgroup Meetings ICS Task Team Session Toulouse, May 14th,2003 Bernhard Buckl.

Slides:

Advertisements

Similar presentations

The Data Information and Management System (DIMS)

Advertisements

ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > Slide 1 A dynamic data integration approach to build scientific workflow systems Markus.

14 May 2002 ESA Catalogue Activities A whirlwind tour of ESAs catalogue activities –overview of the architecture of ESA's.

ESA Data Integration Application Open Grid Services for Earth Observation Luigi Fusco, Pedro Gonçalves.

1 NASA CEOP Status & Demo CEOS WGISS-25 Sanya, China February 27, 2008 Yonsook Enloe.

Remote Visualisation System (RVS) By: Anil Chandra.

GridPP July 2003Stefan StonjekSlide 1 SAM middleware components Stefan Stonjek University of Oxford 7 th GridPP Meeting 02 nd July 2003 Oxford.

V-GISC Presentation – ET_WISC – Geneva - February v-GISC key functionalities ET_WISC meeting 2-5 February 2010 Jean-Pierre Aubagnac, Jacques Roumilhac.

Database System Concepts and Architecture

The System Center Family Microsoft. Mobile Device Manager 2008.

Slide: 1 ROSA GRAS Meeting February 2009 Matera, Italy User Services EUMETSAT EUMETSAT Data Access & User Support.

1 CEOS/WGISS20 – Kyiv – September 13, 2005 Paul Kopp SIPAD New Generation: Dominique Heulet CNES 18, Avenue E.Belin Toulouse Cedex 9 France

6/1/2015Ch.31 Defining Enterprise Architecture Bina Ramamurthy.

May Archiving PAWN: A Policy-Driven Software Environment for Implementing Producer- Archive Interactions in Support of Long Term Digital.

DCS Architecture Bob Krzaczek. Key Design Requirement Distilled from the DCS Mission statement and the results of the Conceptual Design Review (June 1999):

Supporting Customized Archival Practices Using the Producer-Archive Workflow Network (PAWN) Mike Smorul, Mike McGann, Joseph JaJa.

Welcome to this presentation Introduction of CORBA Entertainment Information System (CEIS)

PAWN: Producer-Archive Workflow Network University of Maryland Institute for Advanced Computer Studies Joseph JaJa, Mike Smorul, Mike McGann.

Slide 1 Sterling Software Peter Sharer Sterling Software.

The SAM-Grid Fabric Services Gabriele Garzoglio (for the SAM-Grid team) Computing Division Fermilab.

Upcoming Enhancements to the HST Archive Mark Kyprianou Operations and Engineering Division Data System Branch.

QCDgrid Technology James Perry, George Beckett, Lorna Smith EPCC, The University Of Edinburgh.

FP OntoGrid: Paving the way for Knowledgeable Grid Services and Systems WP8: Use case 1: Quality Analysis for Satellite Missions.

CERN - IT Department CH-1211 Genève 23 Switzerland t Monitoring the ATLAS Distributed Data Management System Ricardo Rocha (CERN) on behalf.

Technology Overview. Agenda What’s New and Better in Windows Server 2003? Why Upgrade to Windows Server 2003 ?  From Windows NT 4.0  From Windows 2000.

NASA/ESA Interoperability Efforts CEOS Subgroup - CINTEX Alexandria, Sept 12, 2002 Ananth Rao Yonsook Enloe SGT, Inc.

Turkey IDA Info-Day AM Session, September 25, 2003 CIRCA 1 CIRCA : The IDA Collaborative Software Tool Grzegorz Ambroziewicz European Commission - DG Enterprise.

Earth Observing System Data and Information System (EOSDIS) provides access to more than 3,000 types of Earth science data products and specialized services.

Enticy GROUP THE A Framework for Web and WinForms (Client-Server) Applications “Enterprise Software Architecture”

SITools Enhanced Use of Laboratory Services and Data Romain Conseil

Robert Fourer, Jun Ma, Kipp Martin Copyright 2006 An Enterprise Computational System Built on the Optimization Services (OS) Framework and Standards Jun.

At A Glance VOLT is a freeware, platform independent tool set that coordinates cross-mission observation planning and scheduling among one or more space.

Generic Instrument Processing Facility Interface Specifications A. BuongiornoFrascati 12 /10/2012 ESA EOP-GS 1.

QCDGrid Progress James Perry, Andrew Jackson, Stephen Booth, Lorna Smith EPCC, The University Of Edinburgh.

Contents 1.Introduction, architecture 2.Live demonstration 3.Extensibility.

ASI-Eumetsat Meeting Matera, 4-5 Feb CNM Context Matera, February 4-5, 20092ASI-Eumetsat Meeting.

Status of the LHCb MC production system Andrei Tsaregorodtsev, CPPM, Marseille DataGRID France workshop, Marseille, 24 September 2002.

Grid Architecture William E. Johnston Lawrence Berkeley National Lab and NASA Ames Research Center (These slides are available at grid.lbl.gov/~wej/Grids)

Metadata Management of Terabyte Datasets from an IP Backbone Network: Experience and Challenges Sue B. Moon and Timothy Roscoe.

Satellites, Ground Segment, and Data Access Evolution at DLR K

IODE Ocean Data Portal - ODP  The objective of the IODE Ocean Data Portal (ODP) is to facilitate and promote the exchange and dissemination of marine.

A radiologist analyzes an X-ray image, and writes his observations on papers  Image Tagging improves the quality, consistency.  Usefulness of the data.

Mantid Stakeholder Review Nick Draper 01/11/2007.

INFSO-RI Enabling Grids for E-sciencE Intelligent Distributed Data Management in Earth System Science S. Kindermann, DKRZ, Germany.

Mantid Stakeholder Review Nick Draper 01/11/2007.

H. Widmann (M&D) Data Discovery and Processing within C3Grid GO-ESSP/LLNL / June, 19 th 2006 / 1 Data Discovery and Basic Processing within the German.

© FPT SOFTWARE – TRAINING MATERIAL – Internal use 04e-BM/NS/HDCV/FSOFT v2/3 JSP Application Models.

August 2003 At A Glance The IRC is a platform independent, extensible, and adaptive framework that provides robust, interactive, and distributed control.

EC Review – 01/03/2002 – WP9 – Earth Observation Applications – n° 1 WP9 Earth Observation Applications 1st Annual Review Report to the EU ESA, KNMI, IPSL,

2. WP9 – Earth Observation Applications ESA DataGrid Review Frascati, 10 June Welcome and introduction (15m) 2.WP9 – Earth Observation Applications.

Open Grid Services for Earth Observation Pedro Gonçalves.

Data Services Task Team WGISS-22 meeting Annapolis, the US, September 12th 2006 Shinobu Kawahito, JAXA/RESTEC.

Copyright 2007, Information Builders. Slide 1 iWay Web Services and WebFOCUS Consumption Michael Florkowski Information Builders.

1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)

Physical Oceanography Distributed Active Archive Center THUANG June 9-13, 20089th GHRSST-PP Science Team Meeting GHRSST GDAC and EOSDIS PO.DAAC.

Proposal of Satellite Data Center India Meteorological Department A.K.Sharma (Chairman), Virendera Singh (Member), R.K.Giri (Member) and N.Puviarasan (Member.

A Semi-Automated Digital Preservation System based on Semantic Web Services Jane Hunter Sharmin Choudhury DSTC PTY LTD, Brisbane, Australia Slides by Ananta.

AIRS Meeting GSFC, February 1, 2002 ECS Data Pool Gregory Leptoukh.

Integrating ArcSight with Enterprise Ticketing Systems

Integrating ArcSight with Enterprise Ticketing Systems

Interoperability between Earth observations and Earth science models Session Introduction ESIP 2016 Winter Meeting, January 6-8, 2016 Liping Di Center.

Data Handling and Preservation of the TanDEM-X Satellite Mission

Joseph JaJa, Mike Smorul, and Sangchul Song

Introduction to J2EE Architecture

Technology for Long Term Digital Preservation Workshop ESA 22/09/2017

The VITO Earth Observation LTDA Facility

Lecture 1: Multi-tier Architecture Overview

Technology Landscape and Enterprise Objectives

Enterprise Integration

Presentation transcript:

DFDs Data and Information Management System a Brief Introduction Joint WGISS Subgroup Meetings ICS Task Team Session Toulouse, May 14th,2003 Bernhard Buckl DLR/DFD

German Remote Sensing Data Center Data Information and Management System Overview Production control organizes the workflow for various processing systems generating raw or value-added products. DIMS supports the production, cataloguing, archiving, ordering and distribution of earth observation products A cornerstone is the product library which is the source of processing input and the destination of the processing output. It provides a complete and consistent reference of the configured products. Based on the product library, order management handles the business process ordering throughout the system. A unified operating tool supplies interactive monitoring and control of the DIMS components. User information services provide the user access to DIMS. A WWW-based interface guides the user from directory information via inventory searches to the desired products which can be directly ordered.

German Remote Sensing Data Center DIMS Scope Overall Requirements Access to products of related systems (e.g. ENVISAT-PDS, EUMETSAT UMARF/EPS) Flexible interfacing with processing systems (e.g. ingestion processing, processing on request) Support of multi-mission data products Support of complete product and order loop Support of existing and producible products Unified solution for distributed sites or institutions

German Remote Sensing Data Center Product and Order Management Domain Processing Domain DIMS Functions Scenarios User Service Domain User Information Services (incl. Pickup-Point) Order Management OrdersPrices Online/Offline Product Generation & Delivery Ordering and Delivery Product Library Archive Inventory Processing SystemIngestion System Level Raw Production Control Request Trees Post-Processing Processing and Archiving Operating Tool Requests Monitoring and Control

German Remote Sensing Data Center DIMS System Characteristics Application Services Overview Product ManagementOrder Management Production Management Post-Processing SystemsProcessing Systems Product Library Archive Inventory Ordering Control Orders Operating Tool Requests Production Control Request Trees Processing SystemIngestion System Level Raw Online/Offline Product Generation & Delivery User Information Services Order Accounting Prices UIS Loader ISIS InterfaceMUIS Interface MUIS ServersISIS Server Web Gateway Post-Processing

German Remote Sensing Data Center DIMS Product Library Product I/O - Item Information File (IIF) Processing System Input IIF Output IIF Product Library Archive Inventory Item Identifier Item Type File Locations & Names ItemReferences to other Items Coverage Information Processing Information Item Status (e.g. reliability) Item Type Specific Metadata Insert/Update/Register NDVI Product PrimaryBrowse

German Remote Sensing Data Center User Information Services - EOWEB Catalogue Search

German Remote Sensing Data Center E. Mikusch DIMS System Characteristics - Distributed Configuration Robot Server SUN/Solaris, PC/LinuxProcessing Server Robot LibraryADIC/Grau - 300TB Data BasesInformix, Oracle, PSEpro Hierarchical Storage ManagementLSC SAM-FS CORBAOrbixWeb SUN/Solaris, PC/WindowsWorkstations SUN/Solaris - Enterprise 3500, 450 Production Control 1 Server Processing 25 Server Product Library 2 Server + Robot Library Neustrelitz Production Control 1 Server Processing 25 Server Product Library 2 Server + Robot Library UserService & Ordering 4 Server Oberpfaffenhofen Remote Processing x Systems Remote Operator Workstations Remote User Workstations World Firewall

German Remote Sensing Data Center SUN/SolarisLINUX Windows Java Virtual Machine DIMS System Characteristics Basic Architecture based on CORBA and Java JDBC Native Methods SwingI/O Logging XML Support GUI Business Service TriggerSessionQueue Specific Application Interoperability between components Relocatable distributed DIMS services Platform independent communication Reusable basic components used to build up an application component Generic components added Platform independent software Numerous Java standard components Processing System Post-Processing System Requests Operating CORBA Order Management OrdersPrices Production Control Request Trees Product Library Archive Inventory

German Remote Sensing Data Center DIMS Multi-Mission Support - Examples DIMS WDC Ozone SAF ENVISAT VA MODIS PAF TerraSAR-X PGS EPSEUMETSAT Polar System PAFProcessing and Archiving Facility PDSPayload Data Handling Segment SAFSatellite Application Facility UMARFUnified Meteorological Archive and Retrieval Facility VAValue Added Others... ESA ENVISAT/PDS EUMETSAT UMARF/EPS ESA Multi-Mission SRTM PAF

German Remote Sensing Data Center DIMS Archive Statistics [TB] DFD-OP Archive Data Volume

German Remote Sensing Data Center Data Information and Management System Conclusion Further extensions which will be made in the following areas: Near real-time distribution Interactive post-processing Interface to GISs (WCS) Support of future products and interface to mission planning Adapt metadata schema to ISO (tbc)