DEIMOS – 17 January Ontogrid Presentation OntoGrid Business Case, User Requirements Analysis and Test Set Definition For Quality Analysis Platform Presentation (ontogrid-dms-ptt ) Ana Isabel Mediavilla

DEIMOS – 17 January Ontogrid Presentation Ontogrid Presentation:Ontogrid Presentation: –Business Approach –Quality Platform –Use case I:Correlation products and mission status –Use case II: Validation of an instrument based in their product files DiscussionDiscussion Agenda

DEIMOS – 17 January Ontogrid Presentation Ontogrid Presentation Presentation Meeting Jan

DEIMOS – 17 January Ontogrid Presentation Business ProcessesBusiness Processes –All business processes are in charge of monitor and control of a satellite or a set of satellites for getting valuable data (products) from the instruments. These data is for covering the mission of the satellite. Satellite is a hardware and software equipment with a concrete mission. For example: Mission from SatellitesMission from Satellites Instrument is a hardware and software component, which allows making measures of specific type. –For example in Envisat: »Envisat Satellite with its instrumentsEnvisat Satellite with its instruments »Use of an instrument: index/asar/animation_2.htmhttp://envisat.esa.int/instruments/tour- index/asar/animation_2.htm Mission is the objective of any element, in this case of the satellite. –For example in Envisat: Envisat data supports earth science research and allows monitoring of the evolution of environmental and climatic changes. Products or product files are files generated by an instrument directly (level 0) or processed after being generated by an instrument. Business (I/VIII)

DEIMOS – 17 January Ontogrid Presentation Navigation process(II/VIII) Navigation process: Navigation process: Verify and control the navigation of the satellite. Inputs: Inputs: Configuration data Outputs: Outputs: Products files and auxiliary files Actors: Actors: · –MCS –PDS· –Satellite

DEIMOS – 17 January Ontogrid Presentation Navigation process(III/VIII)

DEIMOS – 17 January Ontogrid Presentation Quality process (IV/VIII) Quality process: Quality process: Monitorization and control of the instruments included in the satellite and all the parameters involved in the data acquisition. Inputs: Inputs: Products files and auxiliary files Outputs: Outputs: Reports for “Research and developers”. Actors: · –PDS· –Research and Development· –DEIMOS –ESA Maintenance

DEIMOS – 17 January Ontogrid Presentation Quality process (V/VIII)

DEIMOS – 17 January Ontogrid Presentation Development Process (VI/VIII) Develop process:Develop process: Creation of a customized solution for providing new specific reports from the data extracted from the satellites. Inputs:Inputs: Description of the report content Outputs:Outputs: DIM, DPM and new configuration Actors: ·Actors: · –DEIMOS –ESA Development –ESA Maintenance –Research and Development

DEIMOS – 17 January Ontogrid Presentation Quality platform (QUARC): Quality Process (VII/VIII ) Quality platform (QUARC): Quality Process (VII/VIII ) Quality Platform:Quality Platform: –QUARC in grid –Use Cases Generate and distribute report (DPM/DIM) Add subscription to a report Monitor System Configure Use Case Control System –Actors: · PDS ESA Maintenance –Administrator –Configurer Research and Development DEIMOS (Not included because it is not automatic) Monitor system Configure Use Case Administrator Control system Configurer Client Report could be one of these two actors: ESA Maintenance could be one of these two actors: Researcher and Developer Add subscription to a report PDS Generate and Distribute reports

DEIMOS – 17 January Ontogrid Presentation Grid Use Cases: Development Process (VIII/VIII ) Grid Use Cases: Development Process (VIII/VIII ) GRID USE CASES:GRID USE CASES: –Development process –Developed elements: DIM DPM Use Case configuration

DEIMOS – 17 January Ontogrid Presentation Quality Platform: Problems (I/IV) Development CostDevelopment Cost –Ad-hoc development of DIM and DPM Unambiguous languageUnambiguous language –Complicate mapping from scientific language and technical language Reduction the data transferReduction the data transfer –Big product files –Lots of product files –Unused product files –Ad-hoc searching of files Reduction the processing time: On time quality reportsReduction the processing time: On time quality reports –Data transfer –Data storage in the database –Sequential DIMs and DPMs Fault ToleranceFault Tolerance –Unique equipment with the whole system Multiple access controlMultiple access control –Replicate in system and in the resources machines

DEIMOS – 17 January Ontogrid Presentation Quality Platform: OntoGrid Solutions (II/IV) Development CostDevelopment Cost –Create semi-automatic development for DIMs and DPMs Reduction the data transferReduction the data transfer –  Big product files –  Lots of product files – < Unused product files – Ad-hoc searching of files: Dynamic Resource Discovery –  Increase the interconnection between equipments Reduction the processing time ??Reduction the processing time ?? – Data transfer: Reduce the data processing due to reduce of data transfer. – Data storage in the database – Sequential DIMs and DPMs: Parallel several tasks –  < Increase the time of searching product file Decrease the time of searching due policy “incentive the success acquisition” Fault ToleranceFault Tolerance –DIMs and DPMs could be started-up in any place. Multiple access controlMultiple access control –Unify access control.

DEIMOS – 17 January Ontogrid Presentation Quality Platform: Open Points (III/IV) Scalability problem of computationScalability problem of computation Definition of generic and standard list of possible logics over the fields in different filesDefinition of generic and standard list of possible logics over the fields in different files Quality platform implementation depending on basic OntoGrid platformQuality platform implementation depending on basic OntoGrid platform

DEIMOS – 17 January Ontogrid Presentation Quality Platform: Architecture Quality Platform: Architecture

DEIMOS – 17 January Ontogrid Presentation Objective –Report presenting the correct working of an instrument in the timeInput –Some products from some instruments from EnvisatOutput –EnviSat Instrument Availability Interruptions: A history of the periods of unavailability for various instruments onboard EnviSat. This is presented in a table by instrument, unavailability start or unavailability end. An example of presentation is: Availability tableAvailability table –Line in plotXY per each instrument and in the time Use Case I: Interfaces (I/III)

DEIMOS – 17 January Ontogrid Presentation Execution –Retrieved some product files for some instruments using time filter. Optional retrieval, if a file is not available. –Filtering the extracted files through some fields included in the product file: ACQUISITION_STATION, PROC_CENTER –Mapping for language discrepancies: PROC_CENTER (different name for the same elements), PROC_TIME (different format time) –Composition of each product data over the satellite change modes. –Generate the output report –Distribute the output report to the subscribers. Use Case I: Execution (II/III)

DEIMOS – 17 January Ontogrid Presentation Validation –Configure the test case: Include the DPM, DIM and configure data (DPM, DIM, scheduler, workflow) –Verify the selected files used as referenced. –Check the report against the selected files using EnviView to visualize the referenced product files. Use Case I: Validation (III/III)

DEIMOS – 17 January Ontogrid Presentation Objective –Report presenting the correct working of an instrument in the time. For this task, it is generated a report showing the list of periods with an adequate level of quality. In fact, the quality of an instrument is based in the quality of its product files. product quality is based in elimination policy for reducing the list of measures to the ones with adequate level of quality.Input –Several product files from ASAR instrument.Output –Line in plotXY per ASAR instrument and in the time. The elimination policy will be displayed also. Use Case II: Interfaces (I/III)

DEIMOS – 17 January Ontogrid Presentation Execution –Retrieved some product files for ASAR instrument using time filter. –Elimination Plan or policy This elimination plan is done by instrument: one policy per each product file type and the conjunction of all the policies. The elimination plan is based in condition with and annotation per each data record per file. In fact the condition per data record is built with conjunction of simple conditions. Hereafter a simple condition consists of field name (See table “Table 8 Fields for file type”) with an operator and a value. The operator could be, = or !=. The value could be a number or a string. –Generate the output report –Distribute the output report to the subscribers. Use Case II: Execution (II/III)

DEIMOS – 17 January Ontogrid Presentation Validation –Configure the test case: Include the DPM, DIM and configure data (DPM, DIM, scheduler, workflow) –Verify the selected files used as referenced. –Check the report against the selected files using EnviView to visualize the referenced product files. Use Case II: Validation (III/III)

DEIMOS – 17 January Ontogrid Presentation Conclusions Discussions