1. IMAA-CNR activity report
HMA-T Phase 2 CDR/AR
19 February 2009
P. Mazzetti, L. Bigagli IMAA-CNR, PIN
Slide 1

2. Overview Operational Goals (OG) of IMAA-CNR activities in HMA-T
OG 01 - Enabling support of HMA catalog interfaces in GI-cat
OG 02 – Conformance Testing
OG 01 activity report
OG 02 activity report
OG02 Conformance testing demonstration
Q&A
Slide 2

3. Operational Goals
OG 01- enabling support of HMA catalog interfaces in GI- cat
“COTS and/or Open Source Component Implementation and Test” of the SoW referring to the GI-cat open-source catalogue middleware and the HMA catalogue interfaces (06-131, )
OG 02- Conformance testing
“Conformance Testing” of the SoW for the HMA catalogue interfaces
Implementation of conformance test scripts compatible with the OGC CITE initiative
Slide 3

4. OG 01 activity report Enabling support of HMA catalog interfaces in GI-cat
HMA-T Phase 2 CDR/AR
19 February 2009
P. Mazzetti, L. Bigagli IMAA-CNR, PIN
E.Boldrini, F. Papeschi, IMAA-CNR
Slide 4

5. Outline
GI-cat overview
Work performed
Work planned
Issues
Slide 5

6. GI-cat overview
A framework to federate catalog, inventory and access heterogeneous standard services
International standards: OGC CS-W, WCS and WMS
Community standards: UNIDATA THREDDS/OPeNDAP catalog service, the CDI/SeaDataNet (Common Data Index) and the GBIF (Global Biodiversity Information Facility) catalog service
Standard catalog interfaces publication (CSW/ISO & CSW/Core)
An extended SOAP catalog interface to enable user feedback, catalog configuration and incremental queries
Distributed queries, hierarchical data model, incremental queries, translucent and opaque services chaining, modular framework
Experimented and tested in different projects and initiatives including: SeaDataNet FP7 project; GEOSS IP3; GEOSS AIP
Slide 6

7. GI-cat overview Profilers Query Manager Accessors Internal Data Model
Accessors: queries carrying out by mediation to remote service; mapping to GI-cat data model
Profilers: standard catalog interfaces publication; mediation to and from QueryManager
Internal Data Model: based on ISO /19119
QueryManager: queries distribution
Profilers
Query Manager
Internal Data Model
Accessors
Slide 7

8. GI-cat data model
GI-cat data model is based on the catalog information model described by “OpenGIS catalog Services Specification – ISO Metadata Application Profile” [OGC ]
the standard used to describe geospatial metadata is “Geographic Information – Metadata” [ISO 19115:2003(E)]
metadata definitions needed to describe a geoinformation service are specified in “Geographic Information – Services” [ISO 19119:2005/PDAM 1] standard
Slide 8

9. Work performed Design Implementation Data model mapping strategies
Components design
Target deployments
As local catalogues accessing a DB
As a proxy accessing an external CSW catalog
Implementation
First cycle of development:
Accessors
Profilers
Query Manager
Slide 9

10. Extending GI-cat: general approach
Strategies to support discovery and access of additional data models
Mapping: a mapping is defined between the new data model entities and the GI-cat entities. Hence, the new data model is supported by the GI-cat model and can be queried in a convenient way
GI-cat model extension: the new concepts coming from the additional model are added to the GI-cat data model through an extension point
GI-cat model modification: the GI-cat data model is modified in order to accommodate the new concepts coming from the additional data model
GI-cat Data Model
Additional Data Model
Slide 10

11. Extension strategy for ebRIM/CIM
In order to support the CIM data model in GI-cat, a strategy of mapping is chosen, considering that GI-cat model is based on the information model described in [OGC ], that is ISO / compliant
The mapping described in Annex F of [OGC r1] is used for reference
Slide 11

12. Components for ebRIM/CIM support
An ebRIM-CIM Profiler component will map between the ebRIM-CIM and the GI-cat QueryManager.This task is reduced to a mapping of CIM resources to GI-cat resources
An extended QueryManager will support the ebRIM query semantics
An ebRIM-CIM accessor will be able to query the source data (e.g. CIM metadata stored locally)
Slide 12

13. Extension strategy for ebRIM/EO
In order to support the ebRIM/EO data model in GI-cat, a mixed strategy of extension/mapping is adopted.
Basic interoperability is preserved through the partial mapping of data models
EO Products semantics is totally preserved extending the GI-cat data model. Queries can be performed directly on all available EO Products queryables and results will be presented according to the “EO Products data model” schema
Slide 13

14. Data model extension for ebRIM/EO
GI-cat data model is extended with a specialized metadata class to support the EO data model
GML EO
Slide 14

15. Extended Components
An ebRIM-EO Profiler component will forward the requests to the QueryManager and present the results
An extended QueryManager will support the ebRIM query semantics
An ebRIM-EO Accessor will query the source data (e.g. EO metadata stored locally)
Slide 15

16. Open Issues, problems, concerns
Reference datasets
Available as external services
Needed for testing local deployment
Reference implementations
Available for ebRIM/EO
Problems with the RI for ebRIM/CIM
Slide 16

17. Deliverables November 2008 February 2009
Technical Specifications “GI-cat extensions for OGC and OGC support “ v0.1
February 2009
Technical Specifications “GI-cat extensions for OGC and OGC support “v0.2
Slide 17

18. Work planned February 2009 March 2009
Implementation of OGC , OGC support in GI-cat
March 2009
Evaluation and Test
Slide 18

19. Problem description and recommended solution by reviewer
RIDs Responses
RIDs from previous meeting (26/11/2008):
RID's number
Document Name
Severity
Problem location
Problem description and recommended solution by reviewer
Author Response
Final Decision
Author Action
YC-73
CNR- GI-cat extensions
cover
Document should have an identifier in line with convention defined in the HMA-T SPMP, e.g. HMAT-TS-0001-CNR ok
agreed
Done
The document is now HMAT-TS-0002-CNR
YC-74
introduction
Document should contain a section with applicable documents, reference documents and acronyms in the "introduction" chapter. Applicable documents should include the SOW, contract, SPMP, ECSS E40, OGC , OGC
The document contains applicable documents, references and acronyms
YC-75
structure
would be nice to map the RM-ODP onto the structure for a TS as defined in ECSS E40 Part 2b annex C "SDD", or B "SRS" as the SOW required to apply the ECSS E40.
Current TS version is collected from existing GI-cat documentation. Next release will be mapped to the required documentation specs.
Partially
The architecture is still described using RM-ODP to avoid to maintain two architectural documents (internal and external).
A section “Software components design” has been added and it will be expanded for TS 1.0
YC-76
figure 12
This figure uses obsolete names: HMA should be EOP, OHR should be OPT.
The figure was drawn from existing specs using old names. It will be changed in the next release.
Fig. 12 has been corrected
YC-77
page 37
exact versions of OGC are to be specified as r5 can mean both and
see YC-67
The document refers now to 0.2.2
Slide 19

20. OG 02 activity report Conformance Testing
HMA-T Phase 2 CDR/AR
19 February 2009
L. Bigagli, P. Mazzetti, IMAA-CNR, PIN
F. Vitale, IMAA-CNR
Slide 20

21. Outline
Objectives
Work performed
Issues
Actions
Slide 21

22. Objective OG02- Conformance Testing
Development of a conformance test framework for the HMA Catalog Specifications (OGC r5, OGC r1)
Expected output
Specification of Abstract Test Suites (ATS)
Implementation and deployment of CITE Executable Test Suites (ETS)
Slide 22

23. ATS Work performed OG02- Conformance Testing
Specification of Abstract Test Suites
Deliverable
Abstract Test Suite-CSW.ebRIM EO_1.0.1
Abstract Test Suite-CSW.ebRIM CIM_1.0.1
HMA Protocol
ATS
Recommendations for the evolution of the protocol
Issues
ATS, Acceptance test plan
Slide 23

24. Work performed
6-7/10/2008
OGC CSW-ebRIM Registry Service – Part 1: ebRIM profile of CSW (OGC r2)
OGC CSW-ebRIM Registry Service – Part 2: Basic extension package (OGC r2)
CSW-ebRIM 1.0 CIM Extension Package (OGC r1)
CSW-ebRIM 1.0 Extension Package for Earth Observation Products (OGC r5) v.0.2.0
ATS
GUIDANCE ON DEFINING AN ABSTRACT TEST SUITE FOR PROFILES 23/09/2008 (INFOTERRA)
Abstract Test Suite-CSW.ebRIM CIM v.0.1
Abstract Test Suite-CSW.ebRIM EO v.0.1
Slide 24

25. Telecon comments (RIDS)
Work performed
26/11/2008
OGC CSW-ebRIM Registry Service – Part 1: ebRIM profile of CSW (OGC r2)
OGC CSW-ebRIM Registry Service – Part 2: Basic extension package (OGC r2)
CSW-ebRIM 1.0 CIM Extension Package (OGC r1)
CSW-ebRIM 1.0 Extension Package for Earth Observation Products (OGC r5) v.0.2.2
ATS
Telecon comments (RIDS)
GUIDANCE ON DEFINING AN ABSTRACT TEST SUITE FOR PROFILES 23/09/2008 (INFOTERRA)
Abstract Test Suite-CSW.ebRIM CIM v.0.1
Abstract Test Suite-CSW.ebRIM EO v.0.1
Slide 25

26. Work performed
23/12/2008
OGC CSW-ebRIM Registry Service – Part 1: ebRIM profile of CSW (OGC r2)
OGC CSW-ebRIM Registry Service – Part 2: Basic extension package (OGC r2)
CSW-ebRIM 1.0 CIM Extension Package (OGC r1)
CSW-ebRIM 1.0 Extension Package for Earth Observation Products (OGC r5) v.0.2.2
ATS
GUIDANCE ON DEFINING AN ABSTRACT TEST SUITE FOR PROFILES 23/09/2008 (INFOTERRA)
HMAT-TN-0001-IGN, HMA-T PHASE 2 TESTING POLICY, ISSUE 1, REVISION 0, 25/08/2008 (IGN)
Abstract Test Suite-CSW.ebRIM CIM v.0.1
Abstract Test Suite-CSW.ebRIM EO v.0.2
Slide 26

27. ETS feedback, HMA-T phase 1
Work performed
09/01/2009
OGC CSW-ebRIM Registry Service – Part 1: ebRIM profile of CSW (OGC r2)
OGC CSW-ebRIM Registry Service – Part 2: Basic extension package (OGC r2)
CSW-ebRIM 1.0 CIM Extension Package (OGC r1)
CSW-ebRIM 1.0 Extension Package for Earth Observation Products (OGC r5) v.0.2.2
ATS
ETS feedback, HMA-T phase 1
GUIDANCE ON DEFINING AN ABSTRACT TEST SUITE FOR PROFILES 23/09/2008 (INFOTERRA)
HMAT-TN-0001-IGN, HMA-T PHASE 2 TESTING POLICY, ISSUE 1, REVISION 0, 25/08/2008 (IGN)
Abstract Test Suite-CSW.ebRIM CIM v.0.1
Abstract Test Suite-CSW.ebRIM EO v.1.0
Slide 27

28. Telecon comments (RIDS)
Work performed
16/01/2009
OGC CSW-ebRIM Registry Service – Part 1: ebRIM profile of CSW (OGC r2)
OGC CSW-ebRIM Registry Service – Part 2: Basic extension package (OGC r2)
CSW-ebRIM 1.0 CIM Extension Package (OGC r1)
CSW-ebRIM 1.0 Extension Package for Earth Observation Products (OGC r5) v.0.2.2
ATS
Telecon comments (RIDS)
GUIDANCE ON DEFINING AN ABSTRACT TEST SUITE FOR PROFILES 23/09/2008 (INFOTERRA)
HMAT-TN-0001-IGN, HMA-T PHASE 2 TESTING POLICY, ISSUE 1, REVISION 0, 25/08/2008 (IGN)
Abstract Test Suite-CSW.ebRIM CIM v.0.9.0
Abstract Test Suite-CSW.ebRIM EO v.1.0
Slide 28

29. Work performed
23/01/2009
OGC CSW-ebRIM Registry Service – Part 1: ebRIM profile of CSW (OGC r2)
OGC CSW-ebRIM Registry Service – Part 2: Basic extension package (OGC r2)
CSW-ebRIM 1.0 CIM Extension Package (OGC r1)
CSW-ebRIM 1.0 Extension Package for Earth Observation Products (OGC r5) v.0.2.2
ATS
ETS feedback
GUIDANCE ON DEFINING AN ABSTRACT TEST SUITE FOR PROFILES 23/09/2008 (INFOTERRA)
HMAT-TN-0001-IGN, HMA-T PHASE 2 TESTING POLICY, ISSUE 1, REVISION 0, 25/08/2008 (IGN)
Abstract Test Suite-CSW.ebRIM CIM v.1.0
Abstract Test Suite-CSW.ebRIM EO v.1.0
Slide 29

30. Recommendations (see issue tracker)
Work performed
09/02/2009
OGC CSW-ebRIM Registry Service – Part 1: ebRIM profile of CSW (OGC r3)
OGC CSW-ebRIM Registry Service – Part 2: Basic extension package (OGC r3)
CSW-ebRIM 1.0 CIM Extension Package (OGC r1)
CSW-ebRIM 1.0 Extension Package for Earth Observation Products (OGC r5) v.0.2.2
ATS
Recommendations (see issue tracker)
GUIDANCE ON DEFINING AN ABSTRACT TEST SUITE FOR PROFILES 23/09/2008 (INFOTERRA)
HMAT-TN-0001-IGN, HMA-T PHASE 2 TESTING POLICY, ISSUE 1, REVISION 0, 25/08/2008 (IGN)
Abstract Test Suite-CSW.ebRIM CIM v.1.0.1
Abstract Test Suite-CSW.ebRIM EO v.1.0.1
Slide 30

31. ETS Work performed OG02- Conformance Testing
Implementation and deployment of CITE Executable Test Suites (ETS)
Deliverable
Executable Test Suite-CSW.ebRIM CIM
Executable Test Suite-CSW.ebRIM EO
ATS, Acceptance test plan
Issues
ETS
Issues (from Support phase)
Reference Implementation
Test Data, ETS & documentation
Subcontractor local mirror
of the ESA Platform
Slide 31

32. ETS Work performed 09/01/2009 Abstract Test Suite-CSW.ebRIM EO v.0.2
Abstract Test Suite-CSW.ebRIM CIM
ATS, RI, TEAM
Engine feedback
EO RI (EumetSat, Spot Dali)
CIM RI
TEAM Engine (ERGO)
ETS
Executable Test Suite-CSW.ebRIM EO
Executable Test Suite-CSW.ebRIM CIM
EO data forged from
the specification
Slide 32

33. ETS Work performed 19/01/2009 Abstract Test Suite-CSW.ebRIM EO v.0.2
Abstract Test Suite-CSW.ebRIM CIM v.0.1
ATS feedback
EO RI (EumetSat, Spot Dali)
CIM RI (HMA Skeleton)
TEAM Engine (OGC CITE)
ETS
Executable Test Suite-CSW.ebRIM EO
Executable Test Suite-CSW.ebRIM CIM
CIM data forged from
the specification
ISO data from OGC
Slide 33

34. ETS Work performed 20/01/2009 Abstract Test Suite-CSW.ebRIM EO v.1.0
Abstract Test Suite-CSW.ebRIM CIM v.0.9
RI feedback
EO RI (ERDAS)
CIM RI (ERDAS)
TEAM Engine (OGC CITE)
ETS
Executable Test Suite-CSW.ebRIM EO
Executable Test Suite-CSW.ebRIM CIM
Slide 34

35. ETS Work performed 25/01/2009 Abstract Test Suite-CSW.ebRIM EO v.1.0
Abstract Test Suite-CSW.ebRIM CIM v.1.0
RI feedback
EO RI (ERDAS)
CIM RI (ERDAS)
TEAM Engine (OGC CITE)
ETS
Executable Test Suite-CSW.ebRIM EO
Executable Test Suite-CSW.ebRIM CIM
Slide 35

36. Issues (1)
RIDS v7
YC-63 (Clarify the exact version of OGC ) – CLOSED: already in RIDS v4; clarification added in a footnote (ATS EO, p. 3)
YC-64, 65 (Proxy Deployment Architecture support) – CLOSED: discussed with Frederic; ATS/ETS specify appropriate conformance levels and make no assumption on the availability of specific test data; appropriate information may be requested to the user upon launching the ETS’s
YC-66 (SOAP 1.1 test) – CLOSED: as agreed at the telecon; we could add a level 2 ATC to check SOAP 1.1 support and conformance to Annex F (clarify: “SOAP1.1 would be required”)
YC-67 (Align to EO EP 0.2.2) – CLOSED: as agreed at the telecon; conformance levels to be refined wrt Annex G (informative) Proposed Filter Syntax Compliance Levels, OGC Modular Specifications, HMA-T Testing Policy, etc.
YC-68, 69 (Conformance to IGN Testing Policy and Core Conformance class) – CLOSED: as agreed at the telecon; discussed with Frederic; Testing Policy rev. 0 was considered; Proxy Deployment Architecture supported
Slide 36

37. Issues (2)
Tests intended to exercise the specific features of the target specifications
Full compliance with baseline standard specifications assumed
Deployment should provide for chaining of conformance tests
TEAM Engine
No support for SOAP 1.2 (neither in OGC CITE nor in ERGO)
No ETS for the ebRIM AP and CSW 2.0.2
Slide 37

38. Actions (1) Work planned (as by our telecon 26/11/2008 presentation )
[Dec2008] Identify test data necessary to conformance tests
CLOSED – data were forged and/or retrieved from OGC and RI’s
[Jan2009] Implement and deploy ETS for the ERGO/Intecs TEAM Engine for the HMA Catalog Protocol interfaces
Implementation
CLOSED – the OGC CITE TEAM Engine was used instead
Deployment
OPEN – Deployment & validation/Support phases to be defined
Action 17 (as by telecon 26/11/2008 minutes HMAT-MOM-2003-SPB)
CNR-IMAA agrees to align with OGC version 0.2.2
CLOSED – done
(cf. #53) CNR-IMAA agrees to align their ATS description with the updated “Test Policy” document from IGN expected end of December 2008
PARTIAL – aligned with rev. 0 (rev. 1 delivered 03/02/09)
(cf. #36) Lorenzo will contact Frederic to discuss the rids YC-64 and YC-65
CLOSED - done
Slide 38

39. Actions (2) ATS final revision Align with latest ebRIM AP (r4)
Align with latest IGN Test Policy (rev. 1)
Align with latest CIM (07-038r2)?
Slide 39