1. Spatineo Monitor QoS Measuring — a Peak Under the Hood
102nd OGC Technical Committee
Delft, The Netherlands
Ilkka Rinne / Spatineo
22nd March 2017
Copyright © 2017 Open Geospatial Consortium

2. Spatineo Tools for Spatial QoS
Spatineo Monitor
Continuous, intelligent QoS checking for WMS, WMTS, WFS and ArcGIS Rest MapService: service availability, performance under normal load. Additionally we provide service usage analytics.
Key questions answered:
Are my services working correctly now? What’s the availability this month, any trends in response times?
How to respond to technical problems and traffic peaks quickly? Can we get alerts when something is wrong?
Is my service metadata (capabilities) valid, including INSPIRE extended capabilities?
How many users do my services have? How are they using the services, where to they come from, which areas are they most interested in?
Spatineo Performance
Spatially-aware, easy-to-use load testing for WMS, WMTS, WFS and ArcGIS Rest MapService: performance bottleneck detection, run realistic tests for maximum/required service capacity.
Copyright © 2017 Open Geospatial Consortium

3. Spatineo QoS Monitoring
Copyright © 2017 Open Geospatial Consortium

4. Copyright © 2017 Open Geospatial Consortium

5. Copyright © 2017 Open Geospatial Consortium

6. Copyright © 2017 Open Geospatial Consortium

7. Copyright © 2017 Open Geospatial Consortium

8. Copyright © 2017 Open Geospatial Consortium

9. Copyright © 2017 Open Geospatial Consortium
Spatineo Directory – a free search engine for Spatial Data Services
Copyright © 2017 Open Geospatial Consortium

10. Copyright © 2017 Open Geospatial Consortium
Spatineo Service Map – daily updated service availability map
Copyright © 2017 Open Geospatial Consortium

11. Spatineo Monitor Figures
We currently have nearly WMS, WMTS, WFS and ArcGIS MapService services in our Service repository with over a 1 million provided layers/feature types.
Each of the active ~21k services is typically monitored once every 5 minutes 24/7/365 resulting in ~7 million test requests a day or ~2.5 billion data points per year.
Both the monitoring system and the applications are 100% cloud-based, currently in the Amazon Web Services platform.
Currently about 30 reference customers, mostly European public authorities and cities.
Service operative since Feb 2012.
Copyright © 2017 Open Geospatial Consortium

12. Spatineo IPR (Monitoring patent)
Our specific service level monitoring appliance with varying spatial request generation & feedback loop based on genetic algorithm evolution is protected by a patent:
EU patent EP B1 granted in Feb 2016, US patent pending
No conflict with the OGC QoSE activities is foreseen, but for transparency and all fairness we want to communicate this to the group and other OGC members.
the exact way of generating the test requests does not have to be included in the OGC best practice / standards.
We want to agree on comparable QoS metrics, the measurement implementation details may differ from one vendor to another.
Copyright © 2017 Open Geospatial Consortium

13. Spatineo Top Interests in QoSE DWG
QoS metadata (capabilities extensions)
Better automatic QoS monitoring setup on service discovery
Automatic alert configuration for QoS metrics based on declared typical and minimum values for well-defined QoS metrics.
Automatic discovery of maintenance windows and other service interruptions, as well as “office hours”.
A public list (registry?) of OGC QoS metrics with referenceable URIs and commonly agreed definitions.
What does “service availability is 95.5%” mean?
Highlight the importance of measuring in QoS & QoE and collect best practice in service quality measuring to help the spatial data providers.
Copyright © 2017 Open Geospatial Consortium

14. Copyright © 2017 Open Geospatial Consortium
Monitor -
Online continuous QoS monitoring, usage analytics for WMS, WFS, WMTS and ArcGIS MapService REST
Performance -
Online load (capacity) testing for WMS, WFS, WMTS and ArcGIS MapService REST
Directory - directory.spatineo.com/
Free search engine for openly available Spatial Web Services
Service Map - servicemap.spatineo.com/
Free interactive map visualization for Web Service availability
Copyright © 2017 Open Geospatial Consortium