Spatineo Monitor QoS Measuring — a Peak Under the Hood 102nd OGC Technical Committee Delft, The Netherlands Ilkka Rinne / Spatineo 22nd March 2017 Copyright © 2017 Open Geospatial Consortium

Spatineo Tools for Spatial QoS Spatineo Monitor Continuous, intelligent QoS checking for WMS, WMTS, WFS and ArcGIS Rest MapService: service availability, performance under normal load. Additionally we provide service usage analytics. Key questions answered: Are my services working correctly now? What’s the availability this month, any trends in response times? How to respond to technical problems and traffic peaks quickly? Can we get alerts when something is wrong? Is my service metadata (capabilities) valid, including INSPIRE extended capabilities? How many users do my services have? How are they using the services, where to they come from, which areas are they most interested in? Spatineo Performance Spatially-aware, easy-to-use load testing for WMS, WMTS, WFS and ArcGIS Rest MapService: performance bottleneck detection, run realistic tests for maximum/required service capacity. Copyright © 2017 Open Geospatial Consortium

Spatineo QoS Monitoring Copyright © 2017 Open Geospatial Consortium

Copyright © 2017 Open Geospatial Consortium

Copyright © 2017 Open Geospatial Consortium

Copyright © 2017 Open Geospatial Consortium

Copyright © 2017 Open Geospatial Consortium

Copyright © 2017 Open Geospatial Consortium

Copyright © 2017 Open Geospatial Consortium Spatineo Directory – a free search engine for Spatial Data Services Copyright © 2017 Open Geospatial Consortium

Copyright © 2017 Open Geospatial Consortium Spatineo Service Map – daily updated service availability map Copyright © 2017 Open Geospatial Consortium

Spatineo Monitor Figures We currently have nearly 50 000 WMS, WMTS, WFS and ArcGIS MapService services in our Service repository with over a 1 million provided layers/feature types. Each of the active ~21k services is typically monitored once every 5 minutes 24/7/365 resulting in ~7 million test requests a day or ~2.5 billion data points per year. Both the monitoring system and the applications are 100% cloud-based, currently in the Amazon Web Services platform. Currently about 30 reference customers, mostly European public authorities and cities. Service operative since Feb 2012. Copyright © 2017 Open Geospatial Consortium

Spatineo IPR (Monitoring patent) Our specific service level monitoring appliance with varying spatial request generation & feedback loop based on genetic algorithm evolution is protected by a patent: EU patent EP2908468B1 granted in Feb 2016, US patent pending No conflict with the OGC QoSE activities is foreseen, but for transparency and all fairness we want to communicate this to the group and other OGC members. the exact way of generating the test requests does not have to be included in the OGC best practice / standards. We want to agree on comparable QoS metrics, the measurement implementation details may differ from one vendor to another. Copyright © 2017 Open Geospatial Consortium

Spatineo Top Interests in QoSE DWG QoS metadata (capabilities extensions) Better automatic QoS monitoring setup on service discovery Automatic alert configuration for QoS metrics based on declared typical and minimum values for well-defined QoS metrics. Automatic discovery of maintenance windows and other service interruptions, as well as “office hours”. A public list (registry?) of OGC QoS metrics with referenceable URIs and commonly agreed definitions. What does “service availability is 95.5%” mean? Highlight the importance of measuring in QoS & QoE and collect best practice in service quality measuring to help the spatial data providers. Copyright © 2017 Open Geospatial Consortium

Copyright © 2017 Open Geospatial Consortium Monitor - www.spatineo.com/monitor/ Online continuous QoS monitoring, usage analytics for WMS, WFS, WMTS and ArcGIS MapService REST Performance - www.spatineo.com/performance/ Online load (capacity) testing for WMS, WFS, WMTS and ArcGIS MapService REST Directory - directory.spatineo.com/ Free search engine for openly available Spatial Web Services Service Map - servicemap.spatineo.com/ Free interactive map visualization for Web Service availability Copyright © 2017 Open Geospatial Consortium