1. On Monitoring, Diagnostics and Measurement in eduGAIN and Beyond
Miroslav Milinović
University Computing Centre, University of Zagreb, Zagreb, Croatia
Zurich, Switzerland, July 12, 2016

2. The problem space ... monitoring testing diagnostics
continuous, automated testing
to check the health of the service (or a component or a feature)
simple vs. functional
testing
on demand
to verify compliance to a standard / specification
to check the functionality
diagnostics
to resolve incidents
to enhance user experience
measurement (statistics)
facilitate maintenance / management
compute service performance indicators

3. An inventory … The tools we know about: Wiki pages listing tools: …
Web pages with tools collections:
The tools we know about:
eduGAIN Access Check Service (EACS)
eduGAIN Connectvity Check Service (ECCS)
eduGAIN isFederated Check Service (IFCS)
eduGAIN Attribute Release Check Service (EARCS)
CoCo monitor (+on demand check)
SAML and OIDC testing tools (Roland Hedberg / fed-lab)
MET ?
F-Ticks (eduroam, SWAMID,

4. Proposal for monitoring and testing
Build a web page (portal/catalogue)
list all recognized tools
grouped according to the purpose and scope
basic info/description
Link to appropriate tool page/service (if in place)
link to SW repository (if available)
use fed-lab.org or edugain.org or refeds.org ?
currently we have too many pages that list tools
Identify the missing tools and build them

5. Measurement and statistics
Some work has been done:
F-ticks based tools
SSP tool internally used by may be used …
Other tools
RAPTOR
AMAAIS …

6. Proposal for measurement and statistics
Step 1:
Standardise the F-ticks (aka log entry) format
Finish the work on f-ticks RFC
Step 2:
Build the eduGAIN F-ticks service (based on positive experience and tools of eduroam, SWAMID, …)
Ticks
will be sent by the IdPs (even one per federation can sufice in pilot phase?)
can be collected by more than one aggregator
Aggregator
Will provide public stats (popular SPs per IdP, popular IdPs per SP, …)
Will provide additional stats for IdP/SP
Stats of failed AA might be used for diagnostics
Value for actors (IdPs in particular)
ready to consume measurement dana
Logs in f-ticks format might be processed with other (common) tools