2. QoS Evaluation Model for a Campus-Wide Network: an alternative approach Juan Antonio Martínez (Juanan.Martinez@uab.es) Comunicacions - Servei d’Informàtica Universitat Autònoma de Barcelona

3. Index Objectives Objectives Classical approach to QoS Classical approach to QoS Evaluating network availability: a generic model Evaluating network availability: a generic model Extending the model to the services Extending the model to the services Practical results Practical results Comparison to other existing products and future work Comparison to other existing products and future work Conclusions Conclusions

4. Objectives Determine if our network reaches the ‘5 9s’ objective (99.999% of availability) Determine if our network reaches the ‘5 9s’ objective (99.999% of availability) Obtain a generic model to evaluate the quality of the network regarding Obtain a generic model to evaluate the quality of the network regarding  Infrastructure  Services The model must The model must  Be simple  Adapt easily to network topology changes

5. Obtaining the model

6. The classical approach Quality is evaluated as a combination of: Quality is evaluated as a combination of:  Delay  Jitter  Packet loss This approach is useful for WAN links and environments This approach is useful for WAN links and environments  Easy to measure in both router endpoints In our opinion, it is not suitable for LAN environments In our opinion, it is not suitable for LAN environments  Parameters are difficult to determine (distributed environment)  Gathered data is not significant (burst traffic)

7. Problems of this model Quality is not assigned a numeric value Quality is not assigned a numeric value In a LAN environment In a LAN environment  Network probes must be distributed through the network  In switched environments, each segment provides a different value  Expensive to implement  Fluctuant values due to the traffic nature In fact, there is not a model. It is just an evaluation of the aforesaid parameters In fact, there is not a model. It is just an evaluation of the aforesaid parameters

8. Our model:the basis Whichever the system is, it must: Whichever the system is, it must:  Be of low cost.  Provide QoS as a numerical value.  Be flexible enough to adapt itself to network topology changes. Our idea is to get data from : Our idea is to get data from :  Simple tools like ‘ping’  SNMP queries We discard complex solutions (modified TCP stacks, proprietary PING...) We discard complex solutions (modified TCP stacks, proprietary PING...)

9. Conceptual development of the model Assume that all network devices are known and with SNMP management facilities. Assume that all network devices are known and with SNMP management facilities. Assume that the number of users affected by any network device failure can be determined. Assume that the number of users affected by any network device failure can be determined. The idea beyond the process is The idea beyond the process is  Choose the critical network devices  Weight them accordingly  Determine the instant availability  Compute the mean value

10. Choosing the devices and the weights for the model

11. Mathematical analysis (I) Let Let  Kd be the relative availability coefficient  di be a binary value that tells whether a segment is accessible or not For the mean value this implies For the mean value this implies

12. Mathematical analysis (and II) If we sample at constant intervals If we sample at constant intervals For efficient computing, this means For efficient computing, this means In this way, we can evaluate the availability with the number of samples, the previous mean value and the last sample. In this way, we can evaluate the availability with the number of samples, the previous mean value and the last sample.

13. Extending the model to the services Our first goal is to determine whether the service is working or not (ok/not ok) Our first goal is to determine whether the service is working or not (ok/not ok) The explained network model is suitable for the services with few changes : The explained network model is suitable for the services with few changes :  Omission of the criticity values (Kc=1)  A tool to determine instant availability is needed (ping is no longer valid)

14. Details regarding practical implementation

15. Network availability Availability is computed based on ICMP tests (ping) Availability is computed based on ICMP tests (ping) Second-level granularity Second-level granularity To compute the coefficients To compute the coefficients  Kc1 : from the network topology.  Kc2 : from our experience. The global coefficient is computed as the arithmetic mean value The global coefficient is computed as the arithmetic mean value A config file stores the network devices that will be tested A config file stores the network devices that will be tested

16. config file example [ NETWORK] #ip_name ip_address availability coef. gw158.109.0.30.203125 CB158.109.0.260.213541667 si0swfo1+si0swfo2158.109.2.233 0.052340183 c7p1sw1158.109.8.236 0.051626712 anccswit158.109.8.2350.056078767 m0swit158.109.20.2140.045519406 cvcsw158.109.4.200 0.034218037 cibibfo 158.109.29.208 0.036843607 hottwp1+hottwp3 158.109.31.200 0.0355879 dretswit 158.109.25.201 0.050313927 ecllefo 158.109.25.220 0.048658676 bhum1sw1 158.109.184.203 0.042323059 ftisw 158.109.21.202 0.03678653 recswit 158.109.27.222 0.052368721 vetswit 158.109.30.201 0.040667808

17. Service availability The model is essentially the same, but now for each machine we analyse its critical services The model is essentially the same, but now for each machine we analyse its critical services The system can The system can  Evaluate proper function of a service at a given time  Compute the availability over time A proprietary MIB is used to determine the critical parameters of each service (SNMP queries are supported) A proprietary MIB is used to determine the critical parameters of each service (SNMP queries are supported)

18. Monitoring requirements A set of ‘C’ programs (one for each service) A set of ‘C’ programs (one for each service) A global configuration file: A global configuration file: [SERVICES] #host name services to be tested cc.uab.es smtp pop imap news.uab.es nntp ftp.uab.es ftp... Optionally, for the services : A proprietary MIB with the data we want to monitor (not mandatory) A modified version of the snmpd daemon

19. Practical Results in our Campus Network

20. Environment Development : Development :  PC Pentium II 300 + Linux RedHat 6.0  gcc 2.91.66 Production: Production:  Ultra Enterprise 450 + Solaris 2.6 (gcc 2.95.2)  PC Pentium II 400 + Linux RedHat 6.0 (gcc 2.91.66) Our network availability has achieved monthly values between 0.99843 and 1.0 Our network availability has achieved monthly values between 0.99843 and 1.0 For the services, we use it both for availability values and to test that they are working properly. For the services, we use it both for availability values and to test that they are working properly.

21. Overview of the system A set of routines that verify that the services are working properly: A set of routines that verify that the services are working properly:  bootp,dhcp,dns,ftp,http,smtp,pop,imap,radius,nntp A C program that implements the mathematical model A C program that implements the mathematical model Configuration file, which includes Configuration file, which includes  Coefficients for the model  Servers and services to be monitored. Optionally, a modified version of the snmpd daemon if access to the proprietary MIB is desired. Optionally, a modified version of the snmpd daemon if access to the proprietary MIB is desired.

22. Measured availability data

23. ‘on line’ service monitoring Based on the programs that are used to check service availability Based on the programs that are used to check service availability Useful to network operators to detect network problems Useful to network operators to detect network problems Operating modes : Operating modes :  Interactive: provides a report with configurable debug  Cron-based : generates mail/sms messages if any problems are detected

24. Interactive execution example *** 14:35:06.308612 blues.uab.es:smtp... 220 blues Sendmail 5.65v4.0 (1.1.19.2/17Dec99-1023AM) Tue, 7 Nov 2000 13:44:20 + QUIT 221 blues closing connection *** 14:35:06.351857 blues.uab.es:smtp 116b,0.0432s,2.6Kb/s OK! *** 14:35:06.360239 blues.uab.es:pop3... +OK POP3 blues v7.63 server ready QUIT +OK Sayonara *** 14:35:06.512647 blues.uab.es:pop3 49b,0.152s,0.31Kb/s OK! *** 14:35:06.521040 blues.uab.es:imap... * OK blues IMAP4rev1 v12.261 server ready A01 LOGOUT * BYE blues IMAP4rev1 server terminating connection A01 OK LOGOUT completed *** 14:35:06.622567 blues.uab.es:imap 121b,0.102s,1.2Kb/s OK! *** 14:35:06.631185 news.uab.es:nntp... 200 news.cesca.es InterNetNews NNRP server INN 2.3.0 ready (posting ok). QUIT 205. *** 14:35:06.884128 news.uab.es:nntp 81b,0.253s,0.31Kb/s OK! *** 14:35:06.892686 ftp.uab.es:ftp... 220 koala FTP server (Version wu-2.5.0(1) Wed Oct 20 12:02:15 DST 1999) ready.

25. Comparison to other existing products and future work

26. Comparison As a monitoring tool, there are other existing products, which are really powerful As a monitoring tool, there are other existing products, which are really powerful  Big Brother  NoCoL Regarding the graphic tools, they generate no data, but simply display it. Regarding the graphic tools, they generate no data, but simply display it. None of these gives a detailed model for the network availability or monthly reports None of these gives a detailed model for the network availability or monthly reports

27. Future work Analysis and integration of multiple meters Analysis and integration of multiple meters Improvement of the Web interface Improvement of the Web interface WAP interface to the monitoring system WAP interface to the monitoring system

28. Conclusions

29. Benefits of the system Proper working of all servers and services is easy and centrally verified Proper working of all servers and services is easy and centrally verified Easy adaptation to network changes Easy adaptation to network changes  Network devices  New servers or services Monthly reports of both internal and external connectivity Monthly reports of both internal and external connectivity Availability reports of the relevant services Availability reports of the relevant services Easy to integrate with graphic tools such as MRTG Easy to integrate with graphic tools such as MRTG

30. For more information... This presentation: This presentation:  ftp://ftp.uab.es/pub/terena/QoS.ppt The paper can be found at: The paper can be found at:  ftp://ftp.uab.es/pub/terena/QoS.pdf

31. Doubts, comments, suggestions...