1. GIMS Tutorial - GEC 12 Packet Capture for GENI Charles Thomas & Dongchan Kim University of Wisconsin - Madison cthomas@wisc.edu cthomas@wisc.edu dkim24@wisc.edu

2. GIMS Tutorial Follow along (cut and paste commands): http://gims.wail.wisc.edu/docs/Tutorial.html Start your VirtualBox Tutorial image.

3. Tutorial Outline Introduction to GIMS. Setting up for using GIMS. Creating a capture filter. Creating an RSpec. Creating a slice and starting the experiment

4. Tutorial Outline (Cont.) Tour of the monitoring GUI tools. Pause/Restart traffic capture. Stop and teardown the experiment. Post-experiment data analysis. System capabilities. Future directions / Q&A

5. What is GIMS? GENI Instrumentation and Measurement Systems Collaboration between University of Wisconsin (Barford), Colgate University (Sommers) and Boston University (Crovella) High-speed packet capture system integrated with ProtoGENI. Infrastructure could be modified to support other types of instrumentation.

6. GIMS Architecture ProtoGENI Scripts –Allow us to control the capture system. GIMS Backend –Coordinates communication. MySQL Database Capture Device –Daemon & hardware Web-based GUIs –Device and configuration control, real-time monitoring, experiment results.

8. GIMS Database MySQL Stores information about: –Experiments –Capture Devices –Experiment/Device pairings –Device Configurations –Experiment Results –Device Statistics

10. capd, the GIMS Capture Daemon XML/RPC control structures Supports a wide variety of hardware. libpcap support Flow aggregation based on IPFIX CryptoPan anonymization Sampling (every N, randomized) Remote storage (SSH, Amazon S3)

12. ProtoGENI Scripts

13. Current Functionality CreateSliver –Create new experiment –Load config into device –Start capture StopSliver –Pause capture StartSliver –Restart capture after pause DeleteSlice –Shutdown capture activities and cleanup.

15. Installing the ProtoGENI Scripts

16. M2crypto > sudo apt-get install python-m2crypto

17. Test Scripts > wget http://www.emulab.net/downloads/protogeni-tests.tar.gz

18. Test Scripts >mkdir test_scripts; >tar xzf protogeni-tests.tar.gz –C test_scripts;

19. Emulab Account Click Request Account button on http://www.schooner.wail.wisc.edu

20. Emulab Account Choose the corresponding option

21. Emulab Account Fill out the form

22. Emulab Account Click the Submit button when done

23. SSL Certificate Click Login button

24. SSL Certificate Login with your account

25. SSL Certificate Click Generate SSL Cert in the left column

26. SSL Certificate Type the PassPhrase for your certificate and Emulab Password

27. SSL Certificate Click Download to save your SSL Certificate

28. SSL Certificate Save the SSL Certificate as $HOME/.ssl/encrypted.pem

29. SSL Certificate Create a $HOME/.ssl/password file containing the PassPhrase for your certificate

30. SSH Key > cd $HOME/.ssl; ssh-keygen –f protogeni-key

31. SSH Key Click Edit SSH Keys on the Emulab login page

32. SSH Key Add the public key and Emulab password at the bottom of the web page

33. SSH Key The keys added to your account

34. Creating a Capture Filter http://gims.wail.wisc.edu/cgi-bin/GIMSControl.cgi

36. Setup Capture Filter Config Name: GEC12_ Source IP address: 10.1.1.3 Destination IP address: 10.1.1.2 Source port number: 48060 Destination port number: 5001 Protocol: UDP

37. Setup Capture Filter (Cont.) SSH User: gimsusr SSH Host: ops.schooner.wail.wisc.edu SSH Port: 22 SSH Path: /proj/GEC12/data SSH Private Key: foo Rollover Interval: 1 minute Sampling: everyN Param: 5

38. Creating an Rspec For Your Experiment cd ~geni/Tutorials/GIMS/ cp GimsMSNProduction.rspec GEC12.rspec vi GEC12.rspec

40. Save as GEC12.rspec When youre done editing, simply type ZZ

41. Creating a Slice and Starting the Experiment cd ~geni/Tutorials/GIMS ls -l./registerslice.py -n./createsliver.py -m https://gims.wail.wisc.edu/protogeni/xmlrpc/cm -d -n GEC12.rspec

42. GIMS Monitoring Tools gimsd - Device monitor LogViewer.cgi Results.cgi

43. gimsd - The GIMS Hardware Monitoring Daemon Sits in a loop looking for running experiments. If it finds any, queries the capture device via SNMP to get information on the device status (Only queries each device once.), storing results in DB. Calls GetExperimentStats for each running experiment and stores the results in the database. Runs every 15 seconds (configurable).

48. Pause/Restart Capture./sliveraction.py -m https://gims.wail.wisc.edu/protogeni/xmlrpc/cm -d -n stop./sliveraction.py -m https://gims.wail.wisc.edu/protogeni/xmlrpc/cm -d -n start

49. Stopping and Tearing Down the Experiment./deleteslice.py -m https://gims.wail.wisc.edu/protogeni/xmlrpc/cm -d -n

50. Post-Experiment Analysis

51. Accessing Captured Data As configured by GEC12 config, captured data is at: Host: ops.schooner.wail.wisc.edu Username: gimsusr Password: genigec12 Directory: /proj/GEC12/data/[exp ID]/

52. Packet analyzer Display packet in fields Selective view of packets by filters WireShark

53. Experimental Traffic Packet generator: Iperf Protocol: UDP Source IP address: 10.1.1.3 Source port number: 48060 Destnation IP address: 10.1.1.2 Destination port number: 5001

54. Experimental Traffic

55. WireShark Usage

59. System Capabilities Current system is fairly low-end Dell 2650 PowerEdge server Onboard e1000 network card

60. System Capabilities In metadata file, … 11952058 23574 0 11928476 18035855712 …

61. Stress Test – Capture Daemon 1000Mbps w/o Samp. 1000Mbps w/ Samp. 100Mbps w/o Samp. 100Mbps w/ Samp. 1Mbps w/o Samp. 1Mbps w/ Samp. Pkt received3875082523303364152385510042866930452241462695764 Pkt dropped4419683227430032542675000 Ratio11.405391188.3036658250.227488039000 ** Sampled every 5 th packet

62. Stress Test – NIC 1000Mbps w/o Samp. 1000Mbps w/ Samp. 100Mbps w/o Samp. 100Mbps w/ Samp. 1Mbps w/o Samp. 1Mbps w/ Samp. Pkt received3875082523303364152385510042866930452241462695764 Pkt dropped153817830512554814410000 Ratio79.8768781779.169334380000 ** Sampled every 5 th packet

63. Future Directions Wide variety of feature requests, bug fixes, security improvements. Integration with other frameworks. Deployment of 5 more GIMS capture systems across the US to make capture more widely available.

64. Q&A