1. EGEE-III INFSO-RI-222667 Enabling Grids for E-sciencE www.eu-egee.org Enabling OMNET++ Simulations on the Grid Gergely Sipos*, Miklós Kozlovszky*, Ákos Balaskó*, András Varga** *MTA SZTAKI, **OMNEST Inc. sipos@sztaki.hu www.lpds.sztaki.hu/gasuc sipos@sztaki.hu www.lpds.sztaki.hu/gasuc

2. Enabling Grids for E-sciencE EGEE-III-INFSO-RI-222667 What is OMNeT++? A generic simulation framework: For the simulation of complex distributed systems: distributed hardware and software architectures, communication networks, queuing networks,… –An open environment: in terms of source code, embedding, extensibility, integration, modularity Dual licensing: –Academic Public License –Commercial License Vivid and growing academic community Strong commercial references Component-oriented approach: - The basic building block is a module. - Simple modules can be grouped to form compound modules. - Modules are connected with each other.

3. Enabling Grids for E-sciencE EGEE-III-INFSO-RI-222667 OMNET++ simulation domains Modules may represent:Messages / events may represent: hardware systems sensor, controller, disk, interface card, CPU, memory signals, commands, disk head movement, interrupts,… server farm application server, web server, daemon process (service), thread, database, database query process HTTP request, remote method invocation, SQL query,… business processes department, organizational unit, filing cabinet, database, employee, customer,… file or job, email/phone communication, deadline,… communication networks host, router, comm. media, protocol layer, application, simulated user, app. session protocol header, packet, beginning/end of frame transmission, collision, timer expiry, session start/end,… call centers call center, clerk, customerstart/end phone calls, end of customer’s patience (balking),… queuing systems queue, switch,…job, beginning/end of processing

4. Enabling Grids for E-sciencE EGEE-III-INFSO-RI-222667 Defining the Topology (.ned file) Modules are written in C language NED (Network Description Language) defines topology: how modules are assembled to form larger modules and whole models // // Host with an Ethernet interface // module EthernetHost { parameters:... gates:... submodules: app: EtherTrafficGen; llc: EtherLLC; mac: EtherMAC; connections: app.out --> llc.hl_in; app.in <-- llc.hl_out; llc.ll_in <-- mac.hl_out; llc.ll_out --> mac.hl_in; mac.ll_in <-- in; mac.ll_out --> out; } The graphical editor operates directly on NED files

5. Enabling Grids for E-sciencE EGEE-III-INFSO-RI-222667 Defining simulation parameters (omnet.ini file) [General] cmdenv-express-mode = true [Config Ring] description = "a server ring" network = RingQueue **.source.numJobs = ${numJobs=5,10,20} **.source.numJobs = 25 **.serviceTime = exponential(${serviceTimeMean=0.5s,1s,2s}) **.apply-default = true constraint = $numJobs!=20 || $serviceTimeMean<1s repeat = 3 Further runs… Named configurations (by default, config name serves as experiment name) Parameter variations Repeat count

6. Enabling Grids for E-sciencE EGEE-III-INFSO-RI-222667 Inifiles and Experiments Default organization of experiments: Config entryDefault value experiment-label“${configname}” measurement-label“${iterationvars}” replication-label“#${repetition}, seedset=@” seed-set${runnumber} Note: by overriding the defaults, many variations are possible. For example: –By specifying an explicit experiment-label, one can group many configurations into one experiment – seed-set can be set to ${repetition} as well

7. Enabling Grids for E-sciencE EGEE-III-INFSO-RI-222667 Advanced simulation event visualization and result analysis Simulations write result files: –vector results: a sequence of (time, value) pairs recorded during simulation  example: queue lengths during simulation; end-to-end delays of arrived packets  typical visualization: line chart –scalar results: values of variables, typically recorded at the end of simulation  example: total number of packets dropped; average throughput  typical visualization: bar chart, x-y plot (scatter plot) File format: line-oriented text file –you can use OMNeT++'s tools to process and visualize them –or you can use 3rd party tools (R, Matlab, Excel, etc) or write your own ones for specialized computations

8. Enabling Grids for E-sciencE EGEE-III-INFSO-RI-222667 EGEE Application Porting Group Porting legacy applications to EGEE –Some code that already runs on a single machine, cluster or another grid –Not development from scratch Includes –Consultancy –F2F meetings –Customized training –Technology support –Email / telephone help desk –Working together Generic service for any user / community –Independent from application domain, Virtual Organization, project Porting centers in Europe –MTA SZTAKI, Budapest, Hungary –INFN Catania (Italy) –CSIC Santander (Spain) –UCM Madrid (Spain) –WMIN London (UK) More information, stories and how to apply: http://www.lpds.sztaki.hu/gasuc http://www.lpds.sztaki.hu/gasuc

9. Enabling Grids for E-sciencE EGEE-III-INFSO-RI-222667 Support cycle and services Interviews Personalized training Porting specifications Problem analysis Writing publications and case studies Prototyping grid applications Fine tuning applications on production grids Apply online at www.lpds.sztaki.hu/gasuc

10. Enabling Grids for E-sciencE EGEE-III-INFSO-RI-222667 General purpose grid application developer and user environment Since 2003, Latest version: 2.7. To port parameter studies, workflows and workflow based parameter studies to EGEE and Globus grids Open source community coordinated by MTA SZTAKI: http://sourceforge.net/projects/pgportal/ http://sourceforge.net/projects/pgportal/ Supported grid middleware services: ServiceEGEE grid (gLite middleware)Globus grids Job execution Computing ElementGRAM File storage Storage Element, File catalogGridFTP server Certificate management MyProxy server, VOMS Information system BDIIMDS-2, MDS-4 Brokering Workload Management System Application monitoring & visualization PROVE Possibility to hide P-GRADE Portal grid applications behind custom GUIs Chosen porting tool: P-GRADE Portal www.portal.p-grade.hu

11. Enabling Grids for E-sciencE EGEE-III-INFSO-RI-222667 Grid application development vs. Grid application usage EGEE Porting Team with OMNeT++ developer community Ported OMNET framework to gLite with P-GRADE Portal: Workflow based parameter study Created custom web interface to access grid-enabled OMNET++ framework OMNeT++ users Provide custom NED files and INI files, execute simulation, download results OR Provide custom modules, NED files and INI files, execute simulation, download results Benefit from better performance Don’t & can’t see the grid

12. Enabling Grids for E-sciencE EGEE-III-INFSO-RI-222667 OMNET++ Workflow File to specify which “OMNET runs” to execute on the grid Generator: Separates OMNET parameter scans into independent grid jobs.

13. Enabling Grids for E-sciencE EGEE-III-INFSO-RI-222667 OMNET++ Workflow Additional libraries : libstdc++.so.6.0.3, libxml2.so.2.6.16 Output file: Scalar results of simulation Executable: Wrapper script to initialize Simplified OMNET framework Custom NED file Custom INI file Omnet framework (tar.gz) ~10 MByte, Pulled from SE Custom OMNET modules – only in developer portal

14. Enabling Grids for E-sciencE EGEE-III-INFSO-RI-222667 Two types of OMNET portals OMNET user portal User accounts exist for 1 week Can handle NED files that use INET and Queuing module sets from OMNET No binary come from end user –Portal does grid operations with one fixed certificate OMNET developer portal Permanent user accounts Can handle custom OMNET modules and NED files that handle such modules Binaries come from end users –Users are authenticated based on their personal certificates

15. Enabling Grids for E-sciencE EGEE-III-INFSO-RI-222667 OMNeT++ user portal Account request

16. Enabling Grids for E-sciencE EGEE-III-INFSO-RI-222667 OMNeT++ user portal Account request

17. Enabling Grids for E-sciencE EGEE-III-INFSO-RI-222667 OMNeT++ user portal “Account created” email

18. Enabling Grids for E-sciencE EGEE-III-INFSO-RI-222667 OMNeT++ user portal Personal settings

19. Enabling Grids for E-sciencE EGEE-III-INFSO-RI-222667 OMNeT++ user portal Input definition window

20. Enabling Grids for E-sciencE EGEE-III-INFSO-RI-222667 OMNeT++ user portal Simulation execution window

21. Enabling Grids for E-sciencE EGEE-III-INFSO-RI-222667 OMNeT++ user portal Simulation execution window

22. Enabling Grids for E-sciencE EGEE-III-INFSO-RI-222667 OMNeT++ user portal Simulation execution window

23. Enabling Grids for E-sciencE EGEE-III-INFSO-RI-222667 OMNeT++ user portal Result download window

24. Enabling Grids for E-sciencE EGEE-III-INFSO-RI-222667 Available OMNeT modules in user portal INET Framework –TCP/IP based wired and wireless networks: TCP, UDP, IP, IPv6, IEEE 802.11, Ethernet, MPLS, … –several contributors Queuing Framework

25. Enabling Grids for E-sciencE EGEE-III-INFSO-RI-222667 OMNeT++ developer portal Certificate management

26. Enabling Grids for E-sciencE EGEE-III-INFSO-RI-222667 OMNeT++ developer portal Simulation manager window

27. Enabling Grids for E-sciencE EGEE-III-INFSO-RI-222667 OMNeT++ developer portal Input definition

28. Enabling Grids for E-sciencE EGEE-III-INFSO-RI-222667 Status of services OMNET “demo” and advance portal services are currently in final testing phase Portal services will be available in a few weeks Currently 1 CE and 1 SE supports the service Direct feedback from OMNET users –“Enabling OMNET++ Simulations on the Grid” – talk and paper at Annal forum of OMNET Users More information at –EGEE Application Porting Group  http://www.lpds.sztaki.hu/gasuc http://www.lpds.sztaki.hu/gasuc –P-GRADE Grid Portal  http://www.portal.p-grade.hu http://www.portal.p-grade.hu

29. EGEE-III INFSO-RI-222667 Enabling Grids for E-sciencE www.eu-egee.org Thank you Questions? Gergely Sipos sipos@sztaki.hu www.lpds.sztaki.hu/gasuc www.portal.p-grade.hu