Advanced Techniques for Scheduling, Reservation, and Access Management for Remote Laboratories Wolfgang Ziegler, Oliver Wäldrich Fraunhofer Institute SCAI Philipp Wieder Research Centre Jülich Workshop on Collaborative Remote Laboratories In conjunction with e-Science 2006 Amsterdam, December 4, 2006

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 2 Acknowledgements Some of the work reported in this presentation is funded by the German Federal Ministry of Education and Research through the VIOLA project under grant #01AK605F. This presentation also includes work carried out jointly within the CoreGRID Network of Excellence funded by the European Commission’s IST programme under grant #

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 3 Content Motivation Meta-Scheduling in Grids –The VIOLA environment –WS-Agreement Integrating Remote Laboratories Perspectives

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 4 Motivation Obvious commonalities managing Collaborative Remote Laboratories (CRLs) and Grid resources –Advance reservation allows usage at a defined point in time –Negotiation of usage conditions –SLAs as reliable contracts between provider & consumer –Access control based on roles Evaluate potential of integrating CRLs as resources into existing Grid environments

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 5 VIOLA project German project founded by BMBF Duration June 2004 – April Goals –Test of advanced network equipment & network architectures –Development & test of software tools for the user-driven dynamical provision of bandwidth –Enhancement and test of new advanced applications (e.g. Grid, Virtual Reality)

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 6 The VIOLA MetaScheduling Service Site 1 Site n Local Scheduler Site n Adapter HTTPS Partial job n MetaScheduling Service … HTTPS Local Scheduler Site 1 Adapter Partial job 1 Network Network RMS Adapter Switch/Router Client Submission of job data WS-Agreement HTTPS WS-Agreement Goal: Co-allocation of MPI jobs Client initiates the reservation (WS- Agreement) and submits the job- data Negotiation of timeslot with local schedulers Interface between MetaScheduling Service and local RMS realised through Adapter pattern Interface MetaScheduling Service / Adapters based on HTTPS/XML (SOAP)

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 7 Negotiation Protocol

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 8 WS-Agreement Structure WS-Agreement characteristics Protocol for dynamic agreement management Terms can relate to: –functional description –non-functional properties WS-Agreement is domain-agnostic Agreement can involve 4 parties: –agreement initiator and provider –service consumer and provider State can be published and monitored via agreement properties Can be chained or nested to represent complex relationships Service Layer Consumer Operations Server Service Agreement Layer Provider Initiator Create / Query/ Terminate Agreement Term Compositor Creation constraint. Guarantees Service Descriptions Context Service Properties Service References

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 9 Virtual Organisation Management VOs are used for authorisation in Grids –Already in Globus Toolkit & LCG/gLite –UNICORE in transition VOs allow the definition of roles and role based authorisation for resource access and usage However, mostly X.509 certificate based (VOMS/VOMRS) Shibboleth could be an interesting option for CRLs Interoperability with existing Grid Infrastructures seems to be a major advantage of using VO technology also for CRLs Would allow seamless integration

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 10 Integrating Remote Laboratories Site 1 Site n Local Scheduler Site n Adapter HTTPS Partial job n MetaScheduling Service … HTTPS Local Scheduler Site 1 Adapter Partial job 1 Network Network RMS Adapter Switch/Router Client Submission of job data WS-Agreement HTTPS WS-Agreement Laboratory HTTPS Local Scheduler Adapter Instruments Collaboration Tool WS-Agreement

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 11 The Role of the MetaScheduling Service Negotiation of not only computers and network, but also instruments and people Consideration of additional domain-specific SLA terms Provision of authorisation information for the initial setup of the collaborative environment Service orchestration: launching and managing of services, tools, and applications

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 12 Domain-specific tasks Specification of WS-Agreement SLA terms for CRLs Connection of the Collaboration Tool to the MetaScheduling Service Realisation of adaptors towards –laboratories or instruments (possibly via Common Instrument Middleware Arch. (CIMA)) –people to negotiate common time-slot for performing the experiment

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 13 Status Quo Vadis? Meta-scheduling demonstration –at IST 2006 & CoreGRID Industrial Conf –Groundwater pollution simulation (& steering) –Co-scheduling of clusters & network Ongoing work –From co-allocation to workflow scheduling Plans for prototype implementation –Integrating an CRL - looking for volunteers ;-) –Evaluation compared to other approaches