MyOSG and MyEGI - One Stop Shopping for Grid (Operations) Information CHEP 2010, 20 October 15:00 (Asia/Taipei) – Auditorium, BHSS MyOSG and MyEGI - One Stop Shopping for Grid (Operations) Information CHEP 2010, 20 October 15:00 (Asia/Taipei) – Auditorium, BHSS Rob Quick OSG Operations Coordinator Indiana University

OSG Council Aug 18 th 2010 A few Title Snippets from CHEP News from the Battlefield The Nightly Build System A Path to the Future ROOT Spy The ALICE Simulation The Fast and Furious The Cool Green Drive A Step Toward Clouds 2

OSG Council Aug 18 th 2010 MyOSG 3 The Problem we were trying to solve  There are a plethora of Operational Tools  Administrative, Monitoring, Accounting, Information Systems  Several different groups are Developing these tools independently  Users find these tools Useful for various information  These tools are Distributed out among a variety of sources  New collaborators didn’t know each of these tools and sometimes are unaware of the information published about there resource  Experienced collaborators had to manage several bookmarks to each source of information  Different sources could sometime be publishing contradictory information

OSG Council Aug 18 th 2010 Other Considerations Each consumer of Operational Data needs a Unique view  The site administrator, the application submitter, the Operations Coordinator, etc. Data should be available in the form the user can adopt into there own daily workflow New tools services should be easily added as they are developed and become useful to the community All the information should be available from a single location 4

Original Conceptual Design 5

OSG Council Aug 18 th 2010 Consolidators Backend Processes  Consume and Store raw data from various sources  Each independent and potentially very different  RSV – Java that analyzes and calculates status information  Gratia – Proxy that pulls HTML content Examples of Existing Consolidators and Visualizations… 6

OSG Council Aug 18 th 2010 Google Status Map 7

OSG Council Aug 18 th 2010 Gratia Accounting Graphs 8

OSG Council Aug 18 th 2010 Availability and Reliability Calculations from RSV 9

OSG Council Aug 18 th 2010 Another Availability and Reliability Graph (RSV) 10

OSG Council Aug 18 th 2010 Downtime Information 11

OSG Council Aug 18 th 2010 Administrative Registration Data from OIM 12

OSG Council Aug 18 th 2010 Current Status Information and Error Messages (RSV) 13

OSG Council Aug 18 th 2010 OSG Operational Overview (RSV) 14

OSG Council Aug 18 th 2010 MyOSG Interface Based on user query, pull the XML cache created by consolidator and apply applicable filter(s). Add information pulled from OIM and other data sources and create a secondary XML. Expose the XML constructed and transform it to HTML page. Wrap the HTML content generated in step 3 into UWA for widget users, or simply output as MyOSG pages for user who are directly accessing MyOSG. Additional provide XSLT to convert XML generated in step 2 for users who want the data in a machine readable format such as CSV (or a legacy VORS compatible format). 15

OSG Council Aug 18 th 2010 Filtering Options 16

Exportable Formats 17

OSG Council Aug 18 th 2010 Example iGoogle Page 18

OSG Council Aug 18 th 2010 Notes about MyEGI 19 Collaboration still ongoing  Released using some reliability and availability visualizations in MyEGEE  But difficulties and slow going with backend databases and personnel changes According to a presentation at the EGI technical forum - highlighted by one of our colleagues from STFC - MyEGI will replace MyEGEE in the next few months. The developers are expecting to produce the first official MyEGI release in November.

OSG Council Aug 18 th 2010 Experiences Widgets (UWA format) didn’t catch on like we expected  Though it is still available Mobile content, XML or using the MyOSG web pages directly are most popular forms of access New consolidators are rarely necessary  Though easy enough to add Merlin Mann “…open your heart to the remote possibility that any mythology of personal failure that involves messiahs periodically arriving to make everything “easy” for you might not really be helping your work or your mental health or your long-standing addiction to using tools solely to ship new excuses.” 20