MyOSG: A user-centric information resource for OSG infrastructure data sources Arvind Gopu, Soichi Hayashi, Rob Quick Open Science Grid Operations Center.

Slides:



Advertisements
Similar presentations
1 Chapter 11: Data Centre Administration Objectives Data Centre Structure Data Centre Structure Data Centre Administration Data Centre Administration Data.
Advertisements

A COMPLETELY DIFFERENT APPROACH TO CLASSIFIEDS. Our approach is different. Our experience in online communities allows us to think differently. We are.
ASCR Data Science Centers Infrastructure Demonstration S. Canon, N. Desai, M. Ernst, K. Kleese-Van Dam, G. Shipman, B. Tierney.
Chapter 8: Network Operating Systems and Windows Server 2003-Based Networking Network+ Guide to Networks Third Edition.
Windows Server 2008 Chapter 11 Last Update
Winter Consolidated Server Deployment Guide for Hosted Messaging and Collaboration version 3.5 Philippe Maurent Principal Consultant Microsoft.
For more notes and topics visit:
By Mihir Joshi Nikhil Dixit Limaye Pallavi Bhide Payal Godse.
CERN - IT Department CH-1211 Genève 23 Switzerland t Monitoring the ATLAS Distributed Data Management System Ricardo Rocha (CERN) on behalf.
©Kwan Sai Kit, All Rights Reserved Windows Small Business Server 2003 Features.
Rsv-control Marco Mambelli – Site Coordination meeting October 1, 2009.
OSG Operations and Interoperations Rob Quick Open Science Grid Operations Center - Indiana University EGEE Operations Meeting Stockholm, Sweden - 14 June.
Publication and Protection of Site Sensitive Information in Grids Shreyas Cholia NERSC Division, Lawrence Berkeley Lab Open Source Grid.
A Web Based Workorder Management System for California Schools.
G RID M IDDLEWARE AND S ECURITY Suchandra Thapa Computation Institute University of Chicago.
Overview of Monitoring and Information Systems in OSG MWGS08 - September 18, Chicago Marco Mambelli - University of Chicago
1 1 Service Composition for LHC Computing Grid Monitoring Beob Kyun Kim e-Science Division, KISTI
The huge amount of resources available in the Grids, and the necessity to have the most up-to-date experimental software deployed in all the sites within.
Evolution of the Open Science Grid Authentication Model Kevin Hill Fermilab OSG Security Team.
What’s New in WatchGuard XCS v9.1 Update 1. WatchGuard XCS v9.1 Update 1  Enhancements that improve ease of use New Dashboard items  Mail Summary >
The ILC And the Grid Andreas Gellrich DESY LCWS2007 DESY, Hamburg, Germany
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks GStat 2.0 Joanna Huang (ASGC) Laurence Field.
James Casey, CERN, IT-GT-TOM 1 st ROC LA Workshop, 6 th October 2010 Grid Infrastructure Monitoring.
OSG Production Report OSG Area Coordinator’s Meeting Aug 12, 2010 Dan Fraser.
OSG Tier 3 support Marco Mambelli - OSG Tier 3 Dan Fraser - OSG Tier 3 liaison Tanya Levshina - OSG.
July 25, 20071/21 OSG Information Services Gabriele Garzoglio, Rob Quick, Chris Green OSG Information Services, VO Monitoring Services and Resource Selection.
● A system of Internet servers that support specially formatted documents. The documents are formatted in a markup language called HTML. What is the World.
Grid Operations Lessons Learned Rob Quick Open Science Grid Operations Center - Indiana University.
LegendCorp What is System Center Virtual Machine Manager (SCVMM)? SCVMM at a glance Features and Benefits Components / Topology /
Experiment Management System CSE 423 Aaron Kloc Jordan Harstad Robert Sorensen Robert Trevino Nicolas Tjioe Status Report Presentation Industry Mentor:
Microsoft Management Seminar Series SMS 2003 Change Management.
US LHC OSG Technology Roadmap May 4-5th, 2005 Welcome. Thank you to Deirdre for the arrangements.
Mercury – A Service Oriented Web-based system for finding and retrieving Biogeochemical, Ecological and other land- based data National Aeronautics and.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Wojciech Lapka SAM Team CERN EGEE’09 Conference,
EGEE-III INFSO-RI Enabling Grids for E-sciencE Ricardo Rocha CERN (IT/GS) EGEE’08, September 2008, Istanbul, TURKEY Experiment.
Site Validation Session Report Co-Chairs: Piotr Nyczyk, CERN IT/GD Leigh Grundhoefer, IU / OSG Notes from Judy Novak WLCG-OSG-EGEE Workshop CERN, June.
The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana.
RSV: OSG Grid Fabric Monitoring and Interoperation with WLCG Monitoring Systems Rob Quick, Arvind Gopu, and Soichi Hayashi Computing in High Energy and.
Inside GOC Soichi Hayashi Software Engineer. Hardware VM Hosts – Production (B-town & Indi) – Dev & ITB (B-town) LDAP Server (389) Internal.grid.iu.edu.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI How to integrate portals with the EGI monitoring system Dusan Vudragovic.
MND review. Main directions of work  Development and support of the Experiment Dashboard Applications - Data management monitoring - Job processing monitoring.
Windows SharePoint Services Installation and Configuration.
OSG Storage VDT Support and Troubleshooting Concerns Tanya Levshina.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Regional Nagios Emir Imamagic /SRCE EGEE’09,
Area Coordinator Report for Operations Rob Quick 4/10/2008.
Open Science Grid OSG Resource and Service Validation and WLCG SAM Interoperability Rob Quick With Content from Arvind Gopu, James Casey, Ian Neilson,
WIDESCREEN PRESENTATION Tips and tools for creating and presenting wide format slides.
INTERNET AND . WHAT IS INTERNET The Internet can be defined as the wired or wireless mode of communication through which one can receive, transmit.
DIRAC for Grid and Cloud Dr. Víctor Méndez Muñoz (for DIRAC Project) LHCb Tier 1 Liaison at PIC EGI User Community Board, October 31st, 2013.
INFSO-RI Enabling Grids for E-sciencE GOCDB Requirements John Gordon, STFC.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The Dashboard for Operations Cyril L’Orphelin.
HLRmon Enrico Fattibene INFN-CNAF 1EGI-TF Lyon, France19-23 September 2011.
Wednesday NI Vision Sessions
RSV: OSG Grid Monitoring and User Customizable Views Rob Quick, Arvind Gopu, and Soichi Hayashi High Performance Distributed Computing Location: Munich,
March 2014 Open Science Grid Operations A Decade of HTC Infrastructure Support Kyle Gross Operations Support Lead Indiana University / Research Technologies.
INFSO-RI Enabling Grids for E-sciencE GOCDB2 Matt Thorpe / Philippa Strange RAL, UK.
Certificate Security For Users Obtaining and Using Your Personal Certificate using the OSG PKI Kyle Gross – OSG Operations Support Lead Elizabeth Prout.
Open Science Grid Configuring RSV OSG Resource & Service Validation Thomas Wang Grid Operations Center (OSG-GOC) Indiana University.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
Grid Colombia Workshop with OSG Week 2 Startup Rob Gardner University of Chicago October 26, 2009.
MyOSG and MyEGI - One Stop Shopping for Grid (Operations) Information CHEP 2010, 20 October 15:00 (Asia/Taipei) – Auditorium, BHSS MyOSG and MyEGI - One.
OSG Operations – Lessons Learned CHEP 2010, 18 October 15:10 (Asia/Taipei) – Room 2, BHSS OSG Operations – Lessons Learned CHEP 2010, 18 October 15:10.
Open Science Grid Progress and Status
Ian Bird GDB Meeting CERN 9 September 2003
POW MND section.
Leigh Grundhoefer Indiana University
Getting Started.
Getting Started.
The New Face of Information Retrieval: The Ankara University Open Access Platform Prof. Dr. Sekine Karakaş Prof. Dr. Doğan.
* Introduction to Cloud computing * Introduction to OpenStack * OpenStack Design & Architecture * Demonstration of OpenStack Cloud.
Presentation transcript:

MyOSG: A user-centric information resource for OSG infrastructure data sources Arvind Gopu, Soichi Hayashi, Rob Quick Open Science Grid Operations Center (GOC) Indiana University

GCE'09 Workshop (SC'09), Portland, OR 2 Outline Quick introduction to OSG  Explain roles assumed by members Objectives of MyOSG Technical design User interface  Demo (if Internet connection is available!) Questions

GCE'09 Workshop (SC'09), Portland, OR 3 Open Science Grid Researchers – usually geographically distributed – from several scientific domains form Virtual Organizations (VOs) that:  Contribute hardware and software resources Own hardware; allow one or more VOs to use hardware  Develop tools useful to members of the OSG Hard for OSG community – users, support staff, site administrators – to keep up w/ tools & accessibility OSG trying to expand to other sciences  GOC noticed new collaborators/VOs repeatedly complain Most tools on OSG are hard to discover After discovering a tool, the interface is not uniform; Requires one to learn new interface and its data format

GCE'09 Workshop (SC'09), Portland, OR 4 Tools/Services in OSG As with most Grid Computing projects  Status Monitoring (VORS, RSV, Nagios)  Accounting Information (Gratia)  Queue statistics, etc. (GIP+BDII/ReSS, others)  Topology + Human associations (OIM, others) ... Tons of others... Separate interfaces via web/ldap/command line

GCE'09 Workshop (SC'09), Portland, OR 5 MyOSG addresses these issues Highly customizable web portal  Allows vastly different categories of users to Access information important to their role Retrieve information in format convenient to them  Use authoritative source for OSG topology (OIM), auth/authOSG topology  Organize data from different tools around topology to create a web portal Main design goals  Provide ability for users to export / subscribe to a variety of information in formats such as XML, UWA – an industry standard widget format, iCal – for calendar type information, etc.  Enable user to construct Individual Information Centers (IIC) Netvibes, iGoogle, mobile devices (iPhone, etc.)

GCE'09 Workshop (SC'09), Portland, OR 6 OSG Members and Roles End user – VO researcher VO Manager Support  Resource administrator  Support Center  Central operations group like GOC Management Integration Test Bed (ITB), Security, etc.

GCE'09 Workshop (SC'09), Portland, OR 7... OSG Members and Roles Often, one person assumes multiple roles  Each role demands different types of information For example …  End users: resources positive service status, free CPUs, programmatic data  VO manager: Usage information and list of resources with negative status for resources they own  GOC: list of ALL resources with negative status, other monitoring information  Management: Usage information for all resources, contact information, other statistical information

GCE'09 Workshop (SC'09), Portland, OR 8 MyOSG Framework – schematic

GCE'09 Workshop (SC'09), Portland, OR 9 MyOSG Framework: Components Web Interface  PHP (Zend)  jQuery Consolidators  RSV (Monitoring)  GIP Validation (Monitoring)  Gratia (Accounting)

GCE'09 Workshop (SC'09), Portland, OR 10 … MyOSG Framework: Components Backbone: OIM  Topology  Contacts  Downtime information  Simple yet powerful auth/auth Data: MySQL database, files on disk Redundant Server, VM based installation

GCE'09 Workshop (SC'09), Portland, OR 11 MyOSG User Interface Customizable UI – for each top menu item:  Select - Information to display  Use - Data selector based on entity in context  Use - Filters Most information rich menu item: Resource Group (See OIM topology presentation to learn why!) Current data formats: UWA (Netvibes, iGoogle), HTML for Mobile devices, XML, CSV, HTML via permalinks

GCE'09 Workshop (SC'09), Portland, OR 12 MyOSG User Interface Demo (if Internet connection available!)  MyOSG Homepage:  Netvibes example (Arvind’s public page):  iPhone?  Google Wave?

GCE'09 Workshop (SC'09), Portland, OR 13 MyOSG Screenshots – Home page

GCE'09 Workshop (SC'09), Portland, OR 14 MyOSG Screenshots – Resource Group

GCE'09 Workshop (SC'09), Portland, OR 15 MyOSG Screenshots – RG Summary & XML equivalent

GCE'09 Workshop (SC'09), Portland, OR 16 MyOSG Screenshots – RG Status Map

GCE'09 Workshop (SC'09), Portland, OR 17 MyOSG Screenshots – Usage Information

GCE'09 Workshop (SC'09), Portland, OR 18 MyOSG Screenshots – Netvibes (Arvind)

GCE'09 Workshop (SC'09), Portland, OR 19 MyOSG Screenshots – Netvibes (Admin)

GCE'09 Workshop (SC'09), Portland, OR 20 MyOSG Screenshots – Google Wave (Not released yet)

GCE'09 Workshop (SC'09), Portland, OR 21 Future Work Main goal: Make user driven additions/updates GIP/BDII (CPU/storage availability)  Data, graphs, treemaps, etc. (Show LDIF data!)LDIF data VOMS monitoring Continue work with EGEE (MyEGEE) Provide even simpler interface with user option to enable advanced options Other  Even more advanced authorization based on VOMS  High Availability

GCE'09 Workshop (SC'09), Portland, OR 22 Q & A Questions?!