Report on the state of OSG Software Alain Roy. OSG Year 6 Planning, July 2011 Points to discuss 1.State of RPM transition 2.State of last scheduled Pacman.

Slides:

Advertisements

Similar presentations

OSG Technology Area Brian Bockelman Area Coordinators Meeting November 30, 2011.

Advertisements

Dec 14, 20061/10 VO Services Project – Status Report Gabriele Garzoglio VO Services Project WBS Dec 14, 2006 OSG Executive Board Meeting Gabriele Garzoglio.

OSG Council Meeting, August 2nd Executive Director Report to the OSG Council Executive Director Report to the OSG Council August 2 nd 2011, Ruth.

OSG Technology Plans OSG Staff Meeting July 2012 Brian Bockelman.

 Contributing >30% of throughput to ATLAS and CMS in Worldwide LHC Computing Grid  Reliant on production and advanced networking from ESNET, LHCNET and.

May 9, 2008 Reorganization of the OSG Project The existing project organization chart was put in place at the beginning of It has worked very well.

Improving Process for Better Software. Who We Are An experiential learning program that provides technology solutions for our partners, and real- world.

Jan 2010 Current OSG Efforts and Status, Grid Deployment Board, Jan 12 th 2010 OSG has weekly Operations and Production Meetings including US ATLAS and.

OSG Area Coordinators Meeting Operations Rob Quick 2/22/2012.

Open Science Grid Software Stack, Virtual Data Toolkit and Interoperability Activities D. Olson, LBNL for the OSG International.

LHCC Comprehensive Review – September WLCG Commissioning Schedule Still an ambitious programme ahead Still an ambitious programme ahead Timely testing.

OSG Area Coordinators Meeting Operations Rob Quick 2/22/2012.

OSG Area Coordinators Meeting Security Team Report Kevin Hill 08/14/2013.

OSG Operations Rob Quick July 10th, 2012 OSG Staff Retreat.

OSG Area Coordinators Meeting Security Team Report Mine Altunay 12/21/2011.

Integration and Sites Rob Gardner Area Coordinators Meeting 12/4/08.

May 8, 20071/15 VO Services Project – Status Report Gabriele Garzoglio VO Services Project – Status Report Overview and Plans May 8, 2007 Computing Division,

G RID M IDDLEWARE AND S ECURITY Suchandra Thapa Computation Institute University of Chicago.

Apr 30, 20081/11 VO Services Project – Stakeholders’ Meeting Gabriele Garzoglio VO Services Project Stakeholders’ Meeting Apr 30, 2008 Gabriele Garzoglio.

Virtualization within FermiGrid Keith Chadwick Work supported by the U.S. Department of Energy under contract No. DE-AC02-07CH11359.

OSG Area Coordinators Meeting Proposal Chander Sehgal Fermilab

OSG Software and Operations Plans Rob Quick OSG Operations Coordinator Alain Roy OSG Software Coordinator.

OSG Project Manager Report for OSG Council Meeting OSG Project Manager Report for OSG Council Meeting October 14, 2008 Chander Sehgal.

Production Coordination Staff Retreat July 21, 2010 Dan Fraser – Production Coordinator.

OSG Security Review Mine Altunay December 4, 2008.

Jan 10, 20091/16 VO Services Project – Stakeholders’ Meeting Gabriele Garzoglio VO Services Project Stakeholders’ Meeting Jan 10, 2009 Gabriele Garzoglio.

OSG Production Report OSG Area Coordinator’s Meeting Aug 12, 2010 Dan Fraser.

March 11, 2008 USCMS Tier-2 Workshop Oh Dear God Alain made a PowerPoint presentation 1.

OSG Area Coordinators Meeting Security Team Report Mine Altunay 11/02/2011.

OSG Tier 3 support Marco Mambelli - OSG Tier 3 Dan Fraser - OSG Tier 3 liaison Tanya Levshina - OSG.

OSG PKI Transition: Transition Phase Report Von Welch OSG PKI Transition Lead Indiana University Center for Applied Cybersecurity Research.

BNL Tier 1 Service Planning & Monitoring Bruce G. Gibbard GDB 5-6 August 2006.

Grid Operations Lessons Learned Rob Quick Open Science Grid Operations Center - Indiana University.

State of the OSG Software Stack Alain Roy OSG Software Coordinator.

Open Science Grid (OSG) Introduction for the Ohio Supercomputer Center Open Science Grid (OSG) Introduction for the Ohio Supercomputer Center February.

STAR Collaboration, July 2004 Grid Collector Wei-Ming Zhang Kent State University John Wu, Alex Sim, Junmin Gu and Arie Shoshani Lawrence Berkeley National.

OSG Integration Activity Report Rob Gardner Leigh Grundhoefer OSG Technical Meeting UCSD Dec 16, 2004.

9 Oct Overview Resource & Project Management Current Initiatives  Generate SOWs  8 written and 6 remain;  drafts will be complete next week 

The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana.

April 26, Executive Director Report Executive Board 4/26/07 Things under control Things out of control.

Jan 2010 OSG Update Grid Deployment Board, Feb 10 th 2010 Now having daily attendance at the WLCG daily operations meeting. Helping in ensuring tickets.

OSG Area Coordinators Meeting Operations Rob Quick 1/11/2012.

Production Oct 31, 2012 Dan Fraser. Current Production Focus Transition to RPMs 52(44) sites using RPM based installs 52(44) sites using RPM based installs.

OSG Area Report Production – Operations – Campus Grids Jan 11, 2011 Dan Fraser.

Doug Benjamin Duke University. 2 ESD/AOD, D 1 PD, D 2 PD - POOL based D 3 PD - flat ntuple Contents defined by physics group(s) - made in official production.

Sep 25, 20071/5 Grid Services Activities on Security Gabriele Garzoglio Grid Services Activities on Security Gabriele Garzoglio Computing Division, Fermilab.

OSG Deployment Preparations Status Dane Skow OSG Council Meeting May 3, 2005 Madison, WI.

Report from GSSD Storage Workshop Flavia Donno CERN WLCG GDB 4 July 2007.

OSG Report for DOE/NSF Joint Oversight Group U.S. Large Hadron Collider Program OSG Report for DOE/NSF Joint Oversight Group U.S. Large Hadron Collider.

OSG Area Coordinators Meeting Security Team Report Mine Altunay 02/13/2012.

April 25, 2006Parag Mhashilkar, Fermilab1 Resource Selection in OSG & SAM-On-The-Fly Parag Mhashilkar Fermi National Accelerator Laboratory Condor Week.

Sep 17, 20081/16 VO Services Project – Stakeholders’ Meeting Gabriele Garzoglio VO Services Project Stakeholders’ Meeting Sep 17, 2008 Gabriele Garzoglio.

Feb 15, 20071/6 OSG EB Meeting – VO Services Status Gabriele Garzoglio VO Services Status OSG EB Meeting Feb 15, 2007 Gabriele Garzoglio, Fermilab.

OSG Area Report Production – Operations – Campus Grids June 19, 2012 Dan Fraser Rob Quick.

Tier 3 Support and the OSG US ATLAS Tier2/Tier3 Workshop at UChicago August 20, 2009 Marco Mambelli –

The Great Migration: From Pacman to RPMs Alain Roy OSG Software Coordinator.

OSG Area Coordinators Meeting Security Team Report Mine Altunay 8/15/2012.

Parag Mhashilkar Computing Division, Fermilab.  Status  Effort Spent  Operations & Support  Phase II: Reasons for Closing the Project  Phase II:

April 18, 2006FermiGrid Project1 FermiGrid Project Status April 18, 2006 Keith Chadwick.

OSG Facility Miron Livny OSG Facility Coordinator and PI University of Wisconsin-Madison Open Science Grid Scientific Advisory Group Meeting June 12th.

Open Science Grid Configuring RSV OSG Resource & Service Validation Thomas Wang Grid Operations Center (OSG-GOC) Indiana University.

INFSOM-RI WP3: WP3: Software configuration tools and methodologies Status Report ETICS All-Hands – 23 May 2007 E. Ronchieri.

OSG PKI Transition: Status and Next Steps (and Lessons Learned) Von Welch OSG PKI Transition Lead Indiana University Center for Applied Cybersecurity Research.

Software Tools Group & Release Process Alain Roy Mine Altunay.

BeStMan/DFS support in VDT OSG Site Administrators workshop Indianapolis August Tanya Levshina Fermilab.

Gene Oleynik, Head of Data Storage and Caching,

Andrea Manzi, Oliver Keeble

CREAM Status and Plans Massimo Sgaravatto – INFN Padova

Dynamic Process for Source Control

Andrea Manzi, Oliver Keeble

Presentation transcript:

Report on the state of OSG Software Alain Roy

OSG Year 6 Planning, July 2011 Points to discuss 1.State of RPM transition 2.State of last scheduled Pacman release 3.Bestman 4.Management 2

OSG Year 6 Planning, July State of RPM transition Completed, tested/testing:  Xrootd  Bestman Complete, ready for internal testing:  Worker Node Client  Client Close to internal testing:  VOMS/VOMS-Admin Server (~ 1 week?) Good progres:  CE (2-3 weeks?) What remains? Next slide… 3

OSG Year 6 Planning, July 2011 Major remaining tasks Major missing chunks:  GUMS  CREAM  Gratia collector Internal test framework Integration testing Documentation 4

OSG Year 6 Planning, July 2011 Build Fest: Main Results OSG Software Team up to speed on infrastructure & how to make RPMs Team building: first time all of us worked together in person 5

OSG Year 6 Planning, July 2011 Build Fest Stats Wednesday July 20 – Friday July commits to source code repo  About 20 new RPMs  Many others improved/fixed 13 attendees (some part-time)  Alain, Alex, Brian, Dan, Derek, Doug, Igor, Marco, Neha, Scot, Suchandra, Tanya, Tim 6

OSG Year 6 Planning, July State of last scheduled Pacman release Went to:  VTB on July 14  ITB on July 15 Slowed down in ITB  Cooling failures at Fermilab took down one ITB site  Horst’s travel delayed one ITB site Expected release:  Early August—hopefully first week, likely second week 7

OSG Year 6 Planning, July Bestman Ruth asked: What is your understanding of the current requests from OSG stakeholders for Bestman2 features, development and bug fixes? No outstanding requests from OSG Alex is unaware of ATLAS improvement mentioned by Ruth (better asychronous request handling) Request to move SRM from GSI to SSL: a WLCG request, not an OSG request 8

OSG Year 6 Planning, July Management Weekly meetings with ABCD  Have been very helpful in improving team organization Unified OSG Software Team  Weekly team meetings  Storage subgroup (mostly) faded  Unified task tracking  Improved understanding of staff effort Still to do:  Unify support efforts  New process for tracking of requirements  Will have public, accessible list of requirements,  Will discuss at least once a month  Will work on details/technologies with ABCD 9

Extra information, if needed

OSG Year 6 Planning, July 2011 RPM Stats 75 source RPMs in VDT repo O(30) source RPMs to go  Some harder than others  Imprecise because we’ve discovered a few missing pieces, like Globus SEG. 11

OSG Year 6 Planning, July 2011 Year 6 Staffing: 8.05 FTE PersonTotal Software TimeDuties John Hover25%Integration/Packaging Xin Zhao25%Integration/Packaging Doug Strain50%Software Neha50%Software Alex Sim40%Storage/Bestman Igor Sfiligoi50%Software/Evaluations Jeff Dost15%Hadoop integration Alain Roy100%Management Matyas Selmeci100%Software Scot Kronenfeld25-50%?Software Tim Cartwright50%Software UW TBD100%Software Suchandra Thapa100%Integration Haifeng Pi10%Evaluations Sanjay Padhi20%Evaluations Terrence Martin20%Evaluations 12

OSG Year 6 Planning, July 2011 Note from Alex We'll be probably charging 30% FTE (this number can vary depending on Arie's analysis) for the OSG support (and bug fixes, etc) to stretch the remaining OSG funding until Dec There are no additional bestman fundings for developments or features currently. 13