Executive Director Report Ruth Pordes OSG Council Meeting, August 5 th 2008.

Slides:



Advertisements
Similar presentations
Grid Security Policy GridPP18, Glasgow David Kelsey 21sr March 2007.
Advertisements

OSG Council Meeting, August 2nd Executive Director Report to the OSG Council Executive Director Report to the OSG Council August 2 nd 2011, Ruth.
 Contributing >30% of throughput to ATLAS and CMS in Worldwide LHC Computing Grid  Reliant on production and advanced networking from ESNET, LHCNET and.
OSG Area Coordinators Meeting Security Team Report Mine Altunay 05/15/2013.
INFSO-RI Enabling Grids for E-sciencE Update on LCG/EGEE Security Policy and Procedures David Kelsey, CCLRC/RAL, UK
May 9, 2008 Reorganization of the OSG Project The existing project organization chart was put in place at the beginning of It has worked very well.
Jan 2010 Current OSG Efforts and Status, Grid Deployment Board, Jan 12 th 2010 OSG has weekly Operations and Production Meetings including US ATLAS and.
Open Science Grid Frank Würthwein UCSD. 2/13/2006 GGF 2 “Airplane view” of the OSG  High Throughput Computing — Opportunistic scavenging on cheap hardware.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Security Policy Group Summary EGI TF David Kelsey 6/28/
Open Science Ruth Pordes Fermilab, July 17th 2006 What is OSG Where Networking fits Middleware Security Networking & OSG Outline.
OSG Area Coordinators Meeting Security Team Report Mine Altunay 01/29/2014.
LCG Milestones for Deployment, Fabric, & Grid Technology Ian Bird LCG Deployment Area Manager PEB 3-Dec-2002.
Open Science Grid Software Stack, Virtual Data Toolkit and Interoperability Activities D. Olson, LBNL for the OSG International.
Key Project Drivers - FY11 Ruth Pordes, June 15th 2010.
OSG Area Coordinators Meeting Security Team Report Kevin Hill 08/14/2013.
OSG Security Review Mine Altunay June 19, June 19, Security Overview Current Initiatives  Incident response procedure – top priority (WBS.
OSG Area Coordinators Meeting Security Team Report Mine Altunay 12/21/2011.
OSG Operations and Interoperations Rob Quick Open Science Grid Operations Center - Indiana University EGEE Operations Meeting Stockholm, Sweden - 14 June.
GGF12 – 20 Sept LCG Incident Response Ian Neilson LCG Security Officer Grid Deployment Group CERN.
May 8, 20071/15 VO Services Project – Status Report Gabriele Garzoglio VO Services Project – Status Report Overview and Plans May 8, 2007 Computing Division,
Apr 30, 20081/11 VO Services Project – Stakeholders’ Meeting Gabriele Garzoglio VO Services Project Stakeholders’ Meeting Apr 30, 2008 Gabriele Garzoglio.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks David Kelsey RAL/STFC,
JSPG: User-level Accounting Data Policy David Kelsey, CCLRC/RAL, UK LCG GDB Meeting, Rome, 5 April 2006.
OSG Area Coordinators Meeting Proposal Chander Sehgal Fermilab
Discussion Topics DOE Program Managers and OSG Executive Team 2 nd June 2011 Associate Executive Director Currently planning for FY12 XD XSEDE Starting.
OSG Project Manager Report for OSG Council Meeting OSG Project Manager Report for OSG Council Meeting October 14, 2008 Chander Sehgal.
10/24/2015OSG at CANS1 Open Science Grid Ruth Pordes Fermilab
Production Coordination Staff Retreat July 21, 2010 Dan Fraser – Production Coordinator.
OSG Security Review Mine Altunay December 4, 2008.
Key Project Drivers - an Update Ruth Pordes, June 14th 2008, V2: June 23 rd. These slides are in addition to the information available in
Security Policy Update LCG GDB Prague, 4 Apr 2007 David Kelsey CCLRC/RAL
OSG Area Coordinators Meeting Security Team Report Mine Altunay 8/15/2012.
Key Project Drivers - FY10 Ruth Pordes, June 15th 2009.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks David Kelsey RAL/STFC,
OSG Production Report OSG Area Coordinator’s Meeting Aug 12, 2010 Dan Fraser.
Partnerships & Interoperability - SciDAC Centers, Campus Grids, TeraGrid, EGEE, NorduGrid,DISUN Ruth Pordes Fermilab Open Science Grid Joint Oversight.
Job and Data Accounting on the Open Science Grid Ruth Pordes, Fermilab with thanks to Brian Bockelman, Philippe Canal, Chris Green, Rob Quick.
OSG Area Coordinators Meeting Security Team Report Mine Altunay 6/6/2012.
Ian Bird LHC Computing Grid Project Leader LHC Grid Fest 3 rd October 2008 A worldwide collaboration.
OSG PKI Transition: Transition Phase Report Von Welch OSG PKI Transition Lead Indiana University Center for Applied Cybersecurity Research.
Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.
US LHC OSG Technology Roadmap May 4-5th, 2005 Welcome. Thank you to Deirdre for the arrangements.
Summary of AAAA Information David Kelsey Infrastructure Policy Group, Singapore, 15 Sep 2008.
Security Policy Update David Kelsey UK HEP Sysman, RAL 1 Jul 2011.
9 Oct Overview Resource & Project Management Current Initiatives  Generate SOWs  8 written and 6 remain;  drafts will be complete next week 
Open Science Grid & its Security Technical Group ESCC22 Jul 2004 Bob Cowles
Status Organization Overview of Program of Work Education, Training It’s the People who make it happen & make it Work.
Open Science Grid Security Activities Mine Altunay, FNAL OSG Security Officer For the OSG Security Team: Doug Olson, Deputy Security Officer, LBNL, Jim.
The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana.
April 26, Executive Director Report Executive Board 4/26/07 Things under control Things out of control.
DTI Mission – 29 June LCG Security Ian Neilson LCG Security Officer Grid Deployment Group CERN.
CMS Usage of the Open Science Grid and the US Tier-2 Centers Ajit Mohapatra, University of Wisconsin, Madison (On Behalf of CMS Offline and Computing Projects)
Security Policy: From EGEE to EGI David Kelsey (STFC-RAL) 21 Sep 2009 EGEE’09, Barcelona david.kelsey at stfc.ac.uk.
Security Policy Update WLCG GDB CERN, 14 May 2008 David Kelsey STFC/RAL
Sep 25, 20071/5 Grid Services Activities on Security Gabriele Garzoglio Grid Services Activities on Security Gabriele Garzoglio Computing Division, Fermilab.
OSG Report for DOE/NSF Joint Oversight Group U.S. Large Hadron Collider Program OSG Report for DOE/NSF Joint Oversight Group U.S. Large Hadron Collider.
OSG Area Coordinators Meeting Security Team Report Mine Altunay 02/13/2012.
JSPG Update David Kelsey MWSG, Zurich 31 Mar 2009.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Ian Bird All Activity Meeting, Sofia
Towards deploying a production interoperable Grid Infrastructure in the U.S. Vicky White U.S. Representative to GDB.
1 Open Science Grid: Project Statement & Vision Transform compute and data intensive science through a cross- domain self-managed national distributed.
Summary of OSG Activities by LIGO and LSC LIGO NSF Review November 9-11, 2005 Kent Blackburn LIGO Laboratory California Institute of Technology LIGO DCC:
OSG Area Coordinators Meeting Security Team Report Mine Altunay 8/15/2012.
OSG User Group August 14, Progress since last meeting OSG Users meeting at BNL (Jun 16-17) –Core Discussions on: Workload Management; Security.
OSG Security Review Mine Altunay March 12, Jan Security Overview Current Initiatives  OSG Security roadmap  Technical and operational.
Interset Support Overview March 2017
Key Project Drivers - FY10 Ruth Pordes, June 15th 2009
LCG Security Status and Issues
Leigh Grundhoefer Indiana University
Presentation transcript:

Executive Director Report Ruth Pordes OSG Council Meeting, August 5 th 2008

Summary We have met the performance and functionality needs for initial LHC data taking. 2 We have released the baseline production version of OSG software. We have an energetic, solid team: committed, open and collaborative. LIGO, D0, Engage production usage/efficiency /usability have made progress. A potentially significant Campus and User entrant in the Structural Biology Grid (SBGrid). (need to understand expectations).

August 5th, 2008 Outline Accomplishments – each one generating a question. Interactions with the Joint Oversight Team Security Report 3

August 5th, 2008 Deliverables to CCRC’08, ATLAS Full Dress Rehearsal (FDR-2),CMS Computing & Analysis Challenge (CSA08) met currently “hard” to separate out OSG specific contributions? Up to 120 TB/day transfers over a month on >100 links many including Tier-2 end-point. Robust job management and execution on Tier-2s - job throughputs of >40,000/day. 4 End-to-End Data Transfer Throughput(ATLAS) 1.0 GByte/Sec Scaled to ~450 users across ~ 30 Tier2s. Simultaneous with end-to-end Cosmic Ray running. Simultaneous simulation production of >10Mevents/week. Mix of Production and Analysis Jobs(CMS) 80,000 / day

August 5th, 2008 LIGO usage increasing following focus on WS-Gram deployment/testing for 5 Note: Migration of majority of use from Nebraska to BNL to Purdue. why?

August 5th, 2008 Chemistry - Andrew Shultz, University of Buffalo. Application to model virial coefficients of water. Anticipate research highlight/publication this summer. 78,000 jobs consuming average of about 100 CPU days/day over 6 months. 6 User registered to the NYSGrid VO: So, how do we know it is Chemistry? Would running as part of the Engage VO help?

August 5th, 2008 Computational Biology: Protein Folding/Structure 7 Assistant professor and 2 students running fairly steadily. ~620,000 CPU wallclock hours in 2008 (average 120 cpudays/day for ~210 days). Expect research highlight in the next few months. When does a set of individuals become a community/VO?

August 5th, 2008 Engage use is growing. Use continues to be cyclic. More sites used in 2008 than in 2007 sitenameCPU Days MIT_CMS8,344 USCMS-FNAL-WC1-CE4,201 UCSDT21,975 UCR-HEP1,749 FNAL_CDFOSG_21,745 BNL_ATLAS_11,625 FNAL_GPFARM1,437 FNAL_CDFOSG_31,286 CIT_CMS_T21,218 Purdue-RCAC1,210 FNAL_DZEROOSG_21,209 FNAL_DZEROOSG_11,109 FNAL_GPGRID_11,047 NERSC-Jacquard958 TTU-ANTAEUS658 FNAL_CDFOSG_4588 UCLA_Saxon_Tier3441 Nebraska380 GLOW280 SBGrid-Harvard-East220 OCI-NSF185 UFlorida-HPC154 Clemson-IT121 UWMilwaukee105 8

August 5th, 2008 Request from D0 for access to local Storage Resources to improve efficiency Council asked ET to help.  With OSG 1.0 opportunistic & reserved storage more widely supported. US ATLAS, US CMS Tier-2s offered to let D0 use storage up to 1 TB /site over 3 ATLAS and 3 CMS sites. Help from the OSG site admins, users group, storage, D0 throughput increased from 3.6 to 5 and 4 M events /week over the past 2 weeks.  efficiency is >50% some days and then (last weekend) can go down to ~28%.  D0 and OSG continue to track down specific problems. D0 gathering efficiency plots over time d0.fnal.gov/~snow/jobscan/effs.html d0.fnal.gov/~snow/jobscan/effs.html How should OSG organize and prioritize ongoing support/help for robust, effective use of “grown-up” VOs? 9

August 5th, 2008 Recorded use ~15,000 CPUweeks/week. Lack of availability? ability? need? to use cycles from locally reduced use by LHC 10

August 5th, 2008 Major Software Release in June 2008 OSG 1.0 Expect to maintain this as the main baseline software version. Many sites upgraded quickly – confidence or timeliness? Testing included configuration & simple tests of Opportunistic Storage (dCache, Bestman). Enabling US LHC Tier-2 site availability reporting to the WLCG with first official reports for July. 11

August 5th, 2008 Infrastructure Accomplishments Significantly improved local site monitoring tools (RSV). Well received set of storage tools released for administrators. Initial use by VOs of opportunistic storage. Improved administrative information capabilities (OIM). Support for additional LHC Tier-3s:  US CMS: UCLA, UMD, FlTech, UIC  US ATLAS: UIUC, UWisc-Madison, Iowa State (earlier?) 12

August 5th, 2008 Production Information OIM RSV 13 Number of Production CEs86 Number of production SRMV2 SEs17 (4 Bestman)

August 5th, 2008 Jump in # of support tickets for OSG 1.0 configurations –ensure all sites configured right for Information/Monitoring/Accounting 14

Interactions with the Joint Oversight Team

August 5th, 2008 Summary of Interactions with JOT New program managers:  Don Petravick – DOE HEP  Susan Turnbull – DOE ASCR Visit by core-Executive: Miron, Chander, Ruth – to DOE and NSF in June:  Fred Johnson, ASCR, and Susan in the am.  Moishe, Marv, Susan in the pm. Action item: institute regular JOT, OSG mgmt, US ATLAS & US CMS S&C mgmt phone meetings. 16

August 5th, 2008 First EJOT phone meeting Don: “Goal to understand the reliance of the LHC experiments on the OSG, and to understand that status of that reliance.” Discussed kind of items that in a future work agenda: Experience at Run II that more effort is required when experiments start up. Another meeting planned in 2-3 months. 17

Security Report Mine Altunay, FNAL OSG Security Officer For the OSG Security Team: Doug Olson, Deputy Security Officer, LBNL, Jim Basney NCSA, Ron Cudzewicz FNAL,

August 5th, 2008 Change in OSG – JSPG relationship 19 No mandatory acceptance of JSPG policies in OSG.  We contribute in the working groups to make policies as uniform as reasonable & give feedback.  Agreed to by OSG, EGEE, WLCG. We work with US LHC S&C and WLCG on OSG policies & to communicate (& agree on) differences from those recommended by JSPG.  Contact is: Dave Kelsey, WLCG Security Coordinator

August 5th, 2008 TitleComments VO AUP TemplateOSG has a template AUP policy that member VOs are required to fill out. VO User Registration and Management Template Template OSG has a template policy that member VOs can fill out. OSG Security Incident Handling and Response Plan The JSPG’s incident handling and response policy is based on earlier OSG policy. Thus, two policies are compatible. Work is needed to address cross- grid coordination. Also, EGEE has a separate policy/procedure on software vulnerabilities, while OSG doesn't. Grid Acceptable Use PolicyThe OSG and JSPG policies are identical. Approval of Certificate AuthoritiesAuthoritiesThe OSG specific policy complies with the JSPG policy. Service AgreementOSG-specific policy with no equivalent JSP policy. Policy on Grid Pilot JobsThe JSPG policy is based on a Fermilab policy, which will provide the basis for the OSG policy. OSG does not have a specific document produced yet. Privacy PolicyThis is an OSG-only policy. It has been sent to the OSG EB and received feedback. VO Operations PolicyOSG has sent comments to the JSPG’s final call. There is no OSG-specific version of this policy Site Operations PolicyOSG approved the JSPG policy. OSG has not produced an OSG-specific policy yet. Traceability and Logging PolicyLoggingOSG has sent comments to JSPG’s policy. OSG does not have any auditing requirements formally approved beyond those in AUPs and accounting VO Registration Policy and Site Registration Policy These two policies are not reviewed by OSG yet. JSPG will start working on these documents soon and OSG will send comments later. Working with VOs on appropriate detail and contents List of OSG Policies

August 5th, 2008 Recent Iranian CA discussions and questions OSG EB (Kent & Bill) raised the issue of EAR wrt Iranian CA.  FNAL security help determined that site size determines threshold.  Did a rough survey of OSG sites. No university sites are near this threshold. Such policies were, are, and remain, the responsibility of the Site. We will undertake some understanding for communication purposes, but we have no responsibility here. For clarity we may add a sentence to our AUP saying we do not collect citizenship information in OSG? 21

August 5th, 2008 Recent Incidents/Alerts A root-level compromise at one site  No grid incident detected  Take-home messages: Good test for VO security officers:  Very important for VOs to identify Security Officers. Alert at 2 nd site was a mis-communication due to system admin mis-configuration. EGEE security challenge resulted in USCMS having a poor score  Confusion over which policies to follow being addressed.  Now agreed with EGEE security officer - OSG will be involved in the next challenge.  Issue of EGEE or WLCG challenge still to be clarified.

August 5th, 2008 Standing Issue: Partner grids with multiple VOs and sub-VOs: Identifying which VO/Application is the job submitter  We report the partner grid as the VO  How to provide the finer-granularity?  How to provide VO usage policy?