OSG Area Report Production – Operations – Campus Grids Jan 11, 2011 Dan Fraser.

Slides:

Advertisements

Similar presentations

OSG Technology Area Brian Bockelman Area Coordinators Meeting November 30, 2011.

Advertisements

OSG Council Meeting, August 2nd Executive Director Report to the OSG Council Executive Director Report to the OSG Council August 2 nd 2011, Ruth.

Bosco: Enabling Researchers to Expand Their HTC Resources The Bosco Team: Dan Fraser, Jaime Frey, Brooklin Gore, Marco Mambelli, Alain Roy, Todd Tannenbaum,

Contributors & Users Science Communities Campuses Universities & Laboratories Service & Software Providers Scientists, Researchers, Educators, Students.

ANTHONY TIRADANI AND THE GLIDEINWMS TEAM glideinWMS in the Cloud.

Campus High Throughput Computing (HTC) Infrastructures (aka Campus Grids) Dan Fraser OSG Production Coordinator Campus Grids Lead.

May 9, 2008 Reorganization of the OSG Project The existing project organization chart was put in place at the beginning of It has worked very well.

Jan 2010 Current OSG Efforts and Status, Grid Deployment Board, Jan 12 th 2010 OSG has weekly Operations and Production Meetings including US ATLAS and.

SCD FIFE Workshop - GlideinWMS Overview GlideinWMS Overview FIFE Workshop (June 04, 2013) - Parag Mhashilkar Why GlideinWMS? GlideinWMS Architecture Summary.

OSG Area Coordinators Meeting Operations Rob Quick 2/22/2012.

Open Science Grid Software Stack, Virtual Data Toolkit and Interoperability Activities D. Olson, LBNL for the OSG International.

Key Project Drivers - FY11 Ruth Pordes, June 15th 2010.

OSG Area Coordinators Campus Infrastructures Update Dan Fraser Miha Ahronovitz, Jaime Frey, Rob Gardner, Brooklin Gore, Marco Mambelli, Todd Tannenbaum,

OSG Area Coordinators Meeting Operations Rob Quick 2/22/2012.

OSG Area Coordinators Meeting Security Team Report Mine Altunay 12/21/2011.

OSG Site Provide one or more of the following capabilities: – access to local computational resources using a batch queue – interactive access to local.

1 1 Vulnerability Assessment of Grid Software Jim Kupsch Associate Researcher, Dept. of Computer Sciences University of Wisconsin-Madison Condor Week 2006.

Publication and Protection of Site Sensitive Information in Grids Shreyas Cholia NERSC Division, Lawrence Berkeley Lab Open Source Grid.

Campus Grids Report OSG Area Coordinator’s Meeting Dec 15, 2010 Dan Fraser (Derek Weitzel, Brian Bockelman)

May 8, 20071/15 VO Services Project – Status Report Gabriele Garzoglio VO Services Project – Status Report Overview and Plans May 8, 2007 Computing Division,

OSG Security Kevin Hill. Goals Operational Security – Identify software vulnerabilities – observing the practices of our VOs and sites, and sending alerts.

BOSCO Architecture Derek Weitzel University of Nebraska – Lincoln.

Use of Condor on the Open Science Grid Chris Green, OSG User Group / FNAL Condor Week, April

Discussion Topics DOE Program Managers and OSG Executive Team 2 nd June 2011 Associate Executive Director Currently planning for FY12 XD XSEDE Starting.

Report on the state of OSG Software Alain Roy. OSG Year 6 Planning, July 2011 Points to discuss 1.State of RPM transition 2.State of last scheduled Pacman.

OSG Project Manager Report for OSG Council Meeting OSG Project Manager Report for OSG Council Meeting October 14, 2008 Chander Sehgal.

Mar 28, 20071/9 VO Services Project Gabriele Garzoglio The VO Services Project Don Petravick for Gabriele Garzoglio Computing Division, Fermilab ISGC 2007.

Production Coordination Staff Retreat July 21, 2010 Dan Fraser – Production Coordinator.

OSG Area Coordinators Meeting Security Team Report Mine Altunay 8/15/2012.

OSG Production Report OSG Area Coordinator’s Meeting Aug 12, 2010 Dan Fraser.

Evolution of Grid Projects and what that means for WLCG Ian Bird, CERN WLCG Workshop, New York 19 th May 2012.

Turning Software Projects into Production Solutions Dan Fraser, PhD Production Coordinator Open Science Grid OU Supercomputing Symposium October 2009.

OSG Area Coordinators Meeting Security Team Report Mine Altunay 11/02/2011.

OSG Tier 3 support Marco Mambelli - OSG Tier 3 Dan Fraser - OSG Tier 3 liaison Tanya Levshina - OSG.

OSG PKI Transition: Transition Phase Report Von Welch OSG PKI Transition Lead Indiana University Center for Applied Cybersecurity Research.

Grid Operations Lessons Learned Rob Quick Open Science Grid Operations Center - Indiana University.

Open Science Grid Open Science Grid: Beyond the Honeymoon Dane Skow Fermilab September 1, 2005.

State of the OSG Software Stack Alain Roy OSG Software Coordinator.

OSG Production Report OSG Area Coordinator’s Meeting Nov 17, 2010 Dan Fraser.

Open Science Grid (OSG) Introduction for the Ohio Supercomputer Center Open Science Grid (OSG) Introduction for the Ohio Supercomputer Center February.

GLIDEINWMS - PARAG MHASHILKAR Department Meeting, August 07, 2013.

9 Oct Overview Resource & Project Management Current Initiatives  Generate SOWs  8 written and 6 remain;  drafts will be complete next week 

OSG User Support Update OSG Area Coordinators Call February 12, 2014 Chander Sehgal - FNAL.

Production Coordination Area VO Meeting Feb 11, 2009 Dan Fraser – Production Coordinator.

Status Organization Overview of Program of Work Education, Training It’s the People who make it happen & make it Work.

The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana.

April 26, Executive Director Report Executive Board 4/26/07 Things under control Things out of control.

OSG Area Coordinators Meeting Operations Rob Quick 1/11/2012.

Production Oct 31, 2012 Dan Fraser. Current Production Focus Transition to RPMs 52(44) sites using RPM based installs 52(44) sites using RPM based installs.

CMS Usage of the Open Science Grid and the US Tier-2 Centers Ajit Mohapatra, University of Wisconsin, Madison (On Behalf of CMS Offline and Computing Projects)

Where to go and what to do next — OSG, resources, help, mentors Thursday afternoon, 4:30pm Jim Weichel OSG Special Projects Fermi National Laboratory,

OSG Area Coordinators Meeting Security Team Report Mine Altunay 4/11/2012.

1 CMS Software Installation, Bockjoo Kim, 23 Oct. 2008, T3 Workshop, Fermilab CMS Commissioning and First Data Stan Durkin The Ohio State University for.

OSG Deployment Preparations Status Dane Skow OSG Council Meeting May 3, 2005 Madison, WI.

OSG Report for DOE/NSF Joint Oversight Group U.S. Large Hadron Collider Program OSG Report for DOE/NSF Joint Oversight Group U.S. Large Hadron Collider.

OSG Storage VDT Support and Troubleshooting Concerns Tanya Levshina.

OSG Area Report Production – Operations – Campus Grids June 19, 2012 Dan Fraser Rob Quick.

LCG Pilot Jobs + glexec John Gordon, STFC-RAL GDB 7 December 2007.

Fermilab / FermiGrid / FermiCloud Security Update Work supported by the U.S. Department of Energy under contract No. DE-AC02-07CH11359 Keith Chadwick Grid.

The Great Migration: From Pacman to RPMs Alain Roy OSG Software Coordinator.

Campus Grid Technology Derek Weitzel University of Nebraska – Lincoln Holland Computing Center (HCC) Home of the 2012 OSG AHM!

OSG Area Coordinators Meeting Security Team Report Mine Altunay 8/15/2012.

March 2014 Open Science Grid Operations A Decade of HTC Infrastructure Support Kyle Gross Operations Support Lead Indiana University / Research Technologies.

OSG Facility Miron Livny OSG Facility Coordinator and PI University of Wisconsin-Madison Open Science Grid Scientific Advisory Group Meeting June 12th.

Open Science Grid Configuring RSV OSG Resource & Service Validation Thomas Wang Grid Operations Center (OSG-GOC) Indiana University.

Why you should care about glexec OSG Site Administrator’s Meeting Written by Igor Sfiligoi Presented by Alain Roy Hint: It’s about security.

1 Open Science Grid Progress & Vision Keith Chadwick, Fermilab

Grid Colombia Workshop with OSG Week 2 Startup Rob Gardner University of Chicago October 26, 2009.

What is OSG? (What does it have to do with Atlas T3s?) What is OSG? (What does it have to do with Atlas T3s?) Dan Fraser OSG Production Coordinator OSG.

CREAM Status and Plans Massimo Sgaravatto – INFN Padova

Presentation transcript:

OSG Area Report Production – Operations – Campus Grids Jan 11, 2011 Dan Fraser

Current Production Focus Transition to RPMs ABCD team continuing to support Software ABCD team continuing to support Software Main RPM packages have been released Main RPM packages have been released Still to come GUMS GUMS Gratia Gratia Restructuring the Documentation for RPMs Restructuring the Documentation for RPMs ease3/WebHome ease3/WebHome Doc Fest Mon-Tues this week

Other Production Items LIGO - Einstein at Home is no longer being supported under the new contract Still some work on LIGO – PULSAR (Britta) Still some work on LIGO – PULSAR (Britta) Britta working until end March Britta working until end March Atlas, CMS, and other VOs steadily moving Major issue involving VOMS-RS/ VOMS-Admin / GUMS Major issue involving VOMS-RS/ VOMS-Admin / GUMS No major RPM issues yet No major RPM issues yet OSG – XSEDE Collaboration Chander is leading this effort Chander is leading this effort

Overall Production

Some Production Issues… Effort from the entire team Transition to BDII v5 – still problems Transition to BDII v5 – still problems Successful Gratia upgrade to new version Successful Gratia upgrade to new version Not sure yet about performance improvements Recent compromise of TTU Recent compromise of TTU Security vulnerabilities w/Apache, OpenSSL Security vulnerabilities w/Apache, OpenSSL …

Campus Grid Status Campus grid working in production: Glow, Diagrid (All Condor campus grids) Glow, Diagrid (All Condor campus grids) Nebraska Nebraska University of Florida (not being used much yet) University of Florida (not being used much yet)Pre-Production: RENCI RENCI Virginia Tech (Bio-tech) Virginia Tech (Bio-tech) r:dhcpseven237.bioinformatics.vt.edu r:dhcpseven237.bioinformatics.vt.edu Virginia Tech (Belle, DayaBay) Virginia Tech (Belle, DayaBay) FIU FIU Discussions with UWashington

Campus Grid Direction Make the factory easier to install / maintain Current factory = flocking + glide-in + BLAH Current factory = flocking + glide-in + BLAH Fewer “assumptions” about the existing environment Fewer “assumptions” about the existing environment Parallel path of using SSH + BLAH Have been working with Condor & CG team Have been working with Condor & CG team BOSCO (Blah over SSH Condor Overlay) BOSCO (Blah over SSH Condor Overlay) New Documentation Focus on end user Focus on end user Manage multiple sites from one submit host (SSH) Manage multiple sites from one submit host (SSH) The hard part is not “technology” but finding / keeping users

Campus Grids Draft Project Plan Release of BOSCO #1Q1 New Documentation for SSH New Documentation for SSH New Docs for SSH + Central Factory New Docs for SSH + Central Factory Testing plan (tbd) Testing plan (tbd) Plan for handling CG accountingQ1 Release of BOSCO #2Q2 RPM package for the VDT RPM package for the VDT Include Centralized Campus Factory Include Centralized Campus Factory Distribution plan Distribution plan