Production Oct 31, 2012 Dan Fraser. Current Production Focus Transition to RPMs 52(44) sites using RPM based installs 52(44) sites using RPM based installs.

Slides:

Advertisements

Similar presentations

Campus Grids & Campus Infrastructures Community Rob Gardner Computation Institute / University of Chicago July 17, 2013.

Advertisements

Bosco: Enabling Researchers to Expand Their HTC Resources The Bosco Team: Dan Fraser, Jaime Frey, Brooklin Gore, Marco Mambelli, Alain Roy, Todd Tannenbaum,

Campus High Throughput Computing (HTC) Infrastructures (aka Campus Grids) Dan Fraser OSG Production Coordinator Campus Grids Lead.

1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.

Financial Upgrade 8.8 Update. Status Fit Gap Complete Fit Gap Complete Design in Progress Design in Progress Development in Progress Development in Progress.

Deployment and Configuration Management Solution

System Design/Implementation and Support for Build 2 PDS Management Council Face-to-Face Mountain View, CA Nov 30 - Dec 1, 2011 Sean Hardman.

F Run II Experiments and the Grid Amber Boehnlein Fermilab September 16, 2005.

OSG Area Coordinators Meeting Operations Rob Quick 2/22/2012.

Framework for Automated Builds Natalia Ratnikova CHEP’03.

All Experimenters Meetings Windows 7 Migration 1 April 18, 2011 W7 AEM Presentation.

Open Science Grid Software Stack, Virtual Data Toolkit and Interoperability Activities D. Olson, LBNL for the OSG International.

Key Project Drivers - FY11 Ruth Pordes, June 15th 2010.

OSG Area Coordinators Campus Infrastructures Update Dan Fraser Miha Ahronovitz, Jaime Frey, Rob Gardner, Brooklin Gore, Marco Mambelli, Todd Tannenbaum,

OSG Area Coordinators Meeting Operations Rob Quick 2/22/2012.

OSG Operations and Interoperations Rob Quick Open Science Grid Operations Center - Indiana University EGEE Operations Meeting Stockholm, Sweden - 14 June.

OSG Site Provide one or more of the following capabilities: – access to local computational resources using a batch queue – interactive access to local.

Integration and Sites Rob Gardner Area Coordinators Meeting 12/4/08.

1 1 Vulnerability Assessment of Grid Software Jim Kupsch Associate Researcher, Dept. of Computer Sciences University of Wisconsin-Madison Condor Week 2006.

Campus Grids Report OSG Area Coordinator’s Meeting Dec 15, 2010 Dan Fraser (Derek Weitzel, Brian Bockelman)

May 8, 20071/15 VO Services Project – Status Report Gabriele Garzoglio VO Services Project – Status Report Overview and Plans May 8, 2007 Computing Division,

Apr 30, 20081/11 VO Services Project – Stakeholders’ Meeting Gabriele Garzoglio VO Services Project Stakeholders’ Meeting Apr 30, 2008 Gabriele Garzoglio.

Grid Status - PPDG / Magda / pacman Torre Wenaus BNL U.S. ATLAS Physics and Computing Advisory Panel Review Argonne National Laboratory Oct 30, 2001.

Mar 28, 20071/9 VO Services Project Gabriele Garzoglio The VO Services Project Don Petravick for Gabriele Garzoglio Computing Division, Fermilab ISGC 2007.

Evolution of the Open Science Grid Authentication Model Kevin Hill Fermilab OSG Security Team.

Production Coordination Staff Retreat July 21, 2010 Dan Fraser – Production Coordinator.

05/29/2002Flavia Donno, INFN-Pisa1 Packaging and distribution issues Flavia Donno, INFN-Pisa EDG/WP8 EDT/WP4 joint meeting, 29 May 2002.

OSG Area Coordinators Meeting Security Team Report Mine Altunay 8/15/2012.

OSG Production Report OSG Area Coordinator’s Meeting Aug 12, 2010 Dan Fraser.

OSG PKI Transition: Transition Phase Report Von Welch OSG PKI Transition Lead Indiana University Center for Applied Cybersecurity Research.

20/09/2006LCG AA 2006 Review1 Committee feedback to SPI.

Grid Operations Lessons Learned Rob Quick Open Science Grid Operations Center - Indiana University.

GRID Zhen Xie, INFN-Pisa, on DataGrid WP6 meeting1 Globus Installation Toolkit Zhen Xie On behalf of grid-release team INFN-Pisa.

Grid User Interface for ATLAS & LHCb A more recent UK mini production used input data stored on RAL’s tape server, the requirements in JDL and the IC Resource.

US LHC OSG Technology Roadmap May 4-5th, 2005 Welcome. Thank you to Deirdre for the arrangements.

OSG Production Report OSG Area Coordinator’s Meeting Nov 17, 2010 Dan Fraser.

Open Science Grid (OSG) Introduction for the Ohio Supercomputer Center Open Science Grid (OSG) Introduction for the Ohio Supercomputer Center February.

6/23/2005 R. GARDNER OSG Baseline Services 1 OSG Baseline Services In my talk I’d like to discuss two questions:  What capabilities are we aiming for.

Production Coordination Area VO Meeting Feb 11, 2009 Dan Fraser – Production Coordinator.

Status Organization Overview of Program of Work Education, Training It’s the People who make it happen & make it Work.

Report from the WLCG Operations and Tools TEG Maria Girone / CERN & Jeff Templon / NIKHEF WLCG Workshop, 19 th May 2012.

Top 10 Reasons to Upgrade to OSG Version Rob Quick OSG Operations Coordinator.

The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana.

System/SDWG Update Management Council Face-to-Face Flagstaff, AZ August 22-23, 2011 Sean Hardman.

OSG Area Report Production – Operations – Campus Grids Jan 11, 2011 Dan Fraser.

Auditing Project Architecture VERY HIGH LEVEL Tanya Levshina.

CMS Usage of the Open Science Grid and the US Tier-2 Centers Ajit Mohapatra, University of Wisconsin, Madison (On Behalf of CMS Offline and Computing Projects)

David Foster LCG Project 12-March-02 Fabric Automation The Challenge of LHC Scale Fabrics LHC Computing Grid Workshop David Foster 12 th March 2002.

OSG Deployment Preparations Status Dane Skow OSG Council Meeting May 3, 2005 Madison, WI.

Grid Status - PPDG / Magda / pacman Torre Wenaus BNL DOE/NSF Review of US LHC Software and Computing Fermilab Nov 29, 2001.

EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks MSA3.4.1 “The process document” Oliver Keeble.

OSG Area Report Production – Operations – Campus Grids June 19, 2012 Dan Fraser Rob Quick.

LCG Pilot Jobs + glexec John Gordon, STFC-RAL GDB 7 December 2007.

Integration TestBed (iTB) and Operations Provisioning Leigh Grundhoefer.

Campus Grid Technology Derek Weitzel University of Nebraska – Lincoln Holland Computing Center (HCC) Home of the 2012 OSG AHM!

Grid Deployment Technical Working Groups: Middleware selection AAA,security Resource scheduling Operations User Support GDB Grid Deployment Resource planning,

OSG Area Coordinators Meeting Security Team Report Mine Altunay 8/15/2012.

OSG Facility Miron Livny OSG Facility Coordinator and PI University of Wisconsin-Madison Open Science Grid Scientific Advisory Group Meeting June 12th.

Certificate Security For Users Obtaining and Using Your Personal Certificate using the OSG PKI Kyle Gross – OSG Operations Support Lead Elizabeth Prout.

Open Science Grid Configuring RSV OSG Resource & Service Validation Thomas Wang Grid Operations Center (OSG-GOC) Indiana University.

Grid Colombia Workshop with OSG Week 2 Startup Rob Gardner University of Chicago October 26, 2009.

Regional Operations Centres Core infrastructure Centres

EGEE Middleware Activities Overview

Open Science Grid Progress and Status

Overview – SOE PatchTT November 2015.

CREAM Status and Plans Massimo Sgaravatto – INFN Padova

Readiness of ATLAS Computing - A personal view

Technical Support for QuickBooks Enterprise Solutions In May 2002, Intuit Inc launched QuickBooks Enterprise – a brilliant accounting application. The.

Leigh Grundhoefer Indiana University

Adding Computational Resources to SURAgrid (the document) September 27, 2007 Mary Trauner SURA Consultant.

Presentation transcript:

Production Oct 31, 2012 Dan Fraser

Current Production Focus Transition to RPMs 52(44) sites using RPM based installs 52(44) sites using RPM based installs 49(59) sites still using Pacman install 49(59) sites still using Pacman install All the main RPMs have been released All the main RPMs have been released Incl. Gums and Gratia Still working on a few issues / bugs Still working on a few issues / bugs No more Blocker Bugs Plan to phase out Pacman by mid next year Plan to phase out Pacman by mid next year BCDT bringing Tim up to speed BCDT bringing Tim up to speed Tim is doing a good job of jumping in

Overall Production

Some Production Issues… Effort from the entire team New root vulnerabilities in Condor New root vulnerabilities in Condor Procedure for handling CA releases w/o manual intervention Procedure for handling CA releases w/o manual intervention New critical bug in certain Condor configurations New critical bug in certain Condor configurations Encouraging sites to upgrade to OSG1.25+ Encouraging sites to upgrade to OSG1.25+ Critical bug in condor SE-only publishing issue SE-only publishing issue GRAM-5 production issues settling down (memory leaks, scaling, etc.) GRAM-5 production issues settling down (memory leaks, scaling, etc.) CA updates no longer automated by OSG (RPM) CA updates no longer automated by OSG (RPM) GUMS-Voms compatibility with CERN (progress ongoing) GUMS-Voms compatibility with CERN (progress ongoing) …

Production Challenges New monitoring tools suitable for a glide-in based system. Working with Ashu to define and visualize new tools. Working with Ashu to define and visualize new tools. How “autonomous” are the sites? Now that we promise security through a central glide-in system Now that we promise security through a central glide-in system What is OSG’s policy on encouraging sites to upgrade? What is OSG’s policy on encouraging sites to upgrade?

Campus Grid Status Campus grid working in production: Glow, Diagrid (All Condor campus grids) Glow, Diagrid (All Condor campus grids) Nebraska Nebraska University of Florida (not used much) University of Florida (not used much) UC3 (testing the latest Campus Grid Release) UC3 (testing the latest Campus Grid Release)Pre-Production/testing: RENCI RENCI Virginia Tech (Bio-tech) Virginia Tech (Bio-tech) r:dhcpseven237.bioinformatics.vt.edu r:dhcpseven237.bioinformatics.vt.edu Virginia Tech (Belle, DayaBay) Virginia Tech (Belle, DayaBay) FIU FIU

Launching the Campus Infrastructure Center Center where researchers can learn about and adopt campus technologies. Led by Rob Gardner Led by Rob Gardner First meeting planned for November UC Santa Cruz UC Santa Cruz

Campus Grids Project Plan ructureProjectPlan Pushing toward BOSCO V1.1 Target for November Target for November Multi-user capability File transfer over SSH Use multiple OS’s Included Documentation and usability testing. Included Documentation and usability testing. Offered to two users (Uwash not a Bosco candidate but is a campus grid candidate via flocking, Pegasus team tested successfully) Features needed for v1.2 (quick releases): Accounting (integrated probe) Accounting (integrated probe)

Campus Grid Issues Need more interest in adopting Bosco Plan to widen distribution when Bosco is solid Plan to widen distribution when Bosco is solid Condor users mailing list is proposed target Use OIM for campus map Campus registration is in OIM Campus registration is in OIM New Issue with Campus Factory