Integration and Sites Rob Gardner Area Coordinators Meeting 12/4/08.

Slides:



Advertisements
Similar presentations
 Contributing >30% of throughput to ATLAS and CMS in Worldwide LHC Computing Grid  Reliant on production and advanced networking from ESNET, LHCNET and.
Advertisements

Technology Steering Group January 31, 2007 Academic Affairs Technology Steering Group February 13, 2008.
EGI-Engage Recent Experiences in Operational Security: Incident prevention and incident handling in the EGI and WLCG infrastructure.
LCG Milestones for Deployment, Fabric, & Grid Technology Ian Bird LCG Deployment Area Manager PEB 3-Dec-2002.
OSG End User Tools Overview OSG Grid school – March 19, 2009 Marco Mambelli - University of Chicago A brief summary about the system.
Open Science Grid Software Stack, Virtual Data Toolkit and Interoperability Activities D. Olson, LBNL for the OSG International.
Track 1: Cluster and Grid Computing NBCR Summer Institute Session 2.2: Cluster and Grid Computing: Case studies Condor introduction August 9, 2006 Nadya.
Key Project Drivers - FY11 Ruth Pordes, June 15th 2010.
PCGRID ‘08 Workshop, Miami, FL April 18, 2008 Preston Smith Implementing an Industrial-Strength Academic Cyberinfrastructure at Purdue University.
OSG Operations and Interoperations Rob Quick Open Science Grid Operations Center - Indiana University EGEE Operations Meeting Stockholm, Sweden - 14 June.
OSG Services at Tier2 Centers Rob Gardner University of Chicago WLCG Tier2 Workshop CERN June 12-14, 2006.
Integration Program Update Rob Gardner US ATLAS Tier 3 Workshop OSG All LIGO.
OSG Middleware Roadmap Rob Gardner University of Chicago OSG / EGEE Operations Workshop CERN June 19-20, 2006.
EGEE is a project funded by the European Union under contract IST Testing processes Leanne Guy Testing activity manager JRA1 All hands meeting,
Network and Transfer WG Metrics Area Meeting Shawn McKee, Marian Babik Network and Transfer Metrics Kick-off Meeting 26 h November 2014.
G RID M IDDLEWARE AND S ECURITY Suchandra Thapa Computation Institute University of Chicago.
Apr 30, 20081/11 VO Services Project – Stakeholders’ Meeting Gabriele Garzoglio VO Services Project Stakeholders’ Meeting Apr 30, 2008 Gabriele Garzoglio.
Report on the state of OSG Software Alain Roy. OSG Year 6 Planning, July 2011 Points to discuss 1.State of RPM transition 2.State of last scheduled Pacman.
ITB Release Process Suchandra Thapa Computation Institute / University of Chicago.
OSG Software and Operations Plans Rob Quick OSG Operations Coordinator Alain Roy OSG Software Coordinator.
Storage, Networks, Data Management Report on Parallel Session OSG Meet 8/2006 Frank Würthwein (UCSD)
OSG Tier 3 support Marco Mambelli - OSG Tier 3 Dan Fraser - OSG Tier 3 liaison Tanya Levshina - OSG.
OSG Technology Area Brian Bockelman Area Coordinator’s Meeting February 15, 2012.
Grid Operations Lessons Learned Rob Quick Open Science Grid Operations Center - Indiana University.
HEPiX FNAL ‘02 25 th Oct 2002 Alan Silverman HEPiX Large Cluster SIG Report Alan Silverman 25 th October 2002 HEPiX 2002, FNAL.
Microsoft Management Seminar Series SMS 2003 Change Management.
Grid Deployment Board – 10 February GD LCG Workshop Goals Give overview where we are Stimulate cooperation between the centres Improve the communication.
US LHC OSG Technology Roadmap May 4-5th, 2005 Welcome. Thank you to Deirdre for the arrangements.
OSG Integration Activity Report Rob Gardner Leigh Grundhoefer OSG Technical Meeting UCSD Dec 16, 2004.
6/23/2005 R. GARDNER OSG Baseline Services 1 OSG Baseline Services In my talk I’d like to discuss two questions:  What capabilities are we aiming for.
Site Validation Session Report Co-Chairs: Piotr Nyczyk, CERN IT/GD Leigh Grundhoefer, IU / OSG Notes from Judy Novak WLCG-OSG-EGEE Workshop CERN, June.
Status Organization Overview of Program of Work Education, Training It’s the People who make it happen & make it Work.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Using GStat 2.0 for Information Validation.
Report from the WLCG Operations and Tools TEG Maria Girone / CERN & Jeff Templon / NIKHEF WLCG Workshop, 19 th May 2012.
The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana.
Jan 2010 OSG Update Grid Deployment Board, Feb 10 th 2010 Now having daily attendance at the WLCG daily operations meeting. Helping in ensuring tickets.
System/SDWG Update Management Council Face-to-Face Flagstaff, AZ August 22-23, 2011 Sean Hardman.
Doug Benjamin Duke University. 2 ESD/AOD, D 1 PD, D 2 PD - POOL based D 3 PD - flat ntuple Contents defined by physics group(s) - made in official production.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI Accessing Cloud Systems from WS-PGRADE/gUSE Zoltán Farkas MTA SZTAKI LPDS.
Eileen Berman. Condor in the Fermilab Grid FacilitiesApril 30, 2008  Fermi National Accelerator Laboratory is a high energy physics laboratory outside.
Summary from WP 1 Parallel Section Massimo Sgaravatto INFN Padova.
Sep 25, 20071/5 Grid Services Activities on Security Gabriele Garzoglio Grid Services Activities on Security Gabriele Garzoglio Computing Division, Fermilab.
OSG Area Coordinator’s Report: Workload Management Maxim Potekhin BNL May 8 th, 2008.
LCG Accounting Update John Gordon, CCLRC-RAL WLCG Workshop, CERN 24/1/2007 LCG.
April 25, 2006Parag Mhashilkar, Fermilab1 Resource Selection in OSG & SAM-On-The-Fly Parag Mhashilkar Fermi National Accelerator Laboratory Condor Week.
Enabling Grids for E-sciencE INFSO-RI Enabling Grids for E-sciencE Gavin McCance GDB – 6 June 2007 FTS 2.0 deployment and testing.
Area Coordinator Report for Operations Rob Quick 4/10/2008.
Sep 17, 20081/16 VO Services Project – Stakeholders’ Meeting Gabriele Garzoglio VO Services Project Stakeholders’ Meeting Sep 17, 2008 Gabriele Garzoglio.
VOX Project Status T. Levshina. 5/7/2003LCG SEC meetings2 Goals, team and collaborators Purpose: To facilitate the remote participation of US based physicists.
Tier 3 Support and the OSG US ATLAS Tier2/Tier3 Workshop at UChicago August 20, 2009 Marco Mambelli –
Opensciencegrid.org Operations Interfaces and Interactions Rob Quick, Indiana University July 21, 2005.
RI EGI-TF 2010, Tutorial Managing an EGEE/EGI Virtual Organisation (VO) with EDGES bridged Desktop Resources Tutorial Robert Lovas, MTA SZTAKI.
Integration TestBed (iTB) and Operations Provisioning Leigh Grundhoefer.
The Great Migration: From Pacman to RPMs Alain Roy OSG Software Coordinator.
OSG Status and Rob Gardner University of Chicago US ATLAS Tier2 Meeting Harvard University, August 17-18, 2006.
Monitoring and Information Services Core Infrastructure (MIS-CI) Service Description Mark L. Green OSG Integration Workshop at UC Feb 15-17, 2005.
Joe Foster 1 Two questions about datasets: –How do you find datasets with the processes, cuts, conditions you need for your analysis? –How do.
Building on virtualization capabilities for ExTENCI Carol Song and Preston Smith Rosen Center for Advanced Computing Purdue University ExTENCI Kickoff.
April 18, 2006FermiGrid Project1 FermiGrid Project Status April 18, 2006 Keith Chadwick.
OSG Facility Miron Livny OSG Facility Coordinator and PI University of Wisconsin-Madison Open Science Grid Scientific Advisory Group Meeting June 12th.
Open Science Grid Configuring RSV OSG Resource & Service Validation Thomas Wang Grid Operations Center (OSG-GOC) Indiana University.
GridCat ITB Service Integration Plan Bockjoo Kim OSG Integration Workshop at UC Feb 15-17, 2005.
Grid Colombia Workshop with OSG Week 2 Startup Rob Gardner University of Chicago October 26, 2009.
OSG User Group August 14, Progress since last meeting OSG Users meeting at BNL (Jun 16-17) –Core Discussions on: Workload Management; Security.
Panda Monitoring, Job Information, Performance Collection Kaushik De (UT Arlington), Torre Wenaus (BNL) OSG All Hands Consortium Meeting March 3, 2008.
Software Tools Group & Release Process Alain Roy Mine Altunay.
Operations Coordination Team Maria Girone, CERN IT-ES GDB, 11 July 2012.
Leigh Grundhoefer Indiana University
Pierre Girard ATLAS Visit
OU BATTLECARD: WebLogic Server 12c
Presentation transcript:

Integration and Sites Rob Gardner Area Coordinators Meeting 12/4/08

From the Year 3 plan Three initiative areas 1.Speed and ease the release process for OSG software components and services 2.Improvements to OSG configuration programs configure-osg.py + config.ini Evaluation of config management solutions 3.Community building and site effectiveness Investigation and provisioning of community building tools and services for OSG site administrators. Extensions beyond the OSG twiki for info exchange, best practices Reviewing RSV monitoring data 2

Current Initiatives VTB, ITB testing, release testing Synthetic workload system for ITB testing Community Documentation alignment focus 3

Deployment Progress 4 7/08 12/08

Near term ITB DateTask Dec. 7, 2008VDT ready for testing Dec. 7-14, 2008Install on VTB sites Dec , 2008Install on VTB sites Dec Install on ITB sites Dec. 22- Jan 9Test on ITB sites Jan. 9 - Jan 23VO Validation Jan 23 - Jan 30Production packaging and final check Jan 30Release 5 ITB being managed by Suchandra Thapa Near term focus is on the ‘big’ VDT upgrade

VTB/ITB work at LBL (Jeff Porter) Two VTB sites managed at LBL and ready for VTB testing (1 SG3 and 1 PBS). Also testing against GIP test cache Will configure for MPI to test CEMon changes. Ready now (with MPI - Dec 12) 1 ITB site (w/ condor). Also configured to point at gip-test cache but can be ready for ITB cycle within a day. Ready by Dec 11 1 SRM Bestman SE that both ITB and my VTB are configured to use. Update by Dec GUMS server with current version of GUMS Ready now 1 GUMS server prepared for new version of GUMS (machine is ready waiting for software cache) 6

More ITB ITB versioning – Suchandra working with Alain on a RFC for software tools mailing list – In agreement about future changes – OSG versions should be incremented in lockstep with VDT releases – Probably something like OSG 1.x.y based on VDT 1.w.z ITB status (‘persistent’ sites) – UC_ITB is set for production by Friday. GIP testing currently ongoing – FNAL_ITB is up and operational – BNL_ITB ready by next Thursday Caltech coming back into ITB – Robert Engle (0.5 FTE) – Currently setting up 15 server test cluster 7

Synthetic Workload Validation What: – Simple system to populate ITB sites with computational task and other functional tests – Message reporting system to track job states & users – Database backend populated with messages passed from job submission pilots and job- wrappers (‘pilots’) – Web front-end for viewing validation progress Status: – Basic infrastructure in place – testing at UC, LBL – UC student working on web front-end, database schema – Hope to have this in place for ITB Suchandra Thapa Robert Veitch

Community Building I OSG Integration chat cloud – Persistent; transcripts; nice handling of text – Just getting started (7 OSG accounts so far) – Useful for group troubleshooting sessions – Added links to Release Documenation, Integration, Sites twiki’s 9

Community Building II Facebook group created recently to help build social OSG network 10

Community Building III Phone meetings – People don’t want to meet too frequently – once per month at max – Prefer ‘pedagogical’ meetings – a technical feature Workshop – SLAC meeting – One day of overview & instructional presentations; second day of technical tracks, hands-on – 36 registered participants – Topics covered by ‘faculty’ drawn from OSG Fundamentals, Security, Storage (dCache and Bestman-xootd) Networking, Advanced topics (in RSV, high availability, etc.) Workshop – All Hands (March 09) – Shorter presentations (lightning overviews) leading directly into parallel technical breakouts 11

Scenes from SLAC 12

Documentation Alignment Initiative Have been asked to look into aligning various OSG documents Primarily the twiki-based documents targeted for OSG site admins (twiki.ReleaseDocumentation), Grid schools, and Users. Reuse of expert materials Improve ‘how-to’s aspect Ways of getting input from users of the documents to encourage more participation (eg. adding comments) Will get started on this shortly 13