OSG User Support Update OSG Area Coordinators Call February 12, 2014 Chander Sehgal - FNAL.

Slides:



Advertisements
Similar presentations
Information Technologies Page 1 Information Technologies Page 1 Information Technologies Page 1 Information Technologies Page 1Information Technologies.
Advertisements

OSG Technology Area Brian Bockelman Area Coordinators Meeting November 30, 2011.
Campus Grids & Campus Infrastructures Community Rob Gardner Computation Institute / University of Chicago July 17, 2013.
Dec 14, 20061/10 VO Services Project – Status Report Gabriele Garzoglio VO Services Project WBS Dec 14, 2006 OSG Executive Board Meeting Gabriele Garzoglio.
Overview of Wisconsin Campus Grid Dan Bradley Center for High-Throughput Computing.
Libraries in FE Colleges Capita Library Management System Demonstration May 2013.
Knowledge Management, Texas-style Session 508. Presented by: Belinda Perez Stephanie Moorer Knowledge Management, Texas-Style.
OSG Area Coordinators Meeting Security Team Report Mine Altunay 05/15/2013.
Assessment of Core Services provided to USLHC by OSG.
F Run II Experiments and the Grid Amber Boehnlein Fermilab September 16, 2005.
SCD FIFE Workshop - GlideinWMS Overview GlideinWMS Overview FIFE Workshop (June 04, 2013) - Parag Mhashilkar Why GlideinWMS? GlideinWMS Architecture Summary.
Planning for Success Effective Communications for NGSS Adoption & Implementation Efforts.
OSG Area Coordinators Meeting Operations Rob Quick 2/22/2012.
OSG Area Coordinators Meeting Cross-ProjectArea Report Ruth Pordes 2/8/2011.
Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison.
Research Cyberinfrastructure Alliance Working in partnership to enable computationally intensive, innovative, interdisciplinary research for the 21 st.
Key Project Drivers - FY11 Ruth Pordes, June 15th 2010.
Open Science Grid For CI-Days Internet2: Fall Member Meeting, 2007 John McGee – OSG Engagement Manager Renaissance Computing Institute.
OSG Public Storage and iRODS
OSG Area Coordinators Meeting Operations Rob Quick 2/22/2012.
OSG Area Coordinators Meeting Security Team Report Mine Altunay 12/21/2011.
Open Science Grid For CI-Days Elizabeth City State University Jan-2008 John McGee – OSG Engagement Manager Manager, Cyberinfrastructure.
May 8, 20071/15 VO Services Project – Status Report Gabriele Garzoglio VO Services Project – Status Report Overview and Plans May 8, 2007 Computing Division,
CHEP'07 September D0 data reprocessing on OSG Authors Andrew Baranovski (Fermilab) for B. Abbot, M. Diesburg, G. Garzoglio, T. Kurca, P. Mhashilkar.
Apr 30, 20081/11 VO Services Project – Stakeholders’ Meeting Gabriele Garzoglio VO Services Project Stakeholders’ Meeting Apr 30, 2008 Gabriele Garzoglio.
Use of Condor on the Open Science Grid Chris Green, OSG User Group / FNAL Condor Week, April
Organisation Management and Policy Group (MPG): Responsible for setting and policy decisions and resolving any issues concerning fractional usage, acceptable.
OSG Area Coordinators Meeting Proposal Chander Sehgal Fermilab
Discussion Topics DOE Program Managers and OSG Executive Team 2 nd June 2011 Associate Executive Director Currently planning for FY12 XD XSEDE Starting.
OSG Project Manager Report for OSG Council Meeting OSG Project Manager Report for OSG Council Meeting October 14, 2008 Chander Sehgal.
Evolution of the Open Science Grid Authentication Model Kevin Hill Fermilab OSG Security Team.
Production Coordination Staff Retreat July 21, 2010 Dan Fraser – Production Coordinator.
OSG Finance Board 26 April 2007 Paul Avery Kent Blackburn Chander Sehgal.
A Community Information Management System by Pangea Foundation.
OSG Area Coordinators Meeting Security Team Report Mine Altunay 8/15/2012.
OSG Production Report OSG Area Coordinator’s Meeting Aug 12, 2010 Dan Fraser.
OSG Area Coordinator’s Report: Workload Management Maxim Potekhin BNL
February 27, 2007 University Information Technology Services Research Computing Craig A. Stewart Associate Vice President, Research Computing Chief Operating.
Biomedical and Bioscience Gateway to National Cyberinfrastructure John McGee Renaissance Computing Institute
Open Science Grid (OSG) Introduction for the Ohio Supercomputer Center Open Science Grid (OSG) Introduction for the Ohio Supercomputer Center February.
GLIDEINWMS - PARAG MHASHILKAR Department Meeting, August 07, 2013.
Segment 6: Provider Communication California ICD-10 Site Visit Training segments to assist the State of California with the ICD-10 Implementation June.
9 Oct Overview Resource & Project Management Current Initiatives  Generate SOWs  8 written and 6 remain;  drafts will be complete next week 
Production Coordination Area VO Meeting Feb 11, 2009 Dan Fraser – Production Coordinator.
OSG Project Manager Report for OSG Council Meeting OSG Project Manager Report for OSG Council Meeting May 12, 2009 Chander Sehgal.
Production Oct 31, 2012 Dan Fraser. Current Production Focus Transition to RPMs 52(44) sites using RPM based installs 52(44) sites using RPM based installs.
Department of Energy Office of Science  FY 2007 Request for Office of Science is 14% above FY 2006 Appropriation  FY 2007 Request for HEP is 8% above.
OSG Area Report Production – Operations – Campus Grids Jan 11, 2011 Dan Fraser.
CMS Usage of the Open Science Grid and the US Tier-2 Centers Ajit Mohapatra, University of Wisconsin, Madison (On Behalf of CMS Offline and Computing Projects)
State of Georgia Release Management Training
Open Science Grid as XSEDE Service Provider Open Science Grid as XSEDE Service Provider December 4, 2011 Chander Sehgal OSG User Support.
Eileen Berman. Condor in the Fermilab Grid FacilitiesApril 30, 2008  Fermi National Accelerator Laboratory is a high energy physics laboratory outside.
Sep 25, 20071/5 Grid Services Activities on Security Gabriele Garzoglio Grid Services Activities on Security Gabriele Garzoglio Computing Division, Fermilab.
OSG Area Coordinator’s Report: Workload Management Maxim Potekhin BNL May 8 th, 2008.
Parag Mhashilkar Computing Division, Fermi National Accelerator Laboratory.
For Presentation at 28 th APEC Transportation Working Group Meeting Vancouver, Canada Walter Kulyk Director, Office of Mobility Innovation Federal Transit.
OSG Area Report Production – Operations – Campus Grids June 19, 2012 Dan Fraser Rob Quick.
WLCG Status Report Ian Bird Austrian Tier 2 Workshop 22 nd June, 2010.
Campus Grid Technology Derek Weitzel University of Nebraska – Lincoln Holland Computing Center (HCC) Home of the 2012 OSG AHM!
Fabric for Frontier Experiments at Fermilab Gabriele Garzoglio Grid and Cloud Services Department, Scientific Computing Division, Fermilab ISGC – Thu,
Building on virtualization capabilities for ExTENCI Carol Song and Preston Smith Rosen Center for Advanced Computing Purdue University ExTENCI Kickoff.
Presented by Washington State Administrative Office of the Courts New JIS Development Overview AOC ISD Staff June 10, 2004.
March 2014 Open Science Grid Operations A Decade of HTC Infrastructure Support Kyle Gross Operations Support Lead Indiana University / Research Technologies.
OSG Facility Miron Livny OSG Facility Coordinator and PI University of Wisconsin-Madison Open Science Grid Scientific Advisory Group Meeting June 12th.
OSG Production Foundations for 2M+ Hours/Day April 9, 2014 Rob Quick With Help from Shawn McKee and Chander Seghal.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Engagement meeting Gergely Sipos EGI.eu 1.
OSG User Support OSG User Support March 13, 2013 Chander Sehgal
OSG User Group August 14, Progress since last meeting OSG Users meeting at BNL (Jun 16-17) –Core Discussions on: Workload Management; Security.
Gene Oleynik, Head of Data Storage and Caching,
WMS Options: DIRAC and GlideIN-WMS
Presentation transcript:

OSG User Support Update OSG Area Coordinators Call February 12, 2014 Chander Sehgal - FNAL

Feb 12, Overall Opportunistic Usage Last 12 months The trailing 12 month cumulative usage is growing at the rate of 1M hours per week

Feb 12, Researcher Enabled in last 12 months OSG-XD Project NamePIUniversityScience DomainHours TG-ATM130009Phillip AndersonUniversity of Texas at DallasAtmospheric Sciences46,028 TG-ATM130015Phillip AndersonUniversity of Texas at DallasAtmospheric Sciences77,168 TG-OCE130029Yvonne ChanUniversity of Hawaii, ManoaOcean Sciences21,493 TG-IRI130016Joseph CohenUniversity of Massachusetts, BostonInformation, Robotics, and Intelligent Systems70,536 TG-MCB100109Lillian ChongUniversity of PittsburghMolecular Biosciences264,362 TG-CCR120041Luca ClementiSan Diego Supercomputer CenterComputer and Computation Research12 TG-DMR130036Emanuel GullUniversity of MichiganMaterials Research212,059 TG-DMR120085Emanuel GullUniversity of MichiganCondensed Matter Physics60,624 TG-MCB090163Michael HaganBrandeis UniversityBiophysics33,785 TG-MCB120070Joseph HargitaiAlbert Einstein College of MedicineMolecular Biosciences39 TG-MCB090174Shantenu JhaRutgers, the State University of New JerseyMolecular Biosciences127 TG-IBN130001Donald KriegerUniversity of PittsburghIntegrative Biology and Neuroscience24,338,299 TG-CHE130103Jeremy MoixMassachusetts Institute of TechnologyChemistry48,768 TG-PHY110015Pran NathNortheastern UniversityPhysics303,931 TG-DMS120024Benjamin OngMichigan State UniversityMathematical Sciences68,907 TG-MCB130072Robert QuickIndiana UniversityMolecular Biosciences15 TG-TRA100004Andrew RuetherSwarthmore CollegeTraining444,374 TG-IBN130008Jorden SchossauMichigan State UniversityIntegrative Biology and Neuroscience9,042 TG-PHY120014Qaisar ShafiUniversity of DelawarePhysics525,616 TG-CHE130091Paul SidersUniversity of Minnesota, DuluthChemistry80,325 TG-STA110014SNancy Wilkins-DiehrUniversity of California-San DiegoCenter Systems Staff5 TG-STA120004XD StaffVariousTesting & Integration14 TG-TRA120041Hanning ChenGeorge Washington UniversityComputer and Information Science and Engineering230 OSG-XD Total26,605,770

Feb 12, Researcher Enabled in last 12 months OSG-Direct Project NamePIUniversityScience DomainHours Duke-QGPSteffen A. BassDuke UniversityNuclear Physics2,399,539 SPLINTERRobert QuickIndiana University School of MedicineMedicine3,979,535 IU-GALAXYRobert QuickIndiana UniversityBioinformatics200,377 RITAlexander ArlangeRochester Institute of TechnologyRamsey Numbers R(C4,Km)764,216 SnowmassMeenakshi NarainBrown UniversityLPC group9,972,492 ECFAMeenakshi NarainBrown University/LPC groupParticle Physics1,744,646 SNOplusJoshua R KleinUniversity of PennsylvaniaPhysics - Neutrino488 detectorDesignJohn StrologasUniversity of New MexicoMedical Imaging444,403 BNLPETMartin PurschkeBrookhaven National LabBiomedical Imaging22,453 UMichPaul WolbergUniversity of MichiganMicrobiology1,056,952 EICThomas UllrichBrookhaven National LabParticle Physics410,593 UPRRP-MRSteven MasseyUniversidad de Puerto Rico, Rio Piedras Campus (UPRRP)Bioinformatics609,433 DeerDiseaseLene Jung KjaerSouthern Illinois UniversityBiological Sciences11,692 PhenoStefan HoecheSLACHigh Energy Physics367,660 Unknown 4 OSG-Direct Total21,984,490

Feb 12, Key Initiatives 1.Effective service delivery for XSEDE Users of OSG – proceeding well 2.Enabling new researchers, who contact OSG directly, to access DHTC – proceeding OK (need more customers – must cultivate new channels) 3.Engage VO at RENCI is wrapping up; we must transition all the users to either OSG-XD or OSG-Connect/Duke-Connect – proceeding well 4.Working with LBNE to enable MC simulations on multiple OSG sites – just started (similar to work done for SNOWMASS; but there are many stakeholders who want to influence the technical plan) 5.More opportunistic access; develop a plan for 2014 to increase sites and cycles accessible to the osg vo by 50% – new initiative (and a big concern since we have very few tools that provide visibility into usage and issues)

Feb 12, Top Concerns 1.How do we identify more researchers who can benefit from access to OSG DHTC ? *** a priority *** 2.We continue to struggle with inadequate tools for understanding production for our front-end using the Glide-in WMS system; schedule & status of requests to glideinWMS project is unknown 3.Need to develop a plan for site support – especially as we understand the division of effort between gFactory operations and related site support 4.User Support workload has increased to the point that we are now feeling the pain of not having the 0.5FTE planned in the Nebraska SOW for User Support

Feb 12, Other Work Items 1.Work with Gratia to develop a report that shows all OSG VO usage broken down by submit host (recall we have many host flocking into OSG) – need a complete picture of work done (batch_pilot) via this framework OSG-Connect flocking Duke-Connect flocking iPlant flocking VT flocking SAGA flocking Bakerlab flocking 2.Transition UCSD from Engage VO  OSG VO 3.Review Intensity Frontier Data Handling plan and provide inputs for FIFE on how to improve and leverage other OSG initiatives

Feb 12, Recent Accomplishments 1.With assistance from glideinWMS project, we audited the configuration of the OSG-XD frontend – no major issues identified but some fine tuning done 2.OSG-VO access to opportunistic resources appears to have broken thru the 12K cores barrier; recently achieved >18K cores – a couple of days with over 450K hours (unfortunately we can’t explain why we were stuck at 12K cores and what broke the log-jam) 3.Continued to operate the OSG Public storage service (based on iRODs) for the benefit of the OSG VO community; planning to move this services to be hosted at GOC.

Feb 12, User Support Team NameInstitution%FTE Mats RyngeISI50% Marko SlyzFNAL60% Tanya LevshinaFNAL25% Alex ZaytsevBNL10% Chander SehgalFNAL40%