Data Intensive Science Network (DISUN). DISUN Started in May 2005 4 sites: Caltech University of California at San Diego University of Florida University.

Slides:

Advertisements

Similar presentations

Dan Bradley Computer Sciences Department University of Wisconsin-Madison Schedd On The Side.

Advertisements

CHEPREO Tier-3 Center Achievements. FIU Tier-3 Center Tier-3 Centers in the CMS computing model –Primarily employed in support of local CMS physics community.

The Open Science Grid: Bringing the power of the Grid to scientific research

1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.

R. Pordes, I Brazilian LHC Computing Workshop 1 What is Open Science Grid?  High Throughput Distributed Facility  Shared opportunistic access to existing.

US-CMS Meeting (May 19, 2001)Paul Avery1 US-CMS Meeting (UC Riverside) May 19, 2001 Grids for US-CMS and CMS Paul Avery University of Florida

Open Science Grid Frank Würthwein UCSD. 2/13/2006 GGF 2 “Airplane view” of the OSG  High Throughput Computing — Opportunistic scavenging on cheap hardware.

April 2009 OSG Grid School - RDU 1 Open Science Grid John McGee – Renaissance Computing Institute University of North Carolina, Chapel.

Miron Livny Computer Sciences Department University of Wisconsin-Madison From Compute Intensive to Data.

Open Science Ruth Pordes Fermilab, July 17th 2006 What is OSG Where Networking fits Middleware Security Networking & OSG Outline.

SCD FIFE Workshop - GlideinWMS Overview GlideinWMS Overview FIFE Workshop (June 04, 2013) - Parag Mhashilkar Why GlideinWMS? GlideinWMS Architecture Summary.

OSG End User Tools Overview OSG Grid school – March 19, 2009 Marco Mambelli - University of Chicago A brief summary about the system.

Welcome to CW 2007!!!. The Condor Project (Established ‘85) Distributed Computing research performed by.

Open Science Grid Software Stack, Virtual Data Toolkit and Interoperability Activities D. Olson, LBNL for the OSG International.

A. Mohapatra, HEPiX 2013 Ann Arbor1 UW Madison CMS T2 site report D. Bradley, T. Sarangi, S. Dasu, A. Mohapatra HEP Computing Group Outline  Infrastructure.

Key Project Drivers - FY11 Ruth Pordes, June 15th 2010.

Experiment Requirements for Global Infostructure Irwin Gaines FNAL/DOE.

OSG Public Storage and iRODS

INFSO-RI Enabling Grids for E-sciencE The US Federation Miron Livny Computer Sciences Department University of Wisconsin – Madison.

LHC Tier 2 Networking BOF Joe Metzger Joint Techs Vancouver 2005.

1 Open Science Grid.. An introduction Ruth Pordes Fermilab.

Open Science Grid For CI-Days Elizabeth City State University Jan-2008 John McGee – OSG Engagement Manager Manager, Cyberinfrastructure.

OSG Status & Accomplishments Kent Blackburn California Institute of Technology Open Science Grid Joint Oversight Team Meeting February 20th 2007.

SAMGrid as a Stakeholder of FermiGrid Valeria Bartsch Computing Division Fermilab.

Ruth Pordes, Fermilab CD, and A PPDG Coordinator Some Aspects of The Particle Physics Data Grid Collaboratory Pilot (PPDG) and The Grid Physics Network.

Open Science Grid  Consortium of many organizations (multiple disciplines)  Production grid cyberinfrastructure  80+ sites, 25,000+ CPU.

Mar 28, 20071/9 VO Services Project Gabriele Garzoglio The VO Services Project Don Petravick for Gabriele Garzoglio Computing Division, Fermilab ISGC 2007.

10/24/2015OSG at CANS1 Open Science Grid Ruth Pordes Fermilab

14 Aug 08DOE Review John Huth ATLAS Computing at Harvard John Huth.

F Computing at Fermilab Fermilab Onsite Review Stephen Wolbers August 7, 2002.

SouthGrid SouthGrid SouthGrid is a distributed Tier 2 centre, one of four setup in the UK as part of the GridPP project. SouthGrid.

October LHCUSA meeting BNL Bjørn S. Nilsen Update on NSF-ITR Proposal Bjørn S. Nilsen The Ohio State University.

Partnerships & Interoperability - SciDAC Centers, Campus Grids, TeraGrid, EGEE, NorduGrid,DISUN Ruth Pordes Fermilab Open Science Grid Joint Oversight.

Open Science Grid For CI-Days NYSGrid Meeting Sebastien Goasguen, John McGee, OSG Engagement Manager School of Computing.

The Open Science Grid OSG Ruth Pordes Fermilab. 2 What is OSG? A Consortium of people working together to Interface Farms and Storage to a Grid and Researchers.

Open Science Grid Open Science Grid: Beyond the Honeymoon Dane Skow Fermilab September 1, 2005.

OSG Consortium Meeting (January 23, 2006)Paul Avery1 University of Florida Open Science Grid Progress Linking Universities and Laboratories.

ISU DOSAR WORKSHOP Dick Greenwood DOSAR/OSG Statement of Work (SoW) Dick Greenwood Louisiana Tech University April 5, 2007.

Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.

High Energy Physics and Grids at UF (Dec. 13, 2002)Paul Avery1 University of Florida High Energy Physics.

Evolution of a High Performance Computing and Monitoring system onto the GRID for High Energy Experiments T.L. Hsieh, S. Hou, P.K. Teng Academia Sinica,

GLIDEINWMS - PARAG MHASHILKAR Department Meeting, August 07, 2013.

1 Open Science Grid.. An introduction Ruth Pordes Fermilab.

GriPhyN EAC Meeting (Jan. 7, 2002)Paul Avery1 Integration with iVDGL è International Virtual-Data Grid Laboratory  A global Grid laboratory (US, EU, Asia,

OSG Integration Activity Report Rob Gardner Leigh Grundhoefer OSG Technical Meeting UCSD Dec 16, 2004.

6/23/2005 R. GARDNER OSG Baseline Services 1 OSG Baseline Services In my talk I’d like to discuss two questions:  What capabilities are we aiming for.

Open Science Grid & its Security Technical Group ESCC22 Jul 2004 Bob Cowles

Status Organization Overview of Program of Work Education, Training It’s the People who make it happen & make it Work.

U.S. ATLAS Computing Facilities Bruce G. Gibbard GDB Meeting 16 March 2005.

CMS Usage of the Open Science Grid and the US Tier-2 Centers Ajit Mohapatra, University of Wisconsin, Madison (On Behalf of CMS Offline and Computing Projects)

GriPhyN Project Paul Avery, University of Florida, Ian Foster, University of Chicago NSF Grant ITR Research Objectives Significant Results Approach.

June 15, PMG Ruth Pordes Status Report US CMS PMG July 15th Tier-1 –LCG Service Challenge 3 (SC3) –FY05 hardware delivery –UAF support Grid Services.

Doug Benjamin Duke University. 2 ESD/AOD, D 1 PD, D 2 PD - POOL based D 3 PD - flat ntuple Contents defined by physics group(s) - made in official production.

Open Science Grid: Beyond the Honeymoon Dane Skow Fermilab October 25, 2005.

OSG Deployment Preparations Status Dane Skow OSG Council Meeting May 3, 2005 Madison, WI.

Open Science Grid in the U.S. Vicky White, Fermilab U.S. GDB Representative.

Parag Mhashilkar Computing Division, Fermi National Accelerator Laboratory.

April 25, 2006Parag Mhashilkar, Fermilab1 Resource Selection in OSG & SAM-On-The-Fly Parag Mhashilkar Fermi National Accelerator Laboratory Condor Week.

1 Open Science Grid.. An introduction Ruth Pordes Fermilab.

DOE/NSF Quarterly review January 1999 Particle Physics Data Grid Applications David Malon Argonne National Laboratory

1 Open Science Grid: Project Statement & Vision Transform compute and data intensive science through a cross- domain self-managed national distributed.

Summary of OSG Activities by LIGO and LSC LIGO NSF Review November 9-11, 2005 Kent Blackburn LIGO Laboratory California Institute of Technology LIGO DCC:

Ruth Pordes Executive Director University of Washingon Seattle OSG Consortium Meeting 21st August University of Washingon Seattle.

March 2014 Open Science Grid Operations A Decade of HTC Infrastructure Support Kyle Gross Operations Support Lead Indiana University / Research Technologies.

Defining the Technical Roadmap for the NWICG – OSG Ruth Pordes Fermilab.

OSG User Group August 14, Progress since last meeting OSG Users meeting at BNL (Jun 16-17) –Core Discussions on: Workload Management; Security.

NDGF The Distributed Tier1 Site.

Open Science Grid at Condor Week

Grid Laboratory Of Wisconsin (GLOW)

GLOW A Campus Grid within OSG

Presentation transcript:

Data Intensive Science Network (DISUN)

DISUN Started in May sites: Caltech University of California at San Diego University of Florida University of Wisconsin, Madison $1.3M/year for CPU and Disk/ $1.3M/year people - operations, integration and development. Mix of CS and Application staff. Funded jointly by OCI and MPS.

Works with strong cyberinfrastructure efforts at each site Condor GLOW Griphyn iVDGL OSG PPDG UltraLight … and much more.

CMS Physics deliverables DISUN (UFL) installs & validates CMS software at all tier-1, -2, and -3 sites in the US. UCSD: Higgs to gamma gamma bkg UFL: JetMet & SUSY UW: online selection & forward physics Data Hosting for PTDR OSG vs Tier-2 utilization

Support for broad set of science applications Help to run over DISUN-GLOW-OSG sites - GLOW, GADU, CMS, ATLAS, LIGO, SDSS, CDF

As part of the Open Science Grid DISUN co-leads Extensions program in OSG. Provides the testbed infrastructure to prepare new services for inclusion into OSG software stack.

The Grid Landscape DISUN is the multi-site regional grid GLOW is the Campus Grid Open Science Grid is the broader national distributed facility. Resources are shared Development in Condor allows Jobs to be routed to compute nodes on any Grid.

Inter-Grid Scheduling Developed extensions to Schedd- “ on the side ” route GLOW jobs to more than 3 OSG sites in cases where "bare" compute and storage elements are sufficient for CS “ football pool problem ”

Extensions to common technologies Condor scalability, robustness capabilities (condor-c). Integration of storage access Authorzation Integration of OSG Authz for Storage Access. Robust, dynamic, VO software installation for sites.