Extreme Scalability RAT Report title=RATs#Extreme_Scalability Sergiu Sanielevici,

Slides:



Advertisements
Similar presentations
Program Management Office (PMO) Design
Advertisements

TeraGrid Quarterly Meeting Dec 6-7, 2007 DVS GIG Project Year 4&5 Project List Kelly Gaither, DVS Area Director.
1 How will TG support users of DataNet and other NSF CI programs? Sergiu Sanielevici TG QM 9/18/2008 New Orleans.
Common User Environments Working Group Shawn T. Brown, PSC CUE Working Group Lead TeraGrid Annual Review 04/7/
Joint CASC/CCI Workshop Report Strategic and Tactical Recommendations EDUCAUSE Campus Cyberinfrastructure Working Group Coalition for Academic Scientific.
User Support Coordination Objectives for Plan Years 4 and 5 (8/1/2008 to 3/1/2010) Sergiu Sanielevici, GIG Area Director for User Support Coordination.
EInfrastructures (Internet and Grids) US Resource Centers Perspective: implementation and execution challenges Alan Blatecky Executive Director SDSC.
UNCLASSIFIED 1 Enterprise Architecture Career Path Working Group Walt Okon Senior Architect Engineer Architecture & Infrastructure Directorate Office of.
ProActive Task Manager Component for SEGL Parameter Sweeping Natalia Currle-Linde and Wasseim Alzouabi High Performance Computing Center Stuttgart (HLRS),
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
Pertemuan Matakuliah: A0214/Audit Sistem Informasi Tahun: 2007.
TG QM Arlington: GIG User Support Coordination Plan Sergiu Sanielevici, GIG Area Director for User Support Coordination
Improving research management for improving research outcomes Andrea Berti Head of Research and Technology Transfer Office University of Padua 4 th European.
CMM Level 3 KPA’s CS4320 Fall Organizational Process Focus (Goals) Software process development and improvement activities are coordinated across.
NOS Objectives, YR 4&5 Tony Rimovsky. 4.2 Expanding Secure TeraGrid Access A TeraGrid identity management infrastructure that interoperates with campus.
“informed fleet decisions made easy”. Overview About Us ECO, Inc. is the world's leading engine and vehicle emissions certification consulting firm,
US NITRD LSN-MAGIC Coordinating Team – Organization and Goals Richard Carlson NGNS Program Manager, Research Division, Office of Advanced Scientific Computing.
GIG Software Integration: Area Overview TeraGrid Annual Project Review April, 2008.
Brad Armosky, TACC Shawn T. Brown, PSC Scott Lathrop, UC/ANL Laura McGinnis, PSC TeraGrid’08 Conference, Las Vegas, Nevada June 11, 2008.
GIG Software Integration Project Plan, PY4-PY5 Lee Liming Mary McIlvain John-Paul Navarro.
The Preparatory Phase Proposal a first draft to be discussed.
Effective User Services for High Performance Computing A White Paper by the TeraGrid Science Advisory Board May 2009.
Mantychore Oct 2010 WP 7 Andrew Mackarel. Agenda 1. Scope of the WP 2. Mm distribution 3. The WP plan 4. Objectives 5. Deliverables 6. Deadlines 7. Partners.
U.S. Department of the Interior U.S. Geological Survey Next Generation Data Integration Challenges National Workshop on Large Landscape Conservation Sean.
Technology + Process SDCI HPC Improvement: High-Productivity Performance Engineering (Tools, Methods, Training) for NSF HPC Applications Rick Kufrin *,
MAGIC Gabrielle Allen, Richard Carlson, Grant Miller September 13, 2011 Large Scale Networking (LSN) FY12 Annual Planning Meeting.
Coordinating the TeraGrid’s User Interface Areas Dave Hart, Amit Majumdar, Tony Rimovsky, Sergiu Sanielevici.
1 PY4 Project Report Summary of incomplete PY4 IPP items.
Presentation to the Information Services Board March 6, 2008 Bill Kehoe, Chief Information Officer Bill Kehoe, Chief Information Officer.
Strengthening Partnerships: Shaping the Future Portland, OR June 6 th – 10 th, 2004 Planning for Success Implementing the California EDRS.
Pascucci-1 Valerio Pascucci Director, CEDMAV Professor, SCI Institute & School of Computing Laboratory Fellow, PNNL Massive Data Management, Analysis,
PRO-EAST Workshop, Rome, May 9-11, Curriculum and Programme Objectives: Mapping of Learning Outcomes Oleg V. Boev, Accreditation Centre, Russian.
Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.
Information Architecture WG: Report of the Spring 2004 Meeting May 13, 2004 Dan Crichton, NASA/JPL.
Why Practical Design…Why NOW… 1 Practical Design in ODOT (Tab 2) ? Training ? 2010 Cathy Nelson, PE Technical Services Manager/ Chief Engineer.
Joint Meeting of the AUS, US, XS Working Groups TG10 Tuesday August 3, hrs Elwood II.
1 NSF/TeraGrid Science Advisory Board Meeting July 19-20, San Diego, CA Brief TeraGrid Overview and Expectations of Science Advisory Board John Towns TeraGrid.
ARL Workshop on New Collaborative Relationships: The Role of Academic Libraries in the Digital Data Universe September 26-27, 2006 ARL Prue.
Common User Environments Working Group Shawn T. Brown, PSC CUE Working Group Lead April,
Cyberinfrastructure: Many Things to Many People Russ Hobby Program Manager Internet2.
Education, Outreach and Training (EOT) and External Relations (ER) Scott Lathrop Area Director for EOT Extension Year Plans.
ISTeC Research Computing Open Forum: Using NSF or National Laboratory Resources for High Performance Computing Bhavesh Khemka.
U.S. Grid Projects and Involvement in EGEE Ian Foster Argonne National Laboratory University of Chicago EGEE-LHC Town Meeting,
High Risk 1. Ensure productive use of GRID computing through participation of biologists to shape the development of the GRID. 2. Develop user-friendly.
TeraGrid’s Common User Environment: Status, Challenges, Future Annual Project Review April, 2008.
Advanced User Support Amit Majumdar 8/12/10. Outline  Three categories of AUS  Operational Activities  AUS.ASTA  ASTA examples  AUS.ASP  AUS.ASEOT.
Collaborative Tools for the Grid V.N Alexandrov S. Mehmood Hasan.
The HEP Software Foundation Initiative 5 th September 2014 John Harvey, Pere Mato PH-SFT, CERN.
HPC University Requirements Analysis Team Training Analysis Summary Meeting at PSC September Mary Ann Leung, Ph.D.
Petascale Computing Resource Allocations PRAC – NSF Ed Walker, NSF CISE/ACI March 3,
Consortia and Public-Private Partnerships: Informing the GENI Transition Ilya Baldin RENCI Director for Network Research.
Building PetaScale Applications and Tools on the TeraGrid Workshop December 11-12, 2007 Scott Lathrop and Sergiu Sanielevici.
Education, Outreach and Training (EOT) Scott Lathrop Area Director for EOT January 2010.
Building on virtualization capabilities for ExTENCI Carol Song and Preston Smith Rosen Center for Advanced Computing Purdue University ExTENCI Kickoff.
TeraGrid’s Process for Meeting User Needs. Jay Boisseau, Texas Advanced Computing Center Dennis Gannon, Indiana University Ralph Roskies, University of.
TeraGrid Software Integration: Area Overview (detailed in 2007 Annual Report Section 3) Lee Liming, JP Navarro TeraGrid Annual Project Review April, 2008.
Bob Jones EGEE Technical Director
Agile Culture Instructor Pilot ISA 301 March 2017 Robert Thomas.
VisIt Project Overview
Strategies for NIS Development
Accreditation External Review
JRA3 Introduction Åke Edlund EGEE Security Head
Ian Bird GDB Meeting CERN 9 September 2003
Project Management Processes
ESMF Governance Cecelia DeLuca NOAA CIRES / NESII April 7, 2017
Department of Licensing HP 3000 Replatforming Project Closeout Report
Helene Skikos DG Education and Culture
Presentation to Project Certification Committee, DoIT August 24, 2008
Global Grid Forum (GGF) Orientation
NM Department of Homeland Security and Emergency Management
Presentation transcript:

Extreme Scalability RAT Report title=RATs#Extreme_Scalability Sergiu Sanielevici,

Mission and Membership Mission: Recommend how TeraGrid should meet the challenges faced by our users and ourselves in the productive utilization of Track 2 Systems as integrated into the TeraGrid. RAT chartered 6/28 Members volunteered from all RPs: Alameda, Brown, Dennis, Gaither, Lathrop, Lynch, Majumdar, Milfeld, Nystrom, Sanielevici, Sheppard, Whitson. Deliverables: –Whitepaper describing challenges and proposed paths to solution –Draft charter of a new working group to deal with these challenges

Whitepaper Recommendations: Technical Challenge Areas Designing applications for scaling and robustness Coding for performance on multi-core systems Coding for performance on specific T2 architectures Tools for debugging applications at scale Tools for optimizing applications at scale Work and data flows for extracting knowledge from petascale simulations TG to deal with these Challenges by building the infrastructure proposed in the following slides:

Whitepaper Recommendations: Infrastructure (1) TG to charter a new Extreme Scalability Working Group (XSWG) XSWG to spearhead creation of an Extreme Scalability R&D Grid (XSG): –Suitable TG machines including Track-2 access –Consistent R&D environment, including XS Kit in CTSS –Meta-scheduling system and policies –Documentation

Whitepaper Recommendations: Infrastructure (2) XSWG to draft, then help to implement, a new Extreme Scalability Allocations policy for granting access to the XSG –SU amount at today’s MRAC level, but supporting application and tools R&D and training –Clear-cut eligibility criteria, e.g. NSF PetaApps awards and their equivalents sponsored by other programs or agencies; Relevant NSF SDCI awards and their equivalents sponsored by other programs or agencies; Applications, currently running on TG resources, that have demonstrated scalability to at least 4000 cores with at least 60% parallel efficiency; Academic scientists, commercial vendor personnel and TeraGrid staff who collaborate on R&D projects undertaken in support of the XSWG mission; Academic scientists, commercial vendor personnel and TeraGrid staff who collaborate on EOT projects undertaken in support of the XSWG mission.

Whitepaper Recommendations: Infrastructure (3) XSWG to foster collaborative R&D projects –Between RPs, computational and computer scientists, applied mathematicians, and commercial vendors –Methods: write joint proposals to funding agencies, licensing, access to XSG, etc. –Resulting software may become part of CTSS XS Kit XSWG to coordinate the creation and teaching of HPC University workshops and modules. XSWG to work with the TeraGrid User Facing and EOT teams on documentation and dissemination.

Whitepaper Recommendations: XSWG Charter Report via GIG User Support Coordination Area Membership encouraged from all RPs, required from Track-2 sites Ensure presence of skills required to execute XSWG tasks by appointing Core Members: –WG Leader(s); –Leaders for each Framework task and each Challenge area; –Alternates to ensure presence at all WG activities.