CCA Forum Autumn Meeting15 October 2006 CCA Common Component Architecture Component Technology Initiatives How can we exploit the component environment.

Slides:



Advertisements
Similar presentations
Alternate Software Development Methodologies
Advertisements

O AK R IDGE N ATIONAL L ABORATORY U.S. D EPARTMENT OF E NERGY Global Climate Modeling Research John Drake Computational Climate Dynamics Group Computer.
Cracow Grid Workshop, November 5-6, 2001 Towards the CrossGrid Architecture Marian Bubak, Marek Garbacz, Maciej Malawski, and Katarzyna Zając.
Presented by Scalable Systems Software Project Al Geist Computer Science Research Group Computer Science and Mathematics Division Research supported by.
Fungal Semantic Web Stephen Scott, Scott Henninger, Leen-Kiat Soh (CSE) Etsuko Moriyama, Ken Nickerson, Audrey Atkin (Biological Sciences) Steve Harris.
CCA Forum Winter Meeting January CCA Common Component Architecture TASCS Project News Update October 2006 – January 2007.
NGNS Program Managers Richard Carlson Thomas Ndousse ASCAC meeting 11/21/2014 Next Generation Networking for Science Program Update.
Center for Component Technology for Terascale Simulation Software (aka Common Component Architecture) (aka CCA) Rob Armstrong & the CCA Working Group Sandia.
Loads Balanced with CQoS Nicole Lemaster, Damian Rouson, Jaideep Ray Sandia National Laboratories Sponsor: DOE CCA Meeting – January 22, 2009.
CCA Forum Summer Meeting1 27 July CCA Common Component Architecture The SciDAC Center for Technology for Advanced Scientific Component Software(TASCS)
An Automated Component-Based Performance Experiment and Modeling Environment Van Bui, Boyana Norris, Lois Curfman McInnes, and Li Li Argonne National Laboratory,
CCA Forum Fall Meeting October CCA Common Component Architecture Update on TASCS Component Technology Initiatives CCA Fall Meeting October.
1 TOPS Solver Components Language-independent software components for the scalable solution of large linear and nonlinear algebraic systems arising from.
CQoS Update Li Li, Boyana Norris, Lois Curfman McInnes Argonne National Laboratory Kevin Huck University of Oregon.
CCA Forum Fall Meeting October CCA Common Component Architecture Update on TASCS Component Technology Initiatives Lois McInnes, Focus Lead.
Babel F2003 Wrap-up Stefan Muszala*, Tom Epperly(LLNL), Nanbor Wang* Funded by DOE (TASCS) Grant No DE-FC02-07ER25805, DOE Grant No DE-FG02-04ER84099 and.
A Lightweight Platform for Integration of Resource Limited Devices into Pervasive Grids Stavros Isaiadis and Vladimir Getov University of Westminster
CCA Common Component Architecture Manoj Krishnan Pacific Northwest National Laboratory MCMD Programming and Implementation Issues.
CoG Kit Overview Gregor von Laszewski Keith Jackson.
CASC This work was performed under the auspices of the U.S. Department of Energy by University of California Lawrence Livermore National Laboratory under.
November 13, 2006 Performance Engineering Research Institute 1 Scientific Discovery through Advanced Computation Performance Engineering.
Overview of Recent MCMD Developments Manojkumar Krishnan January CCA Forum Meeting Boulder.
CCA Common Component Architecture CCA Forum Tutorial Working Group Welcome to the Common.
SciDAC Projects: Groundwater Tim Scheibe PNNL-SA
Scalable Systems Software Center Resource Management and Accounting Working Group Face-to-Face Meeting October 10-11, 2002.
Programming Models & Runtime Systems Breakout Report MICS PI Meeting, June 27, 2002.
CCA Common Component Architecture CCA Forum Tutorial Working Group Welcome to the Common.
Crystal Ball Panel ORNL Heterogeneous Distributed Computing Research Al Geist ORNL March 6, 2003 SOS 7.
Tech-X Corporation for CCA Overview Tech-X Corporation is an entrepreneurial and dynamic enterprise committed to scientific and technical excellence and.
Overview of Recent MCMD Developments Jarek Nieplocha CCA Forum Meeting San Francisco.
Plans and Opportunities Involving Beam Dynamics Components ComPASS SAP Project and Phase I and II Doe SBIR Boyana Norris (ANL) In collaboration with Stefan.
Grid Computing Research Lab SUNY Binghamton 1 XCAT-C++: A High Performance Distributed CCA Framework Madhu Govindaraju.
Components for Beam Dynamics Douglas R. Dechow, Tech-X Lois Curfman McInnes, ANL Boyana Norris, ANL With thanks to the Common Component Architecture (CCA)
Building an Electron Cloud Simulation using Bocca, Synergia2, TxPhysics and Tau Performance Tools Phase I Doe SBIR Stefan Muszala, PI DOE Grant No DE-FG02-08ER85152.
SAP Participants: Douglas Dechow, Tech-X Corporation Lois Curfman McInnes, Boyana Norris, ANL Physics Collaborators: James Amundson, Panagiotis Spentzouris,
Issues in (Financial) High Performance Computing John Darlington Director Imperial College Internet Centre Fast Financial Algorithms and Computing 4th.
CCA Common Component Architecture 1SciDAC PI Meeting22-24 March 20041SciDAC PI Meeting22-24 March 2004 Enabling Scientific Applications with the Common.
Presented by An Overview of the Common Component Architecture (CCA) The CCA Forum and the Center for Technology for Advanced Scientific Component Software.
CCA Components for Accelerator Physics ComPASS SAP Project and Phase II Doe SBIR Stefan Muszala, Tech-X Corp, Boulder, CO In collaboration with Jim Amundson.
Scott Kohn with Tammy Dahlgren, Tom Epperly, and Gary Kumfert Center for Applied Scientific Computing Lawrence Livermore National Laboratory October 2,
Presented by How the Common Component Architecture (CCA) Advances Computational Science The CCA Forum and the Center for Technology for Advanced Scientific.
Presented by Scientific Data Management Center Nagiza F. Samatova Network and Cluster Computing Computer Sciences and Mathematics Division.
Multilevel Parallelism using Processor Groups Bruce Palmer Jarek Nieplocha, Manoj Kumar Krishnan, Vinod Tipparaju Pacific Northwest National Laboratory.
Scalable Systems Software for Terascale Computer Centers Coordinator: Al Geist Participating Organizations ORNL ANL LBNL.
ISERVOGrid Architecture Working Group Brisbane Australia June Geoffrey Fox Community Grids Lab Indiana University
Enabling Self-management of Component-based High-performance Scientific Applications Hua (Maria) Liu and Manish Parashar The Applied Software Systems Laboratory.
CCA Common Component Architecture CCA Forum Tutorial Working Group CCA Status and Plans.
Scaling and Validation Programme David Groep & vle-pfour-team VL-e SP Meeting NIKHEF SARA LogicaCMG IBM.
Distributed Components for Integrating Large- Scale High Performance Computing Applications Nanbor Wang, Roopa Pundaleeka and Johan Carlsson
Computational Science & Engineering meeting national needs Steven F. Ashby SIAG-CSE Chair March 24, 2003.
11 CCA Common Component Architecture CCA Forum Fall 2008 Meeting21-22 October 2008 Upcoming SciDAC Reviews David E. Bernholdt TASCS Lead PI.
Architecture View Models A model is a complete, simplified description of a system from a particular perspective or viewpoint. There is no single view.
BioPSE NCRR SCIRun2 -THE PROJECT -OBJECTIVES -DEVELOPMENTS -TODAY -THE FUTURE.
NA-MIC National Alliance for Medical Image Computing Core 1b – Engineering Computational Platform Jim Miller GE Research.
Supercomputing 2006 Scientific Data Management Center Lead Institution: LBNL; PI: Arie Shoshani Laboratories: ANL, ORNL, LBNL, LLNL, PNNL Universities:
The Sakai Educational Partnership Program Mark J. Norton Senior Technical Consultant.
© Copyright AARNet Pty Ltd PRAGMA Update & some personal observations James Sankar Network Engineer - Middleware.
Center for Component Technology for Terascale Simulation Software (CCTTSS) 110 April 2002CCA Forum, Townsend, TN CCA Status, Code Walkthroughs, and Demonstrations.
Toward a Distributed and Parallel High Performance Computing Environment Johan Carlsson and Nanbor Wang Tech-X Corporation Boulder,
Center for Component Technology for Terascale Simulation Software (CCTTSS) 110 April 2002CCA Forum, Townsend, TN This work has been sponsored by the Mathematics,
Quality of Service for Numerical Components Lori Freitag Diachin, Paul Hovland, Kate Keahey, Lois McInnes, Boyana Norris, Padma Raghavan.
V-Shaped Software Development Life Cycle Model. Introduction: Variation of water fall model. Same sequence structure as water fall model. Strong emphasis.
Building PetaScale Applications and Tools on the TeraGrid Workshop December 11-12, 2007 Scott Lathrop and Sergiu Sanielevici.
Presented by SciDAC-2 Petascale Data Storage Institute Philip C. Roth Computer Science and Mathematics Future Technologies Group.
CCA Forum Spring Meeting April CCA Common Component Architecture Fault Tolerance and the Common Component Architecture David E. Bernholdt.
CCA Forum Fall Meeting October CCA Common Component Architecture Update on TASCS Component Technology Initiatives CCA Forum Fall Meeting
Kai Li, Allen D. Malony, Sameer Shende, Robert Bell
JRA3 Introduction Åke Edlund EGEE Security Head
DOE 2000 PI Retreat Breakout C-1
Presentation transcript:

CCA Forum Autumn Meeting15 October 2006 CCA Common Component Architecture Component Technology Initiatives How can we exploit the component environment to provide computational scientists with better ways to develop their software? Support for Emerging HPC Hardware and Software Paradigms –Motivation: chemistry, biology, and groundwater Software Quality and Verification –Motivation: CCA toolkit, fusion, combustion, quantum chemistry, accelerators Computational Quality of Service –Motivation: parallel mesh partitioning in combustion, resource management in quantum chemistry, parallel linear solvers in core-edge fusion and high-energy accelerators

CCA Forum Autumn Meeting25 October 2006 CCA Common Component Architecture Support for Emerging HPC Hardware and Software Paradigms Investigate how component environments can be used to enhance the user’s experience programming for new and emerging high-end systems –Massive levels of parallelism ( concurrent threads) –Heterogeneous processor environments FPGAs, scalar+vector+threaded, co-processors, etc. Planned activities –Develop and implement management for progress groups and (multi-level) MCMD parallelism –Develop techniques to support asynchronous interactions of components representing co-processors/accelerators with those running on the traditional processors

CCA Forum Autumn Meeting35 October 2006 CCA Common Component Architecture Software Quality and Verification Extend component interface definitions with semantic annotations which can be verified/enforced at composition or run time (contracts) –Developers provide “executable documentation” about correct use –Users protected against improper usage due to code error, unforeseen circumstances, etc. –Can facilitate verification that the code is actually doing what it was intended to do Planned activities and connections –Method invocation sequencing constraints –Implement and demonstrate annotations in selected Toolkit components –Emphasize annotations needed to support CQoS work

CCA Forum Autumn Meeting45 October 2006 CCA Common Component Architecture Computational Quality of Service Composition, substitution, and reconfiguration of running component applications in response to changing conditions –Performance, accuracy, mathematical consistency, reliability, etc. Planned activities –Develop common software infrastructure for dynamic component adaptivity Analysis (when to change) Control (what to change) Connections –Software Quality initiative –University of Oregon: performance monitoring, modeling, and analysis –TASCS Software Quality Initiative: Interface semantics –CCA Environment: Event model that supports dynamic CQoS behavior –PERC Project: Performance tools –TOPS Project: Solver interfaces –Other external tools where appropriate (e.g., Eijkhout et al., Liu & Parashar, etc.)

CCA Forum Autumn Meeting55 October 2006 CCA Common Component Architecture TASCS Initiative Interactions with Apps TASCS Activities / Contacts Project / PI Funding StatusCollaboration (full/partial/none) Emerging HPC (Jarek Nieplocha) Scaling the Challenges in Subsurface Simulations, Tim Scheibe (PNNL), SAP: Bruce Palmer (PNNL) App: 100%, SAP 90%full Emerging HPC (Jarek Nieplocha) Biopilot project, TJ Strassma (PNNL) Ongoingfull Emerging HPC (Manoj Krishnan), CQoS (Joe Kenny) Chemistry Framework Using the CCA, Mark Gordon (Ames) $0.5m for 3 yearsfull Environment (Tom Epperly, Sveta Shasharina), CQoS (Lois Curfman McInnes) Framework Application for Core- Edge Transport Simulations, John Cary (Tech-X) $2.2m for 5 yearsfull CQoS (Jaideep Ray)CFRFS, Habib Najm (SNL)Under reviewTBD CQoS (Lois Curfman McInnes) High-Energy Accelerators (TBD)Writing new community proposal TBD Software Quality and Verification (Tammy Dahlgren) CCA Toolkit + CQoS applicationsSee above

CCA Forum Autumn Meeting6 5 October CCA Common Component Architecture Environment Year 1 Deliverables Gary Kumfert

CCA Forum Autumn Meeting75 October 2006 CCA Common Component Architecture Core Tools: Ben Institutions: SNL, LLNL, UU, ORNL, ANL PORTING to NLCF Machines –XT-3 Babel (ORNL-lead) –Wael started this in Indiana Mtg. Ccaffeine (SNL-lead) Tutorial (?) Toolkit (?) –Blue Gene Babel (LLNL-lead) Ccaffeine (SNL-lead) Tutorial (?) Toolkit (?) Set up Helpdesk (LLNL-lead) – –14 submissions 6 “fixed” –meaning resolved 3 tests 5 unresolved Documentation –CCA Specification (LLNL-lead) To “encourage” shared staffing of the helpdesk, statistics about time-to-resolution, participating institutions, etc. will be published at CCA meetings.

CCA Forum Autumn Meeting85 October 2006 CCA Common Component Architecture Enhancements: Tom Institutions: LLNL, BU, UU, SNL, ORNL CCA Services –CommandLineService (???) –MPIService (SNL-lead) –EventService (UU-lead) Steve will speak more on this today –GuiBuilderService (ANL-lead) Inter-framework Prototypes –CCA-Kepler (UU-lead) –XCAT-BabelRMI (BU-lead) Services are “MUST-HAVE” for CCA Spec 1.0 Ben was right in Indiana: We should start discussing 1.0 Release Criteria (like LLNL did with Babel). Do we want a more formal specification process?

CCA Forum Autumn Meeting95 October 2006 CCA Common Component Architecture Usability: Craig Institutions: LANL, SNL, ANL, ORNL, Tech-X, PNNL, LLNL Draft CCA-Lite Spec & Fwk (LANL-lead) Component Test Harness (ORNL or Tech-X) Document Multilanguage & Component Debugging Techniques (SNL or ANL)

CCA Forum Autumn Meeting10CCA Forum Autumn Meeting5 October October 2006 CCA Common Component Architecture Toolkit News Rob Armstrong Toolkit Tut Sandia National Labs Livermore, CA

CCA Forum Autumn Meeting115 October 2006 CCA Common Component Architecture Telecon: time to stop talking about the CCA Base Install Build System and just do it. Need a scalable, pluggable build system and install base. Decisions have been made: –Components built against a consistent set of CCA Tools (i.e. Sumo). –where components and their dependencies are mixed and matched. –Components can be added and removed without breaking the build –Individual component code remains separate and individually modifiable in the build tree. –Wael, Boyana, Ben will talk about this later.

CCA Forum Autumn Meeting125 October 2006 CCA Common Component Architecture Nightly build and testing CCA Tools (i.e. Sumo) and Base Install must have automatic testing, nightly build style –Check out CCA Tools from their repositories and build them, test them, automatically. –Many political questions: Should Toolkit components be tested nightly as well? Do you trust Rob with your repository? Repository tagging for “blessed” Toolkit distro's? –Rob (yours truly) will talk about this later.

CCA Forum Autumn Meeting135 October 2006 CCA Common Component Architecture Timetable There are many components that are claimed to be “ready to go” –A consistent approach is all that is lacking. By next meeting we should have a pretty deployable system (?) Front-loading some time on this will leverage the much larger number of component developers sooner rather than later...

CCA Forum Autumn Meeting14CCA Forum Autumn Meeting5 October October 2006 CCA Common Component Architecture User and Applications Outreach and Support David E. Bernholdt Focus Lead

CCA Forum Autumn Meeting155 October 2006 CCA Common Component Architecture Applications Activities ANL –Doug Dechow Beam Dynamics (DOE SBIR) discussions –FACETS (fusion SciDAC2) participants; use of coupling and TOPS solver components –Accelerator Physics SciDAC2 proposal development Indiana, ORNL –SWIM (fusion SciDAC1) participants LLNL –PSI LDRD (MPMD multiscale materials science) project ran large production runs using Babel RMI intensively (680 nodes x 2 CPUs/node x ~48 hours) ORNL –GNEP integrated reactor simulation prototype (ORNL LDRD) PNNL –Updating NWChem MCMD to latest CCA tools Tech-X –various fusion projects UMD –Space weather modeling (NSF) participant –Klasky/Parashar CPES (fusion SciDAC1) discussions

CCA Forum Autumn Meeting165 October 2006 CCA Common Component Architecture User Support ANL –Doug Dechow –Jim Jones (Masha Sosonkina student) SNL –various help desk responses Tech-X –Tech-X internal users

CCA Forum Autumn Meeting175 October 2006 CCA Common Component Architecture Outreach ACTS tutorial –Ben Allan contact with European group interested in componentizing MODFLOW 2000 (groundwater) WoCo9: Grid-based Problem Solving Environments: Implications for the Development and Deployment of Numerical Software –Boyana Norris et al. talk & paper “Computational Quality of Service for Scientific Component Applications” 13th Biennial Computational Techniques and Applications Conference (CTAC '06) –J.W. Larson, talk & paper "Organising Principles for Coupling in Multiphysics and Multiscale Models“ –J.W. Larson, et al. talk & paper "PyMCT and PyCPL: Refactoring the Community Climate System Model Using Python” MODEST-7c: Multi-Scale, Multi-Physics Software Frameworks (in MODEST and Elsewhere) –David Bernholdt, talk “The Common Component Architecture: Building Frameworks for Computational Science” –NSF/Physics and the Information Frontier proposal with Bernholdt and Sussman as collaborators

CCA Forum Autumn Meeting185 October 2006 CCA Common Component Architecture Outreach –N. Wang, an invited talk at GPCE4QoS workshop “Applying GPCE in Distributed and Parallel High-Performance Scientific Computing” –Tech-X APS/DPP November “Framework for Modernization and Componentization of Fusion Modules" –SC06 Binghamton paper "Benchmarking XML Processors for Applications in Grid Web Services“ Global Array tutorial Scientific Data Management tutorial CompFrame BOF –IBM Scientific computer users group (ScicomP 2007) will be held at the Max Plank Institute in Garching (near Munich) July 2007 –Tutorial revamp –cca-forum.org upgrade and migration Applications –PNNL groundwater SAP ramping up –ANL climate SAP ramping up Near-Term Plans

CCA Forum Autumn Meeting195 October 2006 CCA Common Component Architecture Hall of Shame Indiana Rob Armstrong