CCA Forum Fall Meeting1 11-12 October 20071 CCA Common Component Architecture Update on TASCS Component Technology Initiatives Lois McInnes, Focus Lead.

Slides:



Advertisements
Similar presentations
IEEE/FIPA WG Mobile Agents Ulrich Pinsdorf Fraunhofer-Institute IGD, Germany Dept. Security Technology
Advertisements

The System and Software Development Process Instructor: Dr. Hany H. Ammar Dept. of Computer Science and Electrical Engineering, WVU.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
Cracow Grid Workshop, November 5-6, 2001 Towards the CrossGrid Architecture Marian Bubak, Marek Garbacz, Maciej Malawski, and Katarzyna Zając.
Presented by Scalable Systems Software Project Al Geist Computer Science Research Group Computer Science and Mathematics Division Research supported by.
The Role of DANSE at SNS Steve Miller Scientific Computing Group Leader January 22, 2007.
Nick Trebon, Alan Morris, Jaideep Ray, Sameer Shende, Allen Malony {ntrebon, amorris, Department of.
© , Michael Aivazis DANSE Software Issues Michael Aivazis California Institute of Technology DANSE Software Workshop September 3-8, 2003.
CCA Forum Winter Meeting January CCA Common Component Architecture TASCS Project News Update October 2006 – January 2007.
Strategic Directions in Real- Time & Embedded Systems Aatash Patel 18 th September, 2001.
Case Study: The E1 Distributed Operating System Chris Krentz 3/20/2007.
Center for Component Technology for Terascale Simulation Software (aka Common Component Architecture) (aka CCA) Rob Armstrong & the CCA Working Group Sandia.
Loads Balanced with CQoS Nicole Lemaster, Damian Rouson, Jaideep Ray Sandia National Laboratories Sponsor: DOE CCA Meeting – January 22, 2009.
CCA Forum Summer Meeting1 27 July CCA Common Component Architecture The SciDAC Center for Technology for Advanced Scientific Component Software(TASCS)
An Automated Component-Based Performance Experiment and Modeling Environment Van Bui, Boyana Norris, Lois Curfman McInnes, and Li Li Argonne National Laboratory,
CCA Forum Fall Meeting October CCA Common Component Architecture Update on TASCS Component Technology Initiatives CCA Fall Meeting October.
CCA Forum Autumn Meeting15 October 2006 CCA Common Component Architecture Component Technology Initiatives How can we exploit the component environment.
CQoS Update Li Li, Boyana Norris, Lois Curfman McInnes Argonne National Laboratory Kevin Huck University of Oregon.
DORII Joint Research Activities DORII Joint Research Activities Status and Progress 4 th All-Hands-Meeting (AHM) Alexey Cheptsov on.
Component Infrastructure of CQoS and Its Application in Scientific Computations Li Li 1, Boyana Norris 1, Lois Curfman McInnes 1, Kevin Huck 2, Joseph.
Using the Open Metadata Registry (openMDR) to create Data Sharing Interfaces October 14 th, 2010 David Ervin & Rakesh Dhaval, Center for IT Innovations.
November 13, 2006 Performance Engineering Research Institute 1 Scientific Discovery through Advanced Computation Performance Engineering.
Overview of Recent MCMD Developments Manojkumar Krishnan January CCA Forum Meeting Boulder.
CCA Common Component Architecture CCA Forum Tutorial Working Group Welcome to the Common.
PhUSE Computational Science Working Groups Solutions Through Collaboration.
Resource Management Working Group SSS Quarterly Meeting November 28, 2001 Dallas, Tx.
Scalable Systems Software Center Resource Management and Accounting Working Group Face-to-Face Meeting October 10-11, 2002.
Programming Models & Runtime Systems Breakout Report MICS PI Meeting, June 27, 2002.
CCA Common Component Architecture CCA Forum Tutorial Working Group Welcome to the Common.
Accelerating Scientific Exploration Using Workflow Automation Systems Terence Critchlow (LLNL) Ilkay Altintas (SDSC) Scott Klasky(ORNL) Mladen Vouk (NCSU)
Crystal Ball Panel ORNL Heterogeneous Distributed Computing Research Al Geist ORNL March 6, 2003 SOS 7.
Tech-X Corporation for CCA Overview Tech-X Corporation is an entrepreneurial and dynamic enterprise committed to scientific and technical excellence and.
Overview of Recent MCMD Developments Jarek Nieplocha CCA Forum Meeting San Francisco.
Plans and Opportunities Involving Beam Dynamics Components ComPASS SAP Project and Phase I and II Doe SBIR Boyana Norris (ANL) In collaboration with Stefan.
Grid Computing Research Lab SUNY Binghamton 1 XCAT-C++: A High Performance Distributed CCA Framework Madhu Govindaraju.
Components for Beam Dynamics Douglas R. Dechow, Tech-X Lois Curfman McInnes, ANL Boyana Norris, ANL With thanks to the Common Component Architecture (CCA)
Building an Electron Cloud Simulation using Bocca, Synergia2, TxPhysics and Tau Performance Tools Phase I Doe SBIR Stefan Muszala, PI DOE Grant No DE-FG02-08ER85152.
SAP Participants: Douglas Dechow, Tech-X Corporation Lois Curfman McInnes, Boyana Norris, ANL Physics Collaborators: James Amundson, Panagiotis Spentzouris,
Issues in (Financial) High Performance Computing John Darlington Director Imperial College Internet Centre Fast Financial Algorithms and Computing 4th.
Center for Component Technology for Terascale Simulation Software CCA is about: Enhancing Programmer Productivity without sacrificing performance. Supporting.
SCIRun and SPA integration status Steven G. Parker Ayla Khan Oscar Barney.
Combinatorial Scientific Computing and Petascale Simulation (CSCAPES) A SciDAC Institute Funded by DOE’s Office of Science Investigators Alex Pothen, Florin.
Presented by An Overview of the Common Component Architecture (CCA) The CCA Forum and the Center for Technology for Advanced Scientific Component Software.
© 2002 IBM Corporation Confidential | Date | Other Information, if necessary PTP 2.1 Release Review October 29, 2008.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Scott Kohn with Tammy Dahlgren, Tom Epperly, and Gary Kumfert Center for Applied Scientific Computing Lawrence Livermore National Laboratory October 2,
Presented by Scientific Annotation Middleware Software infrastructure to support rich scientific records and the processes that produce them Jens Schwidder.
The GriPhyN Planning Process All-Hands Meeting ISI 15 October 2001.
Integrating Large-Scale Distributed and Parallel High Performance Computing (DPHPC) Applications Using a Component-based Architecture Nanbor Wang 1, Fang.
Scalable Systems Software for Terascale Computer Centers Coordinator: Al Geist Participating Organizations ORNL ANL LBNL.
May 6, 2002Earth System Grid - Williams The Earth System Grid Presented by Dean N. Williams PI’s: Ian Foster (ANL); Don Middleton (NCAR); and Dean Williams.
Enabling Self-management of Component-based High-performance Scientific Applications Hua (Maria) Liu and Manish Parashar The Applied Software Systems Laboratory.
CCA Common Component Architecture CCA Forum Tutorial Working Group CCA Status and Plans.
Distributed Components for Integrating Large- Scale High Performance Computing Applications Nanbor Wang, Roopa Pundaleeka and Johan Carlsson
Lawrence Livermore National Laboratory S&T Principal Directorate - Computation Directorate Tools and Scalable Application Preparation Project Computation.
11 CCA Common Component Architecture CCA Forum Fall 2008 Meeting21-22 October 2008 Upcoming SciDAC Reviews David E. Bernholdt TASCS Lead PI.
ESMF and the future of end-to-end modeling Sylvia Murphy National Center for Atmospheric Research
Center for Component Technology for Terascale Simulation Software (CCTTSS) 110 April 2002CCA Forum, Townsend, TN CCA Status, Code Walkthroughs, and Demonstrations.
Toward a Distributed and Parallel High Performance Computing Environment Johan Carlsson and Nanbor Wang Tech-X Corporation Boulder,
Center for Component Technology for Terascale Simulation Software (CCTTSS) 110 April 2002CCA Forum, Townsend, TN This work has been sponsored by the Mathematics,
Update on CHEP from the Computing Speaker Committee G. Carlino (INFN Napoli) on behalf of the CSC ICB, October
Building PetaScale Applications and Tools on the TeraGrid Workshop December 11-12, 2007 Scott Lathrop and Sergiu Sanielevici.
Performance-Driven Interface Contract Enforcement for Scientific Components 10th International Symposium on Component-Based Software Engineering Medford,
“Port Monitor”: progress & open questions Torsten Wilde and James Kohl Oak Ridge National Laboratory CCA Forum Quarterly Meeting Santa Fe, NM ~ October.
Presented by SciDAC-2 Petascale Data Storage Institute Philip C. Roth Computer Science and Mathematics Future Technologies Group.
CCA Forum Spring Meeting April CCA Common Component Architecture Fault Tolerance and the Common Component Architecture David E. Bernholdt.
CCA Forum Fall Meeting October CCA Common Component Architecture Update on TASCS Component Technology Initiatives CCA Forum Fall Meeting
VisIt Project Overview
Kai Li, Allen D. Malony, Sameer Shende, Robert Bell
EGEE Middleware Activities Overview
Presentation transcript:

CCA Forum Fall Meeting October CCA Common Component Architecture Update on TASCS Component Technology Initiatives Lois McInnes, Focus Lead Presented by Jarek Nieplocha, HPC Initiative Lead

CCA Forum Fall Meeting October 2007 CCA Common Component Architecture Support for Emerging HPC Hardware and Software Paradigms Overall Goal: Enable effective use of CCA on emerging HPC architectures Multiple-Component-Multiple-Data (MCMD) CCA Technology enables componentization of apps based on multiple levels of parallelism with focus on massively parallel systems. CCA on Heterogenous Architectures helps with portability and management of software modules executing on hardware accelerators (FPGA, IBM Cell, NVDIA Tesla etc). –Ongoing work: mass spectrometer applications: code transformations to make new component CCA in Fault Tolerant Environments focuses on better support for massively parallel architectures where frequent hardware faults are expected. –ORNL represents us on ASCR CIFTS project. –Tried to harmonize CCA Event Service with their API for the Fault Tolerance Backplane (currently frozen to support SC’07 demos) –A component-based FT demonstration using the FTB has been delayed due to platform access and application portability issues.

CCA Forum Fall Meeting October 2007 CCA Common Component Architecture MCMD Recent activities focus on development of specifications for CCA-based processor groups teams –BOFs held during CCA meetings in April and July, 2007 –Mini-Workshop held January 24, 2007 –Use cases documented and analyzed –Wiki webpage and mailing list: Specifications document version 0.3 –Telecon held Sept 28, 2007 –Some people sent good comments by –Issues about threads, fault tolerant environment, MPI-centric narrative and examples, ID representation Plans –Complete and present the document at the next meeting –Prototype implementation and some application evaluation

CCA Forum Fall Meeting October 2007 CCA Common Component Architecture Software Quality and Verification Overall Goal: Extend component interface definitions with semantic annotations that can be verified/enforced at composition or run time (contracts) Recent Activities –Publications S. Parker et al., “Enabling Advanced Scientific Software,” submitted to Cyberinfrastructure Technology Watch ( for special 4 th quarter “DOE SciDAC Software Enabling Technologies for Petascale Science” issue. –Presentations T. Dahlgren, “Performance-Driven Interface Contract Enforcement for Scientific Components,” in Proceedings of the 10th International ACM SIGSOFT Symposium on Component-Based Software Engineering (CBSE-10), Medford, MA, July 9-11, Also available as Lawrence Livermore National Laboratory Technical Report UCRL-PRES –Progress integrating experimental enforcement features into Babel repository Refactored runtime library features to better encapsulate internal use-only methods. Revised assertion regression test (Vector Utils) – more robust implementation and client side cleanup (including comments with new enforcement-related calls). Preliminary integration of new features into command line, user options, DTD, XML parser, and symbol table. –University/education interactions: T. Dahlgren submitted to UC Davis committee the latest version of Ph.D. thesis partially based on this work Plans –October-December: Complete integration of experimental enforcement features into the Babel compiler (i.e., symbol table, C back end, and IOR) … capabilities to be used by CQoS working group.

CCA Forum Fall Meeting October 2007 CCA Common Component Architecture Computational Quality of Service Overall Goal: Develop infrastructure for dynamic component adaptivity, i.e., composing, substituting, and reconfiguring running component applications in response to changing conditions –Performance, accuracy, mathematical consistency, reliability, etc. CQoS Wiki and mailing list: Recent Activities –CQoS session (pre-CCA meeting): July 18, 2007, Silver Spring, MD Updates from everyone: See details/slides: –Joe Kenny (SNL): Automatic selection of integral evaluators in quantum chemistry –Jaideep Ray (SNL): A first evaluation of rule-based dynamic configuration of load-balancers for AMR simulations of flows –Masha Sosonkina (Ames): Adaptivity features of sparse iterative linear algebra kernels represented as components –Alan Morris (Univ of Oregon): CQoS infrastructure in TAU –Andrea Berger (Clarion Univ), Lois Curfman McInnes and Boyana Norris (ANL): Simple linear solver components using SciPy –Li Li (ANL): CQoS infrastructure for scientific applications –Rob Armstrong (SNL): A data component for the CQoS testbed Group discussion: Applications teams' highest priority for CQoS infrastructure: tools for performance database query and management Decided to establish monthly group telecons to sync on overall progress –Thus far have been very useful and effective

CCA Forum Fall Meeting October 2007 CCA Common Component Architecture Computational Quality of Service Recent Activities (cont.) –CQoS telecon: Aug 27, 2007 Details: Joe Kenny (SNL): plans for quantum chemistry simulations using CQoS tools Jaideep Ray (SNL): plans for combustion simulations using CQoS tools Li Li (ANL): plans for adaptive linear solvers using matrix metadata via Anamod; proposed performance database store and query API –CQoS telecon: Sept 24, 2007 Details: Jaideep Ray (SNL): CQoS database usage in combustion Joe Kenny (SNL): CQoS database usage in quantum chemistry Meng-Shiou Wu (Ames): chemistry performance database and CQoS Li Li, Boyana Norris, and Lois McInnes (ANL): CQoS database usage in adaptive linear solvers –CQoS BOF: to be held tomorrow (Oct 12, 2007) Review new performance metadata formats that were coordinated by PERI (Boyana Norris) Establish specific requirements for new performance database capabilities Work on defining component interfaces for database query and management (C++ and SIDL)

CCA Forum Fall Meeting October CCA Common Component Architecture Key = Done = On Track | Visible progress = Need More Next Meeting = Unknown Key = Done = On Track | Visible progress = Need More Next Meeting = Unknown Environment Year 1 Deliverables Gary Kumfert ?

CCA Forum Fall Meeting October 2007 CCA Common Component Architecture Feedback to GNU Core Tools: Ben Institutions: SNL, LLNL, UU, ORNL, ANL PORTING to NLCF Machines –XT-3 Babel (ORNL-lead) –Wael started this in Indiana Mtg. Ccaffeine (SNL-lead) Tutorial (?) Toolkit (?) –Blue Gene Babel (LLNL-lead) Ccaffeine (SNL-lead) Tutorial (?) Toolkit (?) Set up Helpdesk (LLNL-lead) – Documentation –CCA Specification (LLNL-lead) Babel ported to BG/L (thanks Tom) C,C++,F77 independently confirmed at ANL (thanks Boyana) Postpone? Tutorial & Toolkit are being rewritten w/ Bocca for SC|07

CCA Forum Fall Meeting October 2007 CCA Common Component Architecture Inter-framework Prototypes –CCA-Kepler (UU-lead) –XCAT-BabelRMI (BU-lead) Enhancements: Tom Institutions: LLNL, BU, UU, SNL, ORNL CCA Services –CommandLineService (???) –MPIService (SNL-lead) –EventService (UU-lead) Waiting on CCARB to be finalized –GuiBuilderService (ANL-lead) Waiting on EventService New CCA Specification Process –Passed –Awaiting CCARB to be named & approved CCA 1.0 Requirements Doc –(Modelled after Babel’s activity) –Will start up as a WG once CCARB is seated Babel Structs (Y2 deliverable) –C/C++ bindings are in SVN –More details in Babel Roadmap talk later Bonus Items Funding delays ?

CCA Forum Fall Meeting October 2007 CCA Common Component Architecture Usability: Craig Institutions: LANL, SNL, ANL, ORNL, Tech-X, PNNL, LLNL Draft CCA-Lite Spec & Fwk (LANL-lead) Component Test Harness (ORNL-lead) Document Multilanguage & Component Debugging Techniques (SNL or ANL) This section is being refocused. Matt will lead a separate discussion about usability. Matt ?

CCA Forum Fall Meeting October 2007 CCA Common Component Architecture Major New Activity Started collaboration with CScADS, ITAPS, and Chemistry Apps to look for optimization techniques to improve performance of Babel. John Mellor-Crumney is looking to apply compiler optimization technologies to the multi-lingual environment Babel presents. New mailing list: We will meet again at SC|07 (exact time/place TBD)

CCA Forum Fall Meeting12CCA Forum Fall Meeting11-12 October CCA Common Component Architecture Toolkit Rob Armstrong Focus Lead

CCA Forum Fall Meeting October 2007 CCA Common Component Architecture Toolkit News Sandia is looking at componentizing Chambo. Bocca is to be released. –Toolkit components can be easily created from existing code –See other presentations today A toolkit component porting camp?

CCA Forum Fall Meeting14CCA Forum Fall Meeting11-12 October CCA Common Component Architecture User and Applications Outreach and Support David E. Bernholdt Focus Lead

CCA Forum Fall Meeting October 2007 CCA Common Component Architecture Application Support and Collaboration ProjectTASCS Institutions Quantum Chemistry SAPSNL SWIM (fusion)IU, ORNL FACETS (fusion)ANL, IU, LLNL, Tech-X TAUCQoS team GWACCAMOLE: GroundWAter CCA MOdeling Library and ExtensionsPNNL Polygraph proteomics mass spect. analysisPNNL CPES (fusion)UMD NWChemPNNL CScADS/TASCS/QC SAP/ITAPSLLNL, ORNL GNEP integrated reactor simulation prototypeORNL Beam dynamics modeling (accel. phys.)ANL COMPASS (accel. phys.)ANL CFRFS (combustion)SNL Instrument Middleware Project (NSF)IU

CCA Forum Fall Meeting October 2007 CCA Common Component Architecture SciDAC Center/Institute Collaborations Center/InstituteLeadTACS POC Petascale Data StorageGarth Gibson, CMU (PERI)Bob Lucas, USC/ISIBoyana Norris Ultrascale VisualizationKwan-Liu Ma, UCD (CSCAPES)Alex Pothen, ODU (APDEC)Phil Colella, LBNL (ITAPS)Lori Diachin, LLNL (TOPS)David Keyes, ColumbiaLois McInnes (CEDPS)Ian Foster, ANL (CScADS)John Mellor-Crummey, RiceGary Kumfert (ESG-CET)Dean Williams, LLNLDavid Bernholdt (SDM)Arie Shoshani, LBNLSteve Parker (VACET)Wes Bethel, LBNL

CCA Forum Fall Meeting October 2007 CCA Common Component Architecture Potential Collaborations Govindaraju–ORNL on HPC checkpointing –not CCA yet, but natural connection with HPC initiative Chiu-BU cardiac modeling –CCA potential Bernholdt, Shasharina–ITER Integrated Modeling –Common data model, interfaces, possibly frameworks –September meeting in France, second with this group Norris–Community Surface Dynamics Modeling U Colorado (NSF) Larson–A Data Domain to Model Domain Conversion Package (DMCP) for Sparse Climate Related Process Measurements (SciDAC SAP)

CCA Forum Fall Meeting October 2007 CCA Common Component Architecture Publications & Presentations Fang Liu and Randall Bramley, CCA-LISI: On Designing A CCA Parallel Sparse Linear Solver Interface, Proc. of the IEEE International Parallel and Distributed Processing Symposium, 2007 Steven G. Parker, Kostadin Damevski, Ayla Khan, Ashwin Swaminathan, Chris R. Johnson. The SCIJump Framework for Parallel and Distributed Scientific Computing. In Advanced Computational Infrastructures for Parallel/Distributed Adaptive Applications. Edited by Manish Parashar, Xiaolin Li, and Sumir Chandra, Wiley Press, 2007 (to appear) K.Damevski, A. Swaminathan, S. Parker. "Highly Scalable Distributed Component Framework for Scientific Computing". In Proceedings of the 3rd International Conference on High Performance Computing and Communication (HPCC 2007), Houston, Texas K. Damevski, K. Zhang, S. Parker "Practical Parallel Remote Method Invocation for the Babel Compiler". In Proceedings of the HPC-GECO/CompFrame'07 Workshop, Montreal, Canada (accepted) Jarek Nieplocha keynote at 7th International Conference on Parallel Processing and Applied Mathematics on Sept. 10 in Gdansk, Poland D. Dechow and L. McInnes, Components for Beam Dynamics, All-Hands kickoff meeting for the Community Petascale Project for Accelerator Science and Simulation (COMPASS), Fermilab, Sept 17, 2007.

CCA Forum Fall Meeting October 2007 CCA Common Component Architecture Publications & Presentations D.R. Dechow, B. Norris, and J. Amundson, The Common Component Architecture for Particle Accelerator Simulations, Proceedings of HPC-GECO/CompFrame'07, October 21-22, 2007, Montreal, Quebec, Canada, ACM, J.W. Larson and B. Norris, Component Specification for Parallel Coupling Infrastructure, in / Proceedings of the International Conference on Computational Science and its Applications (ICCSA 2007)/, O. Gervasi and M.L. Gavrilova (eds) Lecture Notes in Computer Science Volume 4707, Springer-Verlag, (2007). CTWatch paper David E. Bernholdt, The Role of Component Software Technology in Meeting the Challenge of Petascale Scientific Simulation, seminar, PetroBras CENPES (Research Center), David E. Bernholdt, The Common Component Architecture: Building Frameworks for Computational Science, keynote talk, International Conference on Modeling and Simulation in the Petroleum Industry, People & Places Fang (Cherry) Liu Tech-X (intern) Samantha Foley ORNL (intern) Damian SNL –New hire, but past Forum participant

CCA Forum Fall Meeting October 2007 CCA Common Component Architecture Recent Activities/Near-Term Plans October –Kumfert to represent TASCS at SciDAC Centers and Institutes Workshop –Shasharina invited talk at ICALEPCS07 –HPC-GECO/CompFrame, Oct, Montreal November –SC2007: Babel, CCA, Global Arrays tutorials December –e-Science 2007, December, Bangalore, India (contact Ken Chiu) April –High Performance Computing and Simulation Symposium (HPCS 2008), Ottawa, Canada (contact Masha Sosonkina)