CCA Forum Fall Meeting October CCA Common Component Architecture Update on TASCS Component Technology Initiatives Lois McInnes, Focus Lead Presented by Jarek Nieplocha, HPC Initiative Lead
CCA Forum Fall Meeting October 2007 CCA Common Component Architecture Support for Emerging HPC Hardware and Software Paradigms Overall Goal: Enable effective use of CCA on emerging HPC architectures Multiple-Component-Multiple-Data (MCMD) CCA Technology enables componentization of apps based on multiple levels of parallelism with focus on massively parallel systems. CCA on Heterogenous Architectures helps with portability and management of software modules executing on hardware accelerators (FPGA, IBM Cell, NVDIA Tesla etc). –Ongoing work: mass spectrometer applications: code transformations to make new component CCA in Fault Tolerant Environments focuses on better support for massively parallel architectures where frequent hardware faults are expected. –ORNL represents us on ASCR CIFTS project. –Tried to harmonize CCA Event Service with their API for the Fault Tolerance Backplane (currently frozen to support SC’07 demos) –A component-based FT demonstration using the FTB has been delayed due to platform access and application portability issues.
CCA Forum Fall Meeting October 2007 CCA Common Component Architecture MCMD Recent activities focus on development of specifications for CCA-based processor groups teams –BOFs held during CCA meetings in April and July, 2007 –Mini-Workshop held January 24, 2007 –Use cases documented and analyzed –Wiki webpage and mailing list: Specifications document version 0.3 –Telecon held Sept 28, 2007 –Some people sent good comments by –Issues about threads, fault tolerant environment, MPI-centric narrative and examples, ID representation Plans –Complete and present the document at the next meeting –Prototype implementation and some application evaluation
CCA Forum Fall Meeting October 2007 CCA Common Component Architecture Software Quality and Verification Overall Goal: Extend component interface definitions with semantic annotations that can be verified/enforced at composition or run time (contracts) Recent Activities –Publications S. Parker et al., “Enabling Advanced Scientific Software,” submitted to Cyberinfrastructure Technology Watch ( for special 4 th quarter “DOE SciDAC Software Enabling Technologies for Petascale Science” issue. –Presentations T. Dahlgren, “Performance-Driven Interface Contract Enforcement for Scientific Components,” in Proceedings of the 10th International ACM SIGSOFT Symposium on Component-Based Software Engineering (CBSE-10), Medford, MA, July 9-11, Also available as Lawrence Livermore National Laboratory Technical Report UCRL-PRES –Progress integrating experimental enforcement features into Babel repository Refactored runtime library features to better encapsulate internal use-only methods. Revised assertion regression test (Vector Utils) – more robust implementation and client side cleanup (including comments with new enforcement-related calls). Preliminary integration of new features into command line, user options, DTD, XML parser, and symbol table. –University/education interactions: T. Dahlgren submitted to UC Davis committee the latest version of Ph.D. thesis partially based on this work Plans –October-December: Complete integration of experimental enforcement features into the Babel compiler (i.e., symbol table, C back end, and IOR) … capabilities to be used by CQoS working group.
CCA Forum Fall Meeting October 2007 CCA Common Component Architecture Computational Quality of Service Overall Goal: Develop infrastructure for dynamic component adaptivity, i.e., composing, substituting, and reconfiguring running component applications in response to changing conditions –Performance, accuracy, mathematical consistency, reliability, etc. CQoS Wiki and mailing list: Recent Activities –CQoS session (pre-CCA meeting): July 18, 2007, Silver Spring, MD Updates from everyone: See details/slides: –Joe Kenny (SNL): Automatic selection of integral evaluators in quantum chemistry –Jaideep Ray (SNL): A first evaluation of rule-based dynamic configuration of load-balancers for AMR simulations of flows –Masha Sosonkina (Ames): Adaptivity features of sparse iterative linear algebra kernels represented as components –Alan Morris (Univ of Oregon): CQoS infrastructure in TAU –Andrea Berger (Clarion Univ), Lois Curfman McInnes and Boyana Norris (ANL): Simple linear solver components using SciPy –Li Li (ANL): CQoS infrastructure for scientific applications –Rob Armstrong (SNL): A data component for the CQoS testbed Group discussion: Applications teams' highest priority for CQoS infrastructure: tools for performance database query and management Decided to establish monthly group telecons to sync on overall progress –Thus far have been very useful and effective
CCA Forum Fall Meeting October 2007 CCA Common Component Architecture Computational Quality of Service Recent Activities (cont.) –CQoS telecon: Aug 27, 2007 Details: Joe Kenny (SNL): plans for quantum chemistry simulations using CQoS tools Jaideep Ray (SNL): plans for combustion simulations using CQoS tools Li Li (ANL): plans for adaptive linear solvers using matrix metadata via Anamod; proposed performance database store and query API –CQoS telecon: Sept 24, 2007 Details: Jaideep Ray (SNL): CQoS database usage in combustion Joe Kenny (SNL): CQoS database usage in quantum chemistry Meng-Shiou Wu (Ames): chemistry performance database and CQoS Li Li, Boyana Norris, and Lois McInnes (ANL): CQoS database usage in adaptive linear solvers –CQoS BOF: to be held tomorrow (Oct 12, 2007) Review new performance metadata formats that were coordinated by PERI (Boyana Norris) Establish specific requirements for new performance database capabilities Work on defining component interfaces for database query and management (C++ and SIDL)
CCA Forum Fall Meeting October CCA Common Component Architecture Key = Done = On Track | Visible progress = Need More Next Meeting = Unknown Key = Done = On Track | Visible progress = Need More Next Meeting = Unknown Environment Year 1 Deliverables Gary Kumfert ?
CCA Forum Fall Meeting October 2007 CCA Common Component Architecture Feedback to GNU Core Tools: Ben Institutions: SNL, LLNL, UU, ORNL, ANL PORTING to NLCF Machines –XT-3 Babel (ORNL-lead) –Wael started this in Indiana Mtg. Ccaffeine (SNL-lead) Tutorial (?) Toolkit (?) –Blue Gene Babel (LLNL-lead) Ccaffeine (SNL-lead) Tutorial (?) Toolkit (?) Set up Helpdesk (LLNL-lead) – Documentation –CCA Specification (LLNL-lead) Babel ported to BG/L (thanks Tom) C,C++,F77 independently confirmed at ANL (thanks Boyana) Postpone? Tutorial & Toolkit are being rewritten w/ Bocca for SC|07
CCA Forum Fall Meeting October 2007 CCA Common Component Architecture Inter-framework Prototypes –CCA-Kepler (UU-lead) –XCAT-BabelRMI (BU-lead) Enhancements: Tom Institutions: LLNL, BU, UU, SNL, ORNL CCA Services –CommandLineService (???) –MPIService (SNL-lead) –EventService (UU-lead) Waiting on CCARB to be finalized –GuiBuilderService (ANL-lead) Waiting on EventService New CCA Specification Process –Passed –Awaiting CCARB to be named & approved CCA 1.0 Requirements Doc –(Modelled after Babel’s activity) –Will start up as a WG once CCARB is seated Babel Structs (Y2 deliverable) –C/C++ bindings are in SVN –More details in Babel Roadmap talk later Bonus Items Funding delays ?
CCA Forum Fall Meeting October 2007 CCA Common Component Architecture Usability: Craig Institutions: LANL, SNL, ANL, ORNL, Tech-X, PNNL, LLNL Draft CCA-Lite Spec & Fwk (LANL-lead) Component Test Harness (ORNL-lead) Document Multilanguage & Component Debugging Techniques (SNL or ANL) This section is being refocused. Matt will lead a separate discussion about usability. Matt ?
CCA Forum Fall Meeting October 2007 CCA Common Component Architecture Major New Activity Started collaboration with CScADS, ITAPS, and Chemistry Apps to look for optimization techniques to improve performance of Babel. John Mellor-Crumney is looking to apply compiler optimization technologies to the multi-lingual environment Babel presents. New mailing list: We will meet again at SC|07 (exact time/place TBD)
CCA Forum Fall Meeting12CCA Forum Fall Meeting11-12 October CCA Common Component Architecture Toolkit Rob Armstrong Focus Lead
CCA Forum Fall Meeting October 2007 CCA Common Component Architecture Toolkit News Sandia is looking at componentizing Chambo. Bocca is to be released. –Toolkit components can be easily created from existing code –See other presentations today A toolkit component porting camp?
CCA Forum Fall Meeting14CCA Forum Fall Meeting11-12 October CCA Common Component Architecture User and Applications Outreach and Support David E. Bernholdt Focus Lead
CCA Forum Fall Meeting October 2007 CCA Common Component Architecture Application Support and Collaboration ProjectTASCS Institutions Quantum Chemistry SAPSNL SWIM (fusion)IU, ORNL FACETS (fusion)ANL, IU, LLNL, Tech-X TAUCQoS team GWACCAMOLE: GroundWAter CCA MOdeling Library and ExtensionsPNNL Polygraph proteomics mass spect. analysisPNNL CPES (fusion)UMD NWChemPNNL CScADS/TASCS/QC SAP/ITAPSLLNL, ORNL GNEP integrated reactor simulation prototypeORNL Beam dynamics modeling (accel. phys.)ANL COMPASS (accel. phys.)ANL CFRFS (combustion)SNL Instrument Middleware Project (NSF)IU
CCA Forum Fall Meeting October 2007 CCA Common Component Architecture SciDAC Center/Institute Collaborations Center/InstituteLeadTACS POC Petascale Data StorageGarth Gibson, CMU (PERI)Bob Lucas, USC/ISIBoyana Norris Ultrascale VisualizationKwan-Liu Ma, UCD (CSCAPES)Alex Pothen, ODU (APDEC)Phil Colella, LBNL (ITAPS)Lori Diachin, LLNL (TOPS)David Keyes, ColumbiaLois McInnes (CEDPS)Ian Foster, ANL (CScADS)John Mellor-Crummey, RiceGary Kumfert (ESG-CET)Dean Williams, LLNLDavid Bernholdt (SDM)Arie Shoshani, LBNLSteve Parker (VACET)Wes Bethel, LBNL
CCA Forum Fall Meeting October 2007 CCA Common Component Architecture Potential Collaborations Govindaraju–ORNL on HPC checkpointing –not CCA yet, but natural connection with HPC initiative Chiu-BU cardiac modeling –CCA potential Bernholdt, Shasharina–ITER Integrated Modeling –Common data model, interfaces, possibly frameworks –September meeting in France, second with this group Norris–Community Surface Dynamics Modeling U Colorado (NSF) Larson–A Data Domain to Model Domain Conversion Package (DMCP) for Sparse Climate Related Process Measurements (SciDAC SAP)
CCA Forum Fall Meeting October 2007 CCA Common Component Architecture Publications & Presentations Fang Liu and Randall Bramley, CCA-LISI: On Designing A CCA Parallel Sparse Linear Solver Interface, Proc. of the IEEE International Parallel and Distributed Processing Symposium, 2007 Steven G. Parker, Kostadin Damevski, Ayla Khan, Ashwin Swaminathan, Chris R. Johnson. The SCIJump Framework for Parallel and Distributed Scientific Computing. In Advanced Computational Infrastructures for Parallel/Distributed Adaptive Applications. Edited by Manish Parashar, Xiaolin Li, and Sumir Chandra, Wiley Press, 2007 (to appear) K.Damevski, A. Swaminathan, S. Parker. "Highly Scalable Distributed Component Framework for Scientific Computing". In Proceedings of the 3rd International Conference on High Performance Computing and Communication (HPCC 2007), Houston, Texas K. Damevski, K. Zhang, S. Parker "Practical Parallel Remote Method Invocation for the Babel Compiler". In Proceedings of the HPC-GECO/CompFrame'07 Workshop, Montreal, Canada (accepted) Jarek Nieplocha keynote at 7th International Conference on Parallel Processing and Applied Mathematics on Sept. 10 in Gdansk, Poland D. Dechow and L. McInnes, Components for Beam Dynamics, All-Hands kickoff meeting for the Community Petascale Project for Accelerator Science and Simulation (COMPASS), Fermilab, Sept 17, 2007.
CCA Forum Fall Meeting October 2007 CCA Common Component Architecture Publications & Presentations D.R. Dechow, B. Norris, and J. Amundson, The Common Component Architecture for Particle Accelerator Simulations, Proceedings of HPC-GECO/CompFrame'07, October 21-22, 2007, Montreal, Quebec, Canada, ACM, J.W. Larson and B. Norris, Component Specification for Parallel Coupling Infrastructure, in / Proceedings of the International Conference on Computational Science and its Applications (ICCSA 2007)/, O. Gervasi and M.L. Gavrilova (eds) Lecture Notes in Computer Science Volume 4707, Springer-Verlag, (2007). CTWatch paper David E. Bernholdt, The Role of Component Software Technology in Meeting the Challenge of Petascale Scientific Simulation, seminar, PetroBras CENPES (Research Center), David E. Bernholdt, The Common Component Architecture: Building Frameworks for Computational Science, keynote talk, International Conference on Modeling and Simulation in the Petroleum Industry, People & Places Fang (Cherry) Liu Tech-X (intern) Samantha Foley ORNL (intern) Damian SNL –New hire, but past Forum participant
CCA Forum Fall Meeting October 2007 CCA Common Component Architecture Recent Activities/Near-Term Plans October –Kumfert to represent TASCS at SciDAC Centers and Institutes Workshop –Shasharina invited talk at ICALEPCS07 –HPC-GECO/CompFrame, Oct, Montreal November –SC2007: Babel, CCA, Global Arrays tutorials December –e-Science 2007, December, Bangalore, India (contact Ken Chiu) April –High Performance Computing and Simulation Symposium (HPCS 2008), Ottawa, Canada (contact Masha Sosonkina)