DOE 2000 PI Retreat Breakout C-1

Slides:



Advertisements
Similar presentations
DOE 2000 PI Retreat Breakout C-1 Deb AgarwalBruce Mah Ray BairCarmen Pancerella Steve KarmesinMary Thompson Rich LehoucqBrian Toonen Jim Mabon.
Advertisements

University of Chicago Department of Energy The Parallel and Grid I/O Perspective MPI, MPI-IO, NetCDF, and HDF5 are in common use Multi TB datasets also.
Presentation at WebEx Meeting June 15,  Context  Challenge  Anticipated Outcomes  Framework  Timeline & Guidance  Comment and Questions.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
CIM2564 Introduction to Development Frameworks 1 Overview of a Development Framework Topic 1.
Software Frameworks for Acquisition and Control European PhD – 2009 Horácio Fernandes.
Astrophysics, Biology, Climate, Combustion, Fusion, Nanoscience Working Group on Simulation-Driven Applications 10 CS, 10 Sim, 1 VR.
Java Programming, 3e Concepts and Techniques Chapter 1 An Introduction to Java and Program Design.
© , Michael Aivazis DANSE Software Issues Michael Aivazis California Institute of Technology DANSE Software Workshop September 3-8, 2003.
Cyberinfrastructure Breakout Session Looking 5 years ahead... Broad themes that emerged: A) Calibration tools and skill assessment (MInt, as) B) More examples.
The Open Grid Service Architecture (OGSA) Standard for Grid Computing Prepared by: Haoliang Robin Yu.
Knowledge Portals and Knowledge Management Tools
Course Instructor: Aisha Azeem
Presented by Sujit Tilak. Evolution of Client/Server Architecture Clients & Server on different computer systems Local Area Network for Server and Client.
Architectural Design Establishing the overall structure of a software system Objectives To introduce architectural design and to discuss its importance.
System Design/Implementation and Support for Build 2 PDS Management Council Face-to-Face Mountain View, CA Nov 30 - Dec 1, 2011 Sean Hardman.
TPAC Digital Library Talk Overview Presenter:Glenn Hyland Tasmanian Partnership for Advanced Computing & Australian Antarctic Division Outline: TPAC Overview.
Using the WDK for Windows Logo and Signature Testing Craig Rowland Program Manager Windows Driver Kits Microsoft Corporation.
Java Adaptive Mathematical Modeling Engine (JAMME) Leeland Artra, Cell Systems Initiative (CSI) Zheng Li, Department of Bioengineering University of Washington,
GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.
Progress towards a National Collaboratory Stu Loken Lawrence Berkeley Laboratory.
Programming Models & Runtime Systems Breakout Report MICS PI Meeting, June 27, 2002.
Applications --- Internet2 101 Ted Hanss 13 October 2003.
Chapter 4 Realtime Widely Distributed Instrumention System.
Accomplishments and Remaining Challenges: THREDDS Data Server and Common Data Model Ethan Davis Unidata Policy Committee Meeting May 2011.
2009 Federal IT Summit Cloud Computing Breakout October 28, 2009.
Introduction to Grid Computing Ed Seidel Max Planck Institute for Gravitational Physics
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Cactus/TIKSL/KDI/Portal Synch Day. Agenda n Main Goals:  Overview of Cactus, TIKSL, KDI, and Portal efforts  present plans for each project  make sure.
Breakout # 1 – Data Collecting and Making It Available Data definition “ Any information that [environmental] researchers need to accomplish their tasks”
August 3, March, The AC3 GRID An investment in the future of Atlantic Canadian R&D Infrastructure Dr. Virendra C. Bhavsar UNB, Fredericton.
Introduction to Grids By: Fetahi Z. Wuhib [CSD2004-Team19]
Creating SmartArt 1.Create a slide and select Insert > SmartArt. 2.Choose a SmartArt design and type your text. (Choose any format to start. You can change.
Networking: Applications and Services Antonia Ghiselli, INFN Stu Loken, LBNL Chairs.
Fire Emissions Network Sept. 4, 2002 A white paper for the development of a NSF Digital Government Program proposal Stefan Falke Washington University.
GRID ANATOMY Advanced Computing Concepts – Dr. Emmanuel Pilli.
Infrastructure Breakout What capacities should we build now to manage data and migrate it over the future generations of technologies, standards, formats,
All Hands Meeting 2005 BIRN-CC: Building, Maintaining and Maturing a National Information Infrastructure to Enable and Advance Biomedical Research.
Building PetaScale Applications and Tools on the TeraGrid Workshop December 11-12, 2007 Scott Lathrop and Sergiu Sanielevici.
Session 1: Technology Development August 15 NSF Workshop.
European Grid Initiative The EGI Federated Cloud as Educational and Training Infrastructure for Data Science Tiziana Ferrari/ EGI.eu.
1 The XMSF Profile Overlay to the FEDEP Dr. Katherine L. Morse, SAIC Mr. Robert Lutz, JHU APL
April 23, A shared commitment to provide the most effective education to all students so they live successful lives. We envision using technology.
CIS 375 Bruce R. Maxim UM-Dearborn
Strategies for NIS Development
Core Services block.
Netscape Application Server
HDF5 for Real-Time and/or Embedded Test Data
The Open Grid Service Architecture (OGSA) Standard for Grid Computing
Security for Open Science
Joseph JaJa, Mike Smorul, and Sangchul Song
Collaborations and Interactions with other Projects
Software Architecture
Background and Overview
Grid Computing AEI Numerical Relativity Group has access to high-end resources in over ten centers in Europe/USA They want: Bigger simulations, more simulations.
Developing Information Systems
Integration of Network Services Interface version 2 with the JUNOS Space SDK
EGI-Engage Engaging the EGI Community towards an Open Science Commons
Chapter 5 Architectural Design.
Software Connectors.
Chapter 7 –Implementation Issues
Proposed Grid Protocol Architecture Working Group
Emerging Platform#3 Android & Programming an App
Chapter 5 Architectural Design.
Technology Department Annual Update
Segments Introduction: slides minutes
Mark Quirk Head of Technology Developer & Platform Group
Parallel I/O for Distributed Applications (MPI-Conn-IO)
Software Architecture Taxonomy
Presentation transcript:

DOE 2000 PI Retreat Breakout C-1 Deb Agarwal Bruce Mah Ray Bair Carmen Pancerella Steve Karmesin Mary Thompson Rich Lehoucq Brian Toonen Jim Mabon

Enable High-Level Problem Solving Environments Tools to enable scientists to compose solutions from a set of building blocks Seamless access to remote resources Enabling infrastructure Framework standards and interfaces Implementations of reusable components Data object conventions Candidate for SSI effort

Frameworks Interoperable tools for writing an application CCA is just a beginning in that direction Level above libraries End-user is the application developer Important to include reference implementations example application built using the framework tools allows testing of framework installation DOE 2000 and SSI

Reusable Components (Continuing DOE 2000) Separable, hierarchical ensembles Communication libraries intrasystem, intersystem, parallel I/O Numerical libraries large scale - high performance Scientific visualization libraries remote visualization support; shared viz./VR support Security function libraries Continue to identify key applications and tools they need (DOE 2000/SSI)

Common Data Objects Help share data among tools, people, machines Self-describing data structures, HDF, NetCDF (or) Standard representations, e.g., XML, LDIF Data representation conversion capabilities Move toward unique universal identifiers Core set of common objects Objects used frequently in DOE 2000 apps. and tools Ex: compute resources, certificates, ...

Common Data Objects (cont.) DOE 2000 work Standardized objects specific to Collaboratories Data representation designs SSI opportunities Common/self-describing data structures Collaboration opportunities with other agencies Facilitate access to and interoperability with digital libraries and archives Track developments of other projects, e.g., NASA IPG, NSF

Large Data Objects Data management issues for very large objects Transport of large data sets and objects Hiding of (tertiary) storage Lookup capabilities DOE2000 foci Need methods for both small and large objects SSI may need this capability Large simulation datasets Visualization output

Quality of Service End-to-end performance assurance for applications Normally thought to be network bandwidth, but also CPU and storage resources Provide an easy interface for applications to use QoS Tools so adaptive applications can modify behavior Debugging and monitoring capabilities Mostly a new area for DOE 2000 efforts These capabilities useful to SSI, DOE/DP (ASCI), others

Collaboration Environment Important to any large, distributed project Support of interactivity continuum easy progression... from low level interaction (MOO, IRC, e-mail) to mid-level (voice, shared viewers, whiteboard) to high level (video, app. sharing, screen sharing, shared viz.[SSI]) Need single login for all DOE 2000/SSI capabilities Share information between all tools

Collaboration Environment (cont.) Collaboration agents activity monitor contact, filtering, event notification recording and replay Support for asynchronous interaction notebooks and data archives (ongoing) recording and replay (emerging) facilitated search/retrieval (emerging) versioning (new)

Collaboration Environment (cont.) Approach: low threshold for entry base functionality with minimal installation easy installation of additional capabilities session management and directory services web-based view of collaborative activities Remote interaction with resources (instruments, compute resources, databases, compilers) Project management (SSI addition)

Outreach and Support Announce available capabilities provide discovery service (web) Critical to support initial users foster component reuse easy to install, well documented Enable quick success - does something fast Open Software approach (when appropriate) allow users to contribute to the maintenance [Not every innovation has an immediate use. We’re not a large community.]

DOE 2000 Testbed Applications Build relationships with application efforts Real use of Collaboratory and/or ACTS tools establish an initial user base (for feedback) help validate and steer tool R&D learn deployment and support requirements outreach to scientific community Help connect DOE 2000, ESnet, and other research programs Complement SSI applications areas