Presentation is loading. Please wait.

Presentation is loading. Please wait.

Raymond Plante National Center for Supercomputing Applications Coming DC3 Middleware Development.

Similar presentations


Presentation on theme: "Raymond Plante National Center for Supercomputing Applications Coming DC3 Middleware Development."— Presentation transcript:

1 Raymond Plante National Center for Supercomputing Applications Coming DC3 Middleware Development

2 Middleware Development in PT1.1 Data Butler-Job Office integration (rlp; 9/24) Consolidating Pipelines (ktl; Logging in service of performance analysis Production Stopping Data movement automation Other stretch goals: –Cleaning up configuration issues –Realtime status

3 Beyond PT1.1: R&D Replacing Job Office –Prototype with an existing system (NHPPS, Condor X) Interslice communication: –Basics are there, but unexercised –Mechanisms for more logical access to shared data More Complex flow within the harness –Looping over stage sequences, conditionals –Can this be automated or otherwise made easier? Improved I/O techniques –Multithreading for I/O: allow processing and I/O overlap Improving Fault tolerance –Rescheduling failed iterations –Techniques for looser coupling

4 Beyond PT1.1: R&D Tools for validating pipeline construction –Checking stage policies to check if stages fit together Desktop support Freeze-drying a clipboard for debugging purposes


Download ppt "Raymond Plante National Center for Supercomputing Applications Coming DC3 Middleware Development."

Similar presentations


Ads by Google