Pipeline Processing Environment Michael J Pan

Motivation The algorithms have been implemented The algorithms have been implemented Possibly located on different platforms, different machinesPossibly located on different platforms, different machines The data has been gathered The data has been gathered Possibly located on different machines, have different formatPossibly located on different machines, have different format What next? What next?

Solution Pipeline Processing Environment Pipeline Processing Environment A data flow execution environmentA data flow execution environment Useful for…Useful for… Any task where you can draw the steps in a flowchart Any task where you can draw the steps in a flowchart Any task where you need to write instructions for someone Any task where you need to write instructions for someone

A modular architecture Clean code base Clean code base No unnecessary dependenciesNo unnecessary dependencies Rapid prototyping of new functionalities Rapid prototyping of new functionalities Extensible and flexible design Extensible and flexible design

Feature rich GUI

Strong encryption Network communications uses shared secret key Network communications uses shared secret key Diffie Hellman key agreementDiffie Hellman key agreement Advanced Encryption StandardAdvanced Encryption Standard User information User information SHA1 digest of passphraseSHA1 digest of passphrase AES key from digestAES key from digest

Data Visualization Additional functionality Is integrated via the extension architecture.

Data Mediation

Grid Engine Integration

Collaborations National Alliance for Medical Image Computing (NAMIC) National Alliance for Medical Image Computing (NAMIC) Biomedical Informatics Research Network (BIRN) Biomedical Informatics Research Network (BIRN) Scientific Computing and Imaging (SCI) Institute, University of Utah Scientific Computing and Imaging (SCI) Institute, University of Utah

Goals (next 12 months) Improved usability Improved usability Data centric GUIData centric GUI Fault tolerance (system & network) Fault tolerance (system & network) More intelligent processing More intelligent processing Data validationData validation Process validation (even suggestion?)Process validation (even suggestion?) Information recoveryInformation recovery More efficient processing More efficient processing Overlay grid implementationOverlay grid implementation External software linkingExternal software linking