1. Gordon Erlebacher Florida State University
Vlab Framework
Gordon Erlebacher
Florida State University

2. Typical workflow workflow job submission Elasticity code input
data collection ?
data analysis and visualization
Defines a
workflow
Phonon code
… more of the same …

3. VLAB design principles
All services are available at multiple locations (redundancy)
No single point of failure
Automatic resource discovery
Development of client interfaces and services are decoupled
User interaction is through web browsers (and other specialized client software)
Assume the system will be (eventually) be used by hundreds of users on thousands of systems
Independence of the languages used to write the services

4. VLAB requirements Collaboration Ease of use Flexibility
Fault tolerance (hardware failures)
Diversity of tools
analysis, visualization, data reduction, storage, etc .

5. IT team (US component) Gordon Erlebacher (FSU)
Dave Yuen (UMN) (client interfaces)
Marlon Pierce (IU) (portals)
Bijay Karki (LU) (visualization)
Stefano Cozzini (Italy) (scheduling)
Kirsten Kleese van Dam (UK) (metadata)

6. Mantle Convection
5003 grid
Ra=1010

7. Mantle Convection Ra = 5 x 108 Streamlines Isosurface Line Integral
Convolution
Ra = 5 x 108
Produced with Amira

8. ElasViz

9. Visualization Algorithm Challenges
Strike balance between
High- resolution versus interactive speed
Batch versus interactivity
Intelligent compression
Time-dependent datasets
Interactive navigation through a Terabyte dataset across a distributed system?
How to share datasets from > time-dependent simulations

10. Client devices
University of Minnesota

11. Clients Clustering of earthquake events WEB-IS Mantle convection
HTML interface to AMIRA
Clients
Clustering of earthquake events
WEB-IS Mantle convection

12. VLAB components Portals (user front end) Services (tasks)
Schedulers (schedule task execution)
Data/metadata transport mechanisms
Middleware to connect 1-4 based on NaradaBrokering

13. Message structure (publish-subscribe)
Topic
Headers
Body: SOAP message

14. Message Flow with SOAP Client specfies remote commands
Service executes remote commands
Remote call is encoded in soap message
Return values are encoded in soap message

15. Messaging with SOAP through Naradabrokering
Client
Service
Narada-
Brokering
SOAP
SOAP
Wrapped SOAP
Wrapped SOAP
Client Proxy
Service Proxy

16. Grid – Collaboration NaradaBrokering

17. Workflows Services have multiple inputs/outputs
Connect services together to form a workflow
conditionals
loops
Elasticity code
input
job submission
data collection
data analysis and visualization ?
Phonon code

18. Schedulers
Take a high level task definition and break it into subtasks
Submit these subtasks to appropriate services
Return results to the subscribers
(role of HPSEARCH)

19. Grid – Collaboration NaradaBrokering

20. Everything is a service
Data input
Job submission
Analysis tools
Visualization tools
Data storage
Scheduling

21. Services Can be written in any language with an interface to SOAP
Executed via remote calls
Defined in terms of an interface (WSDL)

22. Simulation Services Create “smart” input files Job submissions
hide details of computational resources, concentrate on requirements for successful run(s)

23. Storage Services Retrieve files from storage
Supercomputer
File servers
Archival storage
Process file (on one or multiple servers)
Extract subset
Filter subset
Transform subset
Send processed file for computing or visualization services

24. Visualization Services
Offscreen, hardware-accelerated, remote visualization
Wrap existing visualization software
Amira
VTK
Specialized applications (e.g. elasviz -- Karki 2005)
Movie creators

25. Portals Front end for users Reconfigurable Used for job submission
visualization
data analysis
monitoring
collaboration

26. Summary Challenging goals Potential payback is enormous
Accomplishments
Initial portals to Espresso input
Leveraging of existing software for job submission
In the process of converting visualization tools to visualization
Initial version of Naradabrokering-based framework is in progress

27. 10 months in the future … Implement test workflow
data input and submission of many elastic codes
collection and visualization of data
basic collaboration between two (or more) individuals