1. Extending Petascale I/O with Data Services Hasan Abbasi Karsten Schwan Matthew Wolf Jay Lofstead Scott Klasky (ORNL)

2. Motivation I/O bottleneck Petascale data sizes Data overload Faster solution

3. Observations Fast Extraction Flexibility in where we execute operations Managed output to data consumer Flexible resource utilization

4. Compute Area  Using ADIOS for flexibility in choosing output method  Data is serialized using FFS  COD provides a processing hook within the compute application  SmartTap generates the output buffer through a user defined function  DataTap moves the data to the staging area

5. Staging Area  Additional resources for buffering before storage  Simple operations like aggregation  Complex analysis and compression operations  Domain specific services  Combination of extraction, processing and storage  Placement to optimize performance

6. Runtime Overhead