1. HAH 2007/05/09 Connecting LOFAR to the GRID Hanno Holties, ASTRON IVOA - OGF Astro-RG Work Shop Manchester, 9th May 2007

2. HAH 2007/05/09

4. First result: 96 LBA antennas Upto 400 m apart Dynamic range: ~1000:1 Cas A (strongest source) removed from image

5. HAH 2007/05/09 LOFAR operational model

6. HAH 2007/05/09 LOFAR Central systems Process ‘raw’ data Calibration Reduce in size Temporary Storage Raw data: 5 days Processed dataproducts: 1 month Push data to users Science centers subscribe & publish storage location LOFAR scheduler initiates …or interactive

7. HAH 2007/05/09 The LOFAR Network & GRID 700 Gbps dedicated fibre 2 Gbps lightpaths 20 Gbps lightpaths GRID Computing centers Science centers LOFAR instrument (Dutch part) International LOFAR stations Science center with local storage

8. HAH 2007/05/09 GRID utilization Long term storage In general at computing center Searchable database Data mining Virtual Observatory Offline processing Reprocessing Source extraction Differencing (search for variable or new sources)

9. HAH 2007/05/09 Storage requirements Required storage capacity depends on Datatype (timeseries, visibilities, images) Number of stations involved Required time, frequency, and spatial resolution Prognosis 1.8 PB/Yr

10. HAH 2007/05/09 Processing requirements In process of being defined Applications still being developed GRID awareness of scientists just starting Proximity to, and available bandwidth for, storage IO limited Operate on Multi-Terabyte datasets Mostly embarrassingly parallel Environment Application requirements HPC tuning requires system details Shield from scientist

11. HAH 2007/05/09 Where are we? Working group LOFAR & GRID Meets on monthly basis Users, RCG, SARA, NIKHEF, ASTRON/LOFAR EGEE Tutorial before the summer LOFAR VO (in GRID context) Group for each KSP (to become per science center) Resources at SARA; RCG to follow shortly Glite TAR-UI installed on storage frontend Some groups have started to get their feet wet Kapteyn Institute UvA Transients group

12. HAH 2007/05/09 eLOFAR: The extended LOFAR Interest from international partners in: Germany (www.lofar.de)www.lofar.de UK (www.lofar-uk.org)www.lofar-uk.org France Sweden Italy Poland Aiming to extend LOFAR with: International stations Science Centers. Computing centers

13. HAH 2007/05/09 LOFAR challenges for GRID Storage 20 Gbps sustainable bandwidth Multi-Petabyte growth per year Interactive databases Processing Operate on Multi-TB datasets Applications with varying requirements Usability Reliable facilities Technical details shielded from (general) user

14. HAH 2007/05/09