INAF experience in Grid projects F. Pasian INAF
Wed 17 May GRID.IT Project The GRID.IT Project The GRID.IT Project –Application 1 Accessing Databases through the GRID Accessing Databases through the GRID Processing Data extracted from Databases Processing Data extracted from Databases Ingesting results of Data Processing in Databases Ingesting results of Data Processing in Databases –Application 2 Porting in GRID the VST Pipelines Porting in GRID the VST Pipelines –Application 3 Monitoring of Astronomical Instrumentation through the GRID Monitoring of Astronomical Instrumentation through the GRID
Wed 17 May GRID.IT / Future evolution G-DSE + QE G-DSE + QE –G-DSE prototype engineering –Design, implementation and test of the QE –G-DSE + QE in production G-ICS + IE G-ICS + IE –Design, implementation and test of the G-ICS and of the IE –G-ICS + IE in production
Wed 17 May In production…but where ? G-DSE + QE G-DSE + QE –All INAF Databases in GRID with G-DSE –Other scientific communities are testing it : INFN, Bioinformatics, Archaeologists, … –Supporting Planck simulations in future releases –Projects in preparation to port it on EGEE and DEISA G-ICS + IE G-ICS + IE –Close contacts with GridCC –Strong interest for instruments and sensors in Grid ICTP and INAF Naples : monitoring and controlling networks of sensors via Grid ICTP and INAF Naples : monitoring and controlling networks of sensors via Grid
Wed 17 May DRACO A Grid portal thought and designed for astrophysical applications A Grid portal thought and designed for astrophysical applications Porting astrophysical applications in GRID Porting astrophysical applications in GRID –Definition of astronomical data analysis workflow on a service- oriented Grid architecture using BPEL (Manna et al.) –Data Mining and Massive computing for GRID at Naples-Salerno Unit –Astronomical Data Reduction in Data Grid –Various kinds of evolutionary models –ACME for GRID The INAF VO is now growing The INAF VO is now growing
Wed 17 May Planck simulations in EGEE Planck simulations (whole mission, two complete sky surveys, 74 detectors) Planck simulations (whole mission, two complete sky surveys, 74 detectors) Officially supported pilot EGEE application since November 2004 Officially supported pilot EGEE application since November 2004 Planck application also in EGEE-2 Planck application also in EGEE-2 A Planck VO, led by INAF Trieste, is in place. It groups together Grid sites located in six European countries A Planck VO, led by INAF Trieste, is in place. It groups together Grid sites located in six European countries
Wed 17 May Planck simulations in EGEE Planck simulations didn’t make use of databases until now, but… Planck simulations didn’t make use of databases until now, but… –They could be profitably integrated and used in the near future –Ground based test and calibrations of the spacecraft and of the instruments are now in progress –Data collected in this phase must be saved somewhere and used during the operative phase of the mission …therefore this is a new test-bed for G-DSE …therefore this is a new test-bed for G-DSE
Wed 17 May TriGrid Virtual Laboratory
Wed 17 May TriGrid Virtual Laboratory Catania Pole: Catania Pole: –~100 machines dual CPU 32/64 bit. Aggregated power of 300 kSpecInt2000. –30 TB of storage EIDE-to-SCSI or FC-to-SATA in RAID 0,1,5 –20 working stations for development/porting of applications Messina Pole: Messina Pole: –~80 machines dual CPU 32/64 bit. Aggregated power of ~240 kSpecInt2000. –20 TB of storage EIDE-to-SCSI or FC-to-SATA in RAID 0,1,5 Palermo Pole: Palermo Pole: –~30 machines dual CPU 32/64 bit. Aggregated power of ~100 kSpecInt2000. –10 TB of storage EIDE-to-SCSI or FC-to-SATA in RAID 0,1,5
Wed 17 May Training and dissemination How to train ? How to train ? –Meetings and workshops both at national and European level Theoretical lessons Theoretical lessons Practical training Practical training –Astronomers bring applications of interest and try to gridify them with our help –On site dedicated workshops –Grid schools –Coordination with Working Groups having the same objectives (the Planck Working Group 8)
Wed 17 May INAF and Astro-RG (1) There is a community of astrophysicists (mainly theoreticians) already having “native” access to the “production Grid” facilities There is a community of astrophysicists (mainly theoreticians) already having “native” access to the “production Grid” facilities Need to foster Grid-VObs interoperability in the broader sense: Need to foster Grid-VObs interoperability in the broader sense: –usage within VObs of de-facto Grid standards (besides monitoring GGF evolution) –allow access to the VObs “from the Grid side” (two-way street): e.g. interconnection between Grid and (IVOA- compliant) data resources; VObs accessibility from Grid workflows (BPEL) Training/dissemination activity for Grid-VObs users Training/dissemination activity for Grid-VObs users
Wed 17 May INAF and Astro-RG (2) We propose the formal participation of INAF in IVOA Astro-RG IG on these topics (already investigating interactions between Euro-VO and EGEE within the VO-DCA project) We propose the formal participation of INAF in IVOA Astro-RG IG on these topics (already investigating interactions between Euro-VO and EGEE within the VO-DCA project)