1. EGEE-III INFSO-RI-222667 Enabling Grids for E-sciencE www.eu-egee.org EGEE and gLite are registered trademarks EGEODE usage overview in EGEE infrastructure Gaël Youinou CGGVeritas 4 th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy

2. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 Contents 4 th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy 2 EGEODE Virtual Organisation –Applications –Global Workflow EGEODE Statistics and Usage –ISTEP - Laboratoire de Tectonique Paris6 –UMR – Géosciences Azur –UPMC - Sisyphe –IPG/EOST - Strasbourg –IPGP Jussieu Paris –ENS Géologie Paris EGEE-III Earth Science Cluster –KEREON: Grid file explorer –Automatic application test Conclusion

3. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 EGEODE Virtual Organisation 4 th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy 3 EGEODE Virtual Organization « Expanding GEosciences On DEmand » –Virtual Organization to share IT resources and best-practices –Opened to all Research centers in geosciences, initially geophysics –Close collaboration with ESR « Earth Sciences Research » VO (Earth Observation, Climate, Hydrology, Solid Earth Geophysics)

4. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 EGEODE Application 4 th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy 4 Seismic processing generic platform for research and education –Based on Geocluster (GCT), an industrial application, used in production at CGGVeritas –Key technology for earth sciences in Oil&Gas and Environment –Ported to EGEE infrastructure for Academia (2005)

5. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 4 th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy 5 EGEODE Application Seismic processing generic platform for research and education (cont’d) –Include several standard tools for signal processing, simulation and inversion (model optimization) –Open –Any user can write new algorithms in new modules –Free access for academic research –Controlled by license keys Added value –Capability to solve complex problems and to validate innovative algorithms on real size data sets –Close the gap between Research and Industrial environment –Attract and keep brightest researchers –Framework for Industry/Research collaboration

6. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 4 th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy 6 EGEODE Global workflow Pre-processing (1D, 2D) Velocity Analysis (1D,2D) Time Imaging (3D) Depth Imaging (3D) Velocity model Structural model 3D seismic Reservoir Geophysics Rock properties Run on EGEE

7. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 EGEODE VO Statistics and Usage EGEODE VO statistics –6 CNRS laboratories  ISTEP - Laboratoire de Tectonique Paris6  UMR – Géosciences Azur  UPMC - Sisyphe  IPG/EOST - Strasbourg  IPGP Jussieu Paris  ENS Géologie Paris –UNIL – Université de Lausane –~30 users –2000+ Geocluster batch jobs in 2008 –200 Gb of seismic data 4 th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy 7

8. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 ISTEP - Laboratoire de Tectonique Paris6 Hardware –Local UI (Jason) –GCT4100 &GCT3100 versions on local workstations Grid usage –Geocluster –Joint inversion of geophysical data (gravity, seismic) EGEODE –4 users (permanent members and students) –2D Multichannel seismic (360 channels), 5500 km of lines –Sequence: time variant amplitude adjustment, spherical divergence correction, spiking deconvolution, Radon (τ, p) domain antimultiple, controlled frequency-wave number (F, k) domain antimultiple and (F, k) domain filtering, dynamic correction, stack, migration 4 th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy 8

9. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 ISTEP - Laboratoire de Tectonique Paris6 EGEODE (cont’d) –TIKIM (Kirchhoff prestack time migration) was tested by a student –No use of Geovel (velocity picking) yet Dissemination –Autin Julia, PhD Thesis dec. 2008 –Basuyau Clémence, PhD Thesis, 2011. Articles expected SWOT Analysis –Advantages: Almost no installation and software management is necessary; High level of computation capacity –Drawbacks: Input and output data management; For short job (2D seismic) grid is not necessary; The module KIRCH (post- stack Kirchhoff Migration) and a similar interface as Geopad to manage the project, data, … are lacking 4 th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy 9

10. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 ISTEP - Laboratoire de Tectonique Paris6 Training –Training on the grid Collaborations –With CNRS labs who are providing hardware or expertise –IPSL’s UI ? 4 th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy 10

11. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 UMR - Geoazur Hardware deployments –1 local UI Sun Fire X2200 Opteron dual core 2,2GHz, 4Go Ram, SL 4.4) – 1 CE and 1 WN virtualized with VMware ESXi on a Sun Fire X2200 (Opteron dual core 2,66GHz, 32Go Ram, SL 4.7) –Short term planned installations 2 WN and 1 SE –NX clients are used for remote access to our local UI Grid usage –Seismic data processing on Geocluster –Others software deployed on the Grid are used Seismic Unix and GMT (Generic Mapping Tools) 4 th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy 11

12. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 UMR - Geoazur EGEODE –Users into the laboratory 3 permanent members, students –Processed studies 2D marine multichannel seismic Around 3000 km of seismic lines are recorded during a survey –Seismic processing workflow –Minimum phase conversion (WAPCO) –Static application (HISTA) – High frequency filtering - time gain function, spherical divergence compensation (REFOR, SDICO) – corrections of amplitude anomalies (EDITE, EXPEN, HARMO, SPARN, DYNQ) – Deconvolution (TRITA, (DECON)) 4 th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy 12

13. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 UMR - Geoazur EGEODE (cont’d) –Velocity analysis VESPA, VELCOM –NMO correction (FANMO) - trace muting (MUTES) –F-K multiple attenuation (FKMUL, FKFIL)- 2D Kirchhoff DMO (QRDMO, KIDMO) –Trace stacking (STACK)- frequency filtering (FILTR) – 2D post stack migration (KIRCH, FKMIG)- amplitude equalization - Plots (DYNQ, AMCO, FKFIL, PLOTX) 4 th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy 13

14. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 UMR - Geoazur EGEODE (cont’d) –Feedback information on Geocluster utilization Few difficulties have been encountered when transferring older Geovecteur and local Geocluster sequences to the Grid The Kirchhoff prestack time migration (TIKIM) is still in phase of test Interactive applications on the Grid offer the same performances as working on a local version of the software Dissemination –PhD students were used to working on Geovecteur for their processing workflow This practice tends now to disappear to the benefit of Geocluster usage A Master student is actually working on Geocluster and will transfer very soon her job flow to the Grid 4 th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy 14

15. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 UMR - Geoazur SWOT Analysis –In practice the installation and the setup of a EGEE UI is very simple compared to a local installation of Geocluster, however the installation of CE and WN requires good knowledge in system and network administration –Requests for GCT module: a module that takes seismic section as input and generates images in Postscript format file 4 th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy 15

16. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 UMR - Geoazur Training –Feedback information on CGGVU training courses Very good dedicated program, well adapted to our 2D marine processing sequences and data –Futures needs Deconvolution and multiple attenuation Conclusion –The execution time of a job on the Grid indicates good performances, however when large files are transferred to the Grid, this has direct impact to the execution time of a job In this case, it’s more comfortable to work on a local version of Geocluster –We plan ton install a SE on the laboratory to improve access to the data 4 th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy 16

17. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 UPMC - Sisyphe Hardware –Inside laboratory Small cluster of 9 nodes (bi-processor 32bit) Three years old Access only from local network Study for a computing server gathering several labs of Earth Siences inside UPMC, including Sisyphe. –Nx server Only UI2 from CGGVeritas Grid usage –Geocluster –Geovel –Other in-house codes (Fortran 90) 4 th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy 17

18. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 UPMC - Sisyphe EGEODE –Number of users For now 3 –Type of studies Seismic processing (Geocluster, Geovel), development of a modeling code in CSEM (Controlled Source ElectroMagnetic) –Type of jobs Sequential for Geocluster, MPI for CSEM modeling –Geocluster feedback Simplicity of utilization, but lack of staff for solving technical problems quickly on the site (sometimes long waiting time) –Geovel feed back Simplicity of utilization, but random bugs 4 th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy 18

19. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 UPMC - Sisyphe Dissemination (PhD thesis) –“Contrôle de la qualité du traitement des données sismiques du bassin sédimentaire de la Côte d’Ivoire – Apport de la géostatistique – Tentative de retraitement” (Marie Oussou) –“Etude par simulation de méthodes électromagnétiques employées au suivi d’un réservoir en production” (Cyril Schamper) SWOT Analysis –Pros/Cons in comparison to a local use of Geocluster: access from everywhere via internet –Needs for Geocluster Nothing particular, exhaustive information 4 th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy 19

20. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 UPMC - Sisyphe Training –No training Learning by experiencing Collaborations –Collaboration with other VO With ESR if needed –Collaboration with other CNRS labs (material and expertise) Occasionally with researchers from IPGP who administrate ESR VO 4 th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy 20

21. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 IPG - Strasbourg Hardware –Local UI bi-pro Xeon E5345 quad-core 2,33 GHz, RAM 8Gb) –Nx server usage (local server, server installed on UI2 based in CGGVeritas) Grid usage –Only Geocluster –Local cluster available, access to distant academic clusters EGEODE –3 (1 permanent member, 2 students) –Type of studies: PSV-3C and conventional seismic processing –PSV-3C tests, fluvial seismic –Geometry, anti-multiples, migration 4 th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy 21

22. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 IPG - Strasbourg EGEODE (cont’d) –License sharing (SDI Montage) –Specific software (XPS, Geoland) installed on UI2 located in CGGVeritas Dissemination –Internship reports, current work SWOT Analysis –Advantages: Access to the state of the art software including last versions of new applications (Kereon, Jxjob); Shared resources (CPU’s, disks, …) –Drawbacks: Tapes, cartridges or file management; Delays (execution, end of jobs – listings); No easy procedure for UI installation 4 th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy 22

23. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 IPG - Strasbourg Training –CGGVeritas University training Useful and necessary –Tutorial or HowTo on complex applications (geoland, XPS) would be nedeed Collaborations –Collaborations with EGEODE users 4 th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy 23

24. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 IPG - Paris Hardware –No hardware installed locally Grid usage –Only Geoclustrer EGEODE –Pre-stack migration jobs will be ported ASAP on the grid Training –Well adapted training on TEAMVIEW, GEOVEL and TIKIM –No more need today Collaborations –With IPSL or the “ Laboratoire de Tectonique“ 4 th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy 24

25. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 ENS Géologie Paris 4 th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy 25 User report on Geocluster and EGEODE VO in academic research

26. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 ENS Géologie Paris 4 th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy 26 Marine geophysics in the Geol Lab, geodynamics team –Episodic cruises, episodic processing needs –Basic seismic processing lessons for students using CGG software –Long periods without activity, as marine geophysics is a component amongst wider topics in geodynamics –Software used before Geocluster/EGEODE Geovector 6100! Updates are time consuming for researchers when compared to the episodic use As a result we cannot follow state of the art processing methods

27. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 ENS Géologie Paris 4 th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy 27 Problems solved by Geocluster & EGEODE VO in such an environment –Updates are progressive through the CGGVeritas servers –Stability of the UI platform –No need to invest in a Cluster for just an episodic use The laboratory can just share a few nodes on the grid 24/7 and use this shared capacity in a short time on more nodes when needed –New tools (Teamview, Chronovista...) –Prestack time migration (TIKIM) now possible

28. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 EGEE-III Earth Science Cluster KEREON: Explorer for local and lfc grid files –Browse directories –Upload and download files –Rename files and directories –Delete files and directories –Replicate lfc files –Read the properties of files and directories –A GUI to manage data on the grid –User can browse the grid storage services and catalogs as easier as for a local file system. –Allow the user to exchange data between the local UI and the grid storage services very easily –Without typing any command line, only by mouse click 4 th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy 28

29. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 EGEE-III Earth Science Cluster Automatic application test –Create a tool (like SAM) who  Check all sites automatically for an application  Ban some of them if they are not appropriate for the application  This information could be used before sending a new job 4 th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy 29

30. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 Conclusion EGEODE Virtual Organisation –Advantages  Almost no installation and software management is necessary  High level of computation capacity  Shared resources (CPU’s, disks, …); No need to invest in a Cluster for just an episodic use  Access from everywhere via internet  Access to the state of the art software including last versions of new applications –Drawbacks  Input and output data management  For short job (2D seismic) grid is not necessary  UI installation very simple however the installation of CE and WN requires good knowledge in system and network administration  Good performances, however when large files are transferred to the Grid, this has direct impact to the execution time of a job (more comfortable to work on a local version) 4 th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy 30

31. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 References EGEE project: http://www.eu-egee.org http://www.eu-egee.org EGEE Earth Science Cluster Portal: http://esc.wdcb.ru/ http://esc.wdcb.ru/  ES Workplan: https://edms.cern.ch/file/937512/1/work-plan-ES-v4.0.doc https://edms.cern.ch/file/937512/1/work-plan-ES-v4.0.doc BEinGRID project: http://www.beingrid.eu http://www.beingrid.eu DEGREE project: http://www.eu-degree.eu http://www.eu-degree.eu Geocluster: http://www.cggveritas.com/default.aspx?cid=4-13-1925 http://www.cggveritas.com/default.aspx?cid=4-13-1925 EGEODE: http://www.egeode.org http://www.egeode.org Kereon Online demonstration: http://www.egeode.org/egeode/packages/KEREON/1.4.6/kereon.html Installation document: http://www.egeode.org/egeode/packages/KEREON/1.4.6/kereon-installation.pdf 4 th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy 31

32. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 4 th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy 32 CGGVeritas is the world’s leading international pure-play geophysical company delivering a wide range of technologies, services and equipment to its broad base of customers mainly throughout the global oil and gas industry Focused on Performance. Passion for Innovation. Powered by People. Delivered with Integrity We look forward, as CGGVeritas, to serving you in the future.