EGRID The EGRID project S.Cozzini Athens, 21 rs April 2005

Agenda The EGRID project (short overview) The new egrid community The added value for EGRID The added value for EGEE Our plans/commitments

The EGRID project A FISR project funded by MIUR (2003) Original Aim: Use of grid paradigm for research on complex system in economics and finance MIUR asked to similar FISR projects to coordinate together ICTP new task: Provide a National Italian Facility for economical and financial data using grid technology

The EGRID community Several different research groups in Italy Palermo: dep of Physics; Roma: dep. Of Physics; Roma: IAC-CNR Istitute; Ancona: Department of Economics; Firenze: dep. of Statistics. Alessandria: dep of Physics; Trieste: Dep of Economics Dep of Engineering Area Science Park ICTP 2 groups in USA: UCLA + Columbia Grid research applied to finance They posed the user requirements to the Egrid team at ICTP

User requirements in a nutshell High Frequency Financial Data: raw data Different Stocks Exchanges (NYSE/LSE/Paris/BorsaMilano). Restricted access to raw data acquired under legally binding disclosure policies (privacy and security) Raw Data should be: Safe kept/backed-up/shared on the GRID Actions on the raw data: transformations Filtering procedures (size reduced) Building procedures (size increased) Authorized and authenticated access to financial databases Computational power To transform data / To perform simulations

EGRID infrastructure Version 1.0 released: 8-9 october 2004 (meeting in Trieste) Globus based EDG middleware. Specific VO within Grid.it. ( our Grid provider..) A star shaped topology for data management: Central SE (large and backed up storage) hosted in grid.it Local SE hosted in research centres acting as a temporary storage space. Data management based on EDG Replica manager

PA FI Roma AN TS WNWN WNWN WNWN WNWN CE SuperNode: CE+SE+WN PADOVA Main Storage A graphical view (as 11/04) AL

EDG & Egrid EDGLimits Data privacy not guaranteed EDG software installations: complex/invasive… Other problems Limited Bandwidth among different sites. EGRID solutions Temporary Work-around on privacy/security Temporary cache system based on star-topology Ad hoc procedures for installing (Live CD for UI and SuperNode)

EGRID solution: UI Egrid UI now also on Live CD: Based on Knoppix

EGRID enhancements (from 11/04) Storm project (see later) Filtering tools provided to users EGRID software layer completed Live CD's updated (2.4.0 EDG version) An updated testbed with all the grid services

StoRM: SRM protocol: standard for accessing files in a GRID environment. Storm: an implementation norn from a collaboration between INFN and ICTP EGRID project Storm features: Promiscuous access to files: GRID users and the computing farm's Local users, can access the same files. Support for File protocol: direct Filesystem access for GRID users running jobs on the computing farm's Worker Nodes, by leveraging the farm's Distributed Parallel Filesystem. security model for the our needs of privacy and security

EGRID users’ s financial applications in production Filtering/Building procedures From Row data to ready to use data.. Now inserted in a software layer built on the top of EDG commands and based on the EGRID architecture Pricing financial derivatives by means of MCS and genetic algorithms USA partners + Trieste groups Order Book reconstruction and analysis Palermo Group Volatility estimation via Hidden Markov models Firenze Group GRID USAGE (as today) Jobs : 2961 WallTime: sec. ~ 500 days !!! CPUTime: sec.

The European-EGRID community European research groups interacting with us: Giulia Iori (City College London) MAS Laboratory (Ioane Muni Toke, Lionel Gabet) from the Ecole Centrale Paris, France. European research groups ready to join: Madrid Budapest

EGRID – City College London interaction Giulia Iori’ s research Group Currently using our local testbed to get acquainted and port applications Ready to either to install a small local facility or to contribute to enlarge other sites

EGRID – MAS interaction Currently playing with our UI Live CD and with our testbed. Ready to port their Grid-aware applications on our testbed and our production grid Willing to enlarge the community with their commercial partners Ready to merge local facilities within EGEE

Other future partners: Financial Institutions already working with MAS ready to support our community: Société Générale and other expression of interest from Avanade Italy ( Quite recent (last week meeting)

EGRID added values in joining EGEE EGEE middleware is addressing some of our requirements Egrid needs to be aligned with major european grid research avoiding duplications Egrid partners want to include European research group: infrastructure needs to be at European scale EGRID is now addressing Banks and Financial Institutions interested in using a continental grid instead of a national one.

EGEE added values in accepting EGRID very important security/privacy issues addressed A well trained and motivated group Scientific & academic community with a large technological transfer Financial & economical entities can play a determinant role in spreading grid technologies outside academic/scientific world

EGRID future working plans Applications: Porting of Paris/London applications Fine tuning of currently supported programs Middleware: Integration of our middleware within EGEE glite product (very much interested) Release of version 2.0 of our facility (web portal) Community: Enlarge further the community Go with its own proposal to the next European call

Future EGRID event: “Finance in GRID” Palermo 14/15 october 2005 chair: Rosario Mantegna A international workshop where two communities (Grid and Finance) can meet and discuss and interact Call for papers will be out next week ! (Hopefully with the EGEE logo)