SEE- eInfrastructure projects toward ERA with Institute of Informatics participation Margita Kon-Popovska, FINKI-UKIM DAAD workshop on “Software Engineering”, Ohrid, August 2011

Outline European e-Infrastructures: prospects &projects SEE Region follow up and results Our achievements/challenges

The e-Science paradigm shift towards a scientific Renaissance Wim Jansen European Commission -DG INFSO Géant and e-Infrastructures

ICT infrastructures for e-Science: a Communication to European Institutions Highlighting the importance of embracing the e- Science paradigm shift Highlighting the strategic role of e-Infrastructures as a crucial asset underpinning European research and innovation policies Calling on Member States and the scientific communities, in cooperation with the European Commission, for a reinforced and coordinated effort to further develop world class e-Infrastructures EC COM(2009) 108

Pan-EU e-Infrastructures vision GEANT EGI PRICE The Research Network infrastructure provides fast interconnection and advanced services among Research and Education institutes of different countries’  Main Initiative: GEANT The Research Distributed Computing Infrastructure (Grid, HPC) provides a distributed environment for sharing computing power, storage, instruments and databases through the appropriate software (middleware) in order to solve complex application problems  Main Initiatives: EGI, PRACE This integrated environment is called electronic infrastructure (eInfrastructure) allowing new methods of global collaborative research - often referred to as electronic science (eScience) The creation of the eInfrastructure is a key objective of the European Research Area

e-Infrastructures for science… ubiquitous research environments for accessing and sharing resources and tools… Wim Jansen European Commission -DG INFSO Géant and e-Infrastructures

Actions and funding GÉANTGÉANT: reinforce policy coordination, innovate in use, extend geographical reach (GÉANT connects 40 million users in over 8,000 institutions across 40 countries) GridsGrids (EGI-InSpire): ensure long-term sustainability, interoperability, support new governance models (56 countries, CPUs, DISK PB 117, Tape PB 92, Jobs 28M/month, 217VOs) SupercomputingSupercomputing: deploy top-class ecosystem of computational resources; scale up & pool investments (PRACE) in line with a broad strategic agenda from components and SW to systems and services Scientific data: deploy and manage coherent ecosystem of information repositories; step up investment, define policy, share best practices, support accessibility & preservation Global virtual research communities (GVRC): support scientific communities in optimal use of e-infrastructures For future vision e-Infrastructure Reflection Group white papers (new is 2011) on new and on-going e-Infrastructure challenges

GEANT3 EC FP7 4 year project 95M eur Reinforce policy coordination, innovate in use, extend geographical access

World R&E Communities Connectivity

EGI-InSpire EU FP7 4 years project 25M eur Building and maintaining sustainable European Grid Infrastructure

PRACE - The Partnership for Advanced Computing in Europe Germany France Tier(0) CURIE

SEE eInfrastructure activities – timeline: 8 years of close collaboration Network Infrastructure SEEREN1/2: regional inter-NRN connectivity and GEANT links [DGINFSO]  all countries in GN (except AL and BA) SEEFIRE: studying the feasibility of long-term solutions for dark fiber backbone in the region SEELIGHT: implementation of the lambda facility in SEE [Greek Hiperb]  sustainable regional network Result: partly sustainable national & regional networks, EC 50% funding for GEANT National dimension crucial: Role of NREN in MK this was UKIM/MARNET with participation of researchers from Institute of informatics

SEEREN 1&2 Funding: 3,5 M eur, Duration:4,5 year

Services planned/implemented during the SEEREN1#2 projects and beyond

NATO NIG project NATO funding eur 1G fiber switches+ 2x32Mbps wireless network Project proposing Projecting Procurement Deployment

GMON-Skopje Gigabit network Austrian Gov. Grant eur Proposing Projecting Procurement

Video conferencing Educational Services ViCES Network centre Stip SkopjeTetovo SkopjeBitola Skopje SerbiaAlbania TEMPUS vices.marnet.net.mk

SEELight regional project vision HIPERB Hellenic Plan for the Economic Reconstruction of the Balkan SEE-LIGHT: South-East European Lambda Network Facility for R&E Deployment of an advanced regional network infrastructure (lambda network facility) for R&E, 3 countries committed, others in progress SEENet: a management body for SEELIGHT Current status: Project starts in Serbia & is on the way in Bulgaria MK status: Available national 20% funds eur (expected FINKI involvement) International & national DWDM interconnectivity

SEE Grid eInfrastructure activities – Timeline: 7 years SEEGRID1/2: building regional Grid infrastructure within and beyond EGEE, building NGIs and user communities [DGINFSO] SEE-GRID-SCI: eInfrastructure for large-scale environmental science user communities: meteorology, seismology, environmental protection. Inclusion of Caucasus. [DGINFSO]  All countries in EGI within the same timeframe as rest of Europe Result: sustainable national Grids, EC funding for EGI like rest of EU (with 67% local funds) HP-SEE: regional HPC interconnection and 2 nd generation Caucasus link Expected result: sustainable national HPC centers, long-term sustainable model with PRACE and DEISA, mirroring GEANT/EGI? National dimension crucial: Role of NGI In MK this is MARGI – Macedonian Grid Initiative - with leading role of researchers from Institute of informatics year &HP-SEE from 2010

Infrastructure deployment

Distributed responsibilities for Infrastructure management

Infrastructure operations and QoS Core services deployed redundantly, spread out Catch-All Certification Authority + National CAs Operational tools as shown on previous slide Grid Operator on Duty (GOOD), Operations manual Fully interoperable with EGEE, overlapping SLA definition, monitoring and enforcement and corrective actions Overall availability of services 91.17% Job success rate 94,27%

Key results: User communities support Seismology (6 major applications), meteorology (2) and environmental protection (8) Cross-border user communities and beneficiaries Very clear and efficient procedures for support

Seismology VO Seismology VO offers the researchers:  Access to seismic data mirrored from national research centers on a timely basis  Adequate computing resources close to the seismology data repositories  Collaborative working environment with both regional groups and global organizations Core: seismic data server serving large seismic data sets from sensors (TBs) 6 Applications MK Application: Automatic recognition of Earthake locations Size of Continuous Waveform Data 2.44 TB No. of stations86

Key results: National Grid Initiatives Before SEE-GRID-SCI During SEE-GRID-SCI Initiating and structuring NGIs SEE-GRID pioneer of the NGI concept Significant developments in a number of areas: organisational stability, operational maturity, national-level support

Conclusion: we are going toward successful eInfrastructure, deployment in SEE SEEREN1&2, SEE-LIGHT & BSI & GEANT Comp physics, Comp chem, Life sciences Seismology, Meteorology, Environment SEE-GRID 1 & 2 & SCI HP-SEE User / knowledge layer

SEEREN 1-2 (70-80% EC) SEELIGHT (0% EC) GEANT (EC of 50% int. interconnection) EGI (EC 33%) HP-SEE (50% EC) Pan-EU HPC Initiative? SEE eInfrastructure activities – time frame, convergence with EU projects SEE-GRID 1-2-SCI (100% EC – only international inter-connection) EGEE (Enabling Grid for E- Sciences) GN3

SEERA-EI project One step more SEERA-EI: regional programme managers (relevant ministries) collaboration towards common eInfrastructure vision, strategy and regional funds [DGRTD] Core Objective & Expected result: Develop and strengthen the coordination and cooperation of national eInfrastructures programmes in the region of South-East Europe. Ensuring long-term national-level funds and regional funds to complement EC funds

SEERA-EI: the project Area: "INFRA : ERA-NET supporting cooperation for research infrastructures in all S&T fields“ Start: 1 April 2009 Duration: 36 months Project type: Coordination and support action Core Objective: Develop and strengthen the coordination and cooperation of national eInfrastructures programmes in the region of South-East Europe. Participation of the Programme owners in the region: Ministry of Sciences & Education, Information Society, Development….

Our achievements/challenges Deploy own eInfrastructure part of the SEE/Europe From beneficiary partners become equal or supportive partners in some of projects consortiums and so Part of e-Science in SEE and wider Challenges: In education Utilize eInfrastructure in education at all 3 levels of higher education for various target groups (in informatics/non informatics) Create relevant curricula, courses, labs, trainings for various target groups (in informatics/non informatics) Do it eventually as learning objects available on national and international level so shift towards collaborative education.

Questions THANK YOU