EWISA Second Major eafip Event on Innovation Procurement Pre-Operational Validation (POV) Project for Land Borders Early Warning for Increased Situational Awareness EWISA Dr. George Leventakis Dr. Pantelis Michalis This project has received funding from the European Union’s Seventh Framework Programme for research, technological development and demonstration under grant agreement no 608174 Athens, 19 October 2016

Table Of Content KEMEA Profile. Pre Operational Validation Concept. EWISA Objectives. EWISA Concept. EWISA Core System Video Analytics, Data Fusion, Intelligence Analysis Report. Supporting Surveillance Equipment . Implementation/Procurement.

Institutional Framework The Center for Security Studies (KEMEA) is the research entity of the Hellenic Ministry of Interior and Administrative Reconstruction, established in 2005. The R&D mission of KEMEA includes: Technology and Research Watch on security and civil protection issues worldwide and transfer knowledge to the relevant Greek Public Services; Facilitate the Greek Law Enforcement Agencies, including Hellenic Police, Fire Service, Civil Protection and Coast Guard, in their participation to R&D activities and initiatives and link with the International R&D community; Consulting and technological support for the modernization of the operational services of Hellenic Police and the Ministry dependent organizations KEMEA is officially authorized for the participation of the Hellenic Police (ELAS) in H2020 research activities under the KEMEA PIC. - Conducting the implementation of theoretic and applied research - Performing studies, particularly at a strategic level, regarding issues relevant to Security and Anti-crime Policies - Providing advisory and consulting towards the Ministry of Public Order and Citizen Protection, as well as, other National and International carriers, regarding Security Issues -Operating as think tank for security policies KEMEA was appointed by Presidential Decree No39 (06.05.2011), as the “National Contact Point” for the protection of European Critical infrastructures (ECIs) - “ECIP contact point” – following the implementation of the 2008/114/EC Directive of the European Council of December 8th 2008 “regarding the definition and designation of the European Critical infrastructures and the assessment of the need to improve the protection of such infrastructures" KEMEA is authorized to provide professional certification through examinations (in cooperation with the National Organization for the Certification of Qualifications and Vocational Guidance-EOPPEP no 3200/09−02/2012) to Private Security personnel.

Critical Infrastructures Protection KEMEA was appointed by Presidential Decree No39 (06.05.2011), as the “National Contact Point” of the European Program for Critical Infrastructures Protection (EPCIP) – following the implementation of the 2008/114/EC Directive of the European Council of December 8th 2008, “regarding the definition and designation of the European Critical Infrastructures (ECI) and the assessment of the need to improve the protection of such infrastructures"

Involvement in EU FP7 Research Projects PREFER LOBOS SAGRES PROACTIVE DITSEF CORE VASCO STAR-TRANS SERSCIS ARGOS SAFE-CITY THE HOUSE EUSEC II LEILA P-REACT PACT EWISA PERSEUS SNOOPY DOGGIES TALOS LBCSS SPEED HITGATE SEC IN CORE IMPRESS AIRBEAM SUNNY IDIRA ESS DARIUS CRISYS ACRIMAS POP-ALERT

HORIZON 2020 On-going Projects Inspiring Citizens Participation For Enhanced Community Policing Actions (KEMEA acts as coordinator). A Pan-European Framework for strengthening Critical Infrastructure resilience to climate change

H2020 New Projects ASGARD: FCT-01-2015:Forensics topic 1: Tools and infrastructure for the extraction, fusion, exchange and analysis of big data including cyber-offenses generated data for forensic investigation TENSOR: FCT-06-2015:Law Enforcement capabilities 2: Detection and analysis of terrorist-related content on the Internet MEDIA4SEC: FCT-15-2015:Ethical/Societal Dimension Topic 3: Better understanding the role of new social media networks and their use for public security purposes CIRCUS: BES-03-2015:Maritime Border Security topic 3: Light optionally piloted vehicles (and sensors) for maritime surveillance BROADBAND: DRS-18-2015:Communication technologies and interoperability topic 1: interoperable next generation of broadband radio communication system for public safety and security

From Research to Commercial Procurement Pre-Operational Validation (FP7) Pre-Commercial Procurement (H2020) (TRL up to 9) Research-Innovation Action (TRL up to 7)

Public Authorities Benefit Public Security Authorities realize the added value of the  POV/PCP instrument, which can bring the following benefits: Promotion of further cooperation between public authorities; New solutions being developed, based on public authority needs/requirements; Assessment of performance levels of the (at least two) proposed solutions, based on realistic user-defined operational scenarios in real conditions/environment and the integration of legacy systems; Quality, effectiveness and efficiency of the provided services are improved; The link between end-users and industry extends the benefit of POV/PCP and; Public sector can drive innovation.

Public Authorities Commitment Significant effort by EC and Public Authorities is required to bring success to a POV-PCP project. The effort required is much larger for a PCP - POV project than for a collaborative R&D project; IPRs rights definition; In this sense, public research agencies which are linked with the end users, like KEMEA, take on a critical and advanced role in carrying out the very demanding and complex tasks of PCP-POV projects; Support at national level is needed for public authorities taking part in PCP-POV projects and; Much more commitment is required than that of a "typical" participant in FP7, since it is required that a percentage of costs of their R&D services are recovered;

EWISA Consortium Members Coordinator GREECE – KEMEA (Center for Security Studies) – Hellenic Police/ Border Division Partners SPAIN – Guardia Civil FINLAND – Finnish Border Guards ROMANIA – General Inspectorate of Romanian Border Police

EWISA Objectives The overall project objective is to provide an operational and technical framework that will increase situational awareness and improve the reaction capability of authorities surveying the external land borders of the EU. EWISA will provide an innovative system for warning about possible threats and enhancing the effectiveness and efficiency of all border control relevant systems, equipment, tools and processes for the surveillance in selected areas.

EWISA Objectives EWISA aims to promote further cooperation between (the participating and other) public authorities in National and EU Level in charge of the surveillance of selected portions of the external EU land borders, to improve the quality and efficiency of their services (as related to security), through the Pre-Operational Validation (POV) of novel solutions. The Commission identified POV guided by potential end-users scheme as a way to promote innovation. In POV a tangible assessment of the performance levels offered by innovative technologies in user-defined operational scenarios, in real conditions/environment, where a tradeoff between efficiency, effectiveness and cost can be aligned with actual needs.

EWISA Concept EWISA concept proposal is based on the development of a flexible, modular surveillance capability which maximises the use of existing sensor types, including both static and mobile/deployable sensor platforms, integrated into an architecture that supports automation, where possible, based on the Video Analytics Component, providing Intelligence Analysis Reports.

PARTNERS-Public Authorities PARTNERS-Public Authorities POV EWISA Phases Step 1: Definition Phase (CSA) 2014-2016 Need Analysis Document Validation Strategy Document Joint POV call for Tender STEP 2: Execution Phase (CP) 2017-2018 Two Separate Solutions (LOTs) by Industry (Procurement) Development testing Implementation STEP 3: Ex-Post assessment Phase (CSA) 2018 Joint Validation and Conclusion PARTNERS-Public Authorities Center for Security Studies (KEMEA) Guardia Civil /ISDEFE Finnish Border Guards Romanian Border Police PARTNERS-Public Authorities Solution 1 Industry I Solution 2 Industry II

EWISA Phases PHASE 1-DEFINITION (December 2014-December 2016) Needs and Analysis, Validation Strategy and Tender Preparation and Elaboration WP1 (Needs and Analysis) WP2 (Strategy) WP3 (Tender Preparation, Tender Call and Evaluation) WP51 (Experiment Planning Execution and Supervision) PHASE 2-EXECUTION (January 2017-June 2018) Tender Awarding, Contracting end execution WP4 WP5 PHASE 3-EVALUATION(June 2018-December 2018) Assessment and Recommendations WP6

EWISA Block Concept Strategic Tactical EUROSUR NETWORK BLOCK 3 BLOCK 1 EUROSUR GATEWAY BLOCK 1 Deployable (ground vehicle, aerostat, RPA, etc,) Video sources at national level CENTRALIZED VIDEO ANALYTICS DATA FUSION, EXPLOITATION & INTELLIGENT ANALYSIS REPORTING & SHARING Deployable (ground vehicle, aerostat, RPA, etc,) Other sources at national level (Radar, ESM, etc.) NATIONAL NETWORK Tactical BLOCK 2 BLOCK 4 Surveillance Towers DATA FUSION, EXPLOITATION & INTELILIGENT ANALYSIS &REPORTING&SHARING Deployable (ground vehicle, aerostat, RPA, etc,) Video sources DECENTRALIZED VIDEO ANALYTICS Surveillance towers, fiber optics sensors Other sensors sources (Radar, ESM, etc.) Deployable (ground vehicle, aerostat, RPA, etc,)

EWISA Core System The core of the EWISA system consists of two fundamental components which are the: Video Analytics Component (VAC) fed by Video sources. Data Fusion Component followed by Intelligence Analysis Reporting fed by the VAC information and others sensors/systems and other Databases.

EWISA Core System Data Fusion Video Analytics VA Setup Metadata Level 2 Recognition/ Classification Level 4&5 Understanding & Knowledge Creation Level 1 Motion Detection Object Signature Level 3 Identification Video Sources (Cameras, Encoders, Clips, Images) Features Extraction Detection Alerts Data Fusion Other Sensors and Systems Metadata Fusion Real-Time Multi Sensors Data Correlation (Rule and Workflow Engines) Metadata DB Intelligence Analysis Reporting Analysis Models and Search Engines (profiling, abnormality, prediction)

Video Analytics Component (VAC) Video Analytics is a generic term and refers to the capability of automatically analysing video to detect and determine temporal and spatial events, using algorithm technology to provide two critical capabilities: Real-time analysis of video for immediate detection of events of interest Analysis of pre-recorded video for the purpose of extracting events and data from the recorded video.

EWISA VAC Functionalities The main functionalities of the VAC will be: Motion detection. Pattern recognition (object of interest classification and counting). Anomaly detection. Person Re-identification based on colour and texture features on person. Abandoned object. Text and logo reading.

Supporting Surveillance Equipment For the practical implementation of the EWISA core system, other supporting equipment need to be deployed along with Video Analysis components, either to facilitate the provision of coherent inputs to the VA system, or just to guarantee adequate performance of the overall surveillance deployment. EWISA will not deal with stand-alone technology providing new capabilities. It will rather validate (in terms of capacity to meet the requirements set by the public authorities) the integration of novel solutions, proposed by technology developers, into the current/legacy surveillance infrastructure.

EWISA System implementation The EWISA system proposed to be developed, installed and tested in the following areas: Finland: Centralized (all cameras in the same network-recorders) surveillance system. Romania: Decentralized (cameras are in the same network, regional or local recorders) surveillance system, on towers, mobile platforms and deployable sensors. Greece: Decentralized (all cameras in the same network-recorders) surveillance system, mobile platforms, deployable sensors and UAV sensors. Spain: Decentralized (cameras are in the same network, regional or local recorders) surveillance system, mobile platforms, deployable sensors and sensors on aerostat.

EWISA Evaluation The EWISA system will be integrated, installed and tested in all demo areas based on the requirement of particular scenario for six months. The evaluation of EWISA surveillance System will be done under common evaluation criteria which will be decided in common prior to the tender among the partners. Thus, it will be easy to come to a conclusion at the end of the project, such as: which surveillance solution in a dedicated area, having a limited budget, might be best.

FIN RU UA RO E GR TR MA SCENARIOS & experiment locations

SCENARIOS & experiment locations 1 FINLAND IMATRA AREA, SOUTH-EAST FINLAND FINNISH-RUSSIAN GREEN BORDER FENCE ON THE FINNISH SIDE BUT ONLY 160 CM HIGH (FOR DOMESTIC ANIMALS MAINLY) A MAJOR BCP, RAILROAD, TWO CITIES (IMATRA AND SVETOGORSK) WITHIN FEW KILOMETRES FOREST AREA WITH OCCASIONAL AGRICULTURAL LAND CLOSE TO THE BORDER

SCENARIOS & experiment locations 1 FINLAND

SCENARIOS & experiment locations 2 ROMANIA HALMEU AREA RO-UA GREEN BORDER BETWEEN BCP'S SURVEILLANCE OF RAILWAY CROSSING THE BORDER OPEN TERRAIN WITH HILLS AND BATCHES OF FORESTS

SCENARIOS & experiment locations 3 SPAIN MELILLA AREA, NORTHERN AFRICA SPANISH-MOROCCAN GREEN BORDER SURROUNDED BY FENCES OPEN, HILLY TERRAIN WITH (DRY) RIVERBEDS

SCENARIOS & experiment locations 4 GREECE ORESTIADA GREEK-TURKISH BORDER BORDER RUNS MAINLY ALONG EVROS RIVER 12 KILOMETRES OF GREEN BORDER, FENCED ONE BCP (KASTANIES) AGRICULTURAL LAND, HILLS, FORESTS, RIVER WITH VARIATION IN DEPTH AND FLOW

EWISA Public Procurement The Public Procurement within EWISA will be executed under the EU Directive 2014/24. The Procurement will be split into 2 lots (not geographically) which will be very well described in order to differentiate the conditions of the lots. Transparency and dissemination of the EWISA procurement will be ensured in advance (Press day, Industry day, EU Official Journal, National releases, etc).

EWISA Information Event “EWISA Information Event” will be held on the 8th & 9th of November 2016 in Athens, Greece.   In this Event the consortium partners will outline the EWISA roadmap for the forthcoming procurement of R&D services related to state-of-the-art technologies for “network modular video analysis solutions”, which are to be integrated and fused with other supporting sensors, for the provision of intelligence analysis reports.

Summary The surveillance of the EU land borders is a very sensitive topic of high interest for the EU. There are many factors which influence the performance of surveillance components. This is complicated as threats, vulnerabilities, assets, technologies and policies change over time. Common understanding is required among the end users of what these factors are, and what the nature of their influence on surveillance systems is. This requires a substantial, dedicated effort during the full life cycle of the EWISA project.

Summary Based on the well established POV procedures in EC level and the well defined implementation procedures within the EWISA Consortium, it will be easily to come to a conclusion at the end of the project, such as: “Which could be the best surveillance solution in a dedicated area having a limited or specific budget?”. This conclusion may help a MS seeking for a solution to operational needs which can be met only with the sole video-analysis, or would a supplementary tech be necessary, and of course more budget. At the end of the project we will be able to present to the MS different operational/technical solutions with different necessary budgets.

Thank you for your attention! George Leventakis Pantelis Michalis Senior Researcher Tel.: +30 210 7481630 int. 331 Mobile: +30 6978994406 e-mail: gleventakis@kemea.gr www.kemea.gr Research Associate Tel.: +30 210 7481630 int. 334 Mobile: +30 6974028602 e-mail: p.michalis@kemea-research.gr