Session 2 – Objective of workshop and status quo of project

Agenda Objective of workshop and status quo of project EC + TUV 10:30 – 11:00 Presentation of objectives and impact of project and workshop Mrs. Krzyżanowska, EC, DG CNECT, Head of Unit B5 „Broadband“ Project approach, status, accomplishments Contractor TÜV Rheinland Ms Lehmann

Objective: Development of first European-wide interactive mapping platform All EU and EEA Member States will be covered in the mapping platform Data feeds will come from existing public and private initiatives No data is collected individually from network operators for the time being

Project status in first 6 months of the 3-year project Until June 2016 Status quo analysis Identification of data suppliers and experts, review of existing initiatives and studies / standards Methodology development Development of project data categores, identification of methodological challenges Stakeholder information Presentation of project and data collection approach Test data collection Evaluation of data model on basis of supplied test data sets and feedback provided Platform and database programming Development of platform structure and features, visualisation of test data in alpha version Stakeholder Consultation Workshop Presentation of five months work and seeking feedback Alpha Version Data feeds for all Member States as of month 6

Project status in first 6 months of the 3-year project Until June 2016 Status quo analysis 130 data suppliers and experts at national and international level have been involved so far Identification of data suppliers and experts, review of existing initiatives and studies / standards Methodology development Development of project data categores, identification of methodological challenges Stakeholder information Presentation of project and data collection approach Test data collection Evaluation of data model on basis of supplied test data sets and feedback provided Platform and database programming Development of platform structure and features, visualisation of test data in alpha version Stakeholder Consultation Workshop Presentation of five months work and seeking feedback Alpha Version Data feeds for all Member States as of month 6

Over 70 stakeholders are participating in 1st Consultation Workshop DG CNECT DG COMP EUROSTAT JRC Ministries and NRAs from 33 countries (EU, EEA and candidate countries) Experts on internet measurements and standardisation and experts on geo-data from 10 organisations 6 operators of crowdsourcing applications Who is here today or joining the workshop remotely

First assessment revealed ca First assessment revealed ca. 65 QoS/QoE initiatives in all Member States Please inform us about any news in your country! Number of initiatives per Member State 1 initiative 2 initiatives 3 initiatives 4 initiatives Additionally 13 transnational initiatives have been identified that could deliver data Challenge: heterogeneous data sets Don’t want to mix apples with oranges

To cluster all initiatives, QoS and QoE definitions had to be amended for this project TRP feedback/ Test data sets QoS-1: Theoretical QoS-2: Practice optimal QoS-3: Practice experienced Predicted network performance of existing infrastructure Line qualification Actual user’s experience when using Internet Access Service (IAS) Literature / Standards review QoS offered by provider QoS achieved by provider QoE – Quality of Experience Technical ability infrastructure, network performance based on existing infrastructure Line qualification based on measurements by providers Quality of Service perceived by the user Evolution of terms TOR – starting point QoS – Quality of Service QoE – Quality of Experience Marketed speeds/quality criteria generated within existing national mapping initiatives Actual user´s experiences, to be pulled from crowdsourcing applications servers

Project definitions are based on network infrastructure Our three practice-oriented data categories QoS-1: Theoretical QoS-2: Practice optimal QoS-3: Practice experienced CPE IXP Internet IAP End User What: Predicted network performance of existing infrastructure How: Assessment / calculation / marketed speeds by providers. Theoretical What: Line qualification How: Measurement through panel probes or speed tests with filter to exclude end user‘s environment Practice optimal What: Actual user’s experience when using Internet Access Service (IAS) How: Measurement via online speed tests including end user’s environment QoS1: What: Predicted network performance / technical ability of existing infrastructure Where: Between core network of the Internet Access Provider (IAP) and Network Termination Point (NTP), where end user’s premises / buildings are reached How: Assessment / calculation by providers Example: SMART 2013/0054 project by IHS Consultants, collecting coverage data on a country, regional and rural level for nine broadband access technologies QoS2: What: Line qualification Where: Between reference points / interfaces of Internet Access Service (IAS) - from Internet Exchange Point (IXP) to Network Termination Point (NTP), where end user’s premises / buildings are reached. IXP refers to the place where multiple Internet Service Providers interconnect their respective networks How: Measurement by providers or initiatives Panel measurements through probes Example: SamKnows, RIPE Atlas Crowdsourcing application measurements (speed tests) with filter to exclude end user‘s environment Example: Initiative Netzqualität (by German NRA) QoS3: What: Actual user’s experience when using Internet Access Service (IAS) Where: QoS measurement initiated by end user, triggered via the user terminal equipment (wired and wireless) connected behind Customer-Premises Equipment (CPE). Measurement including individual end user’s activity and environment How: Measurements via online speed tests Examples: Ookla, Akamai, Opensignal Practice experienced

We have identified so far 78 national + transnational initiatives in the data categories QoS-1: Theoretical 38 in total QoS-2: Practice optimal 12 in total QoS-3: Practice experienced 28 in total ∑ 78 in total CPE IXP Internet IAP End User QoS-1 QoS-2 QoS1: What: Predicted network performance / technical ability of existing infrastructure Where: Between core network of the Internet Access Provider (IAP) and Network Termination Point (NTP), where end user’s premises / buildings are reached How: Assessment / calculation by providers Example: SMART 2013/0054 project by IHS Consultants, collecting coverage data on a country, regional and rural level for nine broadband access technologies QoS2: What: Line qualification Where: Between reference points / interfaces of Internet Access Service (IAS) - from Internet Exchange Point (IXP) to Network Termination Point (NTP), where end user’s premises / buildings are reached. IXP refers to the place where multiple Internet Service Providers interconnect their respective networks How: Measurement by providers or initiatives Panel measurements through probes Example: SamKnows, RIPE Atlas Crowdsourcing application measurements (speed tests) with filter to exclude end user‘s environment Example: Initiative Netzqualität (by German NRA) QoS3: What: Actual user’s experience when using Internet Access Service (IAS) Where: QoS measurement initiated by end user, triggered via the user terminal equipment (wired and wireless) connected behind Customer-Premises Equipment (CPE). Measurement including individual end user’s activity and environment How: Measurements via online speed tests Examples: Ookla, Akamai, Opensignal QoS-3

Known initiatives per data category QoS 1 - Theoretical (predicted network performance) 37 national initiatives 1 transnational initiative As a result: All EU/EEA countries covered Covered EU/EEA states Available Not available

Known initiatives per data category QoS 2 – Practice optimal (excluding end user’s environment) 8 national initiatives Existing national initiatives Available Not available

Known initiatives per data category QoS 2 – Practice optimal (excluding end user’s environment) 4 transnational crowdsourcing suppliers: M-Lab MONROE RIPE Atlas SamKnows As a result: All EU/EEA countries covered Existing transnational initiatives Available Not available

Known initiatives per data category QoS 3 – Practice experienced (including end user’s environment) 20 national initiatives Existing national initiatives Available Not available

Known initiatives per data category QoS 3 – Practice experienced (including end user’s environment) 8 transnational crowdsourcing providers: Akamai Cedexis MONROE M-Lab netBravo Netradar OpenSignal Ookla As a result: All EU/EEA countries covered Existing transnational initiatives Available Not available

Contribution of each initiative to mapping platform has to be negotiated Operational „Commercial“ Timing and frequency Spatial resolution Value-added / benefits Publication level / open access Type and number of values It‘s your data, so you can decide what and how it will be presented on our platform

What are the benefits of participation in this project? Publicity Central Info Hub . Network Higher visibility of each initiative outside peer groups Cross-linking of initiatives at EC website and with others Increase awareness on multifaceted initiatives at national and transnational level European-wide visualized QoS data in one platform Multi-purpose platform Complementary monitoring tool to assess policy, regulation, state aid, planning, users‘ experience Basis for dialog between COM and MS – shaping EU policy-making process Access to data sets from other initiatives / „collective learning“ of other methodologies Benchmarking with other countries Access to European mapping community of more than 100 stakeholders Expansion of network to public and private initiatives Opportunity to find partners

We tackle the major challenge: Avoid misinterpretation of data “We don’t mess with your data” Your data You have sovereignty of interpretation of your data The platform presents data in a neutral manner Option for data retention and withdrawal (see MoU) Approach designed in a way that accounts for these requirements

Please access the link: Live Survey Please access the link: https://www.research.net/r/B7Y6H2Z