1. Session 2 – Objective of workshop and status quo of project

2. Agenda Objective of workshop and status quo of project EC + TUV
10:30 – 11:00
Presentation of objectives and impact of project and workshop
Mrs. Krzyżanowska, EC, DG CNECT, Head of Unit B5 „Broadband“
Project approach, status, accomplishments
Contractor TÜV Rheinland
Ms Lehmann

3. Objective: Development of first European-wide interactive mapping platform
All EU and EEA Member States
will be covered in the mapping platform
Data feeds will come from
existing public and private initiatives
No data is collected
individually from network operators
for the time being

4. Project status in first 6 months of the 3-year project
Until June 2016
Status quo analysis
Identification of data suppliers and experts, review of existing initiatives and studies / standards
Methodology development
Development of project data categores, identification of methodological challenges
Stakeholder information
Presentation of project and data collection approach
Test data collection
Evaluation of data model on basis of supplied test data sets and feedback provided
Platform and database programming
Development of platform structure and features, visualisation of test data in alpha version
Stakeholder Consultation Workshop
Presentation of five months work and seeking feedback
Alpha Version
Data feeds for all Member States as of month 6

5. Project status in first 6 months of the 3-year project
Until June 2016
Status quo analysis
130 data suppliers and experts
at national and international level
have been involved so far
Identification of data suppliers and experts, review of existing initiatives and studies / standards
Methodology development
Development of project data categores, identification of methodological challenges
Stakeholder information
Presentation of project and data collection approach
Test data collection
Evaluation of data model on basis of supplied test data sets and feedback provided
Platform and database programming
Development of platform structure and features, visualisation of test data in alpha version
Stakeholder Consultation Workshop
Presentation of five months work and seeking feedback
Alpha Version
Data feeds for all Member States as of month 6

6. Over 70 stakeholders are participating in 1st Consultation Workshop
DG CNECT
DG COMP
EUROSTAT
JRC
Ministries and NRAs from 33 countries (EU, EEA and candidate countries)
Experts on internet measurements and standardisation and experts on geo-data from 10 organisations
6 operators of crowdsourcing applications
Who is here today or joining the workshop remotely

7. First assessment revealed ca
First assessment revealed ca. 65 QoS/QoE initiatives in all Member States
Please inform us about any news in your country!
Number of initiatives
per Member State
1 initiative
2 initiatives
3 initiatives
4 initiatives
Additionally
13 transnational initiatives have been identified
that could deliver data
Challenge: heterogeneous data sets
Don’t want to mix apples with oranges

8. To cluster all initiatives, QoS and QoE definitions had to be amended for this project
TRP feedback/ Test data sets
QoS-1: Theoretical
QoS-2: Practice optimal
QoS-3: Practice experienced
Predicted network performance of existing infrastructure
Line qualification
Actual user’s experience when using Internet Access Service (IAS)
Literature / Standards review
QoS offered by provider
QoS achieved by provider
QoE – Quality of Experience
Technical ability infrastructure, network performance based on existing infrastructure
Line qualification based on measurements by providers
Quality of Service perceived by the user
Evolution of terms
TOR – starting point
QoS – Quality of Service
QoE – Quality of Experience
Marketed speeds/quality criteria generated within existing national mapping initiatives
Actual user´s experiences, to be pulled from crowdsourcing applications servers

9. Project definitions are based on network infrastructure
Our three practice-oriented data categories
QoS-1: Theoretical
QoS-2:
Practice
optimal
QoS-3:
Practice experienced
CPE
IXP
Internet
IAP
End User
What: Predicted network performance of existing infrastructure
How: Assessment / calculation / marketed speeds by providers.
Theoretical
What: Line qualification
How: Measurement through panel probes or speed tests with filter to exclude end user‘s environment
Practice optimal
What: Actual user’s experience when using Internet Access Service (IAS)
How: Measurement via online speed tests including end user’s environment
QoS1:
What: Predicted network performance / technical ability of existing infrastructure
Where: Between core network of the Internet Access Provider (IAP) and Network Termination Point (NTP), where end user’s premises / buildings are reached
How: Assessment / calculation by providers
Example: SMART 2013/0054 project by IHS Consultants, collecting coverage data on a country, regional and rural level for nine broadband access technologies
QoS2:
What: Line qualification
Where: Between reference points / interfaces of Internet Access Service (IAS) - from Internet Exchange Point (IXP) to Network Termination Point (NTP), where end user’s premises / buildings are reached. IXP refers to the place where multiple Internet Service Providers interconnect their respective networks
How: Measurement by providers or initiatives
Panel measurements through probes
Example: SamKnows, RIPE Atlas
Crowdsourcing application measurements (speed tests) with filter to exclude end user‘s environment
Example: Initiative Netzqualität (by German NRA)
QoS3:
What: Actual user’s experience when using Internet Access Service (IAS)
Where: QoS measurement initiated by end user, triggered via the user terminal equipment (wired and wireless) connected behind Customer-Premises Equipment (CPE). Measurement including individual end user’s activity and environment
How: Measurements via online speed tests
Examples: Ookla, Akamai, Opensignal
Practice experienced

10. We have identified so far 78 national + transnational initiatives in the data categories
QoS-1: Theoretical
38 in total
QoS-2:
Practice
optimal
12 in total
QoS-3:
Practice experienced
28 in total ∑
78 in total
CPE
IXP
Internet
IAP
End User
QoS-1
QoS-2
QoS1:
What: Predicted network performance / technical ability of existing infrastructure
Where: Between core network of the Internet Access Provider (IAP) and Network Termination Point (NTP), where end user’s premises / buildings are reached
How: Assessment / calculation by providers
Example: SMART 2013/0054 project by IHS Consultants, collecting coverage data on a country, regional and rural level for nine broadband access technologies
QoS2:
What: Line qualification
Where: Between reference points / interfaces of Internet Access Service (IAS) - from Internet Exchange Point (IXP) to Network Termination Point (NTP), where end user’s premises / buildings are reached. IXP refers to the place where multiple Internet Service Providers interconnect their respective networks
How: Measurement by providers or initiatives
Panel measurements through probes
Example: SamKnows, RIPE Atlas
Crowdsourcing application measurements (speed tests) with filter to exclude end user‘s environment
Example: Initiative Netzqualität (by German NRA)
QoS3:
What: Actual user’s experience when using Internet Access Service (IAS)
Where: QoS measurement initiated by end user, triggered via the user terminal equipment (wired and wireless) connected behind Customer-Premises Equipment (CPE). Measurement including individual end user’s activity and environment
How: Measurements via online speed tests
Examples: Ookla, Akamai, Opensignal
QoS-3

11. Known initiatives per data category QoS 1 - Theoretical (predicted network performance)
37 national initiatives
1 transnational initiative
As a result: All EU/EEA countries covered
Covered EU/EEA states
Available
Not available

12. Known initiatives per data category QoS 2 – Practice optimal (excluding end user’s environment)
8 national initiatives
Existing national initiatives
Available
Not available

13. Known initiatives per data category QoS 2 – Practice optimal (excluding end user’s environment)
4 transnational crowdsourcing suppliers:
M-Lab
MONROE
RIPE Atlas
SamKnows
As a result: All EU/EEA countries covered
Existing transnational initiatives
Available
Not available

14. Known initiatives per data category QoS 3 – Practice experienced (including end user’s environment)
20 national initiatives
Existing national initiatives
Available
Not available

15. Known initiatives per data category QoS 3 – Practice experienced (including end user’s environment)
8 transnational crowdsourcing providers:
Akamai
Cedexis
MONROE
M-Lab
netBravo
Netradar
OpenSignal
Ookla
As a result: All EU/EEA countries covered
Existing transnational initiatives
Available
Not available

16. Contribution of each initiative to mapping platform has to be negotiated
Operational
„Commercial“
Timing and frequency
Spatial resolution
Value-added / benefits
Publication level / open access
Type and number
of values
It‘s your data, so you can decide what and how it will be presented on our platform

17. What are the benefits of participation in this project?
Publicity
Central Info Hub .
Network
Higher visibility of each initiative outside peer groups
Cross-linking of initiatives at EC website and with others
Increase awareness on multifaceted initiatives at national and transnational level
European-wide visualized QoS data in one platform
Multi-purpose platform
Complementary monitoring tool to assess policy, regulation, state aid, planning, users‘ experience
Basis for dialog between COM and MS – shaping EU policy-making process
Access to data sets from other initiatives / „collective learning“ of other methodologies
Benchmarking with other countries
Access to European mapping community of more than 100 stakeholders
Expansion of network to public and private initiatives
Opportunity to find partners

18. We tackle the major challenge: Avoid misinterpretation of data
“We don’t mess with your data”
Your data
You have sovereignty of interpretation of your data
The platform presents data in a neutral manner
Option for data retention and withdrawal
(see MoU)
Approach designed in a way that accounts for these requirements

19. Please access the link:
Live Survey
Please access the link: