1. Day 1 - Session 3: Monitoring and Evaluation Framework

2. If You Can’t Measure It, You Can’t Manage it

3. AmBisyon Natin 2040 and National Tourism Development Plan

4. Competitiveness and Growth
Transport Infrastructure Development
Travel Facilitation
Product Development
Tourism Investments and Business Environment

5. Competitiveness and Growth
Expanded Marketing Plan
Human Resource Capacity and Service Standards
Quality Standards

6. Sustainability and inclusive growth
MSME Development in Tourism
Gender and Women Empowerment
Cultural Offerings
Environment and Climate Change Adaptation
Risks and Crises Management Programs

7. Implementation Framework

8. Session Objectives
Increase participants’ knowledge and understanding of fundamental M&E principles
Set the parameters for NTDP’s national and sub-national M&E initiatives
Engage the participants in providing inputs to the crafting of the NTDP M&E Plan

9. Objectives of the NTDP M&E
Report on the progress and performance of the strategic action programs
Filipinos expect to know what has been achieved with public funds and want to be sure that the plan is implemented
Provide a tool to relate the actions and projects with the NTDP goals and the mechanism for harmonizing sub-national and level M&E
Provide basis for crafting management responses to make programs effective and responsive

10. Components of M&E Plan
Outputs, expected outcomes, and intended impact to be achieved by the Plan (Results Framework)
Indicators to be used to measure achievement of the results
Method of data collection to be used to obtain the indicator data;
Targets for each indicator
Reporting System for timely provision of information on indicators at periodic intervals
Feedback Mechanism to improve performance, decision making and learning.

11. Key Concepts
Monitoring is the ongoing measurement of a set of indicators that are tracked over time
Evaluation is the regular, periodic assessment of progress against a set of reference values
Without M&E it is difficult to know if practices are going in the right direction, whether progress and success can be claimed and how future interventions can be improved.

12. Adaptive Management Process
Use of regular M&E in order to adjust or modify actions so that long term goals can be obtained.
Continuous learning and improvement from the outcomes (results) of actions and interventions.
Source: International Ecotourism Society

13. M&E Initiatives
Sustainable Development Goals and Measuring Sustainable Tourism (MST) Initiative
UNWTO, Philippine Statistical Authority, DOT

14. M&E Initiatives

15. M&E Initiatives ASEAN Tourism Strategic Plan 2016-2025 NTDP
2016 – 2022
ASEAN Tourism Strategic Plan
ASEAN National Tourism Organizations (e.g. Philippine DOT)
NTDP
DOT – Central and Regional Offices, Attached Agencies
Local Tourism Plans
LGUs

16. Levels of Measurements
National Measurement
Aggregates: Philippine Tourism Satellite Accounts
Contributions to GDP, employment
Sub-National Measurement
UNWTO: Tourism is “seen and felt” at the destination level (region, province, city/municipality, site)
The footprints – positive or negative - of tourism (economic, social, cultural and environmental) are most visible at the destination level
Management responses required from LGUs and Regional Offices

17. Philippine Tourism Satellite Accounts

18. Sub-National Measurements
Finland, Metsähallitus Natural Heritage Services
Local income and job benefits of visitor spending for all the 37 national parks, 7 hiking areas and some other protected areas that are important as tourism destinations.
Indicators: visitation numbers, visitor spending figures and multipliers describing the flow of money in the local economy
Source: OECD

19. Sub-National Measurements
Spain, Regional Tourism Satellite Account
Ireland – Using business registers in regional tourism industry analysis
Profile of enterprise demography and employment for the tourism industries at county level
The main variables available from the Business Register: location, legal status and size of enterprise, number of employees and persons engaged, and total turnover.

20. Results Framework
Methodology used for the plan design that focuses on the causal linkages between activities, outputs, desired outcomes, and intended impacts

21. Results Framework
Source: International Ecotourism Society

22. PROPOSED RESULTS FRAMEWORK
IMPACT
Tourism is making significant contributions to the socio-economic well-being of the Filipino people especially among the less-privileged communities in the country.
INTENDED OUTCOMES
A highly competitive quality tourism destination offering a unique, diverse tourism experience across the archipelago, with a strong adherence to the principles of sustainability – economic, socio-cultural and environmental.

23. PROPOSED RESULTS FRAMEWORK
IMPACT
Tourism is making significant contributions to the socio-economic well-being of the Filipino people especially among the less-privileged communities in the country.
INTENDED OUTCOMES
A highly competitive quality tourism destination offering a unique, diverse tourism experience across the archipelago, with a strong adherence to the principles of sustainability – economic, socio-cultural and environmental.
Design and Implement an Expanded Marketing Program
Expand Product Development Initiatives
Expand and Promote Cultural Offerings in Tourism Sites
Attract Tourism Investments and Improve Business Environment
Enhance Human Resource Capacity and Improve Service Standards
Promote Initiatives in Embracing Quality Standards
Adopt Measures to Enhance Environmental Preservation and Climate Change Adaptation
Intensify Transport Infrastructure Development
Pursue Travel Facilitation Initiatives
Support Micro-Small-Medium Enterprise (MSME) Development in Tourism
Actions/
Activities
Formulate Measures to Address Tourism Risks and Crises
Support Gender and Women Empowerment Initiatives
Adapted from the ATSP

24. PROPOSED RESULTS FRAMEWORK
Design and Implement an Expanded Marketing Program
Extensive marketing of highly attractive and diversified PH thematic tourism destinations and products
IMPACT
INTENDED OUTCOMES
TARGET OUTPUTS
Expand Product Development Initiatives
Expand and Promote Cultural Offerings in Tourism Sites
Attract Tourism Investments and Improve Business Environment
Enhance Human Resource Capacity and Improve Service Standards
Promote Initiatives in Embracing Quality Standards
Adopt Measures to Enhance Environmental Preservation and Climate Change Adaptation
Intensify Transport Infrastructure Development
Pursue Travel Facilitation Initiatives
Support Micro-Small-Medium Enterprise (MSME) Development in Tourism
Actions/
Activities
Strong public and private sector investment in tourism infrastructure and superstructure
PH recognized as a quality destination
Well developed connectivity and destination infrastructure implemented and expanded
Well developed cross border arrangements facilitate the movements of international tourists to PH
Local communities participate significantly in the tourism value chain at the destination level
Safety and security of tourists and communities prioritized
Natural and cultural heritage important to tourism is well protected, improved and maintained
Tourism is making significant contributions to the socio-economic well-being of the Filipino people especially among the less-privileged communities in the country.
A highly competitive quality tourism destination offering a unique, diverse tourism experience across the archipelago, with a strong adherence to the principles of sustainability – economic, socio-cultural and environmental.
Support Gender and Women Empowerment Initiatives
Formulate Measures to Address Tourism Risks and Crises
Adapted from the ATSP

25. PROPOSED RESULTS FRAMEWORK
Design and Implement an Expanded Marketing Program
Extensive marketing of highly attractive and diversified PH thematic tourism destinations and products
IMPACT
INTENDED OUTCOMES
TARGET OUTPUTS
Expand Product Development Initiatives
Expand and Promote Cultural Offerings in Tourism Sites
Attract Tourism Investments and Improve Business Environment
Enhance Human Resource Capacity and Improve Service Standards
Promote Initiatives in Embracing Quality Standards
Adopt Measures to Enhance Environmental Preservation and Climate Change Adaptation
Intensify Transport Infrastructure Development
Pursue Travel Facilitation Initiatives
Support Micro-Small-Medium Enterprise (MSME) Development in Tourism
Actions/
Activities
Strong public and private sector investment in tourism infrastructure and superstructure
PH recognized as a quality destination
Well developed connectivity and destination infrastructure implemented and expanded
Well developed cross border arrangements facilitate the movements of international tourists to PH
Local communities participate significantly in the tourism value chain at the destination level
Safety and security of tourists and communities prioritized
Natural and cultural heritage important to tourism is well protected, improved and maintained
Tourism is making significant contributions to the socio-economic well-being of the Filipino people especially among the less-privileged communities in the country.
A highly competitive quality tourism destination offering a unique, diverse tourism experience across the archipelago, with a strong adherence to the principles of sustainability – economic, socio-cultural and environmental.
Support Gender and Women Empowerment Initiatives
Formulate Measures to Address Tourism Risks and Crises
Adapted from the ATSP

26. Indicators From the Latin indicar - to point out
A pointer, a sign of change or a milestone indicating whether something is “on track” (results framework)
Need to know what the track is and where it is headed first before defining (performance) based indicators.
Source: International Ecotourism Society

27. Developing Indicators
Developing a potential indicator list
Conduct review of related literature (i.e. UNWTO, OECD guidebooks, etc.)
Stakeholder sessions and brainstorming
Screening the potential set of indicators
How many indicators are needed?
Defining a core set of Key Indicators based on screening
Source: International Ecotourism Society

28. SMART Indicators
SPECIFIC – one indicator per objective is used. Indicators are linked to the goal, result from one’s methods, be measurable, meaningful to stakeholder
MEASURABLE – baseline data are available and can be used for measuring change
ACHIEVABLE – measurements and time lines in terms of costs, etc are set out realistically
RELIABLE – the same conclusions/results would result if the measurements are carrier out with different people in similar circumstances
TIME-BOUND
Source: IES

29. Criteria for Selecting Indicators
Relevance
Feasibility
Credibility and Clarity
Benchmarking/Comparability

30. Types of Data
Quantitative: where comparable numbers can be obtained over time
Raw data (e.g. 5.9 Million international tourists in 2016)
Ratios, where one data set is related to another showing a relationship (e.g. 1:10 ratio of tourist to local residents)
Percentage, where data is related to total, a benchmark or an earlier measure (e.g.12.7% share of tourism employment to national employment; % change in tourist arrivals and expenditures over last year).
Source: IES

31. Types of Data
Qualitative: where comparable numbers can be obtained over time
Category: describe a state or level of attainment on a graded list (e.g., level of protection of natural areas according to the IUCN Index
Normative: related to existence of certain elements of tourism management and operation (e.g., existence of tourism development plan (1= Yes; 0=No))
Nominal: related to labels (e.g., Green Tourism certification)
Opinion-based: based on questionnaires and may be expressed as numbers, percentages as above - where essentially qualitative data is quantified (e.g. level of tourist satisfaction)
Source: IES

32. Sources of Data Administrative Surveys
Arrivals in accommodation establishments, arrivals in ports of entry, arrivals in sites/attractions
Surveys
Exit surveys at ports, airports, bus terminals
Exit surveys at establishment level
Feedback from customers

33. Sources of Data Enterprises National Agencies LGUs NGOs/CSOs
Crowdsourcing
Big Data Challenges

34. Day 1 - Session 3: Monitoring and Evaluation Framework

35. Workshop I Setting the NTDP Performance Indicators

36. Objective
To engage the participants in identifying the possible performance indicators for the NTDP Strategic Action Programs

37. Inputs
NDTP Strategic Action Plan Matrix Template for Screening Indicators

38. Mechanics
Each group will be assigned to screen plausible performance indicators for assigned strategic action programs
Each group will select a leader or presentor
Each group will be provided with copies of the action plan matrix and template for screening indicators.
Each group will present their outputs during the plenary session after the workshop.

39. Workshop Process
Each group will review the assigned action plan matrix that contains the following:
Strategic Action Programs
Strategic Activities/Tasks
Each group will discuss the list of indicators and assess each indicator based on the criteria for screening indicators (1=yes, low and easy; 3=medium; 5= no, difficult to monitor)
Each group will then agree on the list of proposed indicator/s to be presented during plenary