Day 1 - Session 3: Monitoring and Evaluation Framework

If You Can’t Measure It, You Can’t Manage it

AmBisyon Natin 2040 and National Tourism Development Plan

Competitiveness and Growth Transport Infrastructure Development Travel Facilitation Product Development Tourism Investments and Business Environment

Competitiveness and Growth Expanded Marketing Plan Human Resource Capacity and Service Standards Quality Standards

Sustainability and inclusive growth MSME Development in Tourism Gender and Women Empowerment Cultural Offerings Environment and Climate Change Adaptation Risks and Crises Management Programs

Implementation Framework

Session Objectives Increase participants’ knowledge and understanding of fundamental M&E principles Set the parameters for NTDP’s national and sub-national M&E initiatives Engage the participants in providing inputs to the crafting of the NTDP M&E Plan

Objectives of the NTDP M&E Report on the progress and performance of the strategic action programs Filipinos expect to know what has been achieved with public funds and want to be sure that the plan is implemented Provide a tool to relate the actions and projects with the NTDP goals and the mechanism for harmonizing sub-national and level M&E Provide basis for crafting management responses to make programs effective and responsive

Components of M&E Plan Outputs, expected outcomes, and intended impact to be achieved by the Plan (Results Framework) Indicators to be used to measure achievement of the results Method of data collection to be used to obtain the indicator data; Targets for each indicator Reporting System for timely provision of information on indicators at periodic intervals Feedback Mechanism to improve performance, decision making and learning.

Key Concepts Monitoring is the ongoing measurement of a set of indicators that are tracked over time Evaluation is the regular, periodic assessment of progress against a set of reference values Without M&E it is difficult to know if practices are going in the right direction, whether progress and success can be claimed and how future interventions can be improved.

Adaptive Management Process Use of regular M&E in order to adjust or modify actions so that long term goals can be obtained. Continuous learning and improvement from the outcomes (results) of actions and interventions. Source: International Ecotourism Society

M&E Initiatives Sustainable Development Goals and Measuring Sustainable Tourism (MST) Initiative UNWTO, Philippine Statistical Authority, DOT

M&E Initiatives

M&E Initiatives ASEAN Tourism Strategic Plan 2016-2025 NTDP 2016 – 2022 ASEAN Tourism Strategic Plan 2016-2025 ASEAN National Tourism Organizations (e.g. Philippine DOT) NTDP DOT – Central and Regional Offices, Attached Agencies Local Tourism Plans LGUs

Levels of Measurements National Measurement Aggregates: Philippine Tourism Satellite Accounts Contributions to GDP, employment Sub-National Measurement UNWTO: Tourism is “seen and felt” at the destination level (region, province, city/municipality, site) The footprints – positive or negative - of tourism (economic, social, cultural and environmental) are most visible at the destination level Management responses required from LGUs and Regional Offices

Philippine Tourism Satellite Accounts

Sub-National Measurements Finland, Metsähallitus Natural Heritage Services Local income and job benefits of visitor spending for all the 37 national parks, 7 hiking areas and some other protected areas that are important as tourism destinations. Indicators: visitation numbers, visitor spending figures and multipliers describing the flow of money in the local economy Source: OECD

Sub-National Measurements Spain, Regional Tourism Satellite Account Ireland – Using business registers in regional tourism industry analysis Profile of enterprise demography and employment for the tourism industries at county level The main variables available from the Business Register: location, legal status and size of enterprise, number of employees and persons engaged, and total turnover.

Results Framework Methodology used for the plan design that focuses on the causal linkages between activities, outputs, desired outcomes, and intended impacts

Results Framework Source: International Ecotourism Society

PROPOSED RESULTS FRAMEWORK IMPACT Tourism is making significant contributions to the socio-economic well-being of the Filipino people especially among the less-privileged communities in the country. INTENDED OUTCOMES A highly competitive quality tourism destination offering a unique, diverse tourism experience across the archipelago, with a strong adherence to the principles of sustainability – economic, socio-cultural and environmental.

PROPOSED RESULTS FRAMEWORK IMPACT Tourism is making significant contributions to the socio-economic well-being of the Filipino people especially among the less-privileged communities in the country. INTENDED OUTCOMES A highly competitive quality tourism destination offering a unique, diverse tourism experience across the archipelago, with a strong adherence to the principles of sustainability – economic, socio-cultural and environmental. Design and Implement an Expanded Marketing Program Expand Product Development Initiatives Expand and Promote Cultural Offerings in Tourism Sites Attract Tourism Investments and Improve Business Environment Enhance Human Resource Capacity and Improve Service Standards Promote Initiatives in Embracing Quality Standards Adopt Measures to Enhance Environmental Preservation and Climate Change Adaptation Intensify Transport Infrastructure Development Pursue Travel Facilitation Initiatives Support Micro-Small-Medium Enterprise (MSME) Development in Tourism Actions/ Activities Formulate Measures to Address Tourism Risks and Crises Support Gender and Women Empowerment Initiatives Adapted from the ATSP 2016-2025

PROPOSED RESULTS FRAMEWORK Design and Implement an Expanded Marketing Program Extensive marketing of highly attractive and diversified PH thematic tourism destinations and products IMPACT INTENDED OUTCOMES TARGET OUTPUTS Expand Product Development Initiatives Expand and Promote Cultural Offerings in Tourism Sites Attract Tourism Investments and Improve Business Environment Enhance Human Resource Capacity and Improve Service Standards Promote Initiatives in Embracing Quality Standards Adopt Measures to Enhance Environmental Preservation and Climate Change Adaptation Intensify Transport Infrastructure Development Pursue Travel Facilitation Initiatives Support Micro-Small-Medium Enterprise (MSME) Development in Tourism Actions/ Activities Strong public and private sector investment in tourism infrastructure and superstructure PH recognized as a quality destination Well developed connectivity and destination infrastructure implemented and expanded Well developed cross border arrangements facilitate the movements of international tourists to PH Local communities participate significantly in the tourism value chain at the destination level Safety and security of tourists and communities prioritized Natural and cultural heritage important to tourism is well protected, improved and maintained Tourism is making significant contributions to the socio-economic well-being of the Filipino people especially among the less-privileged communities in the country. A highly competitive quality tourism destination offering a unique, diverse tourism experience across the archipelago, with a strong adherence to the principles of sustainability – economic, socio-cultural and environmental. Support Gender and Women Empowerment Initiatives Formulate Measures to Address Tourism Risks and Crises Adapted from the ATSP 2016-2025

PROPOSED RESULTS FRAMEWORK Design and Implement an Expanded Marketing Program Extensive marketing of highly attractive and diversified PH thematic tourism destinations and products IMPACT INTENDED OUTCOMES TARGET OUTPUTS Expand Product Development Initiatives Expand and Promote Cultural Offerings in Tourism Sites Attract Tourism Investments and Improve Business Environment Enhance Human Resource Capacity and Improve Service Standards Promote Initiatives in Embracing Quality Standards Adopt Measures to Enhance Environmental Preservation and Climate Change Adaptation Intensify Transport Infrastructure Development Pursue Travel Facilitation Initiatives Support Micro-Small-Medium Enterprise (MSME) Development in Tourism Actions/ Activities Strong public and private sector investment in tourism infrastructure and superstructure PH recognized as a quality destination Well developed connectivity and destination infrastructure implemented and expanded Well developed cross border arrangements facilitate the movements of international tourists to PH Local communities participate significantly in the tourism value chain at the destination level Safety and security of tourists and communities prioritized Natural and cultural heritage important to tourism is well protected, improved and maintained Tourism is making significant contributions to the socio-economic well-being of the Filipino people especially among the less-privileged communities in the country. A highly competitive quality tourism destination offering a unique, diverse tourism experience across the archipelago, with a strong adherence to the principles of sustainability – economic, socio-cultural and environmental. Support Gender and Women Empowerment Initiatives Formulate Measures to Address Tourism Risks and Crises Adapted from the ATSP 2016-2025

Indicators From the Latin indicar - to point out A pointer, a sign of change or a milestone indicating whether something is “on track” (results framework) Need to know what the track is and where it is headed first before defining (performance) based indicators. Source: International Ecotourism Society

Developing Indicators Developing a potential indicator list Conduct review of related literature (i.e. UNWTO, OECD guidebooks, etc.) Stakeholder sessions and brainstorming Screening the potential set of indicators How many indicators are needed? Defining a core set of Key Indicators based on screening Source: International Ecotourism Society

SMART Indicators SPECIFIC – one indicator per objective is used. Indicators are linked to the goal, result from one’s methods, be measurable, meaningful to stakeholder MEASURABLE – baseline data are available and can be used for measuring change ACHIEVABLE – measurements and time lines in terms of costs, etc are set out realistically RELIABLE – the same conclusions/results would result if the measurements are carrier out with different people in similar circumstances TIME-BOUND Source: IES

Criteria for Selecting Indicators Relevance Feasibility Credibility and Clarity Benchmarking/Comparability

Types of Data Quantitative: where comparable numbers can be obtained over time Raw data (e.g. 5.9 Million international tourists in 2016) Ratios, where one data set is related to another showing a relationship (e.g. 1:10 ratio of tourist to local residents) Percentage, where data is related to total, a benchmark or an earlier measure (e.g.12.7% share of tourism employment to national employment; % change in tourist arrivals and expenditures over last year). Source: IES

Types of Data Qualitative: where comparable numbers can be obtained over time Category: describe a state or level of attainment on a graded list (e.g., level of protection of natural areas according to the IUCN Index Normative: related to existence of certain elements of tourism management and operation (e.g., existence of tourism development plan (1= Yes; 0=No)) Nominal: related to labels (e.g., Green Tourism certification) Opinion-based: based on questionnaires and may be expressed as numbers, percentages as above - where essentially qualitative data is quantified (e.g. level of tourist satisfaction) Source: IES

Sources of Data Administrative Surveys Arrivals in accommodation establishments, arrivals in ports of entry, arrivals in sites/attractions Surveys Exit surveys at ports, airports, bus terminals Exit surveys at establishment level Feedback from customers

Sources of Data Enterprises National Agencies LGUs NGOs/CSOs Crowdsourcing Big Data Challenges

Day 1 - Session 3: Monitoring and Evaluation Framework

Workshop I Setting the NTDP Performance Indicators

Objective To engage the participants in identifying the possible performance indicators for the NTDP Strategic Action Programs

Inputs NDTP Strategic Action Plan Matrix Template for Screening Indicators

Mechanics Each group will be assigned to screen plausible performance indicators for assigned strategic action programs Each group will select a leader or presentor Each group will be provided with copies of the action plan matrix and template for screening indicators. Each group will present their outputs during the plenary session after the workshop.

Workshop Process Each group will review the assigned action plan matrix that contains the following: Strategic Action Programs Strategic Activities/Tasks Each group will discuss the list of indicators and assess each indicator based on the criteria for screening indicators (1=yes, low and easy; 3=medium; 5= no, difficult to monitor) Each group will then agree on the list of proposed indicator/s to be presented during plenary