Methodologies for BAPS Indicators Kenneth Bambrick Chair, BAPS Task Team

Progress on BAPS Outcome indicators Indicator Milestone Value (2016) Measured Value (2016) Milestone: Achieved or Not? Deviation from Milestone (2016)* 0a: Fully integrate statistics in decision making (average score on the use of statistics in policy making process) 72.5 73.2 Achieved +1% 0b: Promote open access to statistics (number of target countries signed up to Open Government Partnership) 35 52 +49% 0c: Increase resources for statistical systems (global estimated commitments to statistical development in target countries over rolling, three year period) 1.65 Billion USD 1.57 Billion USD Not achieved -5% * In the graphs, red lines indicate milestones (targets) and blue lines give the measured values.

Progress on BAPS Output indicators Indicator Milestone Value (2016) Measured Value (2016) Milestone: Achieved or Not? Deviation from Milestone (2016)* 1a: Share of countries whose government has adopted an NSDS which is currently being implemented 60% 51% Not achieved -15% 2a: Number of online survey catalogues published by ADP countries or others, using the IHSN cataloguing tool 80 88 Achieved +10% 2b: Number of countries that have an Open Data Readiness Assessment (ODRA) with World Bank support 25 30 +20% 3a: Share of MDG indicator series for which the majority of data are "country data" NA 5a: Share of annual aid to statistics (as reported in the PRESS) relative to total ODA 0.26% 0.25% -4% * In the graphs, red lines indicate milestones (targets) and blue lines give the measured values.

Progress on BAPS Output indicators Indicator Milestone Value (2016) Measured Value (2016) Milestone: Achieved or Not? Deviation from Milestone (2016)* 5b: Share of aid to statistics (as reported in the PRESS) that is aligned with NSDS 85% 78% Not achieved -8 % 5c: Annual commitments (in millions) to statistical development NA 470 Million USD NA  1b: Develop a methodology to measure NSDS quality 15 3b: Develop measure of knowledge and skills (statistical literacy) for target countries. 17.24 4a: Develop a measure of explicit references to statistical development and/or data gaps at global summits. 1.21% * In the graphs, red lines indicate milestones (targets) and blue lines give the measured values.

Coverage of CT-GAP Areas by Busan Indicators Strategic Area No. of Objectives Covered by Busan Indicators (%) 4. Dissemination and Use 7 1. Leadership 6 3. Statistical Activities 28 2. Modernization of NSS 12 5. Partnerships 3 6. Resources and Coordination 10

The PARIS21 Secretariat developed and piloted 3 new indicators 3 new BAPS indicators The PARIS21 Secretariat developed and piloted 3 new indicators References to statistical development and/or data gaps in global summits. Knowledge and skills (Statistical literacy). Evaluation of the quality of National Strategies for the Development of Statistics.

1. References to statistics in summits Purpose: Monitoring the outcomes of global summits and high level forums Data source: An analysis was undertaken based on 38 100 unique tweets containing a total of 65 919 hashtags. Indicator result 2016: 1.21% of all the hashtags used by all the UN agencies are related to statistical development. In comparison: only 0.25% of ODA went to statistics in 2014. -> Increase in statistics support to be expected if aid flows follows “aid talk”. Data source: Tweets by UN Agencies Specialized Agencies cover most relevant sectors Hashtags related to statistics are available daily in standardized format Methodology: Obtain hashtags from tweets of statistical agencies Average over relative frequency of these hashtags by all Specialized Agencies Implemented: for all 15 UN Specialized Agencies In the graphs, red lines indicate targets and blue lines give the measured values.

2. Statistical Literacy Purpose: Monitoring of knowledge and skill sets needed to use statistics effectively Assumption: Journalists' references to and critical engagement with statistics are an image of a nation’s statistical literacy. Indicator result 2016: 17.24 is the average score of half of 77 IDA borrowing countries. In comparison: The national level indicators are positively correlated with national TIMSS score. Task Team members: Data source: National newspaper archives obtained by scraping RSS feeds of 5 most popular papers Methodology: Keyword counts reflecting statistical literacy References to statistics as “Appreciation of the relevance of statistics” and statistical fallacies as “Ability to critically evaluate statistical material” (Oxford Dictionary of Statistical Terms, 2003) Assumption: writing of journalists as image for a nation's demand for statistical facts and analysis Implemented: 45 IDA borrowing countries (to date) In the graphs, red lines indicate targets and blue lines give the measured values.

3. NSDS Quality Purpose: Monitoring and evaluating the performance of NSDS. Methodology: A monitoring framework on Information and Status of the NSO Resources and Expenditure Demand Responsive Dissemination and Use Data Quality Results and Performance Implementation: 15 countries have piloted the evaluation tool (to date)

In the graphs, red lines indicate targets and blue lines give the measured values.