Chuck Humphrey, Leah Vanderjagt and Anna Bombak University of Alberta The Winter Institute on Statistical Literacy for Librarians Demystifying statistics for the practitioner

Outline Introductions Statistics and data: what are we talking about? Definitions and standards Metadata and tools Official statistics Non-official statistics Small area statistics

Metadata and tools

Title ProducerDate Unit of Observation Variables Average Tuition Discipline Academic Year Province Statistical Metric Dollars Footnote

Characteristics of statistical displays If we were to undertake the task of defining a standard for describing statistical displays, what attributes or characteristics would we use? We are going to work on a small group exercise exploring this question. Each group will receive a different statistical display and will be asked to develop a list of attributes or characteristics to describe the display.

What are the metadata characteristics of tables & graphs? Is a title provided? Is an author, producer or agency identifiable? Is there a date of creation or publication? What is the entity that has been observed to make this statistic? That is, what is the unit of observation? Are the characteristics of the unit observation (i.e., variables) and their categories clearly identified and defined? Is there a key to explain the use of colours or lines in the graph? Is the type of statistic clearly identified? That is, does the table or graph contain percentages, counts, averages, etc.? Is there a scale for the numbers presented in the table or graph? Is there an overall figure or number (N) presented upon which the table or graph was calculated? Are there footnotes? Are geography, time and social content clearly expressed in the table or graph ?

Summary If statistical tables and graphs were described and indexed by rich metadata, our ability to locate statistics would be greatly enhanced. In the absence of such metadata, we use elements of this metadata structure to search our existing databases. The next generation of metadata in the field of data will work to integrate the description of both data and statistics.

Tools for finding statistics Catalogues NEOS Libraries’ Catalogue UA Library Site Search Statistics Canada Catalogue of Products and Services Pathfinders Guide to Statistical Resources Resource Guide to Health Statistics Economics Statistics Databases Bibliographic/Full-text Statistical Indexes Government Info: The DailyThe Daily Census of Canada  U of A Data Library web site U of A Data Library web site  Statistics Canada web site Statistics Canada web site

Searching strategies We all develop starting strategies that we use when responding to a reference question for which there is no immediate solution. We have five starting scenarios that will be assigned to small groups. Everyone will have the same reference question but will use their different starting strategies in search for an solution.

Unfinished business from day 1 As a lead into a discussion about official statistics, let’s pick up the topic at the end of yesterday that we didn’t get to finish about definitions and standard classifications.

Statistics are about definitions Look at the Census definitions Definitions are in the Census Handbook and the Census DictionaryCensus HandbookCensus Dictionary Search by Census Variable under Topic-Based Tabulations for value categorizations Search Look at some standard classifications used in statisticsstandard classifications SIC, NAICS, NOC, Standard Classification of Goods (SCG), Standard Geographic Classification (SGC), Classification of Instructional Programs (CIP), ICD10

Official vs. non-official statistics Official statistics are those produced by government bodies (such as Statistics Canada or the Office for National Statistics in the UK) and some international agencies (such as the UN). Non-official statistics are produced by other bodies, including trade associations, professional organizations, banks, consultants, marketing companies, academic institutions and so on.

Official statistics (NZ)(NZ) “Official statistics are statistics produced by government agencies to: shed light on economic and social conditions develop, implement and monitor policies inform decision making, debate and discussion both within government and the wider community Government and its administrative arms need official statistics for policy development, implementation and evaluation. The public at large have similar information needs in order to evaluate government policy, to ensure public accountability, and to be adequately informed about social and economic conditions.”

Official statistics (UK)(UK) “Official statistics” can mean different things to different people. There are three broad ways of defining it. First, it may be defined in terms of people providing the service (eg. the Government Statistical Service). Second, it may be defined in terms of activities (e.g., collecting data, publishing statistics, providing statistical advice to support policy work). Third, it may be defined in terms of outputs, or products of statistical work (e.g., the published statistics on the labour market, on crime, on health etc). Source: Statistics: A Matter of Trust

Official statistics (Canada)(Canada) “There is no standard definition among statistical agencies for the term official statistics. There is a generally accepted, but evolving, range of quality issues underlying the concept of 'fitness for use'. These elements of quality need to be considered and balanced in the design and implementation of an agency's statistical program.”

Official statistics (Canada)(Canada) Attributes of quality that make statistics fit for use:  Relevance  Accuracy  Timeliness  Accessibility  Interpretability  Coherence

Official process Official statistics go through a formal process to be created and released. Definitions of concepts are a critical aspect of the process as well as the methodologies for collecting and producing the statistics. This relates directly with the accuracy, coherence and interpretability aspects of quality mentioned by Statistics Canada. This also ties into our discussion yesterday about the life cycle of statistical information.

Official process Official statistics can be created from administrative databases, such as birth or death certificates or from national surveys, such as the Labour Force Survey, which is used to determine employment statistics.

Surveys Census Canadian Community Health Survey Labour Force Survey General social survey National Longitudinal Survey of Children and Youth Business Register Survey of Household Spending Survey of Giving, Volunteering, and Participating Participation and Activities Limitation Survey Ethnic Diversity Survey Vital Statistics Hospital Morbidity Database National Health Expenditure Database Crime reports Court reports Education reports Longitudinal Administrative Data System National Accounts LIDS (Landed Immigrant Data System) Income Statistics (Canadian Revenue Agency) Administrative Records

Federal official health statistics Report of the Auditor General of Canada, December 2002

Perspectives Data perspective: to identify a data source from which the statistics could be produced. The approach replies on knowledge of data sources gathered by agencies. Government Publications perspective: to identify an agency that would produce such a statistic. This approach relies on knowledge of governmental structure and the content for which agencies are responsible.