EMERGING TRENDS IN DATA ARCHIVING Presented by Kizito Kasozi Director Information Technology Uganda Bureau of Statistics Regional Workshop on Data Management October , 2009

OutlineBackground Data Documentation & Archiving - Concept Initiatives in Africa Enhancing Professionalism African Association of Data Archivists (AASDA)

Background Very limited practice of documenting and archiving in Africa & Developing World in General A few independent Repositories exist e.g. SADA, HSRC, DataFirst and a few Institutions of Research & Learning Most Data Repositories are in Statistical Agencies

Background General Status of Data Repositories Poor and Underdeveloped – Fragmented – Most datasets of poor quality – Datasets with minimal or no documentation – No standards (definitions, formats, etc.) – Datasets not properly archived/backed-up

Data Documentation What is Data Documentation? Creation of Metadata “Content about Content”, “Data about Data” – Who, What, Where, When, Which Data Life Cycle What is Data Archiving ? Long Term Preservation & Re-use Long Term Storage of Data and Methods Data Curation ( Digital in this case ) Central statistics agency in Uganda - manages, monitors and co-ordinates the NSS - semi-autonomous - conducts national surveys and censuses - disseminates results/reports - provides data to public, researchers, institutions, etc.

Benefits of Data Documentation Provides Explanatory notes (What, How..) Methods Processes Data Structure Data Life Cycle Data Life Cycle Contextual Information (Why, When..) Need & Justification of Study Better Cataloguing Storage & Retrieval Central statistics agency in Uganda - manages, monitors and co-ordinates the NSS - semi-autonomous - conducts national surveys and censuses - disseminates results/reports - provides data to public, researchers, institutions, etc. Data Documentation

Benefits of Data Documentation… Ease of Data Sharing/Exchange Enables Data Mining Data Standardization Good start for Question Bank Institutional Memory Data Documentation

2004 Marakesh Action Plan for Statistics – International Household Survey Network (IHSN) Coordinate & Harmonize Survey Activities Support Dissemination & Preservation of Micro-data - Accelerated Data Programme (ADP) Initially Supported - 25 Developing Countries -14 In Africa ( Now over 20 Countries )

Microdata Management Toolkit Developed by IHSN Based on Data Documentation Initiative (DDI) & Dublin Core Metadata Initiative (DCMI) metadata standards Provides bridge between data producers and users DDI Standards –DDI 1.0 DDI 3.0

Data Archiving Initiatives Using the Microdata Management Toolkit Niger, Mozambique, Uganda, Nigeria, Gambia, Mali, Cameroon, Ghana, Ethiopian, Liberia, Kenya, Mali, Rwanda, Senegal, Sierra Leone, Zambia, Malawi, Mozambique, Tanzania, Morocco and Swaziland At varied levels of Progress

Data Archiving Initiatives Available On-line Archives Ethiopia, Gambia, Ghana, Lesotho, Liberia, Niger, Nigeria, Senegal, Uganda Documented/Archived Datasets range from 10 – 60

Data Archiving Initiatives Available On-line By End of Year Cameroon, Malawi, Mali, Mozambique, Sierra Leone and Zambia National Data Archives (NADA) available and 0nly awaiting launching Available On-line in 2010 Kenya, Tanzania and Swaziland

Data Archiving Initiatives Promising NADAs –Burundi has done Data Archiving Workshops –Rwanda was introduced to DDI and received Technical support from Uganda –All SADC Countries have been exposed to the Microdata Management Toolkit –Tunisia – Using Toolkit internally –Morocco is about to start using the DDI –Egypt has expressed interest in using the toolkit ADB is to support introduction of Data Archiving in 12 Countries by end of 2010

Data Archiving Initiatives Major ChallengesMajor Challenges –Inadequate Documentation –Exclusive “Ownership” –Data Anonymisation issues –Lack of Institutional Memory –Technical Support (increased demand)

Enhancing Professionalism Professional Networking AASDA MembershipBuilding a community of practice in Africa – AASDA Membership –Inaugural Meeting 10 – 12 th April (Cape Town, SA) Inter-country support, Rwanda, Kenya, Nigeria –Capacity Building & Networking

Community of Practice AFRICAN ASSOCIATION OF STATISTICAL DATA ARCHIVISTS ASSOCIATION AFRICAINE POUR L’ ARCHIVAGE DES DONNÉES STATISTIQUES AASDA

African Association of Statistical Data Archivists (AASDA) Inaugurated 11 th April 2008 (Cape Town, SA) 14 African Founder Members In attendance also were representatives from: Afristat, IASSIST, World Bank (+ IHSN and ADP core team), PARIS21 Secretariat at OECD (+ IHSN and ADP, core team), African Centre for Statistics, UNECA, African Development Bank, DFID (+ IHSN and ADP core team)

AASDA Objectives of AASDA To foster and promote excellence in data curation and dissemination through professional networking To promote wider use of data through adoption of efficient data delivery mechanisms that narrows the bridge between producers and users of data. To promote the development of standards in data curation and dissemination across the region.

AASDA Objectives.. – To provide valuable opportunities for collegial exchange of sound professional practices. – To link members to related initiatives throughout Africa, other international activities and provide a forum for discussion of issues relating to data curation and dissemination.

AASDA Membership Representatives of Statistical Agencies within the African region. Representatives of National Data Archives or institutions engaged in archiving statistical data in Africa. Individual practitioners involved in data curation including data use, analysis or management within Africa. Individuals from any other professional association within the Africa region which has interests related to those of AASDA. Currently with 40 members

AASDA Benefits Increased support to evidence based planning within Region –Advocacy and promotion of: »Documentation and preservation of valuable data »Open access to microdata (easier accessibility) »Exhaustive utility of data (broader analysis & mining) – Value for money »Minimized duplication of effort (reduced wastage)

AASDA Benefits More applicable experiences shared –Similarity in levels of development »Feasible and applicable solutions »More relevant experiences Cheaper Technical Support –Reduced required facilitation

AASDA Road Map Constitution - Developed & Adopted Interim Executive – Appointed –Uganda - President –Ethiopia – Vice President –Niger – Secretary –Gambia – Treasurer –Cameroon – Member Website – www. aasda.net

AASDA The establishment of AASDA is a major step towards formal and open data sharing on the African continent and beyond AASDA Calls on your Support & Active Participation

THANK YOU