Status, Data Transfer and Processing ICP Tool Pack Status, Data Transfer and Processing Vilas Mandlekar, Nada Hamadeh and Yuri Dikhanov ICP Regional Coordinators Meeting 7-11 March 2005, Washington DC

Agenda Status Report – ICP Tool Pack Work Flow and Data Exchange between Countries and Regions Data Processing Module – Demo Q & A

Tool Pack Status Update

Tool Pack 1.2 – what’s changed since 1.1? Price Collection Module (PCM) Export to Excel -- Price observations once entered can be downloaded to Excel for viewing or recording Impact on Data Transfer screen – one new button “Cut and Paste” of observations from other sources (Excel) into the PCM multiple product data entry screen Impact on Multiple Products data entry screen – one new icon on the grid Option to recompute converted prices Impact on Data Editing screen – one new button that appears only if product parameters have changed

Tool Pack 1.2 – what’s changed since 1.1? Price Administration Module (PAM) No change in the screen layouts or text appearing on screens Items (products/observations) beyond tolerance are highlighted in red in the Diagnostics Tables. Old Excel templates used in PAM 1.1 are NOT useable in 1.2 Download blank templates for each of the Master data –products lists, characteristics, characteristic values, specifications, outlets and their mapping etc. “Cut and Paste” product lists etc. from old templates into the new templates Upload into PAM 1.2

Tool Pack 1.2 – what’s changed since 1.1? Data Processing Module (DPM) New module primarily for regional use, but also used by countries Region can create templates, i.e. selections of products, locations, attributes etc., and time periods over which the countries provide their data Enter Exchange rates, population, expenditures, and weights (optional) Run Quaranta Tables, Index processing, and produce Reports

Tool Pack 1.2 – what’s changed since 1.1? Data Processing Module (DPM) For ICP purposes, country use is limited to: Import a template from the Regional Coordinator Export average or raw prices data to Regional Coordinator Tested by Statistics Canada DPM User Manual and DPM Summary Steps prepared DPM Substantive Manual / Step-by-Step Guide underway

Tool Pack 1.2 – what’s changed since 1.1? What do Countries need to know about Tool Pack 1.2 ? There’s very little or no change between 1.1 and 1.2 in terms of functions of price observations data entry and running preliminary diagnostic reports Countries receive from regions a selection of product lists and time periods over which the price observations are required Countries generate average prices data (Excel format) using the DPM module and send it to the Regional Coordinator Raw prices (optionally) can be sent by countries to the Region for index processing

Tool Pack 1.2 – what’s changed since 1.1? How do Countries/Regions upgrade to Tool Pack 1.2 ? Regions Install the PAM 1.2 after first un-installing the PAM 1.1 Input the product lists and any attributes (location attribute such as, Rural/Urban) for their countries, using new Excel templates in PAM 1.2 Regions DO NOT normally NEED PCM to be installed Countries If they have a PAM 1.1 already installed, then use the patch to upgrade to 1.2. Data entered under 1.1 will not be disturbed due to this upgrade They can also install PAM 1.2 afresh if they want to enter their product lists and observations again

Batch Upload Utility for Price Observations Countries not using PCM can use the Batch Upload Utility to upload their data into the PAM to perform data validation Tried and tested by Statistics Canada in their pilot collection Stand-alone utility File for upload of observations must be in “CSV” format Batch Upload User guide and CSV file format

Batch Upload Utility for Price Observations Countries might require the help of RC team to convert their files into the CSV file format Fields in the file must follow a prescribed layout Product codes, UoM codes, UoM conversions must exist on the PAM before upload Utility is in English i.e. the screens labels and messages are in English

Tool Pack 1.2 – Status of implementation

Tool Pack 1.2 – Status of implementation

Other news and issues HHD – ESCWA funded and specified a hand held computer based price collection module. To be finalized in Arabic and English by March end. Transferring Tool Pack software to Regional Coordinator Offices – use of the World Bank FTP site or website for software upgrades/patches. Training of Regional Coordinators staff on DPM.

Lessons from LAC pilot data collection 3 types of problems: Bugs Erroneous use of the system by countries New functionalities required Countries have different levels of technological capabilities Tool Pack needs close support from regional and global offices Troubleshooting capabilities All documentation should be translated

Tool Pack Workflow and Data Exchange

Average Price Templates Individual or Average Prices Country PAM / DPM PAM DPM 1- Setup 4- Data Validation 7- Data Transfer to/from Region Survey Details Observations Country PCM (s) Average Price Templates Individual or Average Prices 2- Data Collection 3- Data Entry and Editing Region PAM / DPM 5- Setup 6- Data Transfer to/from Country 8- Inter Country Validation 9- Index Processing 10- Reports

Country PAM 1- Setup Products Attributes Outlets Price Collectors Mapping Products – Outlets – Price Collectors Surveys

Survey Details XML file Survey products, outlets and price collectors details

Country PCM (s) 2- Data Collection: Printing Data Collection Forms 3- Data Entry and Editing: Data Entry Data Editing Outlier Analysis

Observations XML file Individual observations (including outliers if the country chose to keep the outliers)

Country PAM 4- Data Validation (Diagnostic Reports) Product Level Diagnostics – Table 1 Observation Level Diagnostics – Table 2

Region PAM / DPM 5- Setup Products Attributes Population Expenditures Exchange Rates

Region PAM / DPM 6- Data Transfer to/from Country Send Average Price Templates Receive Average Prices + Indicators Receive Individual Prices

Average Price Templates Analytical template XML file Means of data selection to ensure data quality Determines timeframe coverage, product selection, breakdown by outlet types, and attributes Average prices + indicators (coefficient of variation)

Country DPM 7- Data Transfer to/from Region Receive Average Price Templates Send Individual prices Send Average prices + indicators By outlet types? By attribute breakdown?

Individual or Average Prices Individual prices (preferred) --- xml file Average prices + indicators (minimum requirement to run Quaranta Table) --- Excel file Index processing can be run with individual prices or with average prices.

Region PAM / DPM 8- Inter Country Validation Quaranta Table Iterations between region and countries to revisit some average prices

Region PAM / DPM 9- Index Processing Multiple price indices PPPs, Average Prices, and Real Expenditures

Region PAM / DPM 10- Reports Average prices Price indices Real and nominal expenditures Per capita real and nominal expenditures

Country PAM / DPM Country CPI systems Region PAM / DPM 1- Setup 4- Data Validation 7- Data Transfer to/from Region Observations through Batch Upload Country CPI systems Average Price Templates Individual or Average Prices 2- Data Collection 3- Data Entry and Editing Region PAM / DPM 5- Setup 6- Data Transfer to/from Country 8- Inter Country Validation 9- Index Processing 10- Reports

Data Processing Module Demonstration