1. PRODCOM Working Group JMO M2 29-30 November 2012
Item 10 Quality Visit to Statistics Portugal

2. Purpose Quality visits to the national PRODCOM teams serve to
discuss the methodology
Detect potential problems
Identify best practices that can be shared with other countries
November 2012
Item 10 - Quality visits

3. Statistics Portugal Organogram
Item 10 - Quality visits
November 2012

4. PRODCOM Survey (1)
At NACE level, the enterprise provides the following variables:
Total value of sold production (VSP)
VSP in the domestic market
VSP in other EU countries
VSP in the third countries
Industrial services
Part of the industrial services that result from subcontracting.
Item 10 - Quality visits
November 2012

5. PRODCOM Survey (2)
For each product the enterprise provides the following variables:
Total production
Sold production
Production used by enterprise
Value of Sold production
Item 10 - Quality visits
November 2012

6. PRODCOM Survey (3) Additional data:
Consumption of raw materials by NACE (from 2011: every 5 years with limited annual list)
Total costs
Costs from the domestic market
Costs from other EU countries
Costs from third countries
Pre-filled list of raw materials (PRODCOM + 4)
Purchases
Consumption
Costs
Energy consumption (PRODCOM + 4)
Item 10 - Quality visits
November 2012

7. Classification of users
Relevance
Classification of users
Description of users
United Nations
Commodity questionnaire, FAO international questionnaire
Institutions at European level
EUROSTAT
Institutions at national level
Directorate General for Energy and Geology, Portuguese Environmental Agency (Green Gas Emissions), Other governmental bodies, National Bank, other financial institutions, etc.
Trade associations, Embassies
Media (the main channel of statistics to the general public)
Researchers and students at international or national level
Scientific institutes, universities, students
Companies
Other statistics
National accounts, environmental statistics, SBS, STS
Item 10 - Quality visits
November 2012

8. Target Population Reporting Unit is the enterprise
All the enterprises that produce industrial goods and industrial services on the Portuguese territory during the reference year are targeted by the survey.
Item 10 - Quality visits
November 2012

9. Sampling frame Based on Business Register Structural Population Frame
All active enterprises
Enterprises that ceased activity within the reference period
All institutional sectors
Sampling frame
All enterprises with primary or secondary activity in NACE sections B & C
Classes 3511, 3521, 3530, 3831, 3832 of section D
November 2012
Item 10 - Quality visits

10. Sample design
Mostly SMEs, enterprises with fewer than 20 employees are also surveyed
Sample constructed using the following rules:
At least 5 enterprises per NACE to avoid confidentiality issues
Enterprises are carried over from previous year
Enterprises are sorted per turnover and included until 90% of total turnover is reached
Sample size is roughly 16,000 enterprises
Item 10 - Quality visits
November 2012

11. Product nomenclature PRODCOM based
Extended to cover NA and SBS (V20110) needs:
Energy products (25 codes)
Raw materials (38 codes)
NA(433 products)
Wines, wood, wood pulp
Oil products (Jet fuel, gas oils, fuel oils, liquefied propane and butane)
Pesticides (agricultural and other uses)
Wiring (for vehicles and other)
Users get predefined list of codes but can specify their own codes if required
Item 10 - Quality visits
November 2012

12. Data Collection Methods
Primarily web based questionnaires ("WebInq") per NACE class
Sold Values
Area of sale (domestic, EU, other)
Sold & Total Volume (European requirement)
Raw materials use
Energy consumption
KAU tab to facilitate product selection
Paper form as last resort
Enterprises are encouraged to use the Web questionnaires. If an enterprise has difficulties, guidance is provided by the data collection team. Only if the guidance is not successful or not accepted, paper forms can be downloaded by the enterprise and filled out manually
Item 10 - Quality visits
November 2012

13. On-line identification & authorisation
Designed to minimise management involvement of Statistics Portugal
Master password to enterprise by registered mail
Users registered independently of enterprises
Enterprises manage the delegation of privilege to registered users (e.g. service bureaus)
Primary and secondary respondent accounts
Primary accounts gets alert when secondary submits data
Item 10 - Quality visits
November 2012

14. Confidentiality Data protected by national law
Only Member State to use 100% dominance
In 2011, Statistics Portugal reported data on 2240 products, of which 426 were flagged as confidential
Item 10 - Quality visits
November 2012

15. Measurement Errors (1) Most frequent errors:
Wrong industrial product code
Classification of new products
Wrong volume unit
Failure to distinguish between production and industrial services
Failure to distinguish between production and trade
Failure to distinguish between units produced and units sold
Item 10 - Quality visits
November 2012

16. Measurement Errors (2) Correction of errors: Prevention of errors:
Establish direct and close contact with respondents
Provide guidance and support to respondents
Prevention of errors:
Pre-filled information
Web forms with validation rules and alerts
[Future] Web forms with last year's data for reference purposes
Item 10 - Quality visits
November 2012

17. Processing Errors Credibility & consistency analysis Examples:
Code validation
Unit of Measurement validation
Comparison between indicators
Comparison between reporting units
Cross-check with other surveys
Examples:
Product value within +/- 30% and +/- € of previous return
Unit value within +/- 25% of previous return
Unit value within +/- 25% of aggregate unit value
Item 10 - Quality visits
November 2012

18. Non-response Errors
First report (June Y+1): use information from previous year
Subsequent reports (December Y+1, December Y+2) are adjusted based on:
STS data
Simplified Business Information data
International Trade Statistics data
Imputation based on average values per NACE class
Only adjusted if significant impact on national figures
Item 10 - Quality visits
November 2012

19. Data Processing & Quality Assurance
Integrated and consistent approach
Same system used for internal and external access
Integration, harmonisation and reuse of processes result in:
Efficiency gains
Increase in comparability through the use of the same population
Reduction of the burden on respondents
Quality assurance
Version stack
Only final validated version sent to data warehouse
Item 10 - Quality visits
November 2012

20. Data Processing & Quality Assurance
Missing data
Respondents reminded between April & October
Response rate monitored based on:
Number of enterprises
Value of Sold Production
Item 10 - Quality visits
November 2012

21. Data Processing & Quality Assurance
Item 10 - Quality visits
November 2012

22. Dissemination Annual publication on Industrial Production
Main findings of PRODCOM Survey
Large set of products
Production (in volume)
Sales (in volume and value)
Industrial Services
Latest publication released January 2012 on 2010 data
Available on-line through the Statistics Portugal Website
November 2012
Item 10 - Quality visits