1. DATA VALIDATION Foreign Trade Statistics
ESTP course Data Validation in the ESS

2. Validation process of Foreign trade statistics data
In Latvia CSB Foreign trade statistics data collection and processing section is responsible for Foreign trade statistics data collecting (in case of Intrastat), data entry (in case of paper declaration), data processing and data validation.
Intrastat and Extrastat data sets are processed separately, they are merged only at the last stage of validation – during analysis of aggregated data.
Intrastat data validation
Extarstat data validation

3. INTRASTAT data processing schemedata processing scheme
Collecting
of reports via
CSB e - survey
Collecting
of reports
Data Import in SQL database
FTS data analysis and comparing
Adjustments calculation
FTS data
dissemination
Registration
of reports in ISDMS
Registration module
Data analysis and processing
for Adjustments calculation
Calculating of statistical
value for A type reports
Paper form Intrastat
reports data inputting
in ISDMS Data entry module
Electronically received
Intrastat reports data import
in ISDMS Data entry module
Validation of correctness of codes and credibility checking in
ISDMS Data validation module
14-15/05/2014

4. Intrastat data validation process
Phases of validation process:
Primary (visual) data control for paper declarations
Data entry control and data validation in e-survey system
Data validation in ISDMS Data validation module
Data validation in Access, preparing data set SQL data base

5. Primary (visual) data control

6. Data control in e-survey system

7. Intrastat data entry control

8. Data validation in ISDMS
Most often mistakes referred to incorrect classifications, incomplete information, methodological problems:
not valid CN commodity codes,
volumes expressed in supplementary units are missing,
volumes expressed in net mass (kg) are missing,
ISDMS program identifies:
absolute errors, which should be corrected obligatory,
possible errors, which could be ignored, if the case is checked and approved as correct.

9. Data validation in ISDMS
Additional checks of the Combined Nomenclature codes, used for seasonal goods (for example, new potatoes in dispatches in wrong period).
Credibility checks of some CN codes, goods which are not usual for trade in our country, for example, meat of domestic pigeons, groundnuts seed, tropical wood and so on.
Credibility lines - the description of the CN code determines in some cases the net mass of the commodity and/or supplementary unit, for example live swine weighing less than 50 kg, aircrafts of an unladen weight not exceeding 2000 kg.
Impossible combinations between mode of transport and CN codes, CN code and country code, for example peat could not be transported by post or only certain goods could be transported by fixed transport installations (pipelines).

10. Data validation in ISDMS

11. Price analysis on commodity level
4 8
Price analysis on commodity level (min, max and average prices on based on historical data) and determination of possible ranges for this variation.
Min
price
Average
price
Max
price α% β% β% α%
Flag
α%=10%
β%=80%

12. Price analysis on commodity level
Calculated price
Flag
Min price
Average price
Max price

13. Intrastat data quality control
During data validation process statisticians compare Intrastat data with VAT data at enterprise level. If the difference is high, the statisticians call to the enterprise and clarify the reason of discrepancies.

14. Analysis of aggregated Intrastat data

15. Number of verified Intrastat rows in 2016
Period
Arrivals
Dispatches
Total
Jan
39 951
Feb
43 315
Mar
45 377
Apr
45 690
Mai
46 729
Jun
44 613
Jul
44 186
Aug
46 903
Sep
48 262
Oct
47 630
Nov
48 330
Dec
44 009

16. THANKS FOR YOUR ATTENTION!