1. EGR Identification service
4 NSI data to
EGR Identification service
ESTP Training on EGR
6-7 September 2016

2. NSI data to EGR IS NSIs deliver to EGR IS
Data of resident legal units (May T+1)
Data of non-resident legal units for identification (by October T+1)
EGR IS delivers LEID numbers to NSIs
As feedback for resident legal units
As feedback for non-resident legal units
Communication in CSV files
File transfers via EDAMIS
Automatic validation and upload to the EGR IS at Eurostat

3. Resident legal units to EGR IS (1)
NSIs deliver data on resident legal units to EGR IS in May T+1
Units not liquidated at 31/12/T and liquidated in year T are collected
Authentic store NSIs (28)
Complete population of incorporated resident LEUs
Partly authentic store NSIs (4)
Known population of resident legal units belonging to multinational groups
NSI data are updated in EGR IS once per year (June T+1)

4. Resident legal units to EGR IS (2)
Pos.
Field name
Metadata code list 1
LEU_NAT_ID 2
LEU_NAT_ID_2 3
LEU_PRV_NAT_ID 4
LEU_NAT_ID_NIS_CODE
CL_NIS_CODE_EGR 5
LEU_NAT_ID_2_NIS_CODE 6
LEU_PRV_NAT_ID_NIS_CODE 7
LEU_NSA_ID 8
LEU_LEI_ID 9
LEU_EORI_ID 10
LEU_VAT_ID 11
LEU_NAME 12
LEU_ADDRESS 13
LEU_POSTAL_CODE 14
LEU_CITY_NAME 15
LEU_STATE_NAME
CL_LEU_STATE_NAME 16
LEU_COUNTRY_CODE
CL_COUNTRY_CODE_BOP 17
LEU_RYEAR 18
LEU_CONF_I
CL_CONFIDENTIAL_IND 19
LEU_STA_CODE
CL_STATUS_LEU_B 20
LEU_DATE_INC 21
LEU_DATE_LIQ 22
LEU_LFORM
CL_LEGAL_FORM_EGR 23
LEU_TYPE
CL_TYPE_OF_LEGAL_UNIT
Resident legal units to EGR IS (2)
CSV format
One record = one legal unit
23 variables

5. Resident legal units to EGR IS (3)
National IDs and NIS codes are standardized
Predefined format for every EU and EFTA country
National ID - basis of the LEID number
Country
LEU_NAT_ID
NIS_CODE
LEU_LEID
LEU_NAT_ID_2 AT
094185h
21013
AT h
ATU
22013 BE
21021 BE BG
21023 BG CH
CHE
23043
CH23043E CH
21043 CY
25054 CY
C112623
21054 CZ
21055 CZ

6. Resident legal units to EGR IS (4)
Name and address details
Latin characters only; transformation needed for Greek and Cyrillic names
Characters of the English alphabet, transformation needed for specific characters (e.g. ä, ö, ß, á)
Accepted characters
a b c d e f g h i j k l m n o p q r s t u v w x y z 
A B C D E F G H I J K L M N O P Q R S T U V W X Y Z   
space – - + ( ) . # _ = < > / \

7. Resident legal units to EGR IS (5)
Name and address details
Legal forms abbreviated in company names
Better linking results on names in EGR IS
Abbreviations listed for EU countries
Hungary
Korlatolt felelossegu tarsasag
Zartkoruen mukodo reszvenytartsasag
Nyilvanosan mukodo reszvenytartsasag
Beteti tarsasag
KFT
ZRT
NYRT BT

8. Validation with EDIT
In the EGR process the received NSI files are validated in Eurostat with EDIT
EDIT is a Eurostat tool to validate data files
Validation for file structure and content
If format is correct EDIT splits the files into two:
Valid records
Invalid records
Automatic error report is sent to NSIs in EDAMIS
Valid records are automatically loaded to EGR IS

9. EDIT validation rules
The validation rules of EGR files can be found on the EGR wiki
EDIT files page
2 documents:
EGR IS files
EGR files

10. Most frequent errors of EGR IS files (1)
Wrong file structure
Columns are missing, wrong order
Header row is missing
Separator is comma instead of semi-colon
Special characters in the files
Comma, quotation mark in names, ö, ä, ü, etc.
Empty number fields with double quotations ("")
Invalid date formats:
D/M/YYYY instead of DD/MM/YYYY
Invalid dates, e.g. 31 February

11. Most frequent errors of EGR IS files (2)
Wrong file naming in EDAMIS
EGR_ISRLE_N_CC_2015_0001_V0001_DDMMYYYY_NSA.CSV
EGR_ISRLE_N_CC_2015_0001_V0001_DDMMYYYY_NSA.TXT
EGR_ISRLE_N_CC_2015_0001_V0001_DDMMYYYY-NSA.CSV
EGR_ISRLE_N_CC_2015_0001_V0001_YYYYMMDD_NSA.CSV
File naming in EDAMIS is defined by NSI user
Select the dataset
Select the year
Fill the free text comment : _NSA or _NSA_BR
File is not treated in EGR IS (files should be run and closed by the NSI users)
Start and close request

12. Real-time example with resident EGR IS file
NSI user is sending a resident LEU file in EDAMIS
File is delivered to specific folder at Eurostat drive
EDIT picks up the file automatically
The file will be split to valid and invalid parts
Error report is sent to NSI in EDAMIS
Valid file is sent to input folder at Eurostat drive
File is automatically imported into EGR IS
NSI users can see their file in EGR IS
NSI user should start and close the identification (no manual tasks in this case)

13. EDIT standalone version (1)
Eurostat recommends to NSIs to use the EDIT standalone version for EGR data
To pre-validate the NSI files in the NSI premises
Off-line tool, to be installed in NSIs
The program was developed by Eurostat
The setup file (.exe, 330 MB) can be downloaded from the EGR wiki
Local installation to be done at NSIs (probably by local IT support)

14. EDIT standalone version (2)
NSIs can import their EGR data files to the tool
Error report will be generated by the tool
Same EDIT rules and report as in the central validation
Versioning will be important
Latest version and guide can be downloaded from EGR wiki

15. EDIT standalone version (3)
Where pre-validation will be done by NSIs, files will be validated twice
Why?
Input data to EGR should be consistent
Pre-validation will be missing for some files (for example EDIT stand-alone cannot be installed due to local IT policy)
Versions of the applied validation rules can be different

16. Foreign legal units to EGR IS (1)
The goal is to identify the foreign legal units with a unique ID number
Manual search in the EGR IS (one by one)
Batch file to EGR IS for multiple records
No update in the EGR IS, only search for LEID numbers
Multiple files can be sent to EGR IS
Deadline of identification is the end of October T+1

17. Foreign legal units to EGR IS (2)
Pos
Field name
Metadata code list 1
LEU_NAT_ID 2
LEU_NAT_ID_2 3
LEU_PRV_NAT_ID 4
LEU_NAT_ID_NIS_CODE
CL_NIS_CODE_EGR 5
LEU_NAT_ID_2_NIS_CODE 6
LEU_PRV_NAT_ID_NIS_CODE 7
LEU_NSA_ID 8
LEU_LEI_ID 9
LEU_EORI_ID 10
LEU_VAT_ID 11
LEU_NAME 12
LEU_ADDRESS 13
LEU_POSTAL_CODE 14
LEU_CITY_NAME 15
LEU_STATE_CODE
CL_LEU_STATE_NAME 16
LEU_COUNTRY_CODE
CL_COUNTRY_CODE_BOP 17
LEU_DUNS_ID 18
LEU_BVD_ID 19
LEU_RYEAR 20
DATA_SET_ID 21
LEU_STA_CODE
CL_STATUS_LEU_B 22
LEU_DATE_INC 23
LEU_DATE_LIQ 24
LEU_LFORM
CL_LEGAL_FORM_EGR 25
LEU_TYPE
CL_TYPE_OF_LEGAL_UNIT
Foreign legal units to EGR IS (2)
Continuous action in the period of July-October T+1
CSV format
One record = one legal unit
25 variables

18. Foreign legal units to EGR IS (3)
Key variables of the file
Name, country code (compulsory)
For US and Canada: valid state code (not mandatory)
Preferably ID numbers are requested, e.g. from commercial sources

19. Validation with EDIT Validation is similar to EGR IS resident file
Validation for file structure and content
If format is correct EDIT splits the files into two:
Valid records
Invalid records
Automatic error report is sent to NSIs in EDAMIS
Valid records are automatically loaded to EGR IS

20. LEID numbers to EGR IS (1)
The goal is to validate the already collected LEID numbers of foreign legal units
Batch file to EGR IS with LEID numbers
No update in the EGR IS, only search and matching on LEID numbers in EGR IS
To be done before the identification of foreign records
Multiple files can be sent to EGR IS
Deadline of identification is the end of October T+1

21. LEID numbers to EGR IS (2)
Pos.
Field name 1
LEU_LEID
Continuous action in the period of July-October T+1
CSV format
One record = one legal unit
1 variable, the LEID number

22. Validation and processing of the LEID file
Delivery in EDAMIS
No validation in EDIT (for the moment)
Manual import to EGR IS by EGR staff (for the moment)
Automatic processing in EGR IS, output file with matching results in short time
No user interaction needed in the EGR IS application
Where no match, for that record only the requested LEID number will be in the feedback file

23. Real-time example with a LEID file
NSI user is sending a LEID file in EDAMIS
File is delivered to specific folder at Eurostat drive
File is imported to EGR IS
Automatic processing
Feedback file is sent by EGR team in EDAMIS

24. Feedback files of the EGR IS
In the feedback files the EGR IS is sending back the LEID numbers to NSIs
One format for the feedback of resident and non-resident file
One format for the LEID file
In both files the incoming data and LEID data are included per record
File will be only generated after the user is closing the request in EGR IS! Manual delivery by EGR staff to NSIs
File transfer via eDAMIS

25. Resident, non-resident feedback file
Pos.
Field 1
LEU_NAT_ID 21
R_LEU_NAT_ID 2
LEU_NAT_ID_2 22
R_LEU_NAT_ID_2 3
LEU_PRV_NAT_ID 23
R_LEU_PRV_NAT_ID 4
LEU_NAT_ID_NIS_CODE 24
R_LEU_NAT_ID_NIS_CODE 5
LEU_NAT_ID_2_NIS_CODE 25
R_LEU_NAT_ID_2_NIS_CODE 6
LEU_PRV_NAT_ID_NIS_CODE 26
R_LEU_PRV_NAT_ID_NIS_CODE 7
LEU_NSA_ID 27
R_LEU_NSA_ID 8
LEU_LEI_ID 28
R_LEU_DUNS_ID 9
LEU_EORI_ID 29
R_LEU_BVD_ID 10
LEU_VAT_ID 30
R_LEU_NAME 11
LEU_NAME 31
R_LEU_CITY_NAME 12
LEU_ADDRESS 32
R_LEU_STATE_CODE 13
LEU_POSTAL_CODE 33
R_LEU_COUNTRY_CODE 14
LEU_CITY_NAME 34
R_LEU_STA_CODE 15
LEU_STATE_CODE 35
R_LEU_DATE_INC 16
LEU_COUNTRY_CODE 36
R_LEU_DATE_LIQ 17
LEU_DUNS_ID 37
R_LEU_LFORM 18
LEU_BVD_ID 38
R_LEU_TYPE 19
LEU_RYEAR 39
R_LEU_CONF_I 20
DATA_SET_ID 40
R_DATA_SET_ID 41
R_LEU_LEID 42
R_LEU_LEID_SOURCE_I 43
R_LEU_LEID_STATUS
Resident, non-resident feedback file
CSV format
One record = one legal unit
43 variables
Incoming data (LEU_) and EGR IS data (R_LEU_) per record

26. Example feedback file
;;;;;;;;;;Company A;;;;;IE;;;;;480931;;;21101;;; EN ;;;COMPANY A;MEATH;;IE;A;03/11/2010;; LL;L;C;;IE ;NSA_NA_IE_BR;C
LEU_NAT_ID
R_LEU_NAT_ID
480931
LEU_NAT_ID_2
R_LEU_NAT_ID_2
LEU_PRV_NAT_ID
R_LEU_PRV_NAT_ID
LEU_NAT_ID_NIS_CODE
R_LEU_NAT_ID_NIS_CODE
21101
LEU_NAT_ID_2_NIS_CODE
R_LEU_NAT_ID_2_NIS_CODE
LEU_PRV_NAT_ID_NIS_CODE
R_LEU_PRV_NAT_ID_NIS_CODE
LEU_NSA_ID
R_LEU_NSA_ID EN
LEU_LEI_ID
R_LEU_DUNS_ID
LEU_EORI_ID
R_LEU_BVD_ID
LEU_VAT_ID
R_LEU_NAME
COMPANY A
LEU_NAME
Company A
R_LEU_CITY_NAME
MEATH
LEU_ADDRESS
R_LEU_STATE_CODE
LEU_POSTAL_CODE
R_LEU_COUNTRY_CODE IE
LEU_CITY_NAME
R_LEU_STA_CODE A
LEU_STATE_CODE
R_LEU_DATE_INC
03/11/2010
LEU_COUNTRY_CODE
R_LEU_DATE_LIQ
LEU_DUNS_ID
R_LEU_LFORM LL
LEU_BVD_ID
R_LEU_TYPE L
LEU_RYEAR
R_LEU_CONF_I C
DATA_SET_ID
R_DATA_SET_ID
R_LEU_LEID IE
R_LEU_LEID_SOURCE_I
NSA_NA_IE_BR
R_LEU_LEID_STATUS

27. LEID feedback file CSV format One record = one legal unit 24 variables
Pos.
Field 1
LEU_LEID 2
R_LEU_NAT_ID 3
R_LEU_NAT_ID_2 4
R_LEU_PRV_NAT_ID 5
R_LEU_NAT_ID_NIS_CODE 6
R_LEU_NAT_ID_2_NIS_CODE 7
R_LEU_PRV_NAT_ID_NIS_CODE 8
R_LEU_NSA_ID 9
R_LEU_DUNS_ID 10
R_LEU_BVD_ID 11
R_LEU_NAME 12
R_LEU_CITY_NAME 13
R_LEU_STATE_CODE 14
R_LEU_COUNTRY_CODE 15
R_LEU_STA_CODE 16
R_LEU_DATE_INC 17
R_LEU_DATE_LIQ 18
R_LEU_LFORM 19
R_LEU_TYPE 20
R_LEU_CONF_I 21
R_DATA_SET_ID 22
R_LEU_LEID 23
R_LEU_LEID_SOURCE_I 24
R_LEU_LEID_STATUS
LEID feedback file
CSV format
One record = one legal unit
24 variables
Incoming data (LEU_LEID) and EGR IS data (R_LEU_) per record

28. File processing in EGR IS
As in August 2016
File
EDIT
Loading to EGR IS
Processing
(run, close)
Sending feedback
ISRLEU
AUTO
NSI MANUAL
ESTAT MANUAL
ISNORLEU
ISLEID NO

29. Success factors for NSIs EGR IS files
Timely delivery of files
Pre-validate your files, use the standalone version of EDIT
Country code to be specified in standalone EDIT
Correct file naming in EDAMIS
For automatic EDIT feedback needed
For automatic EGR feedback file is needed
Monitor feedback messages in EDAMIS
Launch and close the files in EGR IS!

30. Guidelines, further reading
EGR wiki
Guidelines page
Guidelines 1 - Resident legal units to the EGR IS
Guidelines 2 - Non-resident legal units to the EGR IS
EDAMIS & EDIT page
File naming
Validation rules

31. Notes

32. Notes