1. A System for Scanner Data
Muhanad Sammar, Anders Norberg & Can Tongur
Statistics Sweden

2. A System for Scanner Data
Several years of wanting and canvassing of retail chains paid off very well
We now have access to vast amounts of data
We receive text files every week
Files contain weekly sales:
sold quantity
price (w/o VAT)
EAN
store name etc.
Transmission is safe (over FTP)

3. The Scanner Data Files …and files look like this Market Postal Code
YearWeek
EAN
Brand
Quantity
Price
ABC
14550
201220
730202…
Y-Brand 43
12.90 …
X-Brand 2
8.90
DEF
75424 …
174
32.90

4. Building the System We wanted to incorporate scanner data:
Either by extending the existing production environment, or creating a new environment
Pity not to use the existing User Interface
Perhaps not so simple to use the regular engine
SAS® seemed extremely attractive & tempting to use…

5. The Existing System The ordinary user interface Pi09 (π09)
Tables in SQL, interface and system in VB.Net

6. Adding SAS We made it simple and added a scroll-down menu
The idea behind this (SAS↔VB.Net) already established in the house

7. The Production Flow

8. Production Initiation
Initially, an EAN – Product code register must be established for extraction of data

9. The Monthly Data Extraction Register
Product Code
EAN
Year
Month
Product Name
Brand
112517
2012 3
BULGUR 1KG
DRUVAN
112710
SPAGHETTI
BARILLA
112737
LASAGNE 1 KG
FAMILJEN DAFGÅRD
123243
BACON
SCAN
GOL PÖLSER RÖDA HOT DOG PÖLSER 375 G
GOL PÖLSER
124079
BUFFALO WINGS 500G
GULDFÅGELN
922449
ALWAYS ULTRA NORMAL PLUS
ALWAYS

10. The Editing Interface

11. Validation and Selection
Given data – Validate
Perform trivial but crucial checks, e.g.:
Numerics are numeric
Check shop names & that all are there
Check that the period in data (YYYYWW) actually is the desired week
Given Validity and a Register – Select data
Revalidate and perform editing and subtraction of deposits etc.
If necessary – use the new interface to make changes/delete prices

12. Aggregation and Uploading
Aggregate data before uploading it
Aggregation by geometric mean over 3 weeks
Make a final register check (=mirror) of EAN – Product in the S.D. sample v.s. the (updated) designated sample
Upload data to the ordinary system
Perform a market analysis of EAN codes
Necessary for maintenance and keeping S.D. register up to date
Pragmatic approach – use MS. Excel

13. Market Analysis

14. Market Analysis Product Code EAN Product Name Brand # stores
# packages
112517
BULGUR 1KG X 17
876
112710
SPAGHETTI Y 4 12
112737
LASAGNE 1 KG Z 20
1347

15. Summing-up
Note merely SAS but also SQL table views with ”the right stuff” required
SAS part not so tricky – system integration harder
Ideas have to mature
It works!