1. A System for Scanner Data Muhanad Sammar, Anders Norberg & Can Tongur Statistics Sweden

2. A System for Scanner Data Several years of wanting and canvassing of retail chains paid off very well We now have access to vast amounts of data We receive text files every week Files contain weekly sales: sold quantity price (w/o VAT) EAN store name etc. Transmission is safe (over FTP)

3. The Scanner Data Files …and files look like this MarketPostal CodeYearWeekEANBrandQuantityPrice ABC14550201220730202…Y-Brand4312.90 ABC145502012207314805…X-Brand28.90 DEF754242012207310265…X-Brand17432.90

4. Building the System We wanted to incorporate scanner data: Either by extending the existing production environment, or creating a new environment Pity not to use the existing User Interface Perhaps not so simple to use the regular engine SAS® seemed extremely attractive & tempting to use…

5. The Existing System The ordinary user interface Pi09 (π09) Tables in SQL, interface and system in VB.Net

6. Adding SAS We made it simple and added a scroll-down menu The idea behind this (SAS↔VB.Net) already established in the house

7. The Production Flow

8. Production Initiation Initially, an EAN – Product code register must be established for extraction of data

9. The Monthly Data Extraction Register Product CodeEANYearMonthProduct NameBrand 112517733101006562220123BULGUR 1KGDRUVAN 112710807680421505820123SPAGHETTIBARILLA 112737731096003921120123LASAGNE 1 KGFAMILJEN DAFGÅRD 123243730020834500620123BACONSCAN 1233124570125150152420123 GOL PÖLSER RÖDA HOT DOG PÖLSER 375 GGOL PÖLSER 124079731394057450420123BUFFALO WINGS 500GGULDFÅGELN 922449401540034745320123ALWAYS ULTRA NORMAL PLUSALWAYS

10. The Editing Interface

11. Validation and Selection Given data – Validate Perform trivial but crucial checks, e.g.: Numerics are numeric Check shop names & that all are there Check that the period in data (YYYYWW) actually is the desired week Given Validity and a Register – Select data Revalidate and perform editing and subtraction of deposits etc. If necessary – use the new interface to make changes/delete prices

12. Aggregation and Uploading Aggregate data before uploading it Aggregation by geometric mean over 3 weeks Make a final register check (=mirror) of EAN – Product in the S.D. sample v.s. the (updated) designated sample Upload data to the ordinary system Perform a market analysis of EAN codes Necessary for maintenance and keeping S.D. register up to date Pragmatic approach – use MS. Excel

13. Market Analysis

14. Product CodeEANProduct NameBrand# stores# packages 112517733101006..BULGUR 1KGX17876 112710807680421..SPAGHETTIY412 112737731096003..LASAGNE 1 KGZ201347

15. Summing-up Note merely SAS but also SQL table views with ”the right stuff” required SAS part not so tricky – system integration harder Ideas have to mature It works!