1. Data Management Seminar, 9-12th July 2007, Hamburg Entering Data Part 2

2. Data Management Seminar, 9-12th July 2007, Hamburg 2 Table of Content 1 Introduction 2 Sequence of Variables 3 Entering Data 4 Material Needed for Data Entry 5 Example: Entering Achievement & Reliability Data 6 Hands-On Training: Entering Test & Reliability Data

3. Data Management Seminar, 9-12th July 2007, Hamburg Enter Achievement and Reliability Data Complete Student Information Enter Background Data Enter Achievement and Reliability Data Data Entry and Verification 3

4. Data Management Seminar, 9-12th July 2007, Hamburg 1Introduction 2Sequence of Variables 3Entering Data 4Material for Data Entry 5Example: Entering Student Achievement Data 6Hands-On Training: Entering Achievement and Reliability Data Table of Content 4

5. Data Management Seminar, 9-12th July 2007, Hamburg Markers evaluate students responses to constructed- response items Interpretation is based on Marking Guides provided by the International Study Center Up to 2 points are assigned –Code 2 is worth 2 points –Code 1 is worth 1 point –Code 0 is worth 0 points (or means invalid) –Code 9 means missing Code is written at prepared places in the Achievement Booklets or Constructed-Response Items Marking Sheets, so key puncher can enter them later Mark Constructed-Response Items 5

6. Data Management Seminar, 9-12th July 2007, Hamburg 50% of sampled students  120 booklets of booklet type 1, 2 and 3 Reliability markers will be recorded on separate Constructed-Response Items Marking Sheet for Double Marking and later entered in the Reliability Data File 3R Reliability Marking 6

7. Data Management Seminar, 9-12th July 2007, Hamburg Contain student responses to multiple-choice and constructed-response items Should contain one record for each COMPLETED Student Test Booklet Student Test Data File 7

8. Data Management Seminar, 9-12th July 2007, Hamburg Contain reliability codes for constructed- response items Should contain one record for each COMPLETED marking sheet Reliability Marking Data File 8

9. Data Management Seminar, 9-12th July 2007, Hamburg File Naming Convention Data FileTarget GradeResp. LevelType Student AchievementISA Student QuestionnaireISG Student ReliabilityISR European Module Student Questionnaire ISE Latin American Module Student Questionnaire ISL Teacher QuestionnaireITG School QuestionnaireICG National Context SurveyING

10. Data Management Seminar, 9-12th July 2007, Hamburg Identification variables IDPUNCH – 3 digits, identifies the key puncher IDSTUD – 8 digits IDCHECK – 3 digits, in combination with unique ID Identification Variables – I 10

11. Data Management Seminar, 9-12th July 2007, Hamburg Identification variables IDBOOK – 1 digit – Applies to Student Achievement and Reliability Data File only – Identifies the booklet that was administered to the student – Used to filter the set of questions to be displayed to the key puncher Identification Variables – II 11

12. Data Management Seminar, 9-12th July 2007, Hamburg Identification variables Test Data Files: IDSCORA – 3 digits, identifies marker for the main marking (Student Achievement Data File) IDSCORR – 3 digits, identifies marker for the reliability marking (Student Reliability Data File) – Usage of those variable permits identification of systematical marking errors for individual markers – Assigning procedure suggested is: - Codes for Marking Team A (Set A) start with 1xx - Codes for Marking Team B (Set B) start with 2xx – Codes for both variables must be different for one and the same student Identification Variables – III 12

13. Data Management Seminar, 9-12th July 2007, Hamburg Identification Variables – III 101 201 13

14. Data Management Seminar, 9-12th July 2007, Hamburg Identification variables Indicator variables CHECK01, CHECK02,…, CHECKn – 1 digit, avoid column shifts – Only entering blank space is allowed – Appear when –Transition is made between ID- and TOKEN-variables –Transition is made between the test booklets (Student Achievement and Reliability Data File only) –The booklet ends Indicator Variables – I 14

15. Data Management Seminar, 9-12th July 2007, Hamburg Identification variables Indicator variables Student Achievement and Reliability Data File: TOKEN01 to TOKEN06 – 1 digit, indicates availability of data, 3 codes 1 – Instrument available, but empty 2 – Instrument not available or lost 3 – Instrument available with responses – TOKENxx appears after CHECKn variable and before survey instrument variables of the corresponding booklet Indicator Variables – II 15

16. Data Management Seminar, 9-12th July 2007, Hamburg Identification variables Indicator variables Test instrument variables Test Instrument Variables 16

17. Data Management Seminar, 9-12th July 2007, Hamburg Variable Value IDBOOK IDPUNCH IDSCORA IDSTUD IDCHECK CHECK01 TOKEN05 CE294M1... 3 1 Sequence in Student Achievement File 201 17 5 5 80010104 844 111 Booklet 5

18. Data Management Seminar, 9-12th July 2007, Hamburg 1Introduction 2Sequence of Variables 3Entering Data 4Material for Data Entry 5Example: Entering Student Achievement Data 6Hands-On Training: Entering Achievement and Reliability Data Table of Content 18

19. Data Management Seminar, 9-12th July 2007, Hamburg Key punchers shall be able to enter the data the easiest way possible: –For multiple-choice items – enter checked category First option  Enter 1 Second option  Enter 2 … Coding of Multiple-Choice Items Enter 1Enter 2Enter 3Enter 4 19

20. Data Management Seminar, 9-12th July 2007, Hamburg Key punchers shall be able to enter the data the easiest way possible: –For constructed-response items – enter value indicated by marker Coding Constructed-Response Items 0 Enter 0 20

21. Data Management Seminar, 9-12th July 2007, Hamburg Missing Codes 21 Default 6, 96, 996,... Invalid 7,97,997,... Omitted 9, 99, 999,... Not Administered 8, 98, 998,...

22. Data Management Seminar, 9-12th July 2007, Hamburg Omitted response (9, 99) –Non-response Enter 9 Omitted Codes – I 22

23. Data Management Seminar, 9-12th July 2007, Hamburg Omitted response (9, 99) –Non-response –Booklet not completed at all Omitted Codes – II 23 Do not enter record in WinDEM.

24. Data Management Seminar, 9-12th July 2007, Hamburg Invalid response (7, 97) –Invalid response Invalid Codes - I Enter 7 24

25. Data Management Seminar, 9-12th July 2007, Hamburg Invalid response (7, 97) –Invalid response Invalid Codes - II Enter 7 25

26. Data Management Seminar, 9-12th July 2007, Hamburg Not administered (8, 98) –Respondent was not administered a section of the booklet Booklet 1 Booklet 2 Booklet 3 Booklet 4 Booklet 5 Booklet 6 Questions in all other booklets are coded to Not Administered later at the IEA DPC! Not Administered Codes – I 26

27. Data Management Seminar, 9-12th July 2007, Hamburg Enter 8 Not Administered Codes – II Not administered (8, 98) –Respondent was not administered a section of the booklet –Question (or page) was misprinted (or missing) in the booklet 27

28. Data Management Seminar, 9-12th July 2007, Hamburg 1Introduction 2Sequence of Variables 3Entering Data 4Material for Data Entry 5Example: Entering Student Achievement Data 6Hands-On Training: Entering Achievement and Reliability Data Table of Content 28

29. Data Management Seminar, 9-12th July 2007, Hamburg Required Information Required information for entering test data  Student Tracking Form (column 9 or 12) –Student Achievement Test Booklet Required information for entering reliability marking data  Student Tracking Form (column 9 or 12) –Constructed-Response Items Marking Sheet for Double Marking (Reliability Marking Sheets) 29

30. Data Management Seminar, 9-12th July 2007, Hamburg 1Introduction 2Sequence of Variables 3Entering Data 4Material for Data Entry 5Example: Entering Student Achievement Data 6Hands-On Training: Entering Achievement and Reliability Data Table of Content 30

31. Data Management Seminar, 9-12th July 2007, Hamburg Start WinDEM Create Student Test Data File from codebook file ISADEUF2.sdb Show WinDEM Example – I D:\Seminar Examples\4_Work_WinDem\ISADEUF2.sdb 31

32. Data Management Seminar, 9-12th July 2007, Hamburg Enter... 1. Student label information 2. Booklet data Show WinDEM Example – II 32

33. Data Management Seminar, 9-12th July 2007, Hamburg 1Introduction 2Sequence of Variables 3Entering Data 4Material for Data Entry 5Example: Entering Student Achievement Data 6Hands-On Training: Entering Achievement and Reliability Data Table of Content 33

34. Data Management Seminar, 9-12th July 2007, Hamburg Hands-On Training Schools 8001 and 8502 What you will need:  Student Tracking Forms –Student Achievement Test Booklets (Tab6) –Reliability Marking Sheets (Tab7) –Codebooks in What you will have to do: –Start WinDEM (Start  Programs  WinDEM_ICCS09_FT  WinDEM_ICCS09_FT) –Create a data file from corresponding codebook (WinDEM menu FILE  NEW DATA FILE) –Enter data from booklet labels, booklets and Reliability Marking Sheets 20 min D:\Seminar Examples\4_Work_WinDem Login: user / bird 34

35. Data Management Seminar, 9-12th July 2007, Hamburg Hands-On Training Entering ACH Data for both Schools What you will need:  Student Tracking Forms (Tab6) –Student Achievement Test Booklets (Tab6) –Codebook in What you will have to do: –Start WinDEM (Start  Programs  WinDEM_ICCS09_FT  WinDEM_ICCS09_FT ) –Create a data file from corresponding codebook (WinDEM menu FILE  NEW DATA FILE: ISADEUF2.dbf) –Enter data from booklet labels and booklets D:\Seminar Examples\4_Work_WinDem\ISADEUF2.sdb 35

36. Data Management Seminar, 9-12th July 2007, Hamburg Hands-On Training Entering REL Data for both Schools What you will need:  Student Tracking Forms (Tab7) –Reliability Marking Sheets (Tab7) –Codebook in What you will have to do: –Start WinDEM (Start  Programs  WinDEM_ICCS09_FT  WinDEM_ICCS09_FT ) –Create a data file from corresponding codebook (WinDEM menu FILE  NEW DATA FILE: ISRDEUF2.dbf) –Enter data from booklet labels and Reliability Marking Sheets D:\Seminar Examples\4_Work_WinDem\ISRDEUF2.sdb 36