ASSESMENT IN OPEN AND DISTANCE LEARNING Objectives: 1.To explain the characteristic of assessment in ODL 2.To identify the problem and solution of assessment in ODL 3.To develop the assessment system in ODL

ASSESSMENT …. Is a process in gathering, processing, interpreting, and using the information of student’s learning achievement in order to know how the goals are attained objectively. Is a process in gathering, processing, interpreting, and using the information of student’s learning achievement in order to know how the goals are attained objectively.

CHARACTERISTIC OF ODL …. Student and instructor are separated Instruction may be synchronous or asynchronous Self directed learning

INSTRUCTION IN ODL …. BASIC COMPETENCIES LEARNING: TUTORIALS SELF DIR. LEARNING ASSESSMENT INDICATORS

BASIC STEPS IN ASSESSMENT Determining the purpose of assessmentDetermining the purpose of assessment Developing the table of specificationDeveloping the table of specification Selecting appropriate instrumentSelecting appropriate instrument Preparing relevant instrumentPreparing relevant instrument Assembling the instrumentAssembling the instrument Administering the assessmentAdministering the assessment Appraising the assessmentAppraising the assessment Using the resultUsing the result

THE PRINCIPLES OF ASSESSMENT IN ODL …  Include the general principles of assessment such as: * valid * Reliable * Fair  Can be managed from distance: * Traditional testing * On line testing

ASSESSMENT ISSUES IN ODL …. ► Quality of instrument ► Large scale assessment ► On line assessment ► Administering assessment ► Scoring process ► Final examination

QUALITY OF INSTRUMENT …. VALIDITY AND RELIABILITY VALID & RELIABEL NOT VALID BUT REL NOT VALID & NOT REL

DOMAIN OF COMPETENCY … TAXONOMY OF EDUC COMPETENCIES COGNITIVE AFFECTIVE PSYCHOMOTOR

ASSESSMENT’S INSTRUMENT ESSAY TEST OBJECTIVE INSTRUMENTSTEST PERFORMANCE ASSESSMENT PORTFOLIO ASSESSMENT

TEST DEVELOPMENT Development of test specification Writing items based on test specification Reviewing test items Assembling test Reproduction test Administering test Scoring and grading

TEST SPECIFICATION …  Representative of material  Type of test  Level of cognitive  Index of difficulty item  The sum of items and time consuming

TABLE OF TEST SPECIFICATION TOPIC & SUB TOPIC LEVEL OF COGNITIVE & INDEX OF DIFFICULTY ITEM TOTAL ITEM

HOW TO CONSTRUCT GOOD ITEM TEST ? Use item test specification Use item test specification Use guide line to construct good item (ex.: there is a key answer for objective test or marking scheme for essay test) Use guide line to construct good item (ex.: there is a key answer for objective test or marking scheme for essay test) Item tests should represent specific objectives Item tests should represent specific objectives The items should have highly internal consistency The items should have highly internal consistency

EXAMPLE OF TEST ITEMS

PREPARE PERFORMANCE OR PORT FOLIO ASSESSMENT ? Identify competencies Identify competencies Prepare the instructional task/ student worksheet Prepare the instructional task/ student worksheet Prepare the rubric (marking scheme) Prepare the rubric (marking scheme)

ADMINISTERING OF PERFORMANCE AND PORTFOLIO ASSESSMENT To motivate student To motivate student Discuss, how to do the instructional task Discuss, how to do the instructional task Give the continuous feedback Give the continuous feedback

HOW TO ASSESS PERFORMANCE AND PORTFOLIO ? Use the rubric consistently Use the rubric consistently Give chance to self assessment based on rubric Give chance to self assessment based on rubric

EXAMPLE IN ASSESSMENT OF PERFORMANCE … Do an experiment with a rope to know the periodic of oscillation: Do an experiment with a rope to know the periodic of oscillation: 1. Length of rope and weight are constant, angle of 1. Length of rope and weight are constant, angle of deviation varies. deviation varies. 2. Length of rope varies, and weight is constant. 2. Length of rope varies, and weight is constant. 3. Length of rope is constant, and weight varies. 3. Length of rope is constant, and weight varies. Write a report of your experiment and send it by (due-date is ….) Write a report of your experiment and send it by (due-date is ….) Criteria of assessment: Criteria of assessment: 1. Time Precision of report submission (10%) 1. Time Precision of report submission (10%) 2. Tidiness of report (10%) 2. Tidiness of report (10%) 2. Procedure of experiment (20%) 2. Procedure of experiment (20%) 3. Systematic of Displaying Data (10%) 3. Systematic of Displaying Data (10%) 5. Data Analysis (30%) 5. Data Analysis (30%) 6. Conclusion (20%) 6. Conclusion (20%)

THE RUBRIC … SCORE ASPECTS TO BE ASSESSED Report submission is on time 1 day delayed 2 days delayed Report is tidy Report is less tidy Report is not tidy

THE RUBRIC … SCORE ASPECTS TO BE ASSESSED Experiment procedure is correct A little error in experiment procedure Too many errors in experiment procedure Systematic of displaying data is correct A little mistake in systematic of displaying data Systematic of displaying data is wrong

THE RUBRIC … SCORE ASPECTS TO BE ASSESSED Data analysis is very good Data analysis is good Data analysis is not good Conclusion is correct Conclusion is not too correct Conclusion is wrong

LARGE SCALE ASSESSMENT … Is an assessment that is administered to a large number of people at one time in which the examinees are spread out in large areaIs an assessment that is administered to a large number of people at one time in which the examinees are spread out in large area

ADVANTAGES OF LARGE SCALE ASSESSMENT …. It is used to measure learning outcomes effectively, esp. Cognitive domain It is used to measure learning outcomes effectively, esp. Cognitive domain It can be managed efficiently It can be managed efficiently The outcomes is standardized The outcomes is standardized It is fair It is fair

THE LIMITATIONS OF LARGE SCALE ASSESSMENT …. It cannot be used to measure learning outcomes comprehensively It cannot be used to measure learning outcomes comprehensively It depends on well organized item bank It depends on well organized item bank It needs a large number of human and financial resources if it is applied manually It needs a large number of human and financial resources if it is applied manually The security of the item test is very sensitive The security of the item test is very sensitive

HOW TO MANAGE LARGE SCALE ASSESSMENT ….  Develop a well organized item bank  Assembling the test  Reproduce test books  Distribute test books to every regional learning center  Test administration  Scoring process  Send the examination result to every student

POTENTIAL PROBLEMS IN LARGE SCALE ASSESSMENT … Test Quality is low Not enough test books at some locations The test administration is uncontrolled Bad management on score processing The students do not receive test result on time

Tips for Successful Large Scale Assessment Develop a well organized item bank Develop standard operation and procedures to control the quality of assessment Build networking with other institutions in developing item tests, recruiting proctors, delivering item booklets and having places for the test Make sure that every person who involved in developing item tests is well-trained

Tips for Successful Large Scale Assessment (cont) Make sure that all proctors are well-informed Make sure that all proctors are well-informed Be sure that item tests are secure Be sure that item tests are secure Make sure that scoring process works on time Make sure that scoring process works on time Make sure that all students have the result on time Make sure that all students have the result on time

ON LINE ASSESSMENT IN ODL Is ICT used for administrating the test ? Is ICT used for administrating the test ? The item bank should have a great number of items The item bank should have a great number of items Computer adaptive testing Computer adaptive testing To have on line assessment facility To have on line assessment facility

THE STRENGTHS AND WEAKNESSES OF ON LINE ASSESSMENT… Strengths: Accurate Accurate Effective and efficient Effective and efficient Long lasting Long lasting Flexible in time and place Flexible in time and placeWeaknesses: Great investment Great investment Limited access to computer for some student Limited access to computer for some student Difficult to control students’ honesty (???) Difficult to control students’ honesty (???)

Scoring process Identity check Identity check Mode of process: - Manual Mode of process: - Manual - Computerized - Computerized Score Interpretation Score Interpretation Grading Grading Distribution of test result Distribution of test result

FINAL ASSIGNMENT OR FINAL EXAMINATION OF A PROGRAM Every degree program should be ended with a final assignment or final examination Final assignment can be in the form of an academic paper. The students can also be tested on their comprehension toward the program by giving them comprehensive examination only