PORTFOLIO ASSESSMENT OVERVIEW Introduction  Alternative and performance-based assessment  Characteristics of performance-based assessment  Portfolio as a performance-based strategy Rubrics and Rubric Generation Scoring/Mark Schemes for Rubrics  Analytic and holistic scoring schemes Implications of Subjective Nature of Scoring Rubrics

CHARACTERISTICS OF PERFORMANCE- BASED ASSESSMENT Performance-based assessments are characterised by:  Clear purpose  Observable aspects  Means of eliciting performance  Clearly articulated scoring procedures

RUBRICS  Rubrics  Rubrics are guides to assessing levels of performance of significant tasks identified for students to perform.  Rubrics  Rubrics serve to assure (to some degree) that assessments are objective, fair, and reliable. They focus on essential tasks, provide benchmarks or standards, promote self-assessment, and allow feedback.  Rubrics  Rubrics relate to the requirements of reliability, validity, and fairness of traditional assessments. (Attempt to address these factors since they are at risk because of the highly subjective nature of performance assessment.)

DEVELOPING RUBRICS AND SCORING SCHEMES Task analysis 1) Task analysis – what students required to do Criteria definition 2) Criteria definition – identification of significance tasks Identification of performance levels for each 3) Identification of performance levels for each criterion criterion – benchmarks or standards Definition of descriptors 4) Definition of descriptors – each performance level Assignment of marks to criterion levels 5) Assignment of marks to criterion levels – along a continuum

SAMPLE CRITERIA FOR ASSESSING A LITERACY PORTFOLIO CRITERIA: PURPOSE QUALITY OF ITEMS/CONTENT REFLECTIONS ON ITEMS (CAPTIONS) FINAL REFLECTIONS PRESENTATION

MARKING SCHEME FOR A POEM - AN ITEM IN A PORTFOLIO CRITERIA MARKS RHYMING5 MOOD3 THEME2 TOTAL10

SAMPLE SCORING SCHEME FOR A PORTFOLIO ITEM - A POEM CRITERIA MARKS RHYMING5 Excellent rhyming pattern (all lines end with rhyming words) 5 good rhyming pattern (most lines end with rhyming words) 4 Adequate rhyming pattern (some lines end with rhyming words) 3 Poor rhyming pattern (very few lines end with rhyming words) 2 Lacking rhyming pattern 1 MOOD3 Creates lively image and generates emotion 3 Creates emotion but lacks lively image 2 Creates lively image but lacks emotion 1 THEME2 Strong link to overall theme 2 Weak link to overall theme 1 TOTAL10

RUBRICS FOR SCORING A PORTFOLIO (Individual Pieces) Criteria No evidence Weak evidence Adequate evidence Strong evidence Rubric The evidence is not present; not clearly labelled; no rationale or self reflection. Evidence is inaccurate; implies misunderstandings; has insufficient rationalisation; insufficient self-reflection. The evidence is presented accurately; no errors; no misunderstandings; but information dealt with at the literal definition level, with no integration across concepts; opinions presented are not sufficiently supported by facts, or facts are presented without clear relevance to opinions or positions. Evidence presented accurately and clearly indicates understanding by integration across concepts. Opinions and positions are clearly supported by referenced facts. Score Slater (1996)

RUBRICS FOR SCORING A PORTFOLIO (Overall) Grade A B+ B C+ C D+ D F Rubric (Strength of evidence for a total of 14 objectives) Strong in 11; adequate in 3 Strong in 11; adequate in 1 Strong in 10; adequate in 3 Strong in 9; adequate in 3 Strong in 9; adequate in 1 Adequate in at least 12 Adequate in at least 9 Adequate in less than 9 Slater (1996)

SAMPLE GUIDELINES TO STUDENTS FOR SELECTING PORTFOLIO CONTENT Relevance: Relevance: Contents should be related to the purpose of the portfolio. A student may compile a variety of pieces of information but should select those which support the stated purpose of the portfolio. Authenticity: Authenticity: Contents should be original and a true reflection of trainee’s learning. All portfolio items should be the results of the trainee’s efforts and should be drawn from his/her educational experiences. Integrity: Integrity: The portfolio should show some consistency in theme, be well-designed, and the individual items should be related to each other. A certain cohesiveness is necessary in a portfolio.

SAMPLE GUIDELINES TO STUDENTS FOR SELECTING PORTFOLIO CONTENT (CONTINUED) Rigour: Rigour: Items included in the portfolio should, when considered together, reflect substantive intellectual effort – depth of thinking. A “thin” portfolio suggests a superficial and/or simplistic approach to the learning experience. Organisation of Contents Organisation of Contents: Contents should be organised in a logical sequence. Include table of contents and an introduction that describes the overall organisation of the portfolio. (The onus is on the student to demonstrate through his/her portfolio his/her ability and levels of competence ….) Presentation: Presentation: Marks will be awarded for the quality of the presentation including its impact, neatness, use of language, and captions.