Student assessment Assessment tools AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences

Assessment tools  Portfolio  Log book  OSCE  Mini CEX  DOPS  360 degrees

Powerpoint Templates Portfolios

Introduction  Portfolio assessments require the accumulation of evidence gathered over time

Characteristics of Portfolio Assessments  Portfolio assessments: purposeful, organized collection of student work that can be used to describe efforts, progress, or achievement The idea of the academic portfolio is derived from an artist’s or writer’s portfolio Provide a means for students to show what they can really do; they are considered to be based on the “real world” Student performances or products are compiled in an effort to show accomplishments or improvement over time

Characteristics of Portfolio Assessments  Portfolio assessments (continued) Are not simply composed of random work samples, nor is everything included; they represent a purposeful collection of work students must be included in the process criteria for selection of work must be identified criteria for judging value of work must be developed evidence of student reflection must exist

Characteristics of Portfolio Assessments  Portfolio assessments (continued) Teachers provide guidelines and work collaboratively with students to identify goals of the portfolio and work samples to be included Both teacher and student have continuous access to its contents (much more student- centered than other forms of classroom assessment) Can be adapted to meet individual instructional needs (each portfolio is treated individually)

Characteristics of Portfolio Assessments  Portfolio assessments (continued) Different from other forms of assessment, portfolios tend to focus on student achievements, not mistakes Portfolios accentuate student strengths Can be an extremely time-consuming endeavor The review process (continual examination of portfolio along with meetings with individual students)

Characteristics of Portfolio Assessments  Portfolio assessments (continued) Three main features of any form of portfolio assessment: collection of student work must have a specific purpose students must be actively involved in the process of selecting work to be included students must actively engage in self- reflection

Creating Portfolios Creating Portfolios: Step-by-Step Procedure Step 1: Determine the purpose to be served by the portfolio Step 2: Identify the content, concepts, and skills to be assessed Step 3: Plan for an efficient review process by developing a time frame. Step 4: Specify how and when students will be involved Step 5: Develop scoring rubrics Step 6: Arrange for multiple reviewers to improve reliability Creating Portfolios: Step-by-Step Procedure Step 1: Determine the purpose to be served by the portfolio Step 2: Identify the content, concepts, and skills to be assessed Step 3: Plan for an efficient review process by developing a time frame. Step 4: Specify how and when students will be involved Step 5: Develop scoring rubrics Step 6: Arrange for multiple reviewers to improve reliability

Creating Portfolios  Decisions on Content In most situations, students hold primary responsibility for selecting the content of portfolios (often in collaboration with the teacher) However, the teacher must make clear the specific criteria to be met by the samples No real limit to what can be included in a portfolio. There must be alignment between goals, objectives for instruction, and the student products that serve as the basis for assessment.

Validity and Reliability of Portfolio Assessments  Validity Important concerns: Specific student capabilities to be represented by samples must be determined in advance Selected works must represent the entire domain of the subject area Scoring rubric must match the work included in the portfolio  Reliability Consistency is interpreted as interrater agreement Multiple raters of a sample of portfolios can facilitate this. Since reliability tends to be low, portfolios should not be used as sole means of assessing student performance.

Advantages and Limitations of Portfolio Assessments  Advantages Substantial involvement of students in the process Can show student growth over time, as opposed to single “snapshot” Foster communication between teachers and students Require a shift in roles for teachers and students  Limitations Time-intensive Labor-intensive Logistical issues of storage