EDA: Educator Disposition Assessment

Slides:



Advertisements
Similar presentations
WV High Quality Standards for Schools
Advertisements

Instructional Decision Making
The Marzano School Leadership Evaluation Model Webinar for Washington State Teacher/Principal Evaluation Project.
Susan Malone Mercer University.  “The unit has taken effective steps to eliminate bias in assessments and is working to establish the fairness, accuracy,
TWS Aid for Scorers Information on the Background of TWS.
Virginia Teacher Performance Evaluation System
What should be the basis of
performance INDICATORs performance APPRAISAL RUBRIC
Welcome What’s a pilot?. What’s the purpose of the pilot? Support teachers and administrators with the new evaluation system as we learn together about.
 Description  The unit has a conceptual framework that defines how our programs prepare candidates to be well-rounded educators. Every course in the.
Overall Teacher Judgements
Interstate New Teacher Assessment and Support Consortium (INTASC)
ASSESSMENT OF STUDENT LEARNING Manal bait Gharim.
CONNECT WITH CAEP | | CAEP Standard 3: Candidate quality, recruitment and selectivity Jennifer Carinci,
Stronge Teacher Effectiveness Performance Evaluation System
CONNECT WITH CAEP | Transitioning from NCATE and TEAC to CAEP: How? Patty Garvin, Senior Director,
NCATE Standard 3: Field Experiences & Clinical Practice Monica Y. Minor, NCATE Jeri A. Carroll, BOE Chair Professor, Wichita State University.
THE DANIELSON FRAMEWORK. LEARNING TARGET I will be be able to identify to others the value of the classroom teacher, the Domains of the Danielson framework.
Classroom Diagnostic Tools. Pre-Formative Assessment of Current CDT Knowledge.
Standard Two: Understanding the Assessment System and its Relationship to the Conceptual Framework and the Other Standards Robert Lawrence, Ph.D., Director.
The Conceptual Framework: What It Is and How It Works Linda Bradley, James Madison University Monica Minor, NCATE April 2008.
Promoting a Culture of Evidence Through Program Evaluation Patti Bourexis, Ph.D. Principal Researcher The Study Group Inc. OSEP Project Directors’ Conference.
STANDARD 4 & DIVERSITY in the NCATE Standards Boyce C. Williams, NCATE John M. Johnston, University of Memphis Institutional Orientation, Spring 2008.
Alternative Assessment Chapter 8 David Goh. Factors Increasing Awareness and Development of Alternative Assessment Educational reform movement Goals 2000,
Continuous Improvement. Focus of the Review: Continuous Improvement The unit will engage in continuous improvement between on-site visits. Submit annual.
Why So Much Attention on Rubric Quality? CAEP Standard 5, Component 5.2: The provider’s quality assurance system relies on relevant, verifiable, representative,
About District Accreditation Mrs. Sanchez & Mrs. Bethell Rickards Middle School
CONNECT WITH CAEP | | Standard 2: Partnership for Practice Stevie Chepko, Sr. VP for Accreditation.
CONNECT WITH CAEP | | Measures of Teacher Impact on P-12 Students Stevie Chepko, Sr. VP for Accreditation.
NOTE: To change the image on this slide, select the picture and delete it. Then click the Pictures icon in the placeholder to insert your own image. COMMON.
CAEP Standard 4 Program Impact Case Study
Lessons from a CAEP Early-Adopter
EVALUATING EPP-CREATED ASSESSMENTS
NCATE Unit Standards 1 and 2
Presented by Deborah Eldridge, CAEP Consultant
Evaluation Requirements for MSP and Characteristics of Designs to Estimate Impacts with Confidence Ellen Bobronnikov March 23, 2011.
Eastern’s Assessment System
Nancy Burstein Sue Sears California State University, Northridge
Partnership for Practice
Phyllis Lynch, PhD Director, Instruction, Assessment and Curriculum
Michael Kelly, Ed. D. John Gratto, Ed. D. Virginia Tech
Department of Political Science & Sociology North South University
Oleh: Beni Setiawan, Wahyu Budi Sabtiawan
Office of Field and Clinical Partnerships and Outreach: Updates
Field Experiences and Clinical Practice
Elayne Colón and Tom Dana
Iowa Teaching Standards & Criteria
PPMES-UPRM Methodology & Practice Working Retreat
CEA Case Study Marianne Farrugia.
Tony Kirchner Developing a Quality Assurance Plan with the Teacher Work Sample as the Linchpin Tony Kirchner
Standard 3 Candidate Quality, Recruitment, and Selectivity
Consistency of Teacher Judgement
FEAPs (Florida Educator Accomplished Practices)
NJCU College of Education
Implementation Guide for Linking Adults to Opportunity
Introduction to Student Achievement Objectives
Standard Four Program Impact
Introduction to Core Professionalism
Unit 7: Instructional Communication and Technology
Assessing Academic Programs at IPFW
Clinical Educator and Teacher Candidate Training Chapter for the Candidate Preservice Assessment for Student Teachers (CPAST) Form Developed by the VARI-EPP*
Deconstructing Standard 2a Dr. Julie Reffel Valdosta State University
February 21-22, 2018.
Association of Teacher Educators Jacsksonville, FL. February 18, 2003
Standard one: revisions
FEEDBACK Dr. Mohammed Moizuddin Khan Associate Professor.
Why do we assess?.
Quality Enhancement Cell
Training Chapter for the Advanced Field Experience Form (Pre-CPAST
Cooperating Teacher and Student Teacher Training Chapter for the Candidate Preservice Assessment for Student Teachers (CPAST) Form Developed by the VARI-EPP*
Presentation transcript:

EDA: Educator Disposition Assessment The EDA is a valid and reliable measure of teacher candidate dispositions used to track and monitor candidate dispositional behaviors as they progress through teacher preparation programs. Gina Almerico, Ph.D. Pattie Johnston, Ph.D. Adrianne Wilson, Ed.D.

Dispositions Defined Villegas (2007) defined dispositions as an individual’s inclination to act in a particular way under particular circumstances, based on personal beliefs.

Dispositions in Teacher Education Tamim, Colburn, & Karp (2017) identified three components of high-quality teaching: 1) content knowledge and skills, 2) pedagogical knowledge; 3) professional dispositions. Tamim, Colburn, & Karp (2017) noted high-quality teaching is not solely linked to academic credentials. They suggested teacher attitudes (manifested through behaviors) have a significant impact on student performance.

CAEP Accreditation, Standards & Disposition CAEP Standards 1, 2, 3, and 5 require teacher preparation programs address and assess candidate dispositions. The EDA provides abundant evidence for programs using the package to successfully meet each standard. Data provided can be part of a wide variety of information EPPs use to understand candidate and cohort dispositional performance to make program improvements. Standard 1: CONTENT AND PEDAGOGICAL KNOWLEDGE Candidate Knowledge, Skills, and Professional Dispositions (1.1) Standard 2: CLINICAL PARTNERSHIPS AND PRACTICE Clinical Experiences (2.3) This standard looks at how EPPs are measuring dispositions in the field. The EDA is one of multiple performance-based assessments to demonstrate candidates’ development of professional dispositions in clinical practice. Standard 3: CANDIDATE QUALITY, RECRUITMENT, AND SELECTIVITY Additional Selectivity Factors 3.3 EPPs establish and monitor attributes and dispositions beyond academic ability that candidates must demonstrate at admissions and during the program. The EDA can be used as a component of the admission process into a Teacher Education Program. And of course, during the program at key checkpoints/transition points. Standard 5: PROVIDER QUALITY ASSURANCE AND CONTINUOUS IMPROVEMENT 5.2 The provider’s quality assurance system relies on relevant, verifiable, representative, cumulative and actionable measures, and produces empirical evidence that interpretations of data are valid and consistent.

CAEP Evaluation Framework Calibration training, Suggestions for administration and explanation of purpose, Indicators aligned to InTASC, Well defined scoring criteria, Estimates of reliability; Evidences of construct validity.

The EDA: A Sound Measure of Dispositions

Methodology Over 700 hours across 7 years of research lead to the development of the EDA tool. Validity Evidences Multiple studies were conducted with extensive input from subject matter experts resulting in the 9 dispositions found in the EDA. Reliability Estimates Inter-rater reliability coefficients (Pearson Product Moment) were calculated for each disposition. Coefficients indicated high levels of agreement between raters (coefficients are reported).

Survey Content Construct Validity An initial list of dispositions was compiled from the literature (N=17). On a 5 point Likert Scale SMEs measured representativeness of each disposition to success in the profession. Highly rated dispositions were retained (N=11 items retained). SMEs consulted to provide descriptions of each disposition to enhance collective understanding (N=9 items left). SMEs aligned the EDA indicators with dispositional indicators suggested by InTASC and prominent evaluation instruments using a Q-sort procedure; alignment was confirmed. SMEs from across the nation at a CAEP Conference rated descriptions/indicators on a 5 point Likert Scale. Results suggested all behaviors rated highly on the scale were retained and serve as the basis for verbiage in the cells.

EDA Racial Bias, Gender Bias, and Ambiguity Examination The EDA team conducted a check for racial bias, gender bias, and ambiguity within the measure. A group of experts (N=125) was gathered and broken into nine teams. They were tasked with rating the perceived biases and ambiguity present in the indicator descriptions. EDA Racial Bias, Gender Bias, and Ambiguity Examination

Dispositions Assessed The nine EDA dispositions are: Oral Communication Written Communication Professionalism Positive Attitude Preparedness Appreciation of and value for cultural and academic diversity Collaboration Self-Regulation Social Emotional Learning

A Look at the EDA

A Closer Look at Oral Communication Demonstrates Effective Oral Communication Skills Needs Improvement Developing 1 Meets Expectations 2   Does not consistently demonstrate professional oral communication skills as evidenced by making major errors in language, grammar, and word choice Does not vary oral communication to motivate students as evidenced by monotone voice with visible lack of student participation Choice of vocabulary is either too difficult or too simplistic Demonstrates professional oral communication skills as evidenced by using appropriate language, grammar, and word choice for the learning environment, yet makes some common and noticeable errors Strives to vary oral communication as evidenced of some students demonstrating a lack of participation Occasionally uses vocabulary that is either too difficult or too simplistic Demonstrates strong professional oral communication skills as evidenced by using appropriate language, grammar, and word choice for the learning environment Varies oral communication as evidenced by encouraging participatory behaviors Communicates at an age appropriate level as evidenced by explaining content specific vocabulary

Benefits of EDA The EDA instrument is intended to be used at multiple points in the program to both raise concerns and identify exemplary dispositional behavior The EDA can identify gaps for the purpose of intervention with a suggested intervention plan. A detailed timeline is provided for programmatic implementation. Curricular suggestions are provided.

Curriculum Integration Cummins and Asempapa (2013) found that dispositions can be taught. Schussler (2006) suggested EPPs define professional dispositions and focus on the scholarship of teaching and learning related to disposition; in essence, study them, teach them, practice, and apply them. Yost (1997) found that dispositions can improve during teacher preparation programs if dispositions foster awareness and reflection. These findings together suggest that teacher preparation programs can improve dispositions during clinical experiences by providing direct and reflective learning opportunities through undergraduate coursework.

Questions ? Please contact Watermark regarding the use of the Educator Disposition Assessment instrument. Contact Educational Dispositional Associates, LLC for further questions. galmerico@ut.edu/edaconsulting3@gmail.com