Critical Thinking and Moral Reasoning Impact Assessment Tools for DE and ESD Nancy. L. Serrano, September 25 th 2009, University of Limerick.

Slides:

Advertisements

Similar presentations

Using Communications for Development 19 May 2006.

Advertisements

Intelligence Step 5 - Capacity Analysis Capacity Analysis Without capacity, the most innovative and brilliant interventions will not be implemented, wont.

Item Writing Techniques KNR 279. TYPES OF QUESTIONS Closed ended  Checking yes/no, multiple choice, etc.  Puts answers in categories  Easy to score.

Fit to Learn Using the Employability Skills Framework to improve your performance at College The Employability Skills Framework has been developed by business.

Learning How to Learn – in classrooms, schools and networks Sue Swaffield University of Cambridge.

Ritual or reality: do student evaluations have any effect on teacher thinking and practices? Presentation at the Australasian Higher Education Evaluation.

‘Building Bridges’ An innovative tool to capture small health behaviour changes; the development process. Mills, H., Uphill, M., & Weed, M. Introduction.

Chapter 3 Doing Sociological Research 1. Sociology & the Scientific Method The research process: 1.Developing a research question 2.Creating a research.

PPA 502 – Program Evaluation

Analytical methods for Information Systems Professionals Week 13 Lecture 1 CONCLUSION.

Measuring Learning Outcomes Evaluation

Wenxin Zhang Department of Civic Design University of Liverpool

RCOG International Office Consultancy Skills and Tools Angela Brown, Technical Assistance Manager, RCOG International Office.

FLCC knows a lot about assessment – J will send examples

Development of Competence Profile Quality managers in VET-institutions Project no: PL1-LEO This publication [communication] reflects the.

Goal Understand the impact on student achievement from effective use of formative assessment, and the role of principals, teachers, and students in that.

CS 347: Operating Systems  In this course, we reason about effective performance of a computer system  The emphasis of this course is on –Concepts –Techniques.

Decision Making Dr Vasuprada Kartic NAC Batch IX PGDCPM.

Monitoring Evaluation Impact Assessment Objectives Be able to n explain basic monitoring and evaluation theory in relation to accountability n Identify.

ISTEP: Technology Field Research in Developing Communities Instructor: M. Bernardine Dias CAs: Sarah Belousov and Ermine Teves Spring 2009.

1 A proposed skills framework for all 11- to 19-year-olds.

A good research question:

Overview: Market Research for Highway Technologies Mia Zmud NuStats Austin, Texas July 22, 2010.

Margaret J. Cox King’s College London

Raising Academic Standards for all School Development Planning Initiative.

Interstate New Teacher Assessment and Support Consortium (INTASC)

Impact assessment framework

Performance and Development Culture Preparing for P&D Culture accreditation April 2008.

UNIT 6 CRITICAL THINKING At the end of this session:  YOU WILL UNDERSTAND THE ESSENTIAL ELEMENTS OF CRITICAL THINKING AND APPLY THOSE PRINCIPLES TO DEVELOP.

Learners’ Attitudes and Perceptions of Online Instruction Presented by: Dr. Karen S. Ivers Dr. JoAnn Carter-Wells Dr. Joyce Lee California State University.

ASSESSMENT OF HRD NEEDS Jayendra Rimal. Goals of HRD Improve organizational effectiveness by: o Solving current problems (e.g. increase in customer complaints)

Communication “the lubricant of organizations…”. Communicating: Vital aspect of management The art of being able to structure and transmit a message in.

Assessing Program-Level SLOs November 2010 Mary Pape Antonio Ramirez 1.

OECD/INFE Tools for evaluating financial education programmes Adele Atkinson, PhD Policy Analyst OECD With the support of the Russian/World Bank/OECD Trust.

Human Computer Interaction

Museums and Galleries Education Programme 2 Final Report Centre for Education and Industry University of Warwick.

Leukemia & Lymphoma Society (LLS) Information Resource Center (IRC) Planning for a Service Program Evaluation - Case Study Public Administration 522 Presented.

Comprehensive Cultural Assessments Summary of Scope & Methodology A. Levin © SYNERGY Consulting Services Corporation, 1999.

Communication & Collaboration Communicate Clearly  Articulate thoughts and ideas effectively using oral, written and nonverbal communication skills in.

Student assessment AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences.

Monitoring & Evaluation Presentation for Technical Assistance Unit, National Treasury 19 August 2004 Fia van Rensburg.

SBSTA Adaptation Workshop June 18, 2004 Incorporating Climate-related Risks into Development Planning: the U.S Approach Ms. Ko Barrett Director, Global.

Access to Medicine Index Problem Statement Long-standing debate about: What is the role of the pharmaceutical industry in access to medicines? Where are.

EFFECTIVE COMMUNICATION. Communication  “the lubricant of organizations…”

Pupil talk and critical thinking in science and citizenship.

Training Resource Manual on Integrated Assessment Session UNEP-UNCTAD CBTF Process of an Integrated Assessment Session 2.

The Major Steps of a Public Health Evaluation 1. Engage Stakeholders 2. Describe the program 3. Focus on the evaluation design 4. Gather credible evidence.

Performance Metrics Tracking Robert J. Hitchcock, Ph.D. Building Technologies Department Lawrence Berkeley National Laboratory This work is supported by.

Affective Assessment. Workshop Agenda  What is Affective Assessment?  How Can Affective Assessment Be Use In The Classroom? In The Classroom?  What.

Chapter 4 Developing and Sustaining a Knowledge Culture

Chapter 4 Developing and Sustaining a Knowledge Culture

Didactic Pedagogical Conditions Of Barriers Overcoming In The Process Of Teachers’ And Students’ Educational Co-operation -to find out the essence of the.

Source : The Problem Learning and innovation skills increasingly are being recognized as the skills that separate students who are.

Student Learning Outcomes (Pharmacy) Susan S. S. Ho School of Pharmacy Faculty of Medicine The Chinese University of Hong Kong 9 September 2007.

BRINGING IT ALL TOGETHER Use of Rich Tasks. What is a Rich Task? Accessible to all levels Provides an opportunity to explore mathematics Involves testing,

Livia Bizikova and Laszlo Pinter

Helping to develop values

Relationships in the 21 st Century Parent Teachers Students Association (PTSA) Goals, Membership, Participation.

10.1.  Probability sampling method  related to statistical probability and representatives ◦ Most rigorous ◦ Inferential statistical tests ◦ Samples.

Methods: The project used a mixed methods approach including qualitative focus groups, a questionnaire study and systematic searches of the research literature.

C2ME Main findings Jeanine Suurmond, AMC, dept of Public Health, Project leader C2ME 18 September 2015 ‘Culturally Competent In Medical Education’ Amsterdam.

Framework of Reference of Competences for Democratic Culture.

1 KULIAH 2B Survey Design PM Abdul Majid Ismail Ir.M Nawawiy Ir.Dwira.

Competencies and consequences … choices to make April

1 Oregon Department of Human Services Senior and People with Disabilities State Unit on Aging-ADRC In partnership with  Portland State University School.

2018 PISA Global Competency Assessment

Accounting 9706.

Organisational perspectives from a higher education institute and challenges of assessing UN activities at the community level Dzulkifli.

Social Research Methods

IB Environmental Systems and Societies

Presentation transcript:

Critical Thinking and Moral Reasoning Impact Assessment Tools for DE and ESD Nancy. L. Serrano, September 25 th 2009, University of Limerick

Presentation Outline Why a DE/ESD evaluation tool? Why a DE/ESD evaluation tool? Project background Project background Qualitative Vs. Quantitative Qualitative Vs. Quantitative Factors influencing decision-making on SD Factors influencing decision-making on SD Values and Attitudes Values and Attitudes Critical Thinking and DE/ESD Critical Thinking and DE/ESD Tool design parameters Tool design parameters Consultation day feedback Consultation day feedback Next steps… Next steps…

Why a DE/ESD Evaluation Tool? No standard assessment to measure impact of work in formal or non-formal DE/ESD sectors No standard assessment to measure impact of work in formal or non-formal DE/ESD sectors To increase transparency, communication, and possible comparisons To increase transparency, communication, and possible comparisons To allow for much-needed benchmarks and baselines to be established To allow for much-needed benchmarks and baselines to be established

Project Background July April 2009 : RCE-Ireland Project “Situated Learning and DE/ESD Activism” - questionnaire tool developed testing 3 variables: situational, knowledge & ability, intrapersonal July April 2009 : RCE-Ireland Project “Situated Learning and DE/ESD Activism” - questionnaire tool developed testing 3 variables: situational, knowledge & ability, intrapersonal (Hines, Homerford and Tomera, 1986) Focus on values and attitudes, and critical thinking - identified in literature for action-orientation, (IRISH AID, 1999, Tormey, 2003, Tilbury and Wortman, 2004) Focus on values and attitudes, and critical thinking - identified in literature for action-orientation, (IRISH AID, 1999, Tormey, 2003, Tilbury and Wortman, 2004) To develop a quantitative evaluation tool To develop a quantitative evaluation tool

Qualitative vs Quantitative Qualitative Interpretive Interpretive Individualistic Individualistic Time consuming Time consuming Wide-ranging Wide-ranging Non-comparative Non-comparative Complex to analyse Complex to analyse Not statistically significant Not statistically significant Can raise ‘new’ issues Can raise ‘new’ issuesQuantitative Addresses pre-determined questions Addresses pre-determined questions Straight forward to collate Straight forward to collate Statistically analytic Statistically analytic Comparative Comparative Dependent on evaluator knowledge Dependent on evaluator knowledge Does not encourage ‘new’ issues Does not encourage ‘new’ issues

Kirkpatrick’s Levels of Evaluation Qualitative Quantitative

Factors influencing decision-making on sustainability Issues 1. Situational factors (e.g existence of recycle banks, public transport) 2. knowledge and ability factors (e.g. knowing about energy saving and how to do it) 3. intrapersonal factors (e.g. attitudes, values, acceptance of responsibility) (Hines, Hungerford and Tomera,1986) The intrapersonal factor MUST be dealt with for LASTING behavioural change

Values and Attitudes -Intrapersonal factors- Social Value Orientation Social Value Orientation Individualistic Individualistic Competitive Competitive Co-operative Co-operative (Osbaldiston and Sheldon, 2002, Komorita and Parks, 1995)

Critical Thinking and DE/ESD “Critical thinking is reasonable, reflective thinking that is focused on deciding what to believe or do.” “Critical thinking is reasonable, reflective thinking that is focused on deciding what to believe or do.” (Ennis, 1993) DE/ESD is cross-curricular DE/ESD is cross-curricular Some critical thinking skills are more relevant to DE/ESD e.g. Some critical thinking skills are more relevant to DE/ESD e.g. open-mindedness open-mindedness ability to judge credibility of sources ability to judge credibility of sources ask clarifying questions and draw conclusions ask clarifying questions and draw conclusions identify conclusions, reasons, and assumptions identify conclusions, reasons, and assumptions (Ennis, 1993) Critical thinking tests: general-content based, subject specific, multiple choice tests exist (Illinois Critical Thinking Project), essay-style tests (simulated situations) (The Ennis-Weir Critical Thinking Essay Test) Critical thinking tests: general-content based, subject specific, multiple choice tests exist (Illinois Critical Thinking Project), essay-style tests (simulated situations) (The Ennis-Weir Critical Thinking Essay Test)

Consultation Day Feedback Values + Attitudes Values + Attitudes Responsibility Responsibility Openness Openness Inter-connectedness Inter-connectedness Tolerance Tolerance Ownership Ownership Motivation Motivation Intention Intention Critical Thinking Skills Critical Thinking Skills See other perspectives See other perspectives Question+critique Question+critique Analyse complex issues Analyse complex issues Make informed choices Make informed choices Action planning Action planning Futures thinking Futures thinking Adapting to changing world Adapting to changing world

Evaluation Tool Design Format July April 2009 : “Situated Learning and DE/ESD Activism” project - questionnaire tool, 3 variables: situational, knowledge & ability, intrapersonal July April 2009 : “Situated Learning and DE/ESD Activism” project - questionnaire tool, 3 variables: situational, knowledge & ability, intrapersonal (Hines, Homerford and Tomera, 1986) Defining Issues Test (Bebeau and Thoma, 2003) Defining Issues Test (Bebeau and Thoma, 2003) moral reasoning psychometric test moral reasoning psychometric test Story-format or scenarios Story-format or scenarios participants rank statements in order of importance, in relation to decision made in each scenario participants rank statements in order of importance, in relation to decision made in each scenario based on the work of Lawrence Kohlberg. (Kohlberg, 1973). The DIT measures moral reasoning on a scale corresponding to these stages based on the work of Lawrence Kohlberg. (Kohlberg, 1973). The DIT measures moral reasoning on a scale corresponding to these stages Adapting scenarios model to test for values and attitudes and critical thinking skills Adapting scenarios model to test for values and attitudes and critical thinking skills Develop DE/ESD scale for action-orientation Develop DE/ESD scale for action-orientation Example Scenario question from original questionnaire Example Scenario question from original questionnaire

DE/ESD Scenario Decision Factors Influencing Factors tested Factors affecting decision-making in SD Personal EffectivenessValues & attitudes (co-operative) Self-InterestValues & attitudes (Individualistic) Community OrientationValues & attitudes (co-operative) KnowledgeKnowledge & Ability Negative Peer PressureRelated to competitive value? Positive Peer PressureRelated to competitive value? OpportunitiesInstitutional factors

Next Steps… Adapting and finalising scenarios to test for priority values, attitudes and critical thinking skills Adapting and finalising scenarios to test for priority values, attitudes and critical thinking skills Piloting tool in DE/ESD sector Piloting tool in DE/ESD sector Analysing data Analysing data Reporting data obtained to sector and Reporting data obtained to sector and fine-tuning tool fine-tuning tool

Thank-you RCE-IRELAND Nancy L. Serrano, RCE Research Assistant, Department of Education and Professional Studies, University of Limerick Phone: Phone: