Thinking Evaluation in(Situ) Action: From theory to program changes Elizabeth Moreira dos Santos National School of Public Health (ENSP/FIOCRUZ), Brazil.

Slides:

Advertisements

Similar presentations

Partnerships: influencing local economic and employment development Brussels, October 9th, 2007 Gabriela Miranda Policy Analyst OECD, LEED Programme.

Advertisements

Meaning and scope of educational development: a conceptual framework grounded in practice Prof. Mariane Frenay Université catholique de Louvain UNESCO.

TWS Aid for Supervisors & Mentor Teachers Background on the TWS.

Ideal-types of Health Promotion Evaluation Practice Louise Potvin, PhD Université de Montréal III Saminario Brasileiro de Efetivivade da Promoçao da Saude.

Intelligence Step 5 - Capacity Analysis Capacity Analysis Without capacity, the most innovative and brilliant interventions will not be implemented, wont.

Implementing Effective School Achievement Reform: Four Principles William G. Huitt Valdosta State University.

CUPA-HR Strong – together!

Measuring Value: Using Program Evaluation to Understand What’s Working -- Or Isn’t Juliana M. Blome, Ph.D. , MPH Office of Program Analysis and Evaluation.

What You Will Learn From These Sessions

ENGAGING ADMINISTRATORS IN UNDERSTANDING AND SUPPORTING CONTEMPORARY SCIENCE EDUCATION 2010 Networking Forum Rodger W. Bybee Executive Director (Emeritus)

Great Lakes Council of Business Schools and Programs Regional Conference October 6 – 7, Dr. Reginald J. Gardner Campus College Chair – School of.

Chapter 1: An Overview of Program Evaluation Presenter: Stephanie Peterson.

Core Competencies Student Focus Group, Nov. 20, 2008.

WIT IN THE EUROPE 2020 PERSPECTIVE Germana Di Falco, External Expert on behalf of the Province of Milan, Berlin, International Conference, 15° May 2014.

Created by CCCOE AB212 Center-Based Professional Learning Communities Project Project Overview Developed by Contra Costa County Office of Education.

ROUND TABLE SESSION 2 Have we got the right training strategy for developing and sustaining knowledge and competence? Panelist: Eliana C. S. Amaral IRD/CNEN.

Building a knowledge platform for agriculture and rural development: Evidence-based learning and results based management in Myanmar. Livelihoods and Food.

Meeting Expectations Gary Jedlovec Purpose of review SPoRT Mission and Vision Role of Science Advisory Committee Charge to Committee members transitioning.

Sustaining Quality in a New Preschool Landscape CSER Early Childhood Care and Education Seminar Dublin Institute of Technology April 4th 2011 Professor.

Michele Dupuis, Senior Officer Knowledge Integration SSHRC Knowledge Mobilization: An Overview of SSHRC’s policies and practices March 31, 2014.

Translating the Core Competencies for Public Health into Action September 23, 2009 “Relationship between the Core Competencies for Public Health and PHN.

Develop Systematic processes Mission Performance Criteria Feedback for Quality Assurance Assessment: Collection, Analysis of Evidence Evaluation: Interpretation.

Shared Decision Making: Moving Forward Together

The SEEAW in the context of Integrated Water Resource Management and the MDGs Roberto Lenton Chair, Technical Committee Global Water Partnership.

Outcomes of Public Health

Collaborative Watershed Management Integrating Participatory Learning and Adaptive Management for Sustainable Development Vicente L. Lopes University of.

EMU Strategic Planning Strategic Planning Material Mission/Vision/Values Goals and Objectives January 10, 2014.

Canadian Cancer Society Manitoba Division: Knowledge Exchange Network (KEN) & CancerCare Manitoba Manitoba Integrated Chronic Disease Primary Prevention.

Evidence of Success: Assessing Student Learning Outcomes in International Education Dr. Darla K. Deardorff Association of International Education.

Thomas College Name Major Expected date of graduation address

1 UNDECLARED WORK IN CROATIA Executive Capacity of Governance and Underground Economy: The Case of Croatia Zagrebl, September 1, 2015.

National Science Foundation 1 Evaluating the EHR Portfolio Judith A. Ramaley Assistant Director Education and Human Resources.

Copyright © 2006 Elsevier, Inc. All rights reserved Chapter 24 Using Nursing Research in Practice.

How to Frame an Ed.D. Program The following are a set of examples of how programs can be framed to make them unique and focused around the values of the.

The Entrepreneurial Revolution Beyond Commercial Entrepreneurism.

T he Istanbul Principles and the International Framework Geneva, Switzerland June 2013.

INNOVATIVE FORMATIVE SETTINGS FOR ORGANIZATIONAL DEVELOPMENT THE EXAMPLE OF COMAU Domenico Bodega – Università Cattolica di Milano Ezio Fregnan – Comau.

Graduate studies - Master of Pharmacy (MPharm) 1 st and 2 nd cycle integrated, 5 yrs, 10 semesters, 300 ECTS-credits 1 Integrated master's degrees qualifications.

K-12 Technology Literacy Curriculum and Assessment.

From policy to practice and back to policy 3 March 2015 Children in Wales Conference Gail Bennett, Parenting Network Chair Flintshire Early Years and Family.

Professional Learning and Development: Best Evidence Synthesis Helen Timperley, Aaron Wilson and Heather Barrar Learning Languages March 2008.

Social Pragmatism Perspectives of John Dewey. Features of Social Pragmatism  Social conditions can be improved through mutual trust and cooperation;

The Next Stage for Results in Africa. Context 2005 Paris Declaration on Aid Effectiveness 2006 Mutual Learning Events Uganda & Burkina Faso 2007 Hanoi.

AN INTRODUCTION TO MENTORING Adapted by SK Lau. WHAT IS MENTORING? Successful mentoring involves having two or more individuals willingly form a mutually.

Developing a Framework In Support of a Community of Practice in ABI Jason Newberry, Research Director Tanya Darisi, Senior Researcher

DARM 2013: Assessment and decision making Mikko V. Pohjola, Nordem Oy, (THL)

1 The Use of Surveys in Determining Outcomes of Research, Technology and Development Programs Presented at:Joint CES / AEA Conference Presented.

Strategies for making evaluations more influential in supporting program management and informing decision-making Australasian Evaluation Society 2011.

Innovators dilemma Changing norms and values of the society Linnar Viik.

Sustainable sector development Development (coop.) results through managing complexity and learning.

Health and Human Services Informatics Master's degree programme Kaija Saranto, Professor, PhD, RN, FACMI Sirpa Kuusisto-Niemi, Ms.Soc.Sc.,Lecturer Department.

Capacity Development Results Framework A strategic and results-oriented approach to learning for capacity development.

Using PLCs to Build Expertise Community of Practice October 9, 2013 Tammy Bresnahan & Tammy Ferguson.

University of Utah Program Goals and Objectives Program Goals and Objectives Constituents U of U, COE, ASCE, IAB Constituents U of U, COE, ASCE, IAB Strategic.

Stimulating innovation in engaged practice and developing institutional cultures that support it 3. Capacity building and skills development  Supporting.

Implementation Science: Finding Common Ground and Perspectives Laura Reichenbach, Evidence Project, Population Council International Conference on Family.

Social Work Competencies Social Work Ethics

MULTICULTURAL SOCIAL WORK AND ANTI-DISCRIMINATIVE AND ANTI-OPRESSIVE PRACTICES Miroslav Brkić.

Henry M. Sondheimer, MD Association of American Medical Colleges 7 August 2013 A Common Taxonomy of Competency Domains for the Health Professions and Competencies.

Authentic service-learning experiences, while almost endlessly diverse, have some common characteristics: Positive, meaningful and real to the participants.

Florian Wetzel, EU BON Biodiversity and Ecosystem Sustainability 2016 GEO Work Programme Symposium Breakout Session Report 4 May 2016.

Monitoring and Evaluating Rural Advisory Services

DARM 2013: Assessment and decision making

Impact assessment and decision making

Monitoring and Evaluating Rural Advisory Services

FRAMEWORK OF EVALUATION QUESTIONS

Joseph B. Berger University of Massachusetts Boston

CEng progression through the IOM3

Presentation transcript:

Thinking Evaluation in(Situ) Action: From theory to program changes Elizabeth Moreira dos Santos National School of Public Health (ENSP/FIOCRUZ), Brazil Rio de Janeiro, March, 2009

Thanks... Thanks...THANKS ! LASER/DENSP ENSP/FIOCRUZ PN DST/HIV/AIDS CDC-GAP/Brasil Guests and participants

Overview Capturing the atmosphere Naming the seminar Framing: questions, focus and dilemmas Realist expectations

Capturing the atmosphere: Guests and Participants Universities and Research Institutions National HIV/AIDS Programs MoH representatives Civil Society Representatives National Regulatory Institutions Graduate Students

Capturing the atmosphere: Thinking Evaluation Advanced and international seminars provide for refreshment and instigate discussion around controversies in the field. Moreover, they account for renewing and establishing new connections which are crucial for collaboration

Naming the seminar: an agony From theory to practice: to know, to do and to interact (connect ?) Program-driven theory and evaluation science (systematic inquiry) M&E can advance knowledge about social problems and their solutions (support action) Embracing diversity (higher-order framework versus the benefits of competing theories and approaches)

Framing questions and focus (Weiss, 1998 p.273) Implementation Evaluation: Outcome Evaluation: Finding out what works and setting standards Questions: What went on in the program over time? How closely did the program follow its plan? Did program recipients improved? Did recipients do better than nonrecipients?

Framing questions and focus (Weiss, 1998 p.273) Impact Evaluation Finding out what works and setting standards Questions: Is the observed change due to the program? What characteristics are associated with success and failure? Through what processes did change take place over time? What was the worth of the relative improvement of recipients ?

Framing questions and focus (Weiss, 1998 p.273) Critical review Connections to utilization Questions: What unexpected events and outcomes were observed? What are the limits to the findings? What do these findings mean in practical terms? What recommendations do the findings imply for modifications in program and policy? What new program and policies do the findings support?

Framing debates and dilemmas Social inquiry and the paradigms: positivism, constructivism and pragmatism Pluralism What works? Which debate? What constitute credible evidence in evaluation? Embracing diversity ? (higher- order framework versus the benefits of competing theories and approaches) Whose perspectives? How much users should be involved?

Realist Expectations Communities of practices are strategic to guarantee sustainability of collaborative initiatives. A skilled evaluator cannot work without the needed expertise and technology. In this, they become dependent on one another in a process of mutual adaptation and identification.

Gracias! Obrigado! Thank you!