Objectives of Session Three Focus Group and Survey Assignment Formative Design Proposal Construct Validity Reliability in Data In-class Data Exercise.

Slides:

Advertisements

Similar presentations

Bridging Research, Information and Culture An Initiative of the Research and Planning Group for California Community Colleges Your Name Your Institution.

Advertisements

Evaluation Issues in Programs that Promote Self-Determination Anita Yuskauskas, Ph.D.

International Research Methods (BRM) Prof. Dr. Mahir Nakip Office hours: Monday : Wednesday: Thursday :

Issues of Technical Adequacy in Measuring Student Growth for Educator Effectiveness Stanley Rabinowitz, Ph.D. Director, Assessment & Standards Development.

© CCSR 5Essentials: Background and methodology Rachel Levenstein Senior Manager for Survey Research

Extended Project Research Skills 1 st Feb Aims of this session  Developing a clear focus of what you are trying to achieve in your Extended Project.

Session 4: Sampling and Data Collection. Objectives for Session 4: Finish in-class data activity – delivery of services in ten food pantries Sampling.

© 2004 The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin.

Objectives of Session Eight Coding strategies – Case study Exercise in coding open-ended responses Data Assignment.

Neuman & Robson Chapters 5, 6, & (some of) 12 (p )

Planning Business Reports and Proposals. Tao Xiang 2 Teamwork on Proposal Select an interesting topic Select an interesting topic E.g., impact of new.

SOWK 6003 Social Work Research Week 4 Research process, variables, hypothesis, and research designs By Dr. Paul Wong.

Session 2: Understanding Program Theory and Implementation Theory.

Session 5: Conducting Focus Groups. Implementing Focus Groups 1 st Focus Group Session (30 minutes): –Group 2 = moderate Group 1 = respondent –Group 4.

Objectives of Session Seven Complete in-class survey Discuss question formats and ordering Case study: face-to-face interviews v. self-administered questionnaires.

Objectives for Session Nine Observation Techniques Participatory Methods in Tanzania Hand back memos.

Survey Research. Structured interview of: Structured interview of: Sample of individuals in order to generalize to a larger population Sample of individuals.

Proposal Writing.

Business Research Methods (BRM) Prof. Dr. Mahir Nakip Office hours: Monday : and Tuesday : and.

Questionnaires and Interviews

CENTER FOR NONPROFIT EXCELLENCE EVALUATION WORKSHOP SERIES Session IV: Analyzing and Reporting Your Data Presenters: Patty Emord.

Measurement Neuman and Robson Ch. 6. What is it? The process of creating measurable concrete variables from abstract concepts Extends the senses (empirical)

CHAPTER III IMPLEMENTATIONANDPROCEDURES.  4-5 pages  Describes in detail how the study was conducted.  For a quantitative project, explain how you.

Evaluating a Research Report

Validity and Reliability Edgar Degas: Portraits in a New Orleans Cotton Office, 1873.

1 NURS 325: Context of Health Care Delivery I Nina Trocky, MSN, RN Vanessa P. Fahie PhD, RNC University of Maryland, Baltimore School of Nursing.

ScWk 242 Course Overview and Review of ScWk 240 Concepts ScWk 242 Session 1 Slides.

Howard University February 13,2013 The Integrity of Data Management Responsible Conduct of Research Workshop Peggy Carr, Ph.D. Associate Commissioner National.

EDU 8603 Day 6. What do the following numbers mean?

Quantitative SOTL Research Methods Krista Trinder, College of Medicine Brad Wuetherick, GMCTE October 28, 2010.

555 Review. Chapter 2: Introduction The sequence of 8 types of research Differences between qualitative and quantitative research – Components of qualitative.

Identify a Health Problem Qualitative Quantitative Develop Program -theory -objectives -format -content Determine Evaluation -design -sampling -measures.

1 Copyright © 2011 by Saunders, an imprint of Elsevier Inc. Chapter 8 Clarifying Quantitative Research Designs.

Measurement Validity.

Beyond Data Why does evaluation seen so foreign to most?

The Integrity of Data Management Responsible Conduct of Research Workshop Howard University November 2, 2010 Peggy Carr, Ph.D. Associate Commissioner National.

[ADD TITLE] Field Experience Culminating Presentation [ADD YOUR NANE] [ADD DATE]

Presented By Dr / Said Said Elshama  Distinguish between validity and reliability.  Describe different evidences of validity.  Describe methods of.

Dave Fennell, Imperial Oil Resources Overview: This package has been developed to help you create awareness for managers, supervisors, employees and contractors.

Phoenix Campus Faculty Refresher Training. This workshop will provide faculty with updated knowledge and tools necessary to be effective in the classroom.

Journalism 614: Survey Research. Survey Research  Structured interview of: –Sample of individuals in order to generalize to a larger population  Survey.

Howard University October 10,2012 The Integrity of Data Management Responsible Conduct of Research Workshop Peggy Carr, Ph.D. Associate Commissioner National.

Interviews, Questionnaires, and control flowcharts Chapter 19.

Table of Contents  Research Design  Threats to Internal Validity  Threats to External Validity  Proposed Data  Pre-Test Post-Test Data Results 

How do you know your product “works”? And what does it mean for a product to “work”?

Welcome to CIT Solutions Diploma of Government (Financial Services)

PSYCH 610 Entire Course (UOP) For more course tutorials visit  PSYCH 610 Week 1 Individual Assignment Research Studies Questionnaire.

PSYCH 610 guide / psych610guidedotcom.  PSYCH 610 Week 1 Individual Assignment Research Studies Questionnaire  PSYCH 610 Week 2 Individual Assignment.

Chapter 29 Conducting Market Research. Objectives  Explain the steps in designing and conducting market research  Compare primary and secondary data.

Overview of Types of Measures Margaret Kasimatis, PhD VP for Academic Planning & Effectiveness.

RES 320 expert Expect Success/res320expertdotcom FOR MORE CLASSES VISIT

MEASURE Evaluation Data Quality Assurance Workshop Session 3 Introduction to Routine Data Quality Assessment.

Overview Introduction to marketing research Research design Data collection Data analysis Reporting results.

© Prentice Hall, 2005 Excellence in Business CommunicationChapter Planning Business Reports and Proposals.

HCS 465 Week 3 Individual Applying the Results and Conclusion of the Research Process to Problems in Health Care To purchase this material click below.

BPA 303 Week 4 Individual Assignment Policy Evaluation Paper - Resources: Electronic Reserve Readings, Internet, University Library - Locate at least two.

Issues in Evaluating Educational Research

Survey Research.

Research Methods For International Relations

PSYCH 610 Competitive Success/snaptutorial.com

HCS 465 Competitive Success-- snaptutorial.com

PSYCH 610 GUIDE Experience Tradition / psych610guide.com.

HCS 465 Education for Service-- snaptutorial.com

PSYCH 610 Education for Service/snaptutorial.com.

PSYCH 610 GUIDE Lessons in Excellence - psych610guide.com.

PSYCH 610 GUIDE Perfect Education/ psych610guide.com.

HCS 465 Teaching Effectively-- snaptutorial.com

Measurement Concepts and scale evaluation

Research Methods For International Relations

Presentation transcript:

Objectives of Session Three Focus Group and Survey Assignment Formative Design Proposal Construct Validity Reliability in Data In-class Data Exercise

Focus Group/Survey Project Select topic and moderator(s) ½ hour – no penalty if you do not finish your guide Short ice-breaker, background on topic, and questions Be prepared with follow-up questions Handout relating to survey design

Sources for Formative Design Proposal Conduct an internet search using keywords for your program area of interest and evaluation terms Points of Light Foundation United Way Electronic Policy Network Evaluation Center Michigan Non-profit link Community Foundation of CNY -

Construct Validity Does the measure capture the construct of interest? How well does the measure capture the process at hand? -Face validity -Content validity -Convergent v. Discriminant validity

Achieving Construct Validity Propose different possibilities for valid measures or operationalizations of the following concepts: –Quality of an individual’s diet –Customer satisfaction with visit to the Dept. of Motor Vehicles –Racial or ethnic identity –Physical limitations

Reliability Free of error Consistency in measurement and in coding Data cannot be valid unless it is reliable, but reliable data can be invalid.

Internal and External Validity Internal Validity: Does the design allow us to reach causal conclusions? External Validity: Are your findings generalizable?

Improving Validity and Reliability of Data Pretest your questions or data collection techniques Use widely trusted measures Correlations between coders/respondents Develop multiple measures Use qualitative findings to check quantitative findings and vice versa

In-Class Data Exercise Data collected from Open Cupboard, nonprofit that opened 10 food pantries 6 months ago What can the data tell us about service delivery? Different measures of initial implementation and service delivery -- no impact or outcomes Frequencies Means and variance Correlation Which measures are most valid? Most reliable?

Readings for Next Time: Weiss, Chapters 4 and 7