Lecture 1 The Foundations of Database. Intro to Logic Models What is a Logic Model? Basically, a logic model is a systematic and visual way to present.

Slides:



Advertisements
Similar presentations
Research Strategies: Joining Deaf Educators Together Deaf Education Virtual Topical Seminars Donna M. Mertens Gallaudet University October 19, 2004.
Advertisements

Performance Measurement and Evaluation 2/8/2014 Performance Measurement and Evaluation 1 Performance Measurement and Evaluation What are they? How are.
The Transition to Adulthood
Evaluation Capacity Building Identifying and Addressing the Fields Needs.
Using Data to Measure and Report Program Impact Anne Basham, MFA MEMconsultants.
RTI as a Lever for School Change School Partnerships for Change in Teacher Education Tom Bellamy—February 2, 2011.
Determining Your Program’s Health and Financial Impact Using EPA’s Value Proposition Brenda Doroski, Director Center for Asthma and Schools U.S. Environmental.
Catulpa Community Support Services.  Use of an electronic data entry program to record demographic data and case notes to reflect service delivery 
Program Evaluation. Lecture Overview  Program evaluation and program development  Logic of program evaluation (Program theory)  Four-Step Model  Comprehensive.
1 Theory of Change Chesapeake Bay Funders Network Program Evaluation Training Workshop OMG Center for Collaborative Learning January 9-10, 2008.
Karen L. Mapp, Ed.D. Deputy Superintendent, Boston Public Schools
Implementing Values through Community Action Research Dr Josephine Bleach
Measuring and reporting outcomes for your BTOP grant 1Measuring and Reporting Outcomes.
3-1 Chapter 3 Data and Knowledge Management
BUSINESS DRIVEN TECHNOLOGY
INSTRUCTIONAL LEADERSHIP FOR DIVERSE LEARNERS Susan Brody Hasazi Katharine S. Furney National Institute of Leadership, Disability, and Students Placed.
Types of Evaluation.
How to Write Goals and Objectives
Presented by Margaret Shandorf
Molly Chamberlin, Ph.D. Indiana Youth Institute
TIMELESS LEARNING POLICY & PRACTICE. JD HOYE President National Academy Foundation.
1 Qualitative Evaluation Terms Coding/categorization The process of condensing qualitative data through the identification of common themes. Data Matrix.
Lecture 03 The Foundations of Database. Intro to Logic Models What is a Logic Model? Basically, a logic model is a systematic and visual way to present.
SESSION ONE PERFORMANCE MANAGEMENT & APPRAISALS.
School Counselors Doing Action Research Jay Carey and Carey Dimmitt Center for School Counseling Outcome Research UMass Amherst CT Guidance Leaders March.
Involving the Whole Organization in Creating or Restructuring a Volunteer Program Louise DeIasi DeCava Consulting.
School’s Cool in Kindergarten for the Kindergarten Teacher School’s Cool Makes a Difference!
Qualitative Evaluation of Keep Well Lanarkshire Alan Sinclair Keep Well Evaluation Officer NHS Lanarkshire.
Prepared by American Humane Association and the California Administrative Office of the Courts.
Microsoft ® Office Access ™ 2007 Training Choose between Access and Excel ICT Staff Development presents:
Tools for Getting Started on Your Project. Today we’ll cover… Tools and activities that can help you:  Think about what you are doing and why  Plan.
Surveying patrons with the Impact Survey A fast, easy way to gather feedback from the community about public technology needs Samantha Becker, MLIS, MPA.
Fundamentals of Evaluation for Public Health Programs ROBERT FOLEY, M.ED. NIHB TRIBAL PUBLIC HEALTH SUMMIT MARCH 31,
Outcome Based Evaluation for Digital Library Projects and Services
Measuring and Improving Practice and Results Practice and Results 2006 CSR Baseline Results Measuring and Improving Practice and Results Practice and Results.
School Improvement Planning Today’s Session Review the purpose of SI planning Review the components of SI plans Discuss changes to SI planning.
Quincy School District “Ready to ROAR" Parent, Family and Community Engagement Program.
END THE SILENCE. THE TEAM APPROACH COMMUNITY NOTIFICATION IN COLLABORATION WITH LAW ENFORCEMENT & VICTIM SERVICES.
A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio.
Julie R. Morales Butler Institute for Families University of Denver.
1 Using Logic Models to Enhance Evaluation WESTAT Center to Improve Project Performance (CIPP) Office of Special Education Programs Amy A. Germuth, Ph.D.
Introduction to Databases Trisha Cummings. What is a database? A database is a tool for collecting and organizing information. Databases can store information.
Microsoft Access Designing and creating tables and populating data.
September 2007 Survey Development Rita O'Sullivan Evaluation, Assessment, & Policy Connections (EvAP) School of Education, University of North Carolina-Chapel.
CHAPTER 12 Descriptive, Program Evaluation, and Advanced Methods.
Improving Eligibility Documents November, Improving Data Collection The State Office of AIDS (OA) is now working with providers to improve the quality.

Family Resource and Youth Services Centers: Action Component Plan.
Mountains and Plains Child Welfare Implementation Center Maria Scannapieco, Ph.D. Professor & Director Center for Child Welfare UTA SSW National Resource.

4-H Science and Access Data. 4-H Science  Collecting 4-H Science data within Access  “4-H Science Ready”  4-H Science Checklist  How to answer “4-H.
The Logic Model An Outcomes-Based Program Model. What is a Logic Model? “a systematic and visual way to present and share your understanding of the relationships.

1 Strategic Plan Review. 2 Process Planning and Evaluation Committee will be discussing 2 directions per meeting. October meeting- Finance and Governance.
The Interactive Strategies Approach to Early Literacy Intervention (ISA) Michelle Eackles RDG 692 Best Practices in Early Literacy Instruction Diane M.
McGraw-Hill/Irwin © 2008 The McGraw-Hill Companies, All Rights Reserved Chapter 7 Storing Organizational Information - Databases.
Behavioral and Emotional Rating Scale - 2 Parents, Caregivers and Youth Information on BERS-2 Parent Rating Scale April 13, 2012.
Lecture 3 Databases and Human Services. Why use a Database kIXB8http:// kIXB8 2.
The Tools of… Today’s Human Services. The Vast transition from Beggars.
The PDA Center is funded by the US Department of Education Office of Special Education Programs Stories from the Field and from our Consumers Building.
[Presentation location] [Presentation date] (Confirm ABT logo) Building Bridges and Bonds (B3): An introduction.
Adult Student Match.
Business Model/ Business Plan and Logic Model
An agency of the Office of the Secretary of Education and the Arts
Loren Bell Linnea Sallack, MPH, RD Altarum Institute
Introduction to Program Evaluation
Partnership Data Collection Manual
SUCCESSFUL MEASURING JAMES HARDIN, DIRECTOR, HEALTH IMPACT
Parent-Teacher Partnerships for Student Success
BOOTCAMP SOCIAL INNOVATION ACCELERATOR TO CREATE LASTING CHANGE
Presentation transcript:

Lecture 1 The Foundations of Database

Intro to Logic Models What is a Logic Model? Basically, a logic model is a systematic and visual way to present and share your understanding of the relationships among the resources you have to operate your program, the activities you plan, and the changes or results you hope to achieve. Kellog Foundation 2004:3

Theory Approach Models emphasize the theory of change that has influenced the design and plan for the program/ illustrate how and why you think your program will work/ “big picture”/ for grant proposals, planning and design Outcomes Approach Models attempt to connect the resources and/or activities with the desired results in a workable program/ for designing effective evaluation and reporting strategies. Activities Approach Models emphasize linking the various planned activities together in a manner that maps the process of program implementation /for management planning activities, databases Types of Logic Models Kellog Foundation 2004

50% of children entering Syracuse City Schools are not ready according to DIBELS assessments of pre-literacy skills Assets: The Say Yes initiative has been launched to provide a pipeline from k through college but children begin unprepared for kindergarten Needs: The community has to focus on preparing children to take advantage of the many resources we have from school age on Literature reviewed on Imagination library book programs shows favorable results The Community Foundation completed a 5 year read ahead imitative building literacy capacity of local childcares and literacy providers A coalition of stakeholders including learners, business, government, nonprofits and institutions of higher education have committed to the value of literacy for the community’s future prosperity Imagination Library book distribution program – one book a month to children from birth through age 5 – results demonstrated in literature Wrap around services and role modeling of reading as delivered by local service provider agencies Assume our community will respond as others have to the Imagination Library. Assume funding can be raised Assume language barriers can be overcome Assume services offered are sufficient Program Planning Logic Model ↑ number of adults who read to their children daily ↑ percent of children that register on time for kindergarten ↑ the % of children assessed as ready on the Initial Sound Fluency ↑ % of kids assessed as ready on Letter Naming Fluency Increased literacy and school success reaching post school into career and a revitalized economy

LiteratureResultsStrengthsWeaknesses Morgan County Schools (2007) Kindergarten readiness ↑from 46% to 90% in 3 yrs (scoring 7 or higher on the DIBELS) / 90% reading on grade level by grade 2 Noticed increased community engagement as a result Not a scientific design Des Arc Arkansas (2009) Reading Scores ↑ 12 points on Stanford 10 test Noted importance of connecting home and school books (90% of kids in district received IL books for 3 yrs) Not a scientific design University of Hawaii (2007) Parents Read to Children more often. Once a day or more ↑ from 52% to 81% Surveyed all participants, high response rate Asked participants to compare in retrospect at time 2 (not surveyed both time 1 & 2) High/Scope Educational Research (2003) Child Excitement is key, ↑impact on family reading when parents have low education High response rateFormative evaluation only. No comparison group, biased to include higher SES Thomason (2008)↑years of exposure lead to improved home literacy environment High Response rate, focus on process of family change Few control variables, focus on process not outcome Trovillo (2006)Multiple programs can have overlapping effects Distinguished at risk vs not students Sample in Jasper Tx too few IL participants Ferst Found Impact Eval (2008) Study not completed. Using Peabody and qualitative data Random Experimental &Control Grp Control grp gets treatment after 1 st year, selection bias only interested included

PR group to outreach to and enroll families Database system and mailing and book return system Nonprofits serving families with youth Assessment team Book sign up outreach and PR Local organizations referring children Book database and mailing system managed Wrap around services coordinated Ongoing assessment and reflective evaluation # of children enrolled match or exceed projections (20% of population by end of year 1, 40% year 2, 60% year 3, 100% year 4) # of local organizations referring children (7 or more) Database and address updates minimize # of returned books (0 books returned from same address more than once) # of children & families attending/ receiving wrap around services – particularly higher need families (half of all children enrolled) Ongoing reflective use of dashboard to refine program implementation (monthly dashboard created) 1-3 year ↑ number of adults who read to their children daily ↑ percent of children that register on time for kindergarten 4-6 year ↑ the % of children assessed as ready for school on the Initial Sound Fluency DIBELS ↑ % of kids assessed as ready for school on Letter Naming Fluency DIBELS Increased literacy and school success reaching post school into career and a revitalized economy Increased community literacy across the lifespan Maximized community engagement Program Implementation Logic Model

Problem, Need Situation ResourcesActivities, Services For Customer s Served Goal/ Outputs1 Goal/ Outcome 2 Goal/ Outcome 3 1. to demonstrate how experience can inform learning 2. to create a supervised context for students to be social scientists, professionals and citizens 3. to provide a context for integration of the accumulation of knowledge through the curriculum as a whole and application of that knowledge to job-related settings 1. # of children enrolled # of local organizations referring children Database and address updates # of children & families attending/ receiving wrap around services 2. ↑ number of adults who read to their children daily ↑ percent of children that register on time for kindergarten 3. ↑ the % of children assessed as ready for school on the Initial Sound Fluency DIBELS ↑ % of kids assessed as ready for school on Letter Naming Fluency DIBELS Distributing Books Children Enrolled Partner Agencies Books Events

Space reserved for Pre and post test – read to child daily Literacy Coalition of Onondaga County Imagination Library Dashboard July 10,2010 $ 29,065

Problem, Need Situation ResourcesActivities, Services For Customer s Served Goal/ Outcome 1 Goal/ Outcome 2 Goal/ Outcome 3

Problem, Need Situation ResourcesActivities, Services For Customer s Served Goal/ Outcome 1 Goal/ Outcome 2 Goal/ Outcome 3 1. to demonstrate how experience can inform learning 2. to create a supervised context for students to be social scientists, professionals and citizens 3. to provide a context for integration of the accumulation of knowledge through the curriculum as a whole and application of that knowledge to job-related settings 1. evaluated through student feedback on field placement 2. evaluated by site supervisor evaluation of student work 3. evaluated through student journals and final paper graded by professor Internships Students Faculty Site Supervisors Site

Problem, Need Situation ResourcesActivities, Services For Customer s Served Goal/ Outcome 1 Goal/ Outcome 2 Goal/ Outcome 3 1. to demonstrate how experience can inform learning 2. to create a supervised context for students to be social scientists, professionals and citizens 3. to provide a context for integration of the accumulation of knowledge through the curriculum as a whole and application of that knowledge to job-related settings 1. evaluated through student feedback on field placement 2. evaluated by site supervisor evaluation of student work 3. evaluated through student journals and final paper graded by professor Internships Students Faculty Site Supervisors Site

ResourcesActivities, Services For Customers Served Goal/ Outcome 1 Goal/ Outco me 2 Goal/ Outcome 3

Relationships Types of Relationships –one to one –one to many –many to many (multiple one to many)

Before we make the E- R diagram, it is important to review the process of completing the logic model.

What is a Logic Model? Wandersman and Linney (1991) describe the logic model as: a logical series of statements linking a condition(s) in the community, The activities that will be employed to address a specific condition, short term outcomes resulting from activities and the long term impacts likely to occur as multiple outcomes are achieved. Thus the logic model provides a simple means of presenting a program and establishing process and outcome goals (Julian et al., 1995; Kumpfer et al., 1993; Wandersman & Linney, 1991). The utilization of the logic model as a system level planning and evaluation device David A. Julian, * United Way of Franklin County, U.S.A. Available online 10 June Evaluation and Program Planning Volume 20, Issue 3, August 1997, Pages * Evaluation and Program Planning Volume 20, Issue 3

U&_fmt=full&_coverDate=06%2F30%2F1999&_rdoc=8&_orig=browse&_srch=%23toc%235852%231999% % !&_cdi=5852&view=c&_acct=C &_version=1&_urlVersion=0&_userid= &md5=6e6b6f f01a88230d7ec29380 Welch and Comer p. 9 Independent and Dependent Variables are implicit in Logic Models IV   DV

U&_fmt=full&_coverDate=06%2F30%2F1999&_rdoc=8&_orig=browse&_srch=%23toc%235852%231999% % !&_cdi=5852&view=c&_acct=C &_version=1&_urlVersion=0&_userid=735929&md5=6e6b6f f01a88230d7ec n Each Box is a step counted or monitored n Each Line/Arrow  is a hypothesized linkage of causal relationship. IV  DV

Fig. 1. Elements of the Logic Model. U&_fmt=full&_coverDate=06%2F30%2F1999&_rdoc=8&_orig=browse&_srch=%23toc%235852%231999% % !&_cdi=5852&view=c&_acct=C &_version=1&_urlVersion=0&_userid=735929&md5=6e6b6f f01a88230d7ec Resources include human and financial resources as well as other inputs required to support the program such as partnerships. Information on customer needs is an essential resource to the program. Activities include all those action steps necessary to produce program outputs. Outputs are the products, goods and services provided to the programs direct customers. For example, conducting research is an activity and the reports generated for other researchers and technology developers could be thought of as outputs of the activity.

Fig. 1. Elements of the Logic Model. U&_fmt=full&_coverDate=06%2F30%2F1999&_rdoc=8&_orig=browse&_srch=%23toc%235852%231999% % !&_cdi=5852&view=c&_acct=C &_version=1&_urlVersion=0&_userid=735929&md5=6e6b6f f01a88230d7ec Customers, the users of a product or service. Outcomes are characterized as changes or benefits resulting from activities and outputs. Programs typically have multiple, sequential outcomes across the full program performance story.

Fig. 1. Elements of the Logic Model. U&_fmt=full&_coverDate=06%2F30%2F1999&_rdoc=8&_orig=browse&_srch=%23toc%235852%231999% % !&_cdi=5852&view=c&_acct=C &_version=1&_urlVersion=0&_userid=735929&md5=6e6b6f f01a88230d7ec short term outcomes, those changes or benefits that are most closely associated with or caused by the programs outputs intermediate outcomes, those changes that result from an application of the short term outcomes. Long term outcomes or program impacts, follow from the benefits accrued though the intermediate outcomes. Tip: List out your outcomes them put them in chronological order.

Fig. 1. Elements of the Logic Model. U&_fmt=full&_coverDate=06%2F30%2F1999&_rdoc=8&_orig=browse&_srch=%23toc%235852%231999% % !&_cdi=5852&view=c&_acct=C &_version=1&_urlVersion=0&_userid=735929&md5=6e6b6f f01a88230d7ec n Example from reading: n results from a laboratory prototype for an energy saving technology may be a short-term outcome; the commercial scale prototype an intermediate outcome, and a cleaner environment once the technology is in use one of the desired longer term benefits or outcomes. Tip: List out your outcomes them put them in chronological order.

3 Making an Entity- Relationship Diagram

Problem, Need Situation ResourcesActivities, Services For Customer s Served Goal/ Outcome 1 Goal/ Outcome 2 Goal/ Outcome 3

Problem, Need Situation ResourcesActivities, Services For Customer s Served Goal/ Outcome 1 Goal/ Outcome 2 Goal/ Outcome 3 1. to demonstrate how experience can inform learning 2. to create a supervised context for students to be social scientists, professionals and citizens 3. to provide a context for integration of the accumulation of knowledge through the curriculum as a whole and application of that knowledge to job-related settings 1. evaluated through student feedback on field placement 2. evaluated by site supervisor evaluation of student work 3. evaluated through student journals and final paper graded by professor Internships Students Faculty Site Supervisors Site

Problem, Need Situation ResourcesActivities, Services For Customer s Served Goal/ Outcome 1 Goal/ Outcome 2 Goal/ Outcome 3 1. to demonstrate how experience can inform learning 2. to create a supervised context for students to be social scientists, professionals and citizens 3. to provide a context for integration of the accumulation of knowledge through the curriculum as a whole and application of that knowledge to job-related settings 1. evaluated through student feedback on field placement 2. evaluated by site supervisor evaluation of student work 3. evaluated through student journals and final paper graded by professor Internships Students Faculty Site Supervisors Site

ResourcesActivities, Services For Customers Served Goal/ Outcome 1 Goal/ Outco me 2 Goal/ Outcome 3

Problem, Need Situation ResourcesActivities, Services For Customer s Served Goal/ Outcome 1 Goal/ Outcome 2 Goal/ Outcome 3 1. to demonstrate how experience can inform learning 2. to create a supervised context for students to be social scientists, professionals and citizens 3. to provide a context for integration of the accumulation of knowledge through the curriculum as a whole and application of that knowledge to job-related settings 1. evaluated through student feedback on field placement 2. evaluated by site supervisor evaluation of student work 3. evaluated through student journals and final paper graded by professor Internships Students Faculty Site Supervisors Site

ResourcesActivities, Services For Customers Served Goal/ Outcome 1 Goal/ Outco me 2 Goal/ Outcome 3

Program Implementation Logic Model

Lab #LabKey ComponentsDatabase Utility 1Tables and Relationshi ps Tables store data. They are very similar to Excel Spreadsheets. In a database, these tables are linked to each other by relationships. Relationships connect one table to another by using a "key" such as your social security number. A key is a field (i.e. variable) or combination of a more than one fields that is unique to each person (for instance your social security number). Since your social security number is unique to you and never changes, if your SSN is in 2 or 3 or more different tables, then we can link all of your data from these different tables together using relationships. There are different types of relationships. One to One means each record in table A has only one corresponding record in table B. One to Many means that each record in table A can have multiple records related to it in Table B (think of you going to a physician's office - you will only have one record in a table that deals with your contact info and insurance, but you could have many records in a table that has a different row of data for each of your visits to record such things as the reason and any prescriptions you receive). An E-R diagram is a blueprint for how your tables are related to each other. E-R stands for Entity (or tables) Relationship. Oftentimes people use spreadsheets to keep track of records, but this can become overly complex quite quickly. What usually happens is that we end up with duplicate records with different information, such as different addresses for the same person, and we do not know what is the correct info. Database structures are designed to help reduce or eliminate such problems. 2FormsForms are the primary means by which data are entered into a database. You can think of a form as a pretty doorway to a spreadsheet (i.e. table). Each space to enter data on a form (such as name or address) corresponds with a particular variable or field in a table. Once you type information in the form (such as for name) it goes directly into the table in the corresponding location (i.e. it goes in the name column and the row for that person). If you edit something in a form, it also edits it in the spreadsheet. Forms can also have sub forms so that on the same page you can enter data all in one place and then the data will be stored in multiple tables (i.e. the table related to the form and the tables related to each sub form). One major problem with spreadsheets is that people can easily type in the wrong row and this will create inaccuracies in the database. Forms help to prevent this. 3QueriesA query is basically a question or a line of inquiry. In a database you are asking the database a question and expecting it to give you an answer. Questions or queries are along the lines of: who are the people in my database older than age 18, who has had a successful outcome, or what is the total cost of serving everyone? For some of these queries the answer is a spreadsheet-like output that would show you who all the people are who are over age 18 or who all the people are with successful outcomes. However, they can also compute a single answer such as what the total cost of serving everyone is. A query includes first including what tables you need to answer a question, what the relationship is between these tables (i.e. how are they linked - this will often be automatic if relationships are established, but if not you must assign them), and what logical or math functions you want it to do with them. For the ones above it would include such things as greater than (i.e. > 18), if statements (i.e. if = successful outcome), and addition (i.e. sum of cost for all clilents served). Many times organizations have questions that they want to ask about their data on a routine basis, such as how many people are we serving, what is the cost of payroll, how many peopld are having successful outcomes. Queries make answering these questions as easy as clicking a button. 4DashboardA Dashboard is a collection of queries that have been formatted nicely to appear as charts or numerical outputs. They are designed to highlight major areas of concern for an organization that need to be monitored on a regular basis. A dashboard allows these data to be easily monitored on a daily, monthly or even minute to minute bais. Organizations often talk about wanting to be run according to principles of performance management. The Key to this is having useful data available at the fingertips of the right people with little effort - so that they can spend their energy on translating the data into useful organizational changes. Dashboards provide an effective way to do this. 5Main PageA Main Page is basically a form that has buttons on it so that a person who opens a database can then select where they want to go to enter data, what types of querries they want to run, or whether they want to run a particulare dashboard. Creating one involves making buttons and then making macros linked to those buttons that do a series of things that will bring the database user to where they want to be in a database. There are many different staff roles in an organization and they each use a database in a different way. Some people only do data entry, others only use the data to manage others. A Main Page brings each person to where they need to be. 6Uploading Fake Data to Test Database Databases are helpful because they not only accept data that is entered in them manually through forms, but they can also accept large batches of data from other places or other databases. These often come in the form of a spreadsheet. Data such as the fake data seen here, can be uploaded into a database from multiple sources. Once the data are uploaded, you can use a database to link the data and create queries and dashboards using these data. Many times data comes from all over or you need to buy a new database and migrate things from the old one to the new one. Uploading as shown here addresses this need.