1. Hazelwood School District Program Evaluation
Mary Piper

2. Designing Evaluation How will information be gathered?
What is measured or assessed?
How will information be used?

3. Levels of Program Evaluation
Description
Participants’ reactions
Initial Satisfaction
To improve program design and delivery

4. Levels of Program Evaluation
Description
Participants’ learning
New Knowledge and Skills
To improve program content, format, and organization

5. Levels of Program Evaluation
Description
Organization support and change
Change Agent
To document, adopt, and inform future change efforts

6. Levels of Program Evaluation
Description
Participants’ use of new knowledge and skills
Implementation
To document and improve the implementation of program content

7. Levels of Program Evaluation
Description
Student learning outcomes
Impact
To focus and improve all aspects of program design, implementation, and follow-up; to demonstrate the overall impact

8. Levels of Program Evaluation
Description
Return on Investment
(ROI)
Value of training
To determine the value of the program in terms of resources (time, money, and/or people)

9. Evaluating Professional Development Thomas Guskey

10. Assessing Impact: Evaluating Professional Development JoEllen Killion

11. The Death and Life of the Great American School System Diane Ravitch
Context Move from a focus on accountability to a focus on curriculum Evidence Common Core Standards

12. A Chance to Make History Wendy Kopp
Context Transforming public education Evidence Teach for America

13. Mindset Carol Dweck
Context Fixed Mindset Growth Mindset Evidence Evaluation of Industrial Age programs needs to move to an Information Age model with ongoing evaluation which allows for rapid course corrections

14. HSD Students 18,405 students in K-12 2nd largest in St. Louis County
70.2% African American
26.4% Caucasian
1.2% Asian and Hispanic
46% free & reduced lunch
26 different languages
55% mobility

15. Inevitable: Mass Customized Learning
Transformational Change versus Tinkering Change Mass Customized Learning is about transformational change. The Industrial Age is about mass producing education. The Information Age is about mass customizing learning

16. Inevitable: Mass Customized Learning
Where We Are
Where We Need to Be
The reality in today’s Information Age, is......that it is now possible for:
anyone
to learn anything
from anywhere
at any time in any way
from worldwide experts
from a specific teacher. 
The reality in today’s Information Age, is......that it is now possible for:
anyone
to learn anything
from anywhere
at any time in any way
from worldwide experts
from a specific teacher. 

17. Inevitable: Mass Customized Learning
Everybody is mass customizing; everybody – except education. iPhone: customize music My Yahoo: news page Starbucks: coffee Facebook: contacts iPad & Google: sightseeing

18. Mass Customized Learning
Meets every learner at his/her learning level,
Provides learning opportunities that sync with the learner’s most effective learning styles, and
Allows the learner to study and learn skills and concepts using content that is relevant and interesting.
MASS CUSTOMIZED EVALUATION