2. 1 New CTE Follow-up Survey

3. 2 Training Topics Discuss Purpose Explain Need for Good Response Rate Explain Interviewer Responsibilities Introduce the Survey Mock Interview Practice (2 w & w/o stumbling blocks) Discuss Problems Consistency & Confidentiality Lessons on making calculations Closely Monitor

4. 3 Purpose & Use Provide data to meet reporting needs. Used for p1 Perkins III Core Performance Indicators. Ranking programs for State Added Cost funding LEAs to use for program improvement & aiding students not placed Program reviews Reporting CTE program impact to public

5. 4 The Interview Process Qualities of Good Implementation Consistency Response Rate Interviewer Responsibilities p6-8

6. 5 Consistency Goal =to collect data from all students statewide p6 in exactly the same way at exactly the same time Timing = 9 mo after June of senior year

7. 6 Response Rate Acceptable Rate P6-8 90% - 100% < 50% Relationship to Placement Rate Unacceptable Rate

8. 7 Tips for Improving RR Use a phone survey method A-C Call from the school phone Leave messages on answering machines Make at least 6 attempts Other suggestions in Attachment C Call in evenings & on weekends

9. 8 Interviewer Responsibilities Be consistent BEFORE Hanging UpP9-10 Follow question wording exactly Be objective Follow the script Check your work Enjoy your work

10. 9 Follow Wording Exactly Would you climb a tree? p9 Should you climb a tree? Could you climb a tree?

11. 10 Be Objective WHY do you say that? p10 Why do YOU say that? Why do you say THAT?

12. 11 New CTE Follow-up Phone Survey Upfront Opening Student contact Proxy contact Part A: Current Status Part B: School/Training Part C: Employment Part D: Only if Not Working ClosingP11-22

13. 12 Opening – Student Contact Hello, this is _____ from _____. Is ____ there? Student : Hi _____. How are you? Single program completed ______, in _____ grade you completed a program in ________. Do you have a few minutes to answer some questions about what you are doing now? All responses will be kept confidential. p11

14. 13 Student contact Multiple programs completed We are talking with students who completed programs in high school. Do you have a few minutes to answer some questions about what you are doing now? All responses will be kept confidential. Our records show that you completed the _____, _____, and _____ programs. Are you pursuing one of these more than the other? Which one? ______________________ This is the class I would like you to think about during this interview. p11 : We can only follow up on one program. Which would you like to think about during this interview? ____________________ If no : We can only follow up on one program. Which would you like to think about during this interview? ____________________

15. 14 Proxy contact Proxy : We are talking with students who completed high school programs to see how they are doing. [Student name] was in the _____ class. How could I reach him/her? If unreachable You could probably answer some of the questions. It would only take a couple minutes and all responses will be kept confidential. p11

16. 15 Part A Current Status 1. Lets start what you’re doing now. Are you going to school? Working? p12Verify applicable part of answer with statement before coding. Yes No a. in a training program or attending school or college?   b. working as an apprentice? ( If Yes : Q1c = Yes*)   c. working?   d. on full-time, active duty in the military?   ( If Yes : Q1c = Yes & Q7 = 40 hrs/wk) e. on part-time duty in the military?   ( If Yes : Q1c = Yes & Q7 = 40 hrs/wk) f. Other: (specify code from list below)____ 1. unpaid leave of absence (disability, Family leave) 2. on seasonal layoff

17. 16 Q1 - Skip Options If working, but not in school or training,  Skip to Part C. If ‘Other’ only,  Skip to Part D. p13

18. 17 Part B: School/Training I have some questions about your schooling or training. 2. In your major area of study or training, how much do you use the skills you learned in this program? Would you say you use them a lot, some, hardly ever, or not at all? If a 3 (Hardly ever) or 4 (Not at all): Hardly Not Hardly Not A lot Some Ever at all        p14 2a. Right now you don’t use your training, but how much do you anticipate using it in the future... a lot, some, hardly ever, or not at all?        

19. 18p15 3. Where are you going to school? (Note: If enrolled in more than one, identify the primary one.)  business or trade school, or career center  community college  college/university  military (National Guard, West Point, Annapolis, DLI, Merchant Marines, etc.)  other ___________________________

20. 19p16 4. What type of program are you in? [Read list]  certificate  associate degree  bachelor’s degree  other (specify) ___________________

21. 20 Part B – Skip Options If No Current job,  Skip to Part D. p16

22. 21 Part C: Employment Now, I’d like to talk about your job as it relates to your (selected) program. p17 5.On your job, how much would you say you’re using the skills you were taught? Would you say you use them... ?  A lot  Some  Hardly ever  Not at all

23. 22p18 6. How strongly do you agree with the statement, I am satisfied with my present job? Do you... ?  Strongly agree  Agree  Disagree  Strongly disagree

24. 23p18 7.How many hours a week do you work? ______________ hrs/week 7a. If not specific : Would you say it’s 35 hrs a week or more?  Yes  No  Yes  No

25. 24p19 8.Including tips and commissions, how much do you make an hour? $ _________ / hr  Skip to Comments

26. 25 Part D: Only if Not Working 9. Are you currently looking for a job?  Yes  No p22

27. 26 Comments Thank you. That’s all I needed. p22 Now, are there any comments you’d like to make to help us improve our programs.

28. 27 Break  Back in 10 min

29. 28 Proxy Survey Part A: Current Status 1.Let’s start with what (she/he) is doing now. p Part B: School/Training 3. Where is (he/she) going to school? 4.What type of program is (he/she) in?

30. 29 Part C: Employment 7. How many hours a week does (he/she) work? 7a. If not specific : Would you say it’s 35 hours a week or more? 8.Including tips and commissions, how much does (he/she) make an hour?  Skip to Comments. Part D: Only if Not Working 9. Is (he/she) currently looking for a job?p

31. 30 Consistency Goal =to collect data from all students statewide in exactly the same way, at exactly the same time. p6

32. 31 Prefaces to Avoid Using Apologetic – If you don’t mind my asking… Blameless – This is confidential, but the state needs it. Estimates – Approximately how much … On guard! – I have to ask this question. Proxy – You may not be able to answer… Opt out – You don’t have to answer … p20

33. 32 Role Play #1 Practice Conducting the Survey Choose a partner. Go to a room Practice both roles – the interviewer and the student. Practice at least three times. Switch roles with your partner. Be KIND. Do not throw in stumbling blocks.  Back in 15 min p

34. 33 Potential Problem & Solution #1 Where are you going to school?  I take a class at the career center. ?Are you registered at the career center? I’m registered at the community college, but they hold the class at the career center. I’m registered at the community college, but they hold the class at the career center.

35. 34 Potential Problem & Solution #2 On your job, how much would you say you’re using the skills you were taught?  Student from automechanics program working at a dealership says “not at all.”  ? What should the interviewer do?  a. Mark the answer and go on.  b. Review skills they learned & ask again.  c. Explain why that’s not possible & ask again.

36. 35 Potential Problem & Solution #3 How strongly do you agree with the statement, “I am satisfied with my present job”?  Student working at McDonald’s “Strongly Agrees”. ?What should the interviewer do? a.Review potential for the program they took. a.Review potential for the program they took. b.Talk about benefits & ask again. c.Mark the answer and go on.

37. 36 Potential Problem & Solution #4 Including tips and commissions, how much do you make an hour?  The completer has more than 1 job. ?What should the interviewer do? Combine and estimate the overall hourly wage. Combine and estimate the overall hourly wage.

38. 37 Potential Problem & Solution #5 Including tips and commissions, how much do you make an hour? The interviewer is uncomfortable about asking the question. ?What should the interviewer do? a.Apologize, say “I know this is sensitive, but b.Ask for an estimate, “About how much … c.Explain it’s optional. Just ask the question. Just ask the question.

39. 38 Role Play #2 Practice Conducting the Survey Choose a partner/new partner Go to a room Practice both roles (interviewer & responder) Practice both surveys (phone & proxy) Do the survey twice (2 each) Go ahead -- throw in stumbling blocks  B B B Back in 15 min

40. 39 Handling Difficult Calls TalkativeA-CGrouchy Irate

41. 40 Best Weapon

42. 41 Confidentiality Part of the 2 Big Cs What was the first C? Meaning A promise by interviewers who know the response of specific completers not to reveal those responses to anyone. Keeping responses a secret Consistencyp

43. 42 Calculations Weekly rate based on 40 hr/wk $400/wk ÷ 40hr/wk = $10.00/hr p19 Monthly rate based on 2080 hr/yr $1200/mo x 12mo = $14,400/yr $14,000/yr ÷ 2080 hr/yr = $6.92/hr Annual rate based on 2080 hr/yr $18,000/yr ÷ 2080 hr/yr = $8.65/hr

44. 43 Strategies for Making Contact Challenges Updated records Mobility of students When to call The Telephone Consumer Protection Act states that telephone solicitation cannot occur before 8:00 a.m. or after 9:00 p.m Schools technically are not solicitors State still recommends keeping within the 8 a.m. - 9 p.m. time framep8

45. 44 Challenges (cont’d) Answering Machines Caller ID Reaching Students Disconnects Callbacks Can’t Get Through p9

46. 45 Solving Problems No finite list of problems Some may be area specific SSC will help with solutions Careful about making snap decisions All solutions are not easy Record enough info – no need to recall Keep own list Experience in handling

47. 46 Process Problems Contact Dr. Jill Kroll Office of Career and Technical Preparation (517) 241- 4354

48. 47 Lunch  Start at 1:00 pm