NM OSAP Recipient Meeting New Mexico Community Survey Martha W. Waller, Ph.D. Pacific Institute for Research and Evaluation

Background on the PIRE Evaluation Team Martha Waller, Ph.D. – Benevolent Overlord Liz Lilliott, Ph.D. - Behavioral Health Star! Day to day management and expert on SMART document and day to day efforts, data, and what works Kim Zamarin, M.A - Training Goddess- Training and hands on expertise of how to manage and organize and plan data collection and prevention efforts Lei Zhang, Ph.D. – Data Analysis Guru

Important dates February 25th - Online survey goes live March 14th and 15th - Data entry training April 28th - All data collection must end May 15th - Data files (for paper surveys) are due May 31st - PIRE returns aggregated data files July 15th - All EOY reports submitted to OSAP. 

Where can you find important NMCS information? The NMCS 2018 Data collection protocol will contain most of this information. All documents you need should be found online: www.nmprevention.org under ‘Evaluation Instruments’ and ‘New Mexico Community Survey’ Or you can always contact me or Liz or Kim

https://tinyurl.com/NMCS2018 Tiny URL for NMCS https://tinyurl.com/NMCS2018

QR CODE

Community and College Community Modules You DO NOT need to collect these modules this year. There is nothing on these modules that is critical for the OSAP evaluation; every other year is sufficient to monitor community attitudes and readiness. While short as a stand alone module, adding to the overall length of the survey should be taken very seriously. If you are not going to use the data for anything in particular, please don’t include them just because it seems interesting.

Tobacco, Mental Health, & Opioid Modules You DO NOT need to collect these modules this year. There is nothing on these modules that is critical for the evaluation for OSAP. While short as a stand alone module, adding to the overall length of the survey should be taken very seriously. If you are not going to use the data for anything in particular, please don’t include them just because it seems interesting.

Gambling and ACEs Module Most of you are implementing the gambling and ACEs modules in addition to the Core module. (THANK YOU!!!) If you are proposing to use one of the modules, then please strongly consider adding the other since this is really the innovative aspect of the research proposed. No one has looked at how ACEs may influence later problem gambling behavior. The reason we provided the option to exclude one is really because we felt the ACEs might be too sensitive for some communities to take on (but then the opioid and mental health modules do as well). If you are already doing the ACEs, please consider adding the gambling. ($250 per module).

Gambling and ACEs Gambling questions- What qualifies as a game of chance? Is a wager involved? Could you win or lose something of value? Not playing games of chance per se but wagering something of value on a game of chance or skill. Or spending money to play a game of chance that may or may not pay off (bingo, lotto, scratch offs, etc.) ACEs- not your job to counsel respondents, please refer them to the behavioral health services available, or to PIRE or IRB, etc.

Gambling and ACEs Modules For those collecting ACEs on paper forms, PIRE has envelopes for you to take home today or tomorrow. We recommend you take 3 boxes (150 in each). Reuse envelopes when possible. Save extras to use next year. If you plan to collect more than 450 surveys, then take more boxes. Please explain to respondents to put the completed questionnaire into the envelope and close it up, seal it, then place it in your container. You may want to place some empty envelopes in the box early on so someone isn’t worried theirs is the only one. NOTE: If you haven’t already, please make sure you send your W-9 to PIRE. This is the only way to get your reimbursement.

A little advice from our training expert Approaching potential respondents What questions might potential respondents have about the survey? How do you sell them on why s/he should take the survey? Can you encourage them to do it on their own time? How? Screening potential respondents Age Residence Taking the survey already? If they agree to take the survey, how do you walk them through the process?

Setting the survey up for respondents The Consent Process: Whether using a paper survey or taking the survey on-line, whether in English or in Spanish, you MUST walk through the consent form with everyone. If taking the survey on a tablet Stand next to the respondent to show them what you are doing Enter the survey by indicating your are taking for someone else… Explain why you are doing this. Enter the log on information- SITE ID is very important!!!!! Consent Tricky questions Close out Getting to the gas card drawing

After the questionnaire is completed Paper surveys- Ask the respondent to place the completed survey into the envelope provided, seal it, and place it in the box. On-line surveys- make sure the respondent has submitted the survey. (If they get to the closing page with the link to the drawing, the survey has been completed and submitted.) Help the respondent get to the drawing page if needed. If they are taking the survey off-line- please remind them they are not able to enter the drawing for the gas cards. Uploading the survey later will be very important to remember Toubleshooting (sign in and out again, upload survey again)

Data collection tips Collect data in pairs (ideally one will be bilingual) Data collectors ust be 18 or older and will ideally be able to connect with the population you are sampling (young adults, elders, parents, men, etc.) Try to make the days of the week and the times of day that you collect data this year match those from last year. (Look at your data collection tracking logs from last year.) Setting up for data collection: Ipads, laptops, hotspots- include App page to take along Incentives (cash requires a log) & takeaway form & Collection box Clipboard (tape your ‘script’ on back) – blank sheet on top for privacy

Data collection tips Team work: Organize your communications: look at your protocol and who’s in charge, who you report to, how you upload app data entry. Tracking app surveys completed (notes app?) Sampling strategies & TIPS High flow area: select every other person. Approach everyone – not just those who look nice. Don’t be shy, don’t make assumptions based on appearance Practice your pitch

After a day of collecting data Wrapping Up Paper surveys – make sure all dated, with site code & location & surveyor info Count paper surveys (English & Spanish) Count app surveys completed Upload app surveys, then logoff Log back into app (username = nmcs@pire.org Password = Pire2018!) Fill out data collection tracking log for the day Secure completed paper surveys and Ipads in safe, locked area

Additional Odds and Ends Incentives- can’t be coercive – what does that mean? Take home information – EVERYONE needs to receive this! How to find Narcan – This is coming by the end of the week hopefully. Data tracking form- super important!!!! You must turn this in at the end of the year. If you make changes to your data collection protocol, you must inform PIRE ahead of time.

Push the survey on your social media Please like on Facebook the New Mexico Community Survey page from your local program’s Facebook page, Twitter Feed, Instagram accounts as well as your personal ones. Like the New Mexico Community Survey ads on Facebook and Instagram when you see them. Comment on the ads. Ask your friends and family to share and comment as well.

We couldn’t do this without you!!! Thank you!!!! Any questions? Please ask them. Any concerns or problems? Please share them! You all make this survey process successful. We are appreciative of all ‘heads up’ you can provide.