National Visitor Use Monitoring Forest Coordinator Training and Educate the Trainer Training Preventing, Finding, & Correcting Errors September 2018 AKB National Visitor Use Monitoring Forest Service

Minimize Errors in 3 Areas: 1 * Minimize Errors in 3 Areas: 1. Preparing for Field Data Collection Training Site and Site Types Back Up and Field Calendars Quality Assurance Checks 3. Individual Interview Form Field Work Schedule Hand Tally Counter Questions 3,4,5 Time Sequence Q4,5,7,8,9 Activities Reported 2. Daily Summary Form Field Work Schedule AM vs PM Shift Hand Tally Counter Traffic Counter

Foundation of Training: Preparing for Field Data Collection TRAINING NVUM WO Team offers 2 webinars: 1. Internal FS Coordinators/CORs/CORs 2. Field Interviewers Field Interviewers also trained by Forest Coordinators or Contract Managers using webinar and on site hands on training Foundation of Training: Webinars NVUM Field Guide Video We can’t teach what to do in every situation you will encounter in the field. Understanding the goals and the protocols will help you to adjust to different situations. You are the most visible and the first person you teams will come to with questions Many of you are not only responsible for the planning and scheduling of each survey, but you will be participating in the interview process yourselves. Knowing your job, and doing what you can do to make sure your teams know the job, will make the year go smoother and the results will be much more accurate. Know WHAT is being done and WHY it is this way Know the Responsibility of the Manager and Field Interviewer

Preparing for Field Data Collection Training Site and Site Types Back Up and Field Calendars Quality Assurance Checks Manager

Common Errors that point to improper Training: Know your site types -Don’t Survey the Wrong Set of Recreating Visitors: Now have DUDS data that is mixed into OUDS data causing high variability and confidence level for overall OUDS data. Toss out survey Survey Day is lost Example 1: DUDS vs OUDS data Survey site is listed as an OUDS campground and is nested in a DUDS. Most surveys show the majority of visitors came that day and are leaving that day. So we can assume the interviewer was not surveying the OUDS visitors. Training Needed: define terms, train how to read field calendar Manager Role: should be proactive and identify recreation complexes and how to set up survey stations in them

Example 2: WILD survey site Know your site types -Don’t Survey the Wrong Set of Recreating Visitors: Example 2: WILD survey site Survey site is listed as a WILD site and boundary of the wilderness is about 3 miles from the parking area. Visitor responded to Question 10 they did not visit the Wilderness Area! Now have GFA only data that is mixed into WILD data causing high variability and confidence level for overall WILD data. Toss out survey Survey Day is lost Training Needed: define terms, train how to read field calendar, know how to set up a GFA vs WILD (trailhead) site Manager Role: should be proactive and identify the two different data sets this area could give us (GFA and WILD)

Preparing for Field Data Collection Training Site and Site Types Back Up and Field Calendars Quality Assurance Checks Manager

Common Errors that point to improper Training: Incorrect Use of Back Up Calendar: NVUM Field Guide 2018 Chpt 4 CANNOT USE back up day for: Bad Weather Fire Closes the Forest No Snow/Low Snow Site Closed – hazard trees, landslide These are all legitimate reasons why visitors are not out on the forest engaging in recreation activities. This is part of the scientific survey process. One district has too many survey days vs. the other districts The inventory design process prior to the field schedule being created. They could have been avoided through a final calendar check in August. Look at NVUM Field Guide for in depth definitions and when the field interviewer should go out there anyway

Common Errors that point to improper Training: NOTE: Fill in the daily summary form (take a zero “0” use day) and write the reason the survey day was not conducted (if this is the case) in the blank space provided on the form in the section under “Recreation use at this site for this day is (above normal, normal, below normal), If not normal, why?” Look at NVUM Field Guide for in depth definitions and when the field interviewer should go out there anyway

Common Errors that point to improper Training: NOTE: Contractors shall notify the COR/CO on days that will be missed to get assigned back up calendar days. Contractors do not have the authority to choose the back-up calendar day without approvals from COR/CO. The COR/CO shall discuss and get the decision from the Forest Program Manager and relay to Contractor. Correct Use of Back Up Calendar: USE Back Up day for: Recreation Event will place the site into a different use range (low to high) Equipment or Staff Logistical Issue double sample days back to back for a week and cannot possibly get all the equipment and interviewers to all the locations Sick Staff Proxy Site –goal is to interview as many exiting visitors as possible

Common Errors that point to improper Training: Correct Use of Back Up Calendar: To use the backup calendar, first identify the site type and the sampling stratum (use level or proxy code) for the day that was missed. That is, backup days must match site type (OUDS, DUDS, etc.) and sampling stratum (HIGH, MEDIUM, LOW, DUR4, DUR5, etc.). Then looking through the backup calendar, find the first day that has not already passed that matches both the site type and sampling stratum. You cannot “shop” for a makeup day on the missed District or missed site. NVUM Field Guide 2018 Chapter 4

Preparing for Field Data Collection Training Site and Site Types Back Up and Field Calendars Quality Assurance Checks Manager

Quality Checks can prevent Common Recurring Errors: Purpose of Quality Checks: Manager’s Role: Quality checks provide continuing education, mentoring & training which improves Data Collection Procedures Field Interviewer’s Role: Monitor the Quality of the Data Collected (use check list on the back of the Daily Summary Form) NVUM Field Guide Chapter 3 and Appendix K 8 Total Checks are Required Annually for entire program: 2 “undercover” checks 6 mentoring training checks Scan/Email to Don English within a week of the check

Quality Checks can prevent Common Recurring Errors: Recommended Quality Checks : 1 per field interviewer during the first 4 weeks Any time new Field Interviewer crew members are added Follow up if a field interviewer is consistently turning in inaccurate data Contracts must always be inspected, and inspections documented. Corrective action must be taken immediately when mistakes are identified.

Quality Checks can prevent Common Recurring Errors: Daily Summary Form Checklist on the back of the form. The Field Interviewer needs to review the check list on the back of the Daily Summary Form after each survey day.

Quality Checks can prevent Common Recurring Errors: Daily Summary Form Checklist on the back of the form. The Forest Coordinator needs to review all survey forms before sending to the Data Processor.

REVIEW: Preparing for Field Data Collection Training Site and Site Types Back Up and Field Calendars Quality Assurance Checks Manager

NEXT: Daily Summary Form Errors Field Work Schedule AM vs PM Shift Hand Tally Counter Traffic Counter

Common Recurring Errors on the Daily Summary Form: NVUM Field Guide 2018 Chapter 4 Chapter 5 Administration Information needs to Match the Field Work Schedule Day: SITETYPE SITENAME RD_CODE SITENUMBER SUBUNIT TYPE SAMP_STRATUM MONTH DAY YEAR SURVTIME NOTE1 REGION FOREST DUDS 1D02 Beartooth Lk Picnic Area Clarks Fork Ranger District 4 NONE NONPROXY HIGH 6 1 2019 AM 2 14

Daily Summary Form Errors Field Work Schedule AM vs PM Shift Hand Tally Counter Traffic Counter

Common Recurring Errors on the Daily Summary Form: NVUM Field Guide 2018 Chapter 4 Interview Hours =AM or PM shift assigned? SITETYPE SITENAME RD_CODE SITENUMBER SUBUNIT TYPE SAMP_STRATUM MONTH DAY YEAR SURVTIME NOTE1 REGION FOREST DUDS 1D02 Beartooth Lk Picnic Area Clarks Fork Ranger District 4 NONE NONPROXY HIGH 6 1 2019 AM 2 14

Daily Summary Form Errors Field Work Schedule AM vs PM Shift Hand Tally Counter Traffic Counter

Common Recurring Errors on the Daily Summary Form: NVUM Field Guide 2018 Chapter 4 Hand Tally Counter – start with “0” end with a number not a time end number > begin count number

Daily Summary Form Errors Field Work Schedule AM vs PM Shift Hand Tally Counter Traffic Counter

Common Recurring Errors on the Daily Summary Form: NVUM Field Guide 2018 Chapter 4 Traffic Counter – start with “0” end with a number not a time end number > begin count number Compare end numbers; do they make sense? Counter set on “interval” = whole vehicle

Common Recurring Errors on the Daily Summary Form: Traffic Counter Counts are in the expected use level range (H,M,L) at top of form? YES If not normal, WHY? ___________ DUDS – Use Level Range – Exiting People (2.3 people/car x 29 cars = 67 exiting people) Low 2-20, Medium 21-60, High 61-99, Very High 100+

Common Recurring Errors on the Daily Summary Form: What would the field interviewer have observed on this day with exiting traffic and use of the site? Hand Tally Count =27 Interviews =5? Complete Interviews = 1 Completed Interviews found by examining each of the Individual Interview Forms and not on the Daily Summary From. I am guessing there are not very many complete interviews due to the fact that snow drifts keep visitors from staying and using the picnic sites.

REVIEW: Preparing for Field Data Collection Daily Summary Form Errors Training Site and Site Types Back Up and Field Calendars Quality Assurance Checks Daily Summary Form Errors Field Work Schedule AM vs PM Shift Hand Tally Counter Traffic Counter

NEXT: Individual Interview Form Field Work Schedule Hand Tally Counter Questions 3,4,5 Time Sequence Q4,5,7,8,9 Activities Reported

Common Recurring Errors on the Individual Summary Form: Administration Information =Field Work Schedule Day =Daily Summary Form SITETYPE SITENAME RD_CODE SITENUMBER SUBUNIT TYPE SAMP_STRATUM MONTH DAY YEAR SURVTIME NOTE1 REGION FOREST DUDS 1D02 Beartooth Lk Picnic Area Clarks Fork Ranger District 4 NONE NONPROXY HIGH 6 1 2019 AM 2 14

Individual Interview Form Field Work Schedule Hand Tally Counter Questions 3,4,5 Time Sequence Q4,5,7,8,9 Activities Reported

Common Recurring Errors on the Individual Summary Form: 1st Interview Form Hand Tally Count goes up as interview forms are completed All exiting vehicles are hand tally counted Hand tally count on 2nd interview form is not 6 as 3 vehicles did not stop for an interview but were still counted on hand tally. 2nd Interview Form

Individual Interview Form Field Work Schedule Hand Tally Counter Questions 3,4,5 Time Sequence Q4,5,7,8,9 Activities Reported

Individual Summary Form: Common Recurring Errors on the Individual Summary Form: For GFA site type there is no Q4 or Q5 site arrival questions asking when they arrived at this site because they are in the General Forest Area!

Individual Interview Form Field Work Schedule Hand Tally Counter Questions 3,4,5 Time Sequence Q4,5,7,8,9 Activities Reported

Questions 4 & 5 Are the dates in order? Do the dates make sense? Common Recurring Errors on the Individual Summary Form: Questions 4 & 5 Are the dates in order? Do the dates make sense? Q4. Leave the site Q5. Arrive at the site

Questions 7, 8 & 9 Are the dates in order? Do the dates make sense? Common Recurring Errors on the Individual Summary Form: Questions 7, 8 & 9 Are the dates in order? Do the dates make sense? Q7. Nights spent on forest? Q8. Arrive on the forest Q9. Leave the forest

Individual Summary Form: Common Recurring Errors on the Individual Summary Form: In this example the visitor arrived on the Shoshone NF on May 30 at Crazy Creek Campground and stayed 2 nights there, recreated at Beartooth Lake Picnic Are on June 1 and is now exiting the NF to go to Billings, MT. Q4. Leave the site (Beartooth PG) 6/1 at 9:55 Q5. Arrive at the site (Beartooth PG) 6/1 at 8:30 Q7. Nights spent on the forest 5/30 and 5/31 = 2 nights Q8. Arrive on the forest 5/30 at 17:30 Q9. Leave the forest same time as interview 6/1 at 0955

Questions 7, 8 & 9 Are the dates in order? Do the dates make sense? Common Recurring Errors on the Individual Summary Form: Questions 7, 8 & 9 Are the dates in order? Do the dates make sense? Q7. Nights spent on forest? Q8. Arrive on the forest Q9. Leave the forest

Individual Summary Form: Common Recurring Errors on the Individual Summary Form: In this example the visitor arrived on the Shoshone NF on May 30 at Crazy Creek Campground and stayed 2 nights there, recreated at Beartooth Lake Picnic Area on June 1 and is now exiting the site but will not leave the NF until June 3. Q4. Leave the site (Beartooth PG) 6/1 at 9:55 Q5. Arrive at the site (Beartooth PG) 6/1 at 8:30 Q7. Nights spent on forest 5/30, 5/31, 6/1, 6/2 = 4 nights Q8. Arrive on the forest 5/30 at 17:30 Q9. Leave the forest 6/3 at 12:00

Common Recurring Errors on the Individual Summary Form: GFA Site on the Shoshone NF: Arrived on the NF on May 30, camped 2 nights at Crazy Creek Campground on the NF. Currently exiting the NF at a GFA interview site after “driving for pleasure on gravel roads”; headed back to the campground to pack up and leave the NF; will leave the NF at 1200 today.

Common Recurring Errors on the Individual Summary Form: 2 GFA Site You must complete date and times for Questions 8 and 9 This is the only place on the form where they are recorded DO NOT fill in bubble “same as interview time” GFA Site on the Shoshone NF: Arrived on the NF on May 30, camped 2 nights at Crazy Creek Campground on the NF. Currently exiting the NF at a GFA interview site after “driving for pleasure on gravel roads”; headed back to the campground to pack up and leave the NF; will leave the NF at 1200 today.

Individual Interview Form Field Work Schedule Hand Tally Counter Questions 3,4,5 Time Sequence Q4,5,7,8,9 Activities Reported

Common Recurring Errors on the Individual Summary Form: Do the Activities they choose occur on this National Forest? Know your National Forest!! Is there a nature center, trail or visitor center on the Shoshone NF? YES, the High Mountain Lookout Tower has historical exhibits and visitor information. It is not called a visitor center but serves as one.

REVIEW Common Errors: Preparing for Field Data Collection Training Site and Site Types Back Up and Field Calendars Quality Assurance Checks Daily Summary Form Errors Field Work Schedule AM vs PM Shift Hand Tally Counter Traffic Counter Individual Interview Form Field Work Schedule Hand Tally Counter Questions 3,4,5 Time Sequence Q4,5,7,8,9 Activities Reported

Resources NVUM SEPTEMBER 2018 Guidebook NVUM VIDEO 2004 (some contractors are using the 2013 guidebook, YIKES) NVUM VIDEO 2004 The guidebook should be your first stop when looking for an answer. Answers to questions should begin locally. The forest and Regional NVUM coordinators should know the answers to most questions.

Questions…