1. National Visitor Use Monitoring
Forest Coordinator Training and Educate the Trainer Training Preventing, Finding, & Correcting Errors
September AKB
National Visitor Use Monitoring
Forest Service

2. Minimize Errors in 3 Areas: 1
* Minimize Errors in 3 Areas: Preparing for Field Data Collection Training Site and Site Types Back Up and Field Calendars Quality Assurance Checks Individual Interview Form Field Work Schedule Hand Tally Counter Questions 3,4, Time Sequence Q4,5,7,8, Activities Reported
2. Daily Summary Form Field Work Schedule AM vs PM Shift Hand Tally Counter Traffic Counter

3. Foundation of Training:
Preparing for Field Data Collection TRAINING NVUM WO Team offers 2 webinars: 1. Internal FS Coordinators/CORs/CORs 2. Field Interviewers Field Interviewers also trained by Forest Coordinators or Contract Managers using webinar and on site hands on training
Foundation of Training:
Webinars
NVUM Field Guide
Video
We can’t teach what to do in every situation you will encounter in the field. Understanding the goals and the protocols will help you to adjust to different situations.
You are the most visible and the first person you teams will come to with questions Many of you are not only responsible for the planning and scheduling of each survey, but you will be participating in the interview process yourselves. Knowing your job, and doing what you can do to make sure your teams know the job, will make the year go smoother and the results will be much more accurate.
Know WHAT is being done and
WHY it is this way
Know the Responsibility of the
Manager and Field Interviewer

4. Preparing for Field Data Collection
Training Site and Site Types Back Up and Field Calendars Quality Assurance Checks
Manager

5. Common Errors that point to improper Training:
Know your site types -Don’t Survey the Wrong Set of Recreating Visitors:
Now have DUDS data that is mixed into OUDS data causing high variability and confidence level for overall OUDS data.
Toss out survey
Survey Day is lost
Example 1: DUDS vs OUDS data
Survey site is listed as an OUDS campground and is nested in a DUDS.
Most surveys show the majority of visitors came that day and are leaving that day. So we can assume the interviewer was not surveying the OUDS visitors.
Training Needed: define terms, train how to read field calendar
Manager Role: should be proactive and identify recreation complexes and how to set up survey stations in them

6. Example 2: WILD survey site
Know your site types -Don’t Survey the Wrong Set of Recreating Visitors:
Example 2: WILD survey site
Survey site is listed as a WILD site and boundary of the wilderness is about 3 miles from the parking area.
Visitor responded to Question 10 they did not visit the Wilderness Area!
Now have GFA only data that is mixed into WILD data causing high variability and confidence level for overall WILD data.
Toss out survey
Survey Day is lost
Training Needed: define terms, train how to read field calendar, know how to set up a GFA vs WILD (trailhead) site
Manager Role: should be proactive and identify the two different data sets this area could give us (GFA and WILD)

7. Preparing for Field Data Collection
Training
Site and Site Types Back Up and Field Calendars Quality Assurance Checks
Manager

8. Common Errors that point to improper Training:
Incorrect Use of Back Up Calendar:
NVUM Field Guide
2018
Chpt 4
CANNOT USE back up day for:
Bad Weather
Fire Closes the Forest
No Snow/Low Snow
Site Closed – hazard trees, landslide
These are all legitimate reasons why visitors
are not out on the forest engaging in recreation activities. This is part of the scientific survey process.
One district has too many survey days vs. the other districts
The inventory design process prior to the field schedule being created. They could have been avoided through a final calendar check in August.
Look at NVUM Field Guide for in depth definitions and when the field interviewer should go out there anyway

9. Common Errors that point to improper Training:
NOTE:
Fill in the daily summary form (take a zero “0” use day) and write the reason the survey day was not conducted (if this is the case) in the blank space provided on the form in the section under “Recreation use at this site for this day is (above normal, normal, below normal), If not normal, why?”
Look at NVUM Field Guide for in depth definitions and when the field interviewer should go out there anyway

10. Common Errors that point to improper Training:
NOTE:
Contractors shall notify the COR/CO on days that will be missed to get assigned back up calendar days. Contractors do not have the authority to choose the back-up calendar day without approvals from COR/CO. The COR/CO shall discuss and get the decision from the Forest Program Manager and relay to Contractor.
Correct Use of Back Up Calendar:
USE Back Up day for:
Recreation Event will place the site into a different use range (low to high)
Equipment or Staff Logistical Issue double sample days back to back for a week and cannot possibly get all the equipment and interviewers to all the locations
Sick Staff
Proxy Site –goal is to interview as many exiting visitors as possible

11. Common Errors that point to improper Training:
Correct Use of Back Up Calendar:
To use the backup calendar, first identify the site type and the sampling stratum (use level or proxy code) for the day that was missed. That is, backup days must match site type (OUDS, DUDS, etc.) and sampling stratum (HIGH, MEDIUM, LOW, DUR4, DUR5, etc.).
Then looking through the backup calendar, find the first day that has not already passed that matches both the site type and sampling stratum. You cannot “shop” for a makeup day on the missed District or missed site.
NVUM Field Guide
2018
Chapter 4

12. Preparing for Field Data Collection
Training
Site and Site Types
Back Up and Field Calendars Quality Assurance Checks
Manager

13. Quality Checks can prevent Common Recurring Errors:
Purpose of Quality Checks:
Manager’s Role: Quality checks provide continuing education, mentoring & training which improves Data Collection Procedures
Field Interviewer’s Role: Monitor the Quality of the Data Collected (use check list on the back of the Daily Summary Form)
NVUM Field Guide
Chapter 3 and
Appendix K
8 Total Checks are Required Annually for entire program:
2 “undercover” checks
6 mentoring training checks
Scan/ to Don English within a week of the check

14. Quality Checks can prevent Common Recurring Errors:
Recommended Quality Checks :
1 per field interviewer during the first 4 weeks
Any time new Field Interviewer crew members are added
Follow up if a field interviewer is consistently turning in inaccurate data
Contracts must always be inspected, and inspections documented. Corrective action must be taken immediately when mistakes are identified.

15. Quality Checks can prevent Common Recurring Errors:
Daily Summary Form
Checklist on the back of the form.
The Field Interviewer needs to review the check list on the back of the Daily Summary Form after each survey day.

16. Quality Checks can prevent Common Recurring Errors:
Daily Summary Form
Checklist on the back of the form.
The Forest Coordinator needs to review all survey forms before sending to the Data Processor.

17. REVIEW: Preparing for Field Data Collection Training
Site and Site Types
Back Up and Field Calendars
Quality Assurance Checks
Manager

18. NEXT:
Daily Summary Form Errors Field Work Schedule AM vs PM Shift Hand Tally Counter Traffic Counter

19. Common Recurring Errors on the Daily Summary Form:
NVUM Field Guide
2018
Chapter 4
Chapter 5
Administration Information needs to
Match the Field Work Schedule Day:
SITETYPE
SITENAME
RD_CODE
SITENUMBER
SUBUNIT
TYPE
SAMP_STRATUM
MONTH
DAY
YEAR
SURVTIME
NOTE1
REGION
FOREST
DUDS
1D02 Beartooth Lk Picnic Area
Clarks Fork Ranger District 4
NONE
NONPROXY
HIGH 6 1
2019 AM 2 14

20. Daily Summary Form Errors
Field Work Schedule AM vs PM Shift Hand Tally Counter Traffic Counter

21. Common Recurring Errors on the Daily Summary Form:
NVUM Field Guide
2018
Chapter 4
Interview Hours =AM or PM shift assigned?
SITETYPE
SITENAME
RD_CODE
SITENUMBER
SUBUNIT
TYPE
SAMP_STRATUM
MONTH
DAY
YEAR
SURVTIME
NOTE1
REGION
FOREST
DUDS
1D02 Beartooth Lk Picnic Area
Clarks Fork Ranger District 4
NONE
NONPROXY
HIGH 6 1
2019 AM 2 14

22. Daily Summary Form Errors
Field Work Schedule
AM vs PM Shift Hand Tally Counter Traffic Counter

23. Common Recurring Errors on the Daily Summary Form:
NVUM Field Guide
2018
Chapter 4
Hand Tally Counter –
start with “0”
end with a number not a time
end number > begin count number

24. Daily Summary Form Errors
Field Work Schedule
AM vs PM Shift
Hand Tally Counter Traffic Counter

25. Common Recurring Errors on the Daily Summary Form:
NVUM Field Guide
2018
Chapter 4
Traffic Counter –
start with “0”
end with a number not a time
end number > begin count number
Compare end numbers; do they make sense?
Counter set on “interval” = whole vehicle

26. Common Recurring Errors on the Daily Summary Form:
Traffic Counter
Counts are in the expected use level range (H,M,L) at top of form? YES
If not normal, WHY? ___________
DUDS – Use Level Range – Exiting People (2.3 people/car x 29 cars = 67 exiting people)
Low 2-20, Medium 21-60, High 61-99, Very High 100+

27. Common Recurring Errors on the Daily Summary Form:
What would the field interviewer have observed on this day with exiting traffic and use of the site?
Hand Tally Count =27
Interviews =5?
Complete Interviews = 1
Completed Interviews found by examining each of the Individual Interview Forms and not on the Daily Summary From.
I am guessing there are not very many complete interviews due to the fact that snow drifts keep visitors from staying and using the picnic sites.

28. REVIEW: Preparing for Field Data Collection Daily Summary Form Errors
Training
Site and Site Types
Back Up and Field Calendars
Quality Assurance Checks
Daily Summary Form Errors
Field Work Schedule
AM vs PM Shift
Hand Tally Counter
Traffic Counter

29. NEXT: Individual Interview Form Field Work Schedule Hand Tally Counter Questions 3,4, Time Sequence Q4,5,7,8, Activities Reported

30. Common Recurring Errors on the Individual Summary Form:
Administration Information =Field Work Schedule Day =Daily Summary Form
SITETYPE
SITENAME
RD_CODE
SITENUMBER
SUBUNIT
TYPE
SAMP_STRATUM
MONTH
DAY
YEAR
SURVTIME
NOTE1
REGION
FOREST
DUDS
1D02 Beartooth Lk Picnic Area
Clarks Fork Ranger District 4
NONE
NONPROXY
HIGH 6 1
2019 AM 2 14

31. Individual Interview Form
Field Work Schedule Hand Tally Counter Questions 3,4, Time Sequence Q4,5,7,8, Activities Reported

32. Common Recurring Errors on the Individual Summary Form:
1st Interview Form
Hand Tally Count goes up as interview forms are completed
All exiting vehicles are hand tally counted
Hand tally count on 2nd interview form is not 6 as 3 vehicles did not stop for an interview but were still counted on hand tally.
2nd Interview Form

33. Individual Interview Form
Field Work Schedule
Hand Tally Counter Questions 3,4, Time Sequence Q4,5,7,8, Activities Reported

34. Individual Summary Form:
Common Recurring
Errors on the
Individual Summary Form:
For GFA site type there is no Q4 or Q5 site arrival questions asking when they arrived at this site because they are in the General Forest Area!

35. Individual Interview Form
Field Work Schedule
Hand Tally Counter
Questions 3,4, Time Sequence Q4,5,7,8, Activities Reported

36. Questions 4 & 5 Are the dates in order? Do the dates make sense?
Common Recurring
Errors on the
Individual Summary
Form:
Questions 4 & 5 Are the dates in order? Do the dates make sense?
Q4. Leave the site
Q5. Arrive at the site

37. Questions 7, 8 & 9 Are the dates in order? Do the dates make sense?
Common Recurring
Errors on the
Individual Summary Form:
Questions 7, 8 & 9 Are the dates in order? Do the dates make sense?
Q7. Nights spent on forest?
Q8. Arrive on the forest
Q9. Leave the forest

38. Individual Summary Form:
Common Recurring
Errors on the
Individual Summary Form:
In this example the visitor arrived on the Shoshone NF on May 30 at Crazy Creek Campground and stayed 2 nights there, recreated at Beartooth Lake Picnic Are on June 1 and is now exiting the NF to go to Billings, MT.
Q4. Leave the site (Beartooth PG) /1 at 9:55
Q5. Arrive at the site (Beartooth PG) /1 at 8:30
Q7. Nights spent on the forest /30 and 5/31 = 2 nights
Q8. Arrive on the forest /30 at 17:30
Q9. Leave the forest same time as interview 6/1 at 0955

39. Questions 7, 8 & 9 Are the dates in order? Do the dates make sense?
Common Recurring
Errors on the
Individual Summary Form:
Questions 7, 8 & 9 Are the dates in order? Do the dates make sense?
Q7. Nights spent on forest?
Q8. Arrive on the forest
Q9. Leave the forest

40. Individual Summary Form:
Common Recurring
Errors on the
Individual Summary Form:
In this example the visitor arrived on the Shoshone NF on May 30 at Crazy Creek Campground and stayed 2 nights there, recreated at Beartooth Lake Picnic Area on June 1 and is now exiting the site but will not leave the NF until June 3.
Q4. Leave the site (Beartooth PG) /1 at 9:55
Q5. Arrive at the site (Beartooth PG) /1 at 8:30
Q7. Nights spent on forest /30, 5/31, 6/1, 6/2 = 4 nights
Q8. Arrive on the forest /30 at 17:30
Q9. Leave the forest /3 at 12:00

41. Common Recurring Errors on the Individual Summary Form:
GFA Site on the Shoshone NF:
Arrived on the NF on May 30, camped 2 nights at Crazy Creek Campground on the NF. Currently exiting the NF at a GFA interview site after “driving for pleasure on gravel roads”; headed back to the campground to pack up and leave the NF; will leave the NF at 1200 today.

42. Common Recurring Errors on the Individual Summary Form:2
GFA Site
You must complete date and times for Questions 8 and 9
This is the only place on the form where they are recorded
DO NOT fill in bubble “same as interview time”
GFA Site on the Shoshone NF:
Arrived on the NF on May 30, camped 2 nights at Crazy Creek Campground on the NF. Currently exiting the NF at a GFA interview site after “driving for pleasure on gravel roads”; headed back to the campground to pack up and leave the NF; will leave the NF at 1200 today.

43. Individual Interview Form
Field Work Schedule
Hand Tally Counter
Questions 3,4,5
Time Sequence Q4,5,7,8, Activities Reported

44. Common Recurring Errors on the Individual Summary Form:
Do the Activities they choose occur on this National Forest? Know your National Forest!!
Is there a nature center, trail or visitor center on the Shoshone NF?
YES, the High Mountain Lookout Tower has historical exhibits and visitor information. It is not called a visitor center but serves as one.

45. REVIEW Common Errors: Preparing for Field Data Collection
Training
Site and Site Types
Back Up and Field Calendars
Quality Assurance Checks
Daily Summary Form Errors
Field Work Schedule
AM vs PM Shift
Hand Tally Counter
Traffic Counter
Individual Interview Form
Field Work Schedule
Hand Tally Counter
Questions 3,4,5
Time Sequence Q4,5,7,8,9
Activities Reported

46. Resources NVUM SEPTEMBER 2018 Guidebook NVUM VIDEO 2004
(some contractors are using the 2013 guidebook, YIKES)
NVUM VIDEO 2004
The guidebook should be your first stop when looking for an answer.
Answers to questions should begin locally. The forest and Regional NVUM coordinators should know the answers to most questions.

47. Questions…