1. Data Collection in MTM
Choosing the right method for survey data collection

2. Class Survey Distribution Considerations
SIMPLE
Minimize the number of survey distribution methods, to keep the process easy to execute
TIMELY
Students should complete the Post Event survey as soon as feasible after the end of class
GOAL: Strike a balance between these two factors

3. Option 1: Surveys Emailed From MTM
#1 recommended approach
ed From MTM:
Students are enrolled in a class in MTM. s are sent to students per established process and settings. Automatic reminders sent to students who have not completed the evaluation after 7 days.
Administrator schedules class in MTM, copy/pastes the addresses of the students who completed the class to designate who should receive a survey for the class
MTM Sends an containing a unique survey link to each student between 8am and 12pm the last day of the class
The student clicks on the link and completes the survey. The student will not be prompted to enter an address
Let’s start at the beginning of the survey process: Survey Distribution.
In order for you to be able to focus more on analyzing the data you are collecting, we shoot to remove the manual work involved with measurement processes.
Along with reporting and benchmarking, one of MTM’s most beneficial pieces of functionality is automation. Having evaluations ed directly to students from MTM will help save you time and reminders will help drive up your response rates. The process is fairly simple and easy to manage. [WALK THROUGH PROCESS]
****
INTERNAL - PRESENTER SOLUTION NOTE:
Promote this as the primary, recommended data collection method. If client wants to collect data in-class, further pursue this recommended process by suggesting that students receive in-class s to ensure accurate response rates. If this is not possible (i.e., can’t get roster), recommend Alias site, with s sent to individuals if enrollments are updated (see Alias slide).

4. Option 2: Alias URL Optimal for clients who:
The Alias URL is a static URL that will present students with a list of classes with open evaluations within your account. The URL’s can be customized to narrow down the list to specific locations, instructors, or form types.
Optimal for clients who:
Receive class rosters after class ends
Have computers in classroom with web access
Class is scheduled in MTM by an Administrator.
MTM Sends an the day after the class containing a unique survey link to each student that has not submitted data
Alias URL is bookmarked on classroom computers or provided by instructor at end of class
Students access Alias URL, selecting the class they attended from a drop-down list.
Students are prompted for their address (if using follow up evaluations later), and complete the evaluation
After roster is received, students are enrolled in the class in MTM to ensure accurate response rates.
The respondent chooses the appropriate class and is taken to the evaluation for that class. The most general Alias is at the organization level, but the link can also be tailored to display only the classes taught at a specific location or by a specific instructor. The most common use of the alias is for the Post Event evaluation for ILT classes, but it can also be configured to display only web-based classes or other form types if needed.
****
INTERNAL - PRESENTER SOLUTION NOTE:
If client wants to collect data in-class, further pursue this recommended process by suggesting that students receive in-class s to ensure accurate response rates. If this is not possible (i.e., can’t get roster), recommend Alias site, with s sent to individuals if enrollments are updated (see Alias slide).
Example of an organization-level Alias URL:

5. Option 3: Manual Class Links
The MTM Class Link is a class-specific url that is created each time a class is scheduled in MTM. The class link can be retrieved by an MTM administrator and provided to the instructor, who can distribute the url to students at the end of class, or it can be ed to students by the instructor or another designee after the class ends.
Class is scheduled in MTM by an Administrator
Link retrieved by Administrator and provided to instructor for distribution in class , or sent directly to students by Administrator or instructor
Students click on class-specific link, are prompted for their address (if using follow up evaluations later), and complete the evaluation

6. Option 4: Link in LMS (Integrated solution only)
Link Embedded in the LMS:
Class-specific or Student-specific links can be created by clients who integrate their LMS with MTM, and presented to students in the LMS. Clients interested in pursuing this option will be provided guidance regarding the values to be used when creating the link, as it will not be created by MTM but instead will be created on the client side, based on the class and student identifiers sent to MTM from the LMS via the nightly feed. This works best when student/class information is sent to MTM before students complete a class, so that the link is immediately active and available upon class completion.
This method is optimal for clients who:
Have an integrated MTM solution
Have learners who may not have addresses but can access a link in the LMS
Want to simplify the student experience by not asking students to provide an address
Class information is sent to MTM via the nightly LMS feed
Some class information from the feed is used to create class-specific or student-specific links in the client system
Students are instructed to access the LMS to complete their evaluation
NOTE: This method is not feasible for a Pilot, but is a common method of distribution in the event of integration with the LMS

7. Option 5: Link posted directly in content (typical for Web-based classes)
Link Posted in Content:
Many clients who use a manual administration solution will post a class link to a Web-based class directly in the content, typically at the end of the course. This allows students the opportunity to complete the evaluation immediately after completing the content. Some integrated clients prefer this approach for Web-based classes, as the link is immediately available to students upon completion of the class.
This method is optimal for clients who:
Have a manual or integrated MTM solution
Want to present the evaluation link at the end of the course material
Web-based Class is scheduled in MTM by an Administrator (one class is created for each Web-based course)
Link retrieved by Administrator and embedded in the course content (typically at the end of the content). This occurs once per course
Students click on class-specific link, are prompted for their address (if using follow up evaluations later), and complete the evaluation
This option is the most feasible option to collect post event data for web-based training for non-integrated clients (an alternative is to enroll students who have completed into MTM on a periodic basis, such as weekly).
Some integrated clients prefer to still use this option for Web-based training instead of sending the information for Web-based classes through the integration, since the link is readily available immediately after completion as opposed to the student receiving an the following day.

8. Option 6: Paper Evaluation Collection
Some clients have a need to collect some or all data in class via paper, for cultural or technical reasons. After the data is collected, it can be manually entered into MTM via the Manual Evaluation Entry tool. Many clients who use this method outsource the evaluation entry to KnowledgeAdvisors for a small fee, instead of entering the evaluations in-house.
This method is optimal for clients who:
Have a learner population without access to the internet or
Desire close to 100% response rate
Have internal or outsourced resources to complete the entry process in a timely manner
Class is scheduled in MTM by an Administrator (this can be before or after the learning event has taken place and may be performed by the client or outsourced to KA)
Students complete paper version of evaluation at the end of class
An Administrator enters the evaluations into the correct class in MTM via the Manual Evaluation Entry tool; either at the client site, or as an outsourced service via KA

9. Option 7: Paper evaluations and Scanning
Scanned Paper Evaluations:
Some clients have a need to collect some or all data in class via paper, for cultural or technical reasons, and have a training volume that is too high for Manual Evaluation Entry to be feasible. In this case, a scanned data integration may be used, whereby student data is collected in class on scannable forms, data is scanned in-house by client or by a third-party scanning provider, and the scanned data is imported into MTM for reporting.
This method is optimal for clients who:
Have a learner population without access to the internet or
Do not plan to modify class evaluations frequently
Have a class volume high enough to justify the investment to install a scanning solution
Have an integrated MTM solution
There are several approaches that may be used to schedule class data in MTM; client needs and capabilities will dictate which method is most appropriate
Students complete scannable paper version of evaluation at the end of class
Evaluations are scanned and student answer data is provided to KA via xml or csv format for processing
A client MUST have an answer-level integration to support scanned paper evaluations
There are 2 approaches: all class and answer data sent in one file, or class data and answer data sent in separate files (with class ID being included in both files to match up the data).
© 2011, KnowledgeAdvisors

10. Option 8: Survey Access via QR Code
A QR code that launches the evaluation link may be generated from the Class > Summary page for class and conference surveys. The QR code may be included in presentation content or printed and posted in the training/conference space for respondents to access via any QR code reader on their mobile device.
This method is optimal for clients who:
Have a manual or integrated MTM solution
Have a mobile, tech-savvy audience that needs access to the survey immediately, not via an after the event ends
Class is scheduled in MTM by an Administrator
QR code is generated from the Class > Summary page for the Post Event survey and displayed to the audience at the learning or conference event
Students use a QR Code Reader application on their smart phone to read the QR code and launch the survey and submit feedback
This option is the most feasible option to collect post event data for web-based training for non-integrated clients (an alternative is to enroll students who have completed into MTM on a periodic basis, such as weekly).
Some integrated clients prefer to still use this option for Web-based training instead of sending the information for Web-based classes through the integration, since the link is readily available immediately after completion as opposed to the student receiving an the following day.

11. Survey Distribution Decision Tree: ILT/Virtual Classes
START:
Manual or Integrated Solution?
MANUAL
INTEGRATED
Do students have internet access in class?
Do all students have a unique address in the LMS?
YES
YES NO
Can students identify the class they attended from a drop-down list? NO
Do students have internet access in class?
link directly to students from MTM
Do all students have a unique address?
YES
YES NO
YES NO NO
Alias site
Use Alias site in class
Does the client have a high volume of classes or students?
Do students have access to the internet at all?
Is there any reason NOT to send the link from MTM? NO
YES
YES
YES NO
Collect via paper and use manual evaluation entry
Collect via paper and set up scanned data integration NO
Admin or other designee s class link or Alias link to students
Collect via paper and use manual evaluation entry
link directly to students from MTM
Admin or other designee s class link to students, uses QR code

12. Survey Distribution Decision Tree: Web-based Classes
START:
Manual or Integrated Solution?
MANUAL
INTEGRATED
Can the survey link be embedded in the course content?
Can the survey link be embedded in the course content?
YES
YES NO NO
Embed survey link in course content
Do all students have a unique address in the LMS?
Embed survey link in course content, do not include WBT classes in integration file
Can the class survey link be embedded in the LMS?
YES NO
YES NO
Do all students have a unique address in the LMS?
link directly to students from MTM
YES
Can the class survey link be embedded in the LMS?
Embed survey link in LMS NO
YES NO
No remaining options
Periodically download addresses of students who completed each WBT and enroll in MTM for survey distribution
Embed survey link in LMS
No remaining options