1. An information system to ease the creation and deployment of context-aware, location-based surveys
Christopher Scaffidi
Center for Applied Systems and Software
School of Electrical Engineering and Computer Science
Oregon State University
Corvallis, OR, United States

2. Background Part of a larger project
Monitoring ambient air pollution, location, and air function

3. Requirements Remote deployment Copy-paste textual compatibility
Deploy without having to edit JSON
Copy-paste textual compatibility
For easy compliance with university regulatory requirements
Triggering questions
Depending on the time of day, current or recent locations, spirometry measures, and prior answers (skip logic).

4. Related Work Many available tools Common limitations
For example: LimeSurvey, MaritzCX, Zapier, KoBoToolbox, Qualtrics, Dooblo, mapitgis, SurveyMonkey
Common limitations
Triggering questionnaires based on physical phenomena
Such as spirometry?
Such as retrospective location tracking?
Deploying remotely, then using even when offline?
Support for textual copy-paste integration with university processes?

6. CPQ Editor

7. Other components CPQ server Existing app Data repository
Storage, verioning of surveys
Existing app
Data logger
CPQ presenter
Outbound data transmitter
Data repository

8. Evaluation Each participant completed two tasks
Creating survey with CPQ editor
Creating survey with Qualtrics
Chosen due support for location-based logic
Random task ordering
Performing task after a 2-minute tutorial on the appropriate editor
Each survey specification
10 questions long
Provided in Microsoft Word (similar to real university setting)
Simplified form of the survey we really need for our project
Qualtrics survey was simplified even further (due to its limited features)

9. Participants and recruitment
Students from introductory web development class
Comparable to pool of undergraduate assistants
Recruited via s
12 enrolled in the study
Paid $15 for completing the study

10. Measures and analysis ** = one-tail non-parametric Wilcoxon Rank Sum Test
Completion time
The time taken to create the survey **
Adjusted time: Time taken to create the survey, after adjustment for learning (speed up) reflected in the second task's time **
Error rates
Counting errors that would invalidate logic and/or data validity **
Usability
Rating on a 5-point Liker scale, overall, for each tool
Also ratings of aspects of the CPQ editor

11. Results * = significant at p < 0.05
Qualtrics
CPQ editor
Task completion time (min) *
21.00
13.42
Adjusted time (min) *
22.46
14.88
Total number of errors *
10.42
0.33
Overall difficulty rating *
2.17
1.08
CPQ text-editing
N/A
0.25
CPQ skip-controlling
1.00
CPQ survey-testing
0.92
(Very easy = 0, Very difficult = 4)

12. Conclusions User interface succeeded in the two key objectives
Enabling users to copy-paste
Enabling users to construct question triggers
Accomplishing these goals, in turn, achieved our goals
Speeding up the time to create surveys from textual specifications
Reducing the potential for errors
Increasing user ratings of usability

13. Thank you… To CISTI for this opportunity to present
To NIEHS (NIH) for funding
To you for your comments and questions