An information system to ease the creation and deployment of context-aware, location-based surveys Christopher Scaffidi Center for Applied Systems and Software School of Electrical Engineering and Computer Science Oregon State University Corvallis, OR, United States

Background Part of a larger project Monitoring ambient air pollution, location, and air function

Requirements Remote deployment Copy-paste textual compatibility Deploy without having to edit JSON Copy-paste textual compatibility For easy compliance with university regulatory requirements Triggering questions Depending on the time of day, current or recent locations, spirometry measures, and prior answers (skip logic).

Related Work Many available tools Common limitations For example: LimeSurvey, MaritzCX, Zapier, KoBoToolbox, Qualtrics, Dooblo, mapitgis, SurveyMonkey Common limitations Triggering questionnaires based on physical phenomena Such as spirometry? Such as retrospective location tracking? Deploying remotely, then using even when offline? Support for textual copy-paste integration with university processes?

CPQ Editor

Other components CPQ server Existing app Data repository Storage, verioning of surveys Existing app Data logger CPQ presenter Outbound data transmitter Data repository

Evaluation Each participant completed two tasks Creating survey with CPQ editor Creating survey with Qualtrics Chosen due support for location-based logic Random task ordering Performing task after a 2-minute tutorial on the appropriate editor Each survey specification 10 questions long Provided in Microsoft Word (similar to real university setting) Simplified form of the survey we really need for our project Qualtrics survey was simplified even further (due to its limited features)

Participants and recruitment Students from introductory web development class Comparable to pool of undergraduate assistants Recruited via emails 12 enrolled in the study Paid $15 for completing the study

Measures and analysis ** = one-tail non-parametric Wilcoxon Rank Sum Test Completion time The time taken to create the survey ** Adjusted time: Time taken to create the survey, after adjustment for learning (speed up) reflected in the second task's time ** Error rates Counting errors that would invalidate logic and/or data validity ** Usability Rating on a 5-point Liker scale, overall, for each tool Also ratings of aspects of the CPQ editor

Results * = significant at p < 0.05 Qualtrics CPQ editor Task completion time (min) * 21.00 13.42 Adjusted time (min) * 22.46 14.88 Total number of errors * 10.42 0.33 Overall difficulty rating * 2.17 1.08 CPQ text-editing N/A 0.25 CPQ skip-controlling 1.00 CPQ survey-testing 0.92 (Very easy = 0, Very difficult = 4)

Conclusions User interface succeeded in the two key objectives Enabling users to copy-paste Enabling users to construct question triggers Accomplishing these goals, in turn, achieved our goals Speeding up the time to create surveys from textual specifications Reducing the potential for errors Increasing user ratings of usability

Thank you… To CISTI for this opportunity to present To NIEHS (NIH) for funding To you for your comments and questions