Ocean Observatories Initiative R2.0 Beta Test Field Report January 24, ION R2.0 Beta Test 2013-Jan-24 Field Report Susanne Jul, Carolanne Fisher, Lynn Morgan CI User Experience Team

R2.0 Beta Session 4 January 24, 2013 Introduction This is a compilation of preliminary results from Sessions 1- 3 of the R2.0 Beta Test effort. It represents issues identified through a rapid triage process used while testing was in progress. An in-depth analysis of the data collected is in progress and may reveal deeper issues. The first section, Findings to Date, contains a summary of findings from the rapid analysis that was presented to the Beta Test User group on Jan 24. The second section, Findings Reported at Individual Sessions, contains the report-back of issues identified presented to testers on a session by session basis. 2

R2.0 Beta Session 4 January 24, 2013 FINDINGS TO DATE (PRELIMINARY) 3

R2.0 Beta Session 4 January 24, Sessions Completed # Start Date Title Topics Covered 112/18/2012 Session 1 - R2.0 Beta Test - System Setup & Orientation Browser set up, user documentation, sign in, account creation 201/09/2013 Session 2 - R2.0 Beta Test - Working with Marine Resources OOI marine resource preload, commanding marine resource, resource status, user roles/permissions 301/16/2013 Session 3 - R2.0 Beta Test - Working with Resources & Data OOI data product preload, interacting with charts, data visualizations, downloading data and attached files 401/24/2013 Session 4 - R2.0 Beta Test - Review Review of Findings, Discussion Topics 501/30/2013Session 5 - DiscussionContent as needed. 602/06/2013Session 6 - R2.0 Beta Test - tbdContent as needed.  Session topics adjusted with tester requests and system evolution

R2.0 Beta Session 4 January 24, Participants 5 11 individuals participating regularly 2 individuals with occasional particpation (B Pritchett, H-J Kim) Pilot testers test materials and system in advance of full group

R2.0 Beta Session 4 January 24, Tester Participation WebEx/ One-One Attendance Worksheets Completed Phone Debriefs Conducted Unique Issues Identified Session ** Session Session *** Total to Date 32* *** * 13 different individuals ** Includes “Session 2” issues from 3 testers *** Collation still in progress – 176 total 1/24

R2.0 Beta Session 4 January 24, 2013 Types of Issues Identified Issues 5 “Beta test” issues omitted ✕ ✕

R2.0 Beta Session 4 January 24, 2013 Types of Issues Beta test Issues related to test materials and dummy data Display Issue related to screen rendering (e.g., lines misaligned) Text formatting issues excluded Documentation Issues related to User Documentation (e.g., editing suggestions, content additions) Information displayed Issues related to information content of screens (e.g., information missing or superflous) Interaction o Issue related to user interaction and screen element behavior (e.g., button not working or suggestion for desired interaction) Naming & Terminology o Issues related to object names and on-screen labels Question or Misconception o Question about system or project plans (e.g., for FAQ) Security concern o Issue related to credentialing process Text format o Issue related to formatting or rendering of text on screen (e.g., font size, overlapping text) 8

R2.0 Beta Session 4 January 24, 2013 Issue Analysis Issues Beta test, marine integration, security issues omitted

R2.0 Beta Session 4 January 24, 2013 Categories of Resolution Bug System is not as intended, recommend fixing Concern Further consideration needed to determine recommended solution Feature request System enhancement, consider when planning system evolution Known issue Fix is already planned User Documentation Issue is addressed through User Documentation FAQ Question response should be placed in FAQ and sent back to user community 10

R2.0 Beta Session 4 January 24, 2013 Resolution Status Issues Fixed Bug/Known Issue/User Documentation

R2.0 Beta Session 4 January 24, 2013 Types of Issues Issues Beta test omitted

R2.0 Beta Session 4 January 24, 2013 Naming & Terminology “Node” mapped to “Platform” Creates “Sub-Platform” Reference designators used as Instrument names Use of “Observatory,” Platform/Instrument “Family” New two-character codes 13

R2.0 Beta Session 4 January 24, 2013 Resolution Integrating OOI definitions and names into ION Issue caused by lag of information propagation Reviewing within CI Platform naming CI proposing standardized naming convention 14

R2.0 Beta Session 4 January 24, 2013 Marine Integration Clarification of social processes and plans for defining, implementing and testing status value calculations of marine assets (instrument, platform, observatory) Clarification of procedures for assigning Product and QC Levels of Data Products 15

R2.0 Beta Session 4 January 24, 2013 Resolution 16 TBD

R2.0 Beta Session 4 January 24, 2013 Proposed Next Steps Continue weekly sessions through Feb, Wed 1 pm PT Discussion forum to resolve issues and answer questions Hands-on as soon as useful and meaningful 17

R2.0 Beta Session 4 January 24, 2013 ION Beta Access Will be up as much as possible Check User Documentation page for status and planned downtime We will post summary of new features when system is updated Link from User Documentation status area to ionbetatesters and io_integration_group Briefing in Wed sessions 18

R2.0 Beta Session 4 January 24, 2013 Proposed Schedule Wed 1/30 Question responses Issue resolution discussion Topics determined Monday Fri 2/1 11 am PT R2.0 Beta Test Findings (Presentation) Wed 2/5 Hands-on (editing attributes, lifecycle state, charts, adding users) 19

R2.0 Beta Session 4 January 24, 2013 FINDINGS REPORTED AT INDIVIDUAL SESSIONS 20

Ocean Observatories Initiative R2.0 Beta Test Field Report January 24, Report-Back Session 1: System Setup and Orientation

R2.0 Beta Session 4 January 24, 2013 Key Findings issues reported from 9 testers ~> 68 unique issues collected 7 - Fixed Main stumbling block with Session 1 was logging in using a Google account when another Google account was already in use on the browser. 51 – Under Evaluation 10 - Known Issues All beta testers successfully o opened Beta System on Chrome, Mozilla, or Safari browsers o signed-in using the test account o created account

R2.0 Beta Session 4 January 24, Report-Back Session 2 Working with Marine Resources

R2.0 Beta Session 4 January 24, 2013 Key Findings 24 Findings / Statistics – Session 2 67 issues reported from 9 testers > 47 unique issues collected 6 - Fixed Memory Issues in ion-beta Terminology & Composition 34 - Under Evaluation 3 - Known Issues Some Status page input Account Settings visible Commanding Instrument (3) 4 – longer term in JIRA 20 - Fixed 97 - Under Evaluation 12 - Known Issues 6 – longer term in JIRA All Beta Testing Findings / Statistics; Total unique issues - 135

Ocean Observatories Initiative R2.0 Beta Test Field Report January 24, 2013 Report-Back Session 3 Working with Marine Resources 25

R2.0 Beta Session 4 January 24, 2013 Key Findings – Session 3 26 Terminology & Marine IO feedback on Composition of System Memory Issues in ion-beta, system brought down Fri, 2 pm PT Findings / Statistics – Session 3 67 issues reported from 9 testers > 47 unique issues collected 6 - Fixed Memory Issues in ion-beta Terminology & Composition 34 - Under Evaluation 3 - Known Issues Some Status page input Account Settings visible Commanding Instrument (3) 4 – longer term in JIRA