1. Ellen M. Rathje University of Texas at Austin NEEScomm IT Development Team

2.  Introduction (Ellen Rathje)  Procedures for Data Archiving and Sharing  Data Management and Curation Process ◦ Standa Pejsa (NEEScomm Data Curator)  Tools for Data Management ◦ Project Warehouse/Project Editor (Gaby Ou) ◦ Specimen Authoring Tool and inDEED (Kari Nasi) ◦ Project Explorer for NEES (Rachelle Howell)  Tools for Collaboration (Santiago Pujol) ◦ Group Space ◦ SynchroNEES Post-webinar survey

3. We’ve got a HUB for that!

4. An environment for collaborative earthquake engineering research

5. Personal Workspace (private) NEEShub Project Warehouse (private/ public) Group Spaces (restricted) There are different levels of sharing and collaboration within NEEShub

7. A centralized data repository for managing, sharing, storing, and publishing research data

8. Descriptions Drawings Mat’l Descriptions Photos Publications Data

9. Every project is created with the same structure This provides consistency between projects and aids in the navigation of project information

10.  Project Experiment Trial Repetition  A project represents an entire research project, which consists of a suite of tests and associated simulations  Each test is set up as an individual experiment  Within each experiment there are several trials or separate events for which data is measured  If the same trial is performed more than once, it may have multiple repetitions The model governing the organization of data within a project

11. NEES-GC: Seismic Risk Mitigation for Port Systems Centrifuge Test of PV Drains Mar 2007 Crane Shake Table Test Nov 2009 Pile-Wharf Connection Test Sept 2007 Sine1Cyclic LoadShake1Shake2 Rep1 Project Experiments Sine2Sine3 Rep1 Repetitions Trials

12. The model governing the organization of data within a project

13. A centralized data repository for managing, sharing, storing, and publishing research data

14.  For each repetition within a trial, there are four data folders that are automatically created 1.Unprocessed data  Raw voltages, channel names, potentially non-standard formats (e.g., binary files) 2.Converted data  Measurement units, instrument names 3.Corrected data  Filtering, baseline corrections, removal of bad data 4.Derived data  Corrected data plus values derived from measured units (data not directly measured). Remember the data within the Project Warehouse is PUBLIC ASCII tab delimited files recommended for all sensor data

15.  Experiment Documentation ◦ Metadata fields within the Project Display ◦ Experimental Setup Report placed in Documentation folder  Sensor Measurement Data ◦ Unprocessed ◦ Converted ◦ Corrected ◦ Derived Data cannot be shared without proper documentation Uploaded by Researcher within 6 months of experiment Uploaded by Site within 1-week of experiment Requirements and definitions have the goal of making data EASILY re-useable

16.  The Project Editor ◦ Create, edit, and update projects ◦ File uploads through web interface  The Project Explorer for NEES (PEN) ◦ Efficient upload/download for bulk file management ◦ Direct file upload (not a web interface) ◦ Files organized offline and then uploaded  inDEED Data Viewer ◦ Facilitates browsing/viewing/investigating data within Warehouse without download The nuts and bolts

17. Projects are created using the Project Editor

19. Enhancing bulk upload of files

20. Facilitating data queries

21. Projects with Data Visualization

22.  Definition of Enhanced ◦ Metadata fields in Project Display are complete (including drawings, material properties) ◦ Project includes at least one visualization of data ◦ inDEED is currently the only visualization tools that allows for viewing data within the NEEShub without download Projects with Data Visualization

23. Facilitating data queries

25. Think of the Group Space as a user forum An easy way to share content and conversation

26.  Groups can be: ◦ Public, restricted, or private  Purpose ◦ To facilitate conversation, collaboration, and data sharing between group members. Discussions, wiki posts, and files are in one central location available to all group members.  Features ◦ Wiki, messaging, discussion boards, and file sharing via the dropbox An easy way to share content and conversation

28.  SynchroNEES ◦ A graphical user interface for transferring files  Local PC to NEES group workspace  NEES Personal workspace to NEES group workspace The nuts and bolts

30. The first time you use them Tools & Resources > Tools

31. Tools that you use most often will appear on your “My NEEShub” page My NEEShub The tools you use most often Your current sessions

32. NEES has created tools to help you visualize and analyze your data! Specimen Authoring Tool InDEED For visualization, simulation, and analysis

33.  inDEED ◦ Visualization and analysis capabilities ◦ Utilizes the instrument /specimen information from the files created by the Specimen Authoring Tool  Specimen Authoring Tool ◦ Specify instrument names, types, units, and locations ◦ Organize instruments into groups ◦ Load specimen views and locate the sensors on the view to aid in the visualization of the specimen setup  Databases (coming in Release 2) ◦ Collection of data with a common theme For visualization, simulation, and analysis

36.  Use the Group Space to coordinate and communicate with your project group ◦ Share planning files such as drawings, test plans, etc. with your entire group ◦ Discussion board entries are retained and can be easily located later (better than email chains) ◦ The wiki can help your group keep track of significant events in the planning process  Use the inDEED Specimen Authoring Tool to view planned specimen geometry and assist determining sensor placement locations

37.  Use inDEED to quickly create data plots during the execution of the experiment ◦ Compare data plots from different trials or repetitions to see how changes in the test conditions have impacted the results ◦ Share your inDEED sessions with remote group members  Use the Group Space wiki and messaging functions to keep your group members updated on the testing progress

38.  Use inDEED to analyze data ◦ Plot data from several files at once, allowing for comparison of data across trials or repetitions ◦ Download plots to image files of various formats ◦ Associate videos with the data ◦ Calculate averages or differences between data sets  Share inDEED files via the Group Workspace ◦ Allow group members to comment via the discussion board

39.  Develop resources for education and outreach, and contribute them to the NEES Academy  Develop a webinar to reach practicing engineers  Contribute publications that others may access via the NEEShub **Contact Thalia Anagnos (Thalia.Anagnos@sjsu.edu) or Sean Brophy (sbrophy@purdue.edu) with your ideas or questions**

41.  Contribute tools and resources to share with the community ◦ CMMI Virtual Poster fair at https://nees.org/education/ cmmi-poster-session-mainhttps://nees.org/education/ cmmi-poster-session-main  Submit tickets to get problems/issues resolved  Submit wishes about things you would like to see on the NEEShub

43.  Create drawing files during the planning process that can be used in the inDEED Specimen Authoring Tool.  Create instrument lists and data files in formats compatible with the Specimen Authoring Tool and inDEED  Create your Specimen Authoring Tool files before you begin testing so you can quickly load and plot data in inDEED during testing  Organize your instruments into groups that correspond to the plots you will make most often

44.  Before making your project public, remove any data that you do not want in the public realm.  Do not upload files that are not necessary. Having too many files can make it difficult to find the important files.  Create processed data files that are in an accessible format (e.g., ascii) with headers and units.  Do not upload zip files. Someone may want to download a single file rather than ALL of your files. **The NEEScomm Data Curator (Standa Pejsa) has already created projects in the Project Warehouse for all 2009 and 2010 NEESR projects**

45.  Data Documentation Wiki (under construction) nees.org/topics/DataDocumentation ◦ For documents describing recommended procedures for data sharing and archiving  NEEScomm IT Director Dawn Weisman (dweisman@purdue.edu)  Data Curator Standa Pejsa (spejsa@purdue.edu) ◦ Standa is a resource for assisting in sharing and archiving your data