Presenter: Cindi Dunn, Principal Evaluator Office of Educational Innovation & Evaluation College of Education, Kansas State University June 13, 2013 EVALUATION AND ASSESSMENT 3 RD PARTY EXTERNAL EVALUATION NORTH GULF COASTAL HAZARDS COLLABORATORY TRACK II

“AREAS OF SUCCESS” METRICS 1.Cyberinfrastructure Improvement (Cyberinfrastructure Development; Simulation Experiments) 2.Research Production 3.Research Collaboration 4.Human Resource Development (Outreach and Education Activities; Diversity) 5.Sustainability for Future Cyber-Enabled Research and Innovation

DATA SOURCES 1.DRAFT Third Annual Report to NSF 2.Project Documents on Portal 3.NG-CHC Retreat held October NG-CHC Annual Conference June Collaboration Survey Spring Portal Analysis Spring Reports and other documentation

“AREAS OF SUCCESS” METRICS 1.Cyberinfrastructure Improvement (Cyberinfrastructure Development; Simulation Experiments) 2.Research Production 3.Research Collaboration 4.Human Resource Development (Outreach and Education Activities; Diversity) 5.Sustainability for Future Cyber-Enabled Research and Innovation

Number of Researchers and Students Supported by NG-CHC 1. CYBERINFRASTRUCTURE AND EXPERIMENTS

MetricData Status Year 3 Number of high performance computing services and tools in NG- CHC  Operational Storm Surge Forecast System (MSU)  Data Grabber to Download Coastal Data (LSU)  Data Merging Tool (MMRI)  Data Extraction Tool (MMRI)  MODIS Daily Imagery Download Too (MMRI)  ASGS-NHC Text Advisories to ATCF format  ASGS-ADCIRC ASCII to NetCDF script  Sulis Metadata Creator  EnVis  Spatial Watershed Erosion Tool  FloodVix  ADCIRC to ESRI Shape File Scripts  Data to NetCDF Scripts  Sulis Portal Viewer  Sulis Severe Weather Viewer  Sulis Informatics Services Portal  Weather Underground Web Data Extraction Tool (WUDEXT)  Coastal Datafactory  Multi-layer Data Infrastructure for System of Systems

1. CYBERINFRASTRUCTURE AND EXPERIMENTS MetricData Status Functionality of each cyber-enabled tool and service Year 1 = Stage 1 (organizing) Year 2 = Stage 2 (defined workflow) Year 3 = Stage 3 (product) What can users do now that they couldn’t do prior? What feedback have users provided? Usability of each cyber-enabled tool and service Functionality of the ASGS, SULIS, and Flood Risk Models Usability of the ASGS, SULIS, and Flood Risk Models Usability of Technologies developed from the ASGS, SULIS, and Flood Risk Models

1. CYBERINFRASTRUCTURE AND EXPERIMENTS MetricData Status Quantitative performance of each cyber-enabled tool and service No data reported any year Number of data analysis services developed and deployed in NG-CHC No data reported any year Capacity and performance of distributed storage systems in NG- CHC Developed by Mississippi in Year 1 Number of virtual organizations and communities established in NG-CHC 3 simulation experiments Number of cyber-enabled applications supported by NG-CHC No data reported any year Number of courses supported by NG- CHC One reported in Year 1; no data reported in subsequent years

“AREAS OF SUCCESS” METRICS 1.Cyberinfrastructure Improvement (Cyberinfrastructure Development; Simulation Experiments) 2.Research Production 3.Research Collaboration 4.Human Resource Development (Outreach and Education Activities; Diversity) 5.Sustainability for Future Cyber-Enabled Research and Innovation

Number of Publications in Major Scientific Journals 2. RESEARCH PRODUCTION Published or accepted

Number of Presentations at Major Peer-reviewed Conferences 2. RESEARCH PRODUCTION Need to identify peer-reviewed 2

Number of Products and Other Types of Intellectual Property 2. RESEARCH PRODUCTION Year 1Year 2Year 3 Website Portal Structured Data Set via THREDDS Server

Number and Types of Media Exposure 2. RESEARCH PRODUCTION 8

Number and Types of Awards and Honors 2. RESEARCH PRODUCTION Advisory Boards Editorial Boards Fellowships

“AREAS OF SUCCESS” METRICS 1.Cyberinfrastructure Improvement (Cyberinfrastructure Development; Simulation Experiments) 2.Research Production 3.Research Collaboration 4.Human Resource Development (Outreach and Education Activities; Diversity) 5.Sustainability for Future Cyber-Enabled Research and Innovation

Number of Multi-State/Institution Research Projects (per year and total) 3. COLLABORATION

Number of Researchers from Multi- State/Institutions (per strategy* and total) 3. COLLABORATION 66 *Faculty could be in more than one strategy

Quality of Collaboration (per strategy* and total Year 1 = 3.8; Year 2 = 4.1) 3. COLLABORATION Governance, Administration, Mutuality (Y2H), Norms (Y1H)

Overall Quality of Collaboration (per strategy* and total) 3. COLLABORATION

Number of Publications Produced by Collaborative Efforts (NSF acknowledged) 3. COLLABORATION Year 1 = 67%; Year 2 = 73%; Year 3 = 89%

Number of Collaborative Research Proposals Developed by NG-CHC 3. COLLABORATION Year 1Year 2Year 3 NG-CHC 1Not evident Multiple Partners 2Not evident External Partners 334

“AREAS OF SUCCESS” METRICS 1.Cyberinfrastructure Improvement (Cyberinfrastructure Development; Simulation Experiments) 2.Research Production 3.Research Collaboration 4.Human Resource Development (Outreach and Education Activities; Diversity) 5.Sustainability for Future Cyber-Enabled Research and Innovation

*Graduate Students in NG-CHC Research Program *Number of Students Recruited for Project that Persist in STEM 4. HUMAN RESOURCES Year 1Year 2Year 3 NG-CHC Graduate Students Earned Ph.D. 324 Earned Masters 043 Earned Bachelors 020

Numbers of Minorities in Outreach and Education Activities 4. HUMAN RESOURCES Year 1Year 2Year 3 Education Activities (UG/GRA) 3 women 4 URM 8 women 7 URM 8 women 3 URM Outreach STEM Bowl 32 URM No report

*Number of Summer Workshops for Junior/Senior High Schools 4. HUMAN RESOURCES Year 1Year 2Year 3 Beowulf (40) Northern Gulf Institute STEM Bowl Scholarship Competition (37) Lockheed Martin IT Day/STEM Bowl Scholarship Competition (1000) STEM Bowl Scholarship Competition Teachers Exploring Coastal Hazards and Resilience (20) Teachers Exploring Coastal Hazards and Resilience Dauphin Island Sea Lab (19 teachers)

*Number of Summer Workshops for Undergraduate/Graduate Students 4. HUMAN RESOURCES Year 1Year 2Year 3 Evidence not explicitly stated Delft3D Tutorial Evidence not explicitly stated USGS National Wetlands Research Center Modeling Teams NG-CHC Student Poster Session (15)

*Number of faculty and staff trained in NG-CHC. *Number of students trained in NC-CHC. *Number of new courses. 4. HUMAN RESOURCES

“AREAS OF SUCCESS” METRICS 1.Cyberinfrastructure Improvement (Cyberinfrastructure Development; Simulation Experiments) 2.Research Production 3.Research Collaboration 4.Human Resource Development (Outreach and Education Activities; Diversity) 5.Sustainability for Future Cyber-Enabled Research and Innovation

*Number of funded research clusters & other organizations established. *Number of researchers and graduate students in each established center. 5. SUSTAINABILITY

Number of Successful Awards from NSF and Other Agencies 5. SUSTAINABILITY $2,604,374 $1,083,000 $210,000 EPA FESD Industry NASA NSF NOAA

“AREAS OF SUCCESS” METRICS 1.Cyberinfrastructure Improvement (Cyberinfrastructure Development; Simulation Experiments) 2.Research Production 3.Research Collaboration 4.Human Resource Development (Outreach and Education Activities; Diversity) 5.Sustainability for Future Cyber-Enabled Research and Innovation