Presentation is loading. Please wait.

Presentation is loading. Please wait.

And 170+ member organizationsESIP is supported by | #ESIPfed INDEPENDENT TECHNOLOGY ASSESSMENT WITHIN THE ESIP TESTBED Annie Burgess.

Published byMariah Malone Modified over 8 years ago

Similar presentations

Presentation on theme: "And 170+ member organizationsESIP is supported by | #ESIPfed INDEPENDENT TECHNOLOGY ASSESSMENT WITHIN THE ESIP TESTBED Annie Burgess."— Presentation transcript:

1 and 170+ member organizationsESIP is supported by www.esipfed.org @ESIPfed | #ESIPfed INDEPENDENT TECHNOLOGY ASSESSMENT WITHIN THE ESIP TESTBED Annie Burgess 1, Erin Robinson 1 and John Graybeal 2 1 ESIP, 2 Stanford University

2 EVALUATION NEED Earth sciences technologies benefits from diverse perspectives and end-user input.

3 BACKGROUND NASA’s Advanced Information Systems Technology (AIST) Program supports information technology development. A Technology Readiness Level (TRL) is used to assess project maturity. TRL assessment is internal only. Research to operations transitions have suffered from surprises in technology adoption.

4 BACKGROUND NASA’s Advanced Information Systems Technology (AIST) Program supports information technology development. A Technology Readiness Level (TRL) is used to assess project maturity. TRL assessment is internal only. Research to operations transitions have suffered from surprises in technology adoption.

5 ESIP/AIST COLLABORATION ESIP was tasked with: Providing an independent assessment of AIST project TRL. Identifying opportunities/roadblocks for project infusion within the broader Earth science community.

6 EVALUATION GOALS Achieve consistency, traceability and defensibility of evaluation results. Be recognized as comprehensive and fair. Provide a valuable experience for PIs and project evaluators.

7 EVALUATION COMPONENTS

8

9 TIMELINE Lead TimeAug 1Aug 15Sep 1Sep 15Oct 1Oct 15Nov 1Nov 15Dec 1 Project Selection PI Communications Evaluator Selection Intro. Telcons + Planning Testing Period Evaluators Final Report Prep. ESIP Final Report Prep. Reports Submitted to AIST AIST ESIP Evaluators

10 WORKFLOW ESIP Edits and Submits Reports to AIST Evaluators Submit Final Report Content Evaluators Fill Out Evaluation Structure Evaluators Carry Out Testing Evaluators/AIST PIs Create Test Plan ESIP Selects Evaluators AIST Selects Projects 8 Evaluators: - 1 Private Sector - 1 Non-Profit - 2 Federal Government - 4 Academic 3 Projects - ESIP solicits suggestions from PI. - ESIP reaches out to community.

11 WORKFLOW ESIP Edits and Submits Reports to AIST Evaluators Submit Final Report Content Evaluators Fill Out Evaluation Structure Evaluators Carry Out Testing Evaluators/AIST PIs Create Test Plan ESIP Selects Evaluators AIST Selects Projects Access Restrictions Software Readiness 1-2 Telecons

12 WORKFLOW ESIP Edits and Submits Reports to AIST Evaluators Submit Final Report Content Evaluators Fill Out Evaluation Structure Evaluators Carry Out Testing Evaluators/AIST PIs Create Test Plan ESIP Selects Evaluators AIST Selects Projects Checklist for software development best practices

13 CHECKLIST FOR SOFTWARE DEVELOPMENT BEST PRACTICES Supportability Portability Testability Accessibility Community Governance Licensing Copyright Installability Buildability Learnability Documentation Understandability Friendliness 200+ questions about software development

14 Supportability Portability Testability Accessibility Community Governance Licensing Copyright Installability Buildability Learnability Documentation Understandability Friendliness 200+ questions about software development CHECKLIST FOR SOFTWARE DEVELOPMENT BEST PRACTICES

15 WORKFLOW ESIP Edits and Submits Reports to AIST Evaluators Submit Final Report Content Evaluators Fill Out Evaluation Structure Evaluators Carry Out Testing Evaluators/AIST PIs Create Test Plan ESIP Selects Evaluators AIST Selects Projects Content was KEY! - AIST Reviews Reports - PIs receive Final Reports

16 EXAMPLE FINAL REPORT

17 FEEDBACK FROM EVALUATORS + Multiple communication choices. + Compensation. + Selecting evaluators from potential infusion sites. -Short evaluation period lead time. -Software best-practices checklist overly complex.

18 LESSONS LEARNED Start evaluation with a technical exchange meeting. – Motivation – Challenges (Technology access) – Infusion Potential Diversify evaluation teams with domain and technical expertise. Give PI option to review report BEFORE going to AIST. Manage privacy on PI/Evaluator communications. Each evaluation will be different, coordination and communication are KEY!

19 OUTLOOK Provide the Earth sciences community with a novel, needed evaluation framework to improve technology development and infusion potential.

20 PARTICIPANTS Evaluators PIs

21 COMMUNITY FEEDBACK

22 THANK YOU! Contact: annieburgess@esipfed.org and 170+ member organizationsESIP is supported by www.esipfed.org @ESIPfed | #ESIPfed

Download ppt "And 170+ member organizationsESIP is supported by | #ESIPfed INDEPENDENT TECHNOLOGY ASSESSMENT WITHIN THE ESIP TESTBED Annie Burgess."

Similar presentations

Timeline and Product Development Aug-Oct 2007Recovery Plan completed and adopted 2007-2008Recovery Plan Adaptive Management Framework developed and adopted.

Timeline and Product Development Aug-Oct 2007Recovery Plan completed and adopted Recovery Plan Adaptive Management Framework developed and adopted.
SEE-ECN Meeting, Sarajevo - 15 May 2004 Report on the Regional Seminar on Decentralization in Education 6-7 February 2004.

SEE-ECN Meeting, Sarajevo - 15 May 2004 Report on the Regional Seminar on Decentralization in Education 6-7 February 2004.
Pathway to Excellence & Equity September 25, 2007.

Pathway to Excellence & Equity September 25, 2007.
Step Into Your Future: Preparing for College. STEP 1: Prepare Yourself Academically STEP 2: Become a Well-Rounded Student STEP 3: Impress for Success.

Step Into Your Future: Preparing for College. STEP 1: Prepare Yourself Academically STEP 2: Become a Well-Rounded Student STEP 3: Impress for Success.
Beta Testing: The Contractor’s Perspective Trns·port User Group Meeting October 2005.

Beta Testing: The Contractor’s Perspective Trns·port User Group Meeting October 2005.
NSF Merit Review Criteria Revision Background. Established Spring 2010 Rationale: – More than 13 years since the last in-depth review and revision of.

NSF Merit Review Criteria Revision Background. Established Spring 2010 Rationale: – More than 13 years since the last in-depth review and revision of.
8 1Source: Development of the Next Generation Science Standards Stephen Pruitt, Ph.D., Vice President, Content and Policy Research; Science.

8 1Source: Development of the Next Generation Science Standards Stephen Pruitt, Ph.D., Vice President, Content and Policy Research; Science.
DMM Implementation Teams Institutes of Higher Education.

DMM Implementation Teams Institutes of Higher Education.
Open Library Environment Designing technology for the way libraries really work November 19, 2008 ~ ASERL, Atlanta Lynne O’Brien Director, Academic Technology.

Open Library Environment Designing technology for the way libraries really work November 19, 2008 ~ ASERL, Atlanta Lynne O’Brien Director, Academic Technology.
History/Government/Social Studies Update December 15, 2011 Don Gifford History/Government/Social Studies.

History/Government/Social Studies Update December 15, 2011 Don Gifford History/Government/Social Studies.
Webinar #1 The Webinar will begin shortly. Please make sure your phone is muted. (*6 to Mute, #6 to Unmute) 7/3/20151.

Webinar #1 The Webinar will begin shortly. Please make sure your phone is muted. (*6 to Mute, #6 to Unmute) 7/3/20151.
Comprehensive Guidance and Counseling

Comprehensive Guidance and Counseling
Alternate Assessment on Alternate Achievement Standards Aligned to Common Core State Standards 1.

Alternate Assessment on Alternate Achievement Standards Aligned to Common Core State Standards 1.
Slide: 1 27 th CEOS Plenary |Montréal | 5 - 6 November 2013 Agenda Item: 15 Chu ISHIDA(JAXA) on behalf of Rick Lawford, GEO Water CoP leader GEO Water.

Slide: 1 27 th CEOS Plenary |Montréal | November 2013 Agenda Item: 15 Chu ISHIDA(JAXA) on behalf of Rick Lawford, GEO Water CoP leader GEO Water.
U.S. Department of the Interior U.S. Geological Survey CDI Webinar Series 2013 Mobile Framework Lorna Schmid, AEI Tim Kern, Fort Collins Science Center.

U.S. Department of the Interior U.S. Geological Survey CDI Webinar Series 2013 Mobile Framework Lorna Schmid, AEI Tim Kern, Fort Collins Science Center.
Matt Moxham EDUC 290. The Idaho Core Teacher Standards are ten standards set by the State of Idaho that teachers are expected to uphold. This is because.

Matt Moxham EDUC 290. The Idaho Core Teacher Standards are ten standards set by the State of Idaho that teachers are expected to uphold. This is because.
Standardized Discharge Summary Template Project Mary Shanahan, Senior Manager Dr John Edmonds, Clinical Director Medical Informatics.

Standardized Discharge Summary Template Project Mary Shanahan, Senior Manager Dr John Edmonds, Clinical Director Medical Informatics.
B ALTIMORE C ITY P UBLIC S CHOOLS District Research Partnerships Jennifer K. Bell-Ellwanger Chief Accountability Officer Office of Achievement and Accountability.

B ALTIMORE C ITY P UBLIC S CHOOLS District Research Partnerships Jennifer K. Bell-Ellwanger Chief Accountability Officer Office of Achievement and Accountability.
1 Open Library Environment Designing technology for the way libraries really work December 8, 2008 ~ CNI, Washington DC Lynne O’Brien Director, Academic.

1 Open Library Environment Designing technology for the way libraries really work December 8, 2008 ~ CNI, Washington DC Lynne O’Brien Director, Academic.
EMERGING AS PUBLIC HEALTH POLICY PROFESSIONALS: TRAINEES’ REFLECTIONS ON THE CIHR STRATEGIC TRAINING PROGRAM Tuesday, May 27, 2014.

EMERGING AS PUBLIC HEALTH POLICY PROFESSIONALS: TRAINEES’ REFLECTIONS ON THE CIHR STRATEGIC TRAINING PROGRAM Tuesday, May 27, 2014.

Similar presentations

Ads by Google