And 170+ member organizationsESIP is supported by | #ESIPfed INDEPENDENT TECHNOLOGY ASSESSMENT WITHIN THE ESIP TESTBED Annie Burgess.

Slides:

Advertisements

Similar presentations

Timeline and Product Development Aug-Oct 2007Recovery Plan completed and adopted Recovery Plan Adaptive Management Framework developed and adopted.

Advertisements

SEE-ECN Meeting, Sarajevo - 15 May 2004 Report on the Regional Seminar on Decentralization in Education 6-7 February 2004.

Pathway to Excellence & Equity September 25, 2007.

Step Into Your Future: Preparing for College. STEP 1: Prepare Yourself Academically STEP 2: Become a Well-Rounded Student STEP 3: Impress for Success.

Beta Testing: The Contractor’s Perspective Trns·port User Group Meeting October 2005.

NSF Merit Review Criteria Revision Background. Established Spring 2010 Rationale: – More than 13 years since the last in-depth review and revision of.

8 1Source: Development of the Next Generation Science Standards Stephen Pruitt, Ph.D., Vice President, Content and Policy Research; Science.

DMM Implementation Teams Institutes of Higher Education.

Open Library Environment Designing technology for the way libraries really work November 19, 2008 ~ ASERL, Atlanta Lynne O’Brien Director, Academic Technology.

History/Government/Social Studies Update December 15, 2011 Don Gifford History/Government/Social Studies.

Webinar #1 The Webinar will begin shortly. Please make sure your phone is muted. (*6 to Mute, #6 to Unmute) 7/3/20151.

Comprehensive Guidance and Counseling

Alternate Assessment on Alternate Achievement Standards Aligned to Common Core State Standards 1.

Slide: 1 27 th CEOS Plenary |Montréal | November 2013 Agenda Item: 15 Chu ISHIDA(JAXA) on behalf of Rick Lawford, GEO Water CoP leader GEO Water.

U.S. Department of the Interior U.S. Geological Survey CDI Webinar Series 2013 Mobile Framework Lorna Schmid, AEI Tim Kern, Fort Collins Science Center.

Matt Moxham EDUC 290. The Idaho Core Teacher Standards are ten standards set by the State of Idaho that teachers are expected to uphold. This is because.

Standardized Discharge Summary Template Project Mary Shanahan, Senior Manager Dr John Edmonds, Clinical Director Medical Informatics.

B ALTIMORE C ITY P UBLIC S CHOOLS District Research Partnerships Jennifer K. Bell-Ellwanger Chief Accountability Officer Office of Achievement and Accountability.

1 Open Library Environment Designing technology for the way libraries really work December 8, 2008 ~ CNI, Washington DC Lynne O’Brien Director, Academic.

EMERGING AS PUBLIC HEALTH POLICY PROFESSIONALS: TRAINEES’ REFLECTIONS ON THE CIHR STRATEGIC TRAINING PROGRAM Tuesday, May 27, 2014.

Is My Organization Ready?  Collaborations and Sustainability.

GEO Work Plan Symposium 2012 ID-05 Resource Mobilization for Capacity Building (individual, institutional & infrastructure)

Test Organization and Management

Ensuring a Quality Workforce Via Skill Standards and Certifications Presented by the Palm Beach County Workforce Development Board.

Alternative Approaches to Collaborative Software Deployment Leveraging Open Source Software Robert R. Downs NASA Socioeconomic.

WHEN TITLE IS NOT A QUESTION N O ‘WE CAN’ WHEN TITLE IS NOT A QUESTION N O ‘WE CAN’ WHEN TITLE IS NOT A QUESTION N O ‘WE CAN’ Identity and Privacy: the.

Continuing Accreditation The Higher Learning Commission provides institutional accreditation through the evaluation of the entire university organization.

Understanding the Higher Education Achievement Report (HEAR) Workshop at the HEA Annual Conference 2013 Dr Erica Morris and Dr Nikki Spalding 3 July 2013.

Kim J. Runk June 4, 2014 Satellite Proving Ground User Readiness Meeting.

Project Focus Academy April 10, 2006 iVocalize Session #1 Click the ALL tab Add a comment in the text block, introducing yourself, your school and your.

ESIP Federation 101 Federation of Earth Science Information Partners July 17, 2012.

October 14, 2003NSDL All Projects Meeting Federation of Earth Science Information Partners: An Organization that Promotes and Facilitates Collaboration.

Building and Recognizing Quality School Systems DISTRICT ACCREDITATION © 2010 AdvancED.

Effective Professional Development through Distance Technology John LaMaster IU-IMI Web Technology Coordinator.

Overview of Indiana’s Alternate Assessment October 2014 Karen Stein, IDOE.

Where We Are Now 14–2. Where We Are Now 14–2 Major Tasks of Project Closure Evaluate if the project delivered the expected benefits to all stakeholders.

Robert M. Summers, Ph.D. September 16, 2015 How can we make sure the Chesapeake Bay Restoration really works?

Review and Revision of the Nebraska Mathematics Standards DL Session – Jan 20, 2015 ESUs.

Building the LTER Network Information System. NIS History, Then and Now YearMilestone 1993 – 1996NIS vision formed by Information Managers (IMs) and LTER.

ESIP Vision: “Achieve a sustainable world” by Serving as facilitator and advisor for the Earth science information community Promoting efficient flow of.

Joint Meeting of the AUS, US, XS Working Groups TG10 Tuesday August 3, hrs Elwood II.

Moving Title IA School Plans into Indistar ESEA Odyssey Summer 2015 Presented by Melinda Bessner Oregon Department of Education.

TEN-T Executive Agency and Project Management Anna LIVIERATOU-TOLL TEN-T Executive Agency Senior Programme and Policy Coordinator European Economic and.

NSDI Strategic Plan Update National Geospatial Advisory Committee Meeting December 11, 2013.

Workshop For Reviewers Operating the Developmental Engagements Prof. Dr. Hala SalahProf. Dr. Hoda ELTalawy.

© BLR ® —Business & Legal Resources 1408 Teambuilding for All Employees.

A Division of the American Library Association Presentation copyright © 1999 American Association of School.

Report of the 6 th GEOSS Evaluation Presentation to GEO-XII 11 November 2015 John Adamec Co-Chair GEO Monitoring & Evaluation Working Group.

Unit 8: Implementation, Part II Seminar Wednesday pm ET.

NSDI Strategic Plan Update August NSDI Strategic Plan – Purpose/Scope Purpose: Develop a concise, updated strategic plan to guide the Federal government’s.

Information Quality Cluster - Introduction H. K. (Rama) Ramapriyan Science Systems and Applications, Inc. & NASA Goddard Space Flight Center David Moroni.

National Geospatial Advisory Committee State of the Committee National Geospatial Advisory Committee May 2009.

PESB Standards Standard 4: Program Design. How Standards are Judged Standards are deemed unmet, met or exemplary. A standard is deemed ‘met’ if: A program.

Association of Enterprise Architects International Committee on Enterprise Architecture Standards Jan 23, Collaborative Expedition Workshop #57aeajournal.org.

AdaptNRM Adaptation information for NRM planning Lilly Lim-Camacho 10 September 2014 Image: River, by L Gener, Credits: SA MDB,

Larry Fazzari Program Supervisor k12.wa.us 1 TITLE I, PART A PROGRAMS SCHOOLWIDE VS. TARGETED

Success on the Ground The State’s Role in Facilitative Leadership by Lauri Wilson, MS & Ron Chapman, MSW.

The VCCS Administrative & Professional Faculty Development, Evaluation, and Recognition System Task Force Report March, 2016.

Federation of Earth Science Information Partners EGIDA Workshop May 9-11, 2011, Bonn, Germany.

A. Rosenqvist, S. Yabe-Ogawa SDCG-10 Session #4 Element 3 Space Data Support to GFOI R&D.

PresQT Workshop, Tuesday, May 2, 2017

Update from the Faster Payments Task Force

Vietnam Development Partnership Forum

A Step by step guidance for permitting and inspection

Making Data Matter: Earth Science Information Partners

Pupil Health & Well-Being External evaluation

Alignment of curriculum, instruction and classroom assessments

Street Manager High-level roadmap

Designing a student services ecosystem for Gillings’ students Kathy Anderson, Assoc Dean for IT and Project Planning October 2018.

Presentation transcript:

and 170+ member organizationsESIP is supported by | #ESIPfed INDEPENDENT TECHNOLOGY ASSESSMENT WITHIN THE ESIP TESTBED Annie Burgess 1, Erin Robinson 1 and John Graybeal 2 1 ESIP, 2 Stanford University

EVALUATION NEED Earth sciences technologies benefits from diverse perspectives and end-user input.

BACKGROUND NASA’s Advanced Information Systems Technology (AIST) Program supports information technology development. A Technology Readiness Level (TRL) is used to assess project maturity. TRL assessment is internal only. Research to operations transitions have suffered from surprises in technology adoption.

BACKGROUND NASA’s Advanced Information Systems Technology (AIST) Program supports information technology development. A Technology Readiness Level (TRL) is used to assess project maturity. TRL assessment is internal only. Research to operations transitions have suffered from surprises in technology adoption.

ESIP/AIST COLLABORATION ESIP was tasked with: Providing an independent assessment of AIST project TRL. Identifying opportunities/roadblocks for project infusion within the broader Earth science community.

EVALUATION GOALS Achieve consistency, traceability and defensibility of evaluation results. Be recognized as comprehensive and fair. Provide a valuable experience for PIs and project evaluators.

EVALUATION COMPONENTS

TIMELINE Lead TimeAug 1Aug 15Sep 1Sep 15Oct 1Oct 15Nov 1Nov 15Dec 1 Project Selection PI Communications Evaluator Selection Intro. Telcons + Planning Testing Period Evaluators Final Report Prep. ESIP Final Report Prep. Reports Submitted to AIST AIST ESIP Evaluators

WORKFLOW ESIP Edits and Submits Reports to AIST Evaluators Submit Final Report Content Evaluators Fill Out Evaluation Structure Evaluators Carry Out Testing Evaluators/AIST PIs Create Test Plan ESIP Selects Evaluators AIST Selects Projects 8 Evaluators: - 1 Private Sector - 1 Non-Profit - 2 Federal Government - 4 Academic 3 Projects - ESIP solicits suggestions from PI. - ESIP reaches out to community.

WORKFLOW ESIP Edits and Submits Reports to AIST Evaluators Submit Final Report Content Evaluators Fill Out Evaluation Structure Evaluators Carry Out Testing Evaluators/AIST PIs Create Test Plan ESIP Selects Evaluators AIST Selects Projects Access Restrictions Software Readiness 1-2 Telecons

WORKFLOW ESIP Edits and Submits Reports to AIST Evaluators Submit Final Report Content Evaluators Fill Out Evaluation Structure Evaluators Carry Out Testing Evaluators/AIST PIs Create Test Plan ESIP Selects Evaluators AIST Selects Projects Checklist for software development best practices

CHECKLIST FOR SOFTWARE DEVELOPMENT BEST PRACTICES Supportability Portability Testability Accessibility Community Governance Licensing Copyright Installability Buildability Learnability Documentation Understandability Friendliness 200+ questions about software development

Supportability Portability Testability Accessibility Community Governance Licensing Copyright Installability Buildability Learnability Documentation Understandability Friendliness 200+ questions about software development CHECKLIST FOR SOFTWARE DEVELOPMENT BEST PRACTICES

WORKFLOW ESIP Edits and Submits Reports to AIST Evaluators Submit Final Report Content Evaluators Fill Out Evaluation Structure Evaluators Carry Out Testing Evaluators/AIST PIs Create Test Plan ESIP Selects Evaluators AIST Selects Projects Content was KEY! - AIST Reviews Reports - PIs receive Final Reports

EXAMPLE FINAL REPORT

FEEDBACK FROM EVALUATORS + Multiple communication choices. + Compensation. + Selecting evaluators from potential infusion sites. -Short evaluation period lead time. -Software best-practices checklist overly complex.

LESSONS LEARNED Start evaluation with a technical exchange meeting. – Motivation – Challenges (Technology access) – Infusion Potential Diversify evaluation teams with domain and technical expertise. Give PI option to review report BEFORE going to AIST. Manage privacy on PI/Evaluator communications. Each evaluation will be different, coordination and communication are KEY!

OUTLOOK Provide the Earth sciences community with a novel, needed evaluation framework to improve technology development and infusion potential.

PARTICIPANTS Evaluators PIs

COMMUNITY FEEDBACK

THANK YOU! Contact: and 170+ member organizationsESIP is supported by | #ESIPfed