AMMOS-PDS Pipeline Service (APPS) NASA-Planetary Data System Management Council Meeting Berkeley, CA November 18, 2014 Costin Radulescu *, Steve Spohn.

Slides:

Advertisements

Similar presentations

CACORE TOOLS FEATURES. caCORE SDK Features caCORE Workbench Plugin EA/ArgoUML Plug-in development Integrated support of semantic integration in the plugin.

Advertisements

Future of NIEM Tools Delivery Public Sector NIEM Team, July 2012 Futureof NIEM Tools.

July 07, 2011 Oracle Apps Workflow Process. 2 Mission Work flow Integrating your Self Service Application Workflow with Microsoft Exchange.

Semantics and Information Exchanges Overview – Public Sector NIEM Team, June 2011 CAM Test Model Data Deploy Requirements Build Exchange Generate Dictionary.

1 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

Surfing the Data Standards: Colorado’s Path 2012 MIS Conference – San Diego Daniel Domagala, Colorado Department of Education David Butter, Deloitte Consulting.

ICS (072)Database Systems: A Review1 Database Systems: A Review Dr. Muhammad Shafique.

Building Enterprise Applications Using Visual Studio ®.NET Enterprise Architect.

An Agent-Oriented Approach to the Integration of Information Sources Michael Christoffel Institute for Program Structures and Data Organization, University.

Microsoft Office Open XML Formats Brian Jones Lead Program Manager Microsoft Corporation.

The ARTIST project Add name here / institution presentation event / date Advanced software-based seRvice provisioning and migraTIon of legacy SofTware.

XML Exchange Development CAM Technology Tutorial – Public Sector NIEM Team, June 2011 CAM Test Model Data Deploy Requirements Build Exchange Generate Dictionary.

Esri International User Conference | San Diego, CA Technical Workshops | Esri Tracking Solutions: Working with real-time data Adam Mollenkopf David Kaiser.

Session Objectives And Takeaways Identify the role of Service Manager in the System Center suite Service Manager - Integrating People, Process and Technology.

Michael Solomon Tugboat Software Managing the Software Development Process.

©2011 Quest Software, Inc. All rights reserved. Steve Walch, Senior Product Manager Blog: November, 2011 Partner Training Webcast.

System Design/Implementation and Support for Build 2 PDS Management Council Face-to-Face Mountain View, CA Nov 30 - Dec 1, 2011 Sean Hardman.

InSight Archive Status Ed Guinness and Susie Slavney PDS Geosciences Node PDS Management Council Berkeley, California November 18-19, 2014.

ArcGIS Workflow Manager An Introduction

Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 Quick Tutorial – Part 1 Using Oracle BPM with Open Data Web Services David Webber.

C Copyright © 2009, Oracle. All rights reserved. Appendix C: Service-Oriented Architectures.

Thirteenth Lecture Hour 8:30 – 9:20 am, Sunday, September 16 Software Management Disciplines Process Automation (from Part III, Chapter 12 of Royce’ book)

© 2010 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Adobe Flash Catalyst for Agile Interaction Design Harish Sivaramakrishnan |

Web Services for Earth Science Data Edward Armstrong, Thomas Huang, Charles Thompson, Nga Quach, Richard Kim, Zhangfan Xing Winter ESIP 2014 Washington.

David Webber, NIEM Team, Oracle Public Sector Rapid NIEM XML Exchange Design, Semantics and UML Models NIEM Test Model Data Deploy Requirements Build Exchange.

Interfacing Registry Systems December 2000.

Oracle Application Express. Program Agenda Oracle Application Express Overview Use Cases Key Features Packaged Applications Packaging Pricing Call to.

Introduction to the ESA Planetary Science Archive  Jose Luis Vázquez (ESAC/ESA)  Dave Heather (ESTEC/ESA)  Joe Zender (ESTEC/ESA)

DEV-05: Ratcheting up your OpenEdge™ Development Productivity Sunil S Belgaonkar Principal Software Engineer.

1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.

Page 1 WWRF Briefing WG2-br2 · Kellerer/Arbanowski · · 03/2005 · WWRF13, Korea Stefan Arbanowski, Olaf Droegehorn, Wolfgang.

PDS4 Tool Development Strategy PDS Management Council Meeting November 18, 2014 Dan Crichton.

PDS4 and Build 5a Update Dan Crichton, Emily Law November

1 Geospatial and Business Intelligence Jean-Sébastien Turcotte Executive VP San Francisco - April 2007 Streamlining web mapping applications.

ICS (072)Database Systems: An Introduction & Review 1 ICS 424 Advanced Database Systems Dr. Muhammad Shafique.

PDS Geosciences Node Page 1 Archiving Mars Mission Data Sets with the Planetary Data System Report to MEPAG Edward A. Guinness Dept. of Earth and Planetary.

James Akrigg Microsoft Ltd Integrating InfoPath Forms Into Workflow Solutions And Business Processes.

Techcello Provides SaaS Lifecycle Management Solution to “SaaS-ify” Your Application Efficiently on the Powerful Microsoft Azure Cloud Platform MICROSOFT.

PDS4 Project Report PDS MC F2F Columbia, MD Dan Crichton April 2-3,

06/30/ Data Product Service (DPS) Packaging and Context Dan Crichton Steve Hughes Ron Joyner Chris Mattman Paul Ramirez Peter Shames.

Label Design Tool Management Council F2F Washington, D.C. November 29-30, 2006

Standards for Technology in Automotive Retail STAR Update Michelle Vidanes STAR XML Data Architect April 30 th, 2008.

PDS M/C August 2012 PPI Node Report PDS Management Council August 28-29, 2012 R. J. Walker S. P. Joy T.A. King J. Mafi.

System Design and Deployment Status PDS Management Council Face-to-Face UCLA, Los Angeles, California November 28-29, 2012 Sean Hardman.

User Profiling using Semantic Web Group members: Ashwin Somaiah Asha Stephen Charlie Sudharshan Reddy.

Revolutionized, Automated Cash and Gratuity Management for the Hospitality Industry, Thanks to Microsoft Azure MICROSOFT AZURE APP BUILDER PROFILE: Evention.

PDS Geosciences Node Page 1 Archiving LCROSS Ground Observation Data in the Planetary Data System Edward Guinness and Susan Slavney PDS Geosciences Node.

Software Development and Deployment PDS Management Council Face-to-Face Los Angeles, California August 26-27, 2014 Sean Hardman.

Barry Weiss 1/4/ Jet Propulsion Laboratory, California Institute of Technology Quality Elements in ISO Metadata Design for Proposed SMAP Data.

August 2003 At A Glance The IRC is a platform independent, extensible, and adaptive framework that provides robust, interactive, and distributed control.

System/SDWG Update Management Council Face-to-Face Flagstaff, AZ August 22-23, 2011 Sean Hardman.

THE 1 ST NATIONAL PUC DOCKETS DATABASE: AEE POWERSUITE Eric Fitz Director, Engineering and Product Development NARUC Subcommittee on Information Services.

Open Spatial Adds Scalable Functionality to As Constructed Design Certification Validation Portal Using Microsoft Azure MICROSOFT AZURE APP BUILDER PROFILE:

A Technical Overview Bill Branan DuraCloud Technical Lead.

Software Development and Deployment PDS Management Council Face-to-Face Berkeley, California November 18-19, 2014 Sean Hardman.

PDS4 Demonstration Management Council Face-to-Face Flagstaff, AZ August 22-23, 2011 Sean Hardman.

PDS4 Build 3b System Readiness PDS Management Council Face-to-Face Columbia, Maryland April 2-3, 2013 Sean Hardman.

March 2004 At A Glance The AutoFDS provides a web- based interface to acquire, generate, and distribute products, using the GMSEC Reference Architecture.

PDS4 Project Report PDS MC F2F University of Maryland Dan Crichton March 27,

Physical Oceanography Distributed Active Archive Center THUANG June 9-13, 20089th GHRSST-PP Science Team Meeting GHRSST GDAC and EOSDIS PO.DAAC.

Sharepoint-Biztalk Integration with Multiple Transport protocols Jin Thakur

IPDA Architecture Project International Planetary Data Alliance IPDA Architecture Project Report.

IPDA PDS4 Report July 17, PDS4: The Next Generation PDS PDS4 is a PDS-wide project to upgrade from PDS version 3 to version 4 to address many.

Statistics Estonia's new system for statistical data activity processing (VAIS) ITDG Luxembourg 2010 Allan Randlepp.

International Planetary Data Alliance Registry Project Update September 16, 2011.

DreamFactory for Microsoft Azure Is an Open Source REST API Platform That Enables Mobilization of Data in Minutes across Frameworks and Storage Methods.

Costin Radulescu Steve Spohn 26 August, 2014

Couchbase Server is a NoSQL Database with a SQL-Based Query Language

Cloud optimized preprocessing and Data Transformation Demonstration

Jeff Hollan / Kevin Lam Program Manager / Principal Program Manager- Microsoft Bringing Logic Apps into DevOps with Visual Studio and monitoring.

Presentation transcript:

AMMOS-PDS Pipeline Service (APPS) NASA-Planetary Data System Management Council Meeting Berkeley, CA November 18, 2014 Costin Radulescu *, Steve Spohn * * Jet Propulsion Laboratory, California Institute of Technology © All rights reserved.

ISSUESSOLUTIONS Early detection of problems in the science product labels (as early as they are generated). APPS Validation, Reporting -Most (“all”) problems can be fixed by the PDS delivery date because they were identified early. Product SIS not in sync with the PDS4 model. APPS LDT -GUI to enable easy Mission label (dictionary) creation. (no XML experience required) -Eliminates the split between an ops and an archive label. Manual Archive Volume Generation. APPS Bundle Service -Eliminates the problem of manually creating archive volumes during operations (manual process, very tedious) -Uses BPMN standard to specify and extend (if necessary) the process of creating bundles. PDS4 Transition arduous.APPS LDT, Transformation, Validation, Bundle -“I am so glad we have a tool like this to helps us understand how to navigate through PDS4.”, Payam Zamani, InSight MIPL SE. -Transform PDS3 to (best-effort) PDS4 constructs to provided a starting point for the label design. No common platform for PDS Engineers and Mission Engineers to design, exchange, validate and track science products. APPS Web Console (“webtop”) -All tools can be shared and accessed from a single console/desktop (light-weight, everyone can use ). -Future tools can be added to the platform. -Single sign-on (CAM) provides secure access & information exchange with minimal user intervention. Manual spot checks.Bundle Validation (future) -Complete archive bundle data validation against label information will provided a much better and improved archive product. Why APPS ? © All rights reserved.

APPS Role Partner with PDS to develop a pipeline service that integrates PDS4 tools and standards, and infuses them into the missions, from concept to product delivery into PDS Archive(s). Provide missions with an early view into PDS4 compliance level (as the first products are being generated), allowing adequate time for developers and operations personnel to build and provide a fully PDS compliant science product. © All rights reserved.

Vision © All rights reserved.

Today: APPS Pipeline PDS4 Model Product Generator PDS Archive(s) APPS Web Console Label Design Tool (LDT) Mission Label Data + Label Template Transformation Service Validation Service Report Bundle Builder PDS Component APPS Component Mission Component Legend: Data Access (W10n) Data Access (W10n) Product SIS © All rights reserved.

APPS Components Description LDT Label Design Tool (using PDS4 Model) ( Transformation (transcoder) PDS to PDS to ImageIO and back Using Velocity templates (commonly used PDS4 practice) Validation (using PDS vTool) Generate both XML and JSON reports Reporting (various queries to the APPS database) JSON reports Bundle Builder Using Business Process Model Notation (BPMN 2.0) Standard process definitions. Web Console © All rights reserved.

Technology Profile Infusion of AMMOS technologies as part of the strategic AMMOS goals: APPS PDS Tools CAM CWS W10n © All rights reserved.

Demo Agenda Demo of the following components: 1.APPS LDT  Generate Mission Label.  Generate SIS Appendix. 2.APPS Transform-Validate pipeline  Populate the system with data 3.APPS Reporting  Explore and describe system components 1.Workspace navigation (Web Console) 2.Lookup validation reports, keyword search, generate temporal reports, etc. 3.Webification workspace (W10n), database (NoSQL), message bus (AMQ) 4.Bundle Builder Service 1.BPMN-driven deployment (CWS) 2.Configuration, features 5.Project adaptation(s) © All rights reserved.

APPS Pipeline Demo PDS4 Model Product Generator PDS Archive(s) APPS Web Console Label Design Tool (LDT) Mission Label Data + Label Template Transformation Service Validation Service Report Bundle Builder Data Access (W10n) Data Access (W10n) Product SIS © All rights reserved.

APPS Pipeline Demo PDS4 Model Product Generator PDS Archive(s) APPS Web Console Label Design Tool (LDT) Mission Label Data + Label Template Transformation Service Validation Service Report Bundle Builder Data Access (W10n) Data Access (W10n) Product SIS © All rights reserved.

APPS Pipeline Demo PDS4 Model Product Generator PDS Archive(s) APPS Web Console Label Design Tool (LDT) Mission Label Data + Label Template Transformation Service Validation Service Report Bundle Builder Data Access (W10n) Data Access (W10n) Product SIS © All rights reserved.

APPS Pipeline Demo PDS4 Model Product Generator PDS Archive(s) APPS Web Console Label Design Tool (LDT) Mission Label Data + Label Template Transformation Service Validation Service Report Bundle Builder Data Access (W10n) Data Access (W10n) Product SIS © All rights reserved.

APPS PDS4 Bundle Builder view Document Collection Context Collection Schema Collection Miscellaneous Collection Data Collection Calibration Collection APPS Archive Product Builder Timer On-demand trigger Validation Report(s) Summary Data generation pipeline Bundle Ingest Validation Report © All rights reserved.