HOW TO: Spin Up Apache OODT Faster with RADiX Paul Ramirez & Cameron Goodale NASA – Jet Propulsion Laboratory November 9 th, 2011.

Slides:



Advertisements
Similar presentations
Configuration management
Advertisements

Software change management
Configuration management
Softricity LLC Advance slides with arrow keys. Without PDMLynx Informal processes based upon excel, access, paper files No consistency across organization.
Introduction to Maven 2.0 An open source build tool for Enterprise Java projects Mahen Goonewardene.
PROCESS FRAMEWORK Lecture - 3. Topics covered PROCESS FRAMEWORK PROCESS MODELS DIFFERENCE.
Unveiling ProjectWise V8 XM Edition. ProjectWise V8 XM Edition An integrated system of collaboration servers that enable your AEC project teams, your.
® IBM Software Group © 2010 IBM Corporation What’s New in Profiling & Code Coverage RAD V8 April 21, 2011 Kathy Chan
Test Automation Framework Ashesh Jain 2007EE50403 Manager Amit Maheshwari.
NIEM, CAM and the 7 “D’s” David Webber - Public Sector NIEM Team, November 2011 NIEM Test Model Data Deploy Requirements Build Exchange Generate Dictionary.
Having Your Cake and Eating It Too With Apache OODT and Apache Solr Andrew F. Hart Paul M. Ramirez.
© 2004 Visible Systems Corporation. All rights reserved. 1 (800) 6VISIBLE Holistic View of the Enterprise Business Development Operations.
HyperContent 2.0 JA-SIG Winter Conference December 5, 2005 Alex Vigdor, Columbia University.
Content provided under the terms and conditions of the Eclipse Public License Version Eclipse Foundation - Kathy Chan.
Aug. 20, JPL, SoCalBSI '091 The power of bioinformatics tools in cancer research Early Detection Research Network, JPL Mentors: Dr. Chris Mattmann,
XMAS installation instructions Windows Version: 1.0 4/22/2008.
© 2004, The Trustees of Indiana University 1 OneStart Workflow Basics Brian McGough, Manager, Systems Integration, UITS Ryan Kirkendall, Lead Developer.
CLIMATE SCIENTISTS’ BIG CHALLENGE: REPRODUCIBILITY USING BIG DATA Kyo Lee, Chris Mattmann, and RCMES team Jet Propulsion Laboratory (JPL), Caltech.
BizTalk Deployment using Visual Studio Release Management
Open source administration software for education software development simplified KRAD Kuali Application Development Framework.
IPUMS to IHSN: Leveraging structured metadata for discovering multi-national census and survey data Wendy L. Thomas 4 th Conference of the European Survey.
NASA PKI for PKI FORUM Presenters: Paul Ma, NASA-Ames Research Center
ArcGIS Workflow Manager An Introduction
JWST Integrated Modeling Environment James Webb Space Telescope.
Creating Business Workflow Using SharePoint Designer 2007 Presented by Tarek Ghazali IT Technical Specialist Microsoft SQL Server MVP Microsoft SQL Server.
M. Taimoor Khan * Java Server Pages (JSP) is a server-side programming technology that enables the creation of dynamic,
Interoperability with CMIS and Apache Chemistry
Lesley Bross, August 29, 2010 ArcGIS 10 add-in glossary.
By: Paul Hill Technology Coordinator Gwinn Area Community Schools.
Teaching End User SharePoint Robert Bogue
Copyright © IBM Corp., All rights reserved; made available under the EPL v1.0 | March 20, 2008 | Short Talk Standards based systems management: An.
Geospatial Systems Architecture Todd Bacastow. GIS Evolution
C. Mattmann 1, C. Goodale 1, J. Kim 2, D.E. Waliser 1,2, D. Crichton 1, A. Hart 1, P. Zimdars 1 and Peter Lean* The International Workshop on CORDEX-East.
Magnolia Modules. Architecture Web Application (WAR) Magnolia CoreGUICache Modules DMS 2.3Data 1.1Scheduler Custom Project Base 2.2 Project.
Natural Resource Program Center Data Manager’s Conference Data Store and NatureBib April 3, 2008 Brent Frakes.
Introduction to Apache OODT Yang Li Mar 9, What is OODT Object Oriented Data Technology Science data management Archiving Systems that span scientific.
Configuration Management (CM)
INFSOM-RI Juelich, 10 June 2008 ETICS - Maven From competition, to collaboration.
SharePoint Workflows with Visual Studio Stuart Cox RBA Consulting techpunch.wordpress.com.
Introduction to Nutch CSCI 572: Information Retrieval and Search Engines Summer 2010.
HyperContent 2.0 Common Solutions Group September 21, 2005 Alex Vigdor, Columbia University.
Shakeh Elisabeth Khudikyan NASA Jet Propulsion Laboratory, California Institute of Technology A Look at Apache OODT Balance Framework.
Distributed Java Programming Distributed Java Programming Setting up a Java Development Environment.
The Roadmap to Software Factories Tools, Patterns and Frameworks.
Software Engineering Prof. Ing. Ivo Vondrak, CSc. Dept. of Computer Science Technical University of Ostrava
Leveraging Globus Services to Support Climate Model Data Access Through the Earth System Grid Federation (ESGF) Brian Knosp 1, Luca Cinquini 1, Lukasz.
Geospatial Systems Architecture Todd Bacastow. Views of a System Architecture Enterprise Information Computational Engineering Technology.
National Aeronautics and Space Administration Jet Propulsion Laboratory California Institute of Technology Pasadena, California EDGE: The Multi-Metadata.
Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.
Figure 11.1 The overlap of DMS and PDM functions. © 2003 Crnkovic, Asklund, Persson Dahlqvist, ”Implementing and Integrating Product Data Management and.
GLite build and integration system Building and Packaging Robert HARAKALY
Software Deployment & Release 26/03/2015 1EN-ICE.
Future of Distributed Production in US Facilities Kaushik De Univ. of Texas at Arlington US ATLAS Distributed Facility Workshop, Santa Cruz November 13,
Integrated Modeling Environment System Engineering Seminar Johnny Medina / Code 531 Chris Stone / Code 531 / Constellation Software Engineering.
Briefing and Planning meeting on INSPIRE validator implementation – Discussion 16/12/2015.
Physical Oceanography Distributed Active Archive Center THUANG June 9-13, 20089th GHRSST-PP Science Team Meeting GHRSST GDAC and EOSDIS PO.DAAC.
Maven. Introduction Using Maven (I) – Installing the Maven plugin for Eclipse – Creating a Maven Project – Building the Project Understanding the POM.
Meeting of the Member States Expert Group on Digitisation and Digital Preservation , Luxembourg European Archival Records and Knowledge Preservation.
Statistics Estonia's new system for statistical data activity processing (VAIS) ITDG Luxembourg 2010 Allan Randlepp.
The Earth System Curator Metadata Infrastructure for Climate Modeling Rocky Dunlap Georgia Tech.
TOWARDS AN ARCHITECTURE FOR NATIONAL DATA SERVICES Ian Foster Director, Computation Institute Argonne National Laboratory & The University of
SharePoint 101 – An Overview of SharePoint 2010, 2013 and Office 365
Agenda:- DevOps Tools Chef Jenkins Puppet Apache Ant Apache Maven Logstash Docker New Relic Gradle Git.
An introduction to MEDIN Data Guidelines September 2016
Document & Web Content Management
Carbon Dioxide and GIS CO2 Virtual Science Data Environment
An introduction to MEDIN Data Guidelines.
A technical look at new capabilities and features
iCrawl – Master Thesis and Hiwi Jobs
ArcGIS Workflow Manager Getting Started with Out-of-the-Box Templates
Presentation transcript:

HOW TO: Spin Up Apache OODT Faster with RADiX Paul Ramirez & Cameron Goodale NASA – Jet Propulsion Laboratory November 9 th, 2011

Our Background  Cameron Goodale  NASA – Jet Propulsion Laboratory (6 years)  Software Engineer  Your area of interest Geospatial / Data Visualization Python Working on my Road Racing License  Paul Ramirez  NASA – Jet Propulsion Laboratory (10 years)  Software Engineer  Your area of interest Geospatial Search Java My family (wife, son, 2 dogs)

Roadmap  Apache OODT – Brief Intro  Working With OODT  What is RADiX  Technical Details  RADiX your next OODT Deployment

Apache OODT  Data Management System (DMS) Framework  History at JPL  Medical, Astronomy, Climate Research, etc…  Collection of Loosely Coupled Components  Crawler  File Manager  Workflow  Driven by Metadata and Product Types

Working With OODT Now  Download the source and build  Grab one of the component distribution tarballs  Install and Configure  Repeat for each component you want  For our webapps grab the war and configure  User ensures that configuration matches across components  Launch each of the components individually

Using OODT  Crawler Actions  Metadata Extractors  Versioners  Tasks  Configuration  Crawler Policy  FileManager Policy  Workflow Policy  PGE (Product Generation Executive) Configuration

RADiX What and Why  Distribution of Apache OODT  Define deployment and development  Reduce ramp up time  Eliminate confusion with documentation  Eliminate some configuration  Focus on data management  Focus on component extensions  Bored of repeating  Create shared experience

RADiX Technical Details  Uses Apache Maven 2.2  Maven Archetype  Used to drive creation of a template OODT project  Resultant project can be used for development  Maven Assembly Descriptor

OODT RADiX in Action % wget % tar –xzvf radix-0.4.tgz % export PATH=${PATH}:/usr/local/radix % oodt-radix my-oodt-dms my.package.name %./deploy/bin/oodt_pcs start % ls deploy mvn-repo my-oodt-dms

What did that give me?  Deployment of OODT  Sample configuration to show things in action  Development structure that you can check in  That’s it for now

Closing Remarks  Available in OODT 0.4  Worked under OODT-140  y/OODT/RADiX+Powered+By+OODT  Future Work  Screencasts  Integrate more components  More documentation and links to existing  Promote deploying with RADiX

Contact  Cameron  Paul