Imaging Node Lisa Gaddis/Sue LaVoie PDSMC Face-to-Face Meeting Westwood, CA - UCLA 26, 27 August 2014.

Slides:



Advertisements
Similar presentations
Navigation and Ancillary Information Facility NIF The NAIF Node PDSMC Report Addresses both NAIF Node and Core SPICE Development August 23, 2011 Chuck.
Advertisements

LADEE PDS4 Experience G. Delory LADEE Instrument and PDS Teams LADEE SOC PDS Management Council Nov /19/2014 LADEE PDS4 Experience 1.
CIRS Data Archiving Status Presentation to the Cassini CIRS Team Meudon, France - April 2004 Conor A Nixon (University of Maryland) Mike Flasar (NASA GSFC)
PPI Node Report Raymond J. Walker Steven P. Joy Todd A. King PDS Management Council March 25, 2010.
March 2010 PDS Imaging Node 1 NASA PDS Imaging Node: NASA PDS Imaging Node: Digital Data Archives and Distribution Archiving and distributing data and.
System Design/Implementation and Support for Build 2 PDS Management Council Face-to-Face Mountain View, CA Nov 30 - Dec 1, 2011 Sean Hardman.
Working with Info Tech, Inc. Teresa Franklin Trnsport Product Manager November 6, 2005 A Primer for Trnsport Users.
P l a n e t a r y D a t a S y s t e m 1 Data Integrity Compilation Data Integrity Compilation Presented by: Al Schultz Location: PDS Management Council.
Data Compression for PDS4 Lisa Gaddis, Sue LaVoie, Jeff Anderson, Elizabeth Rye PDS Imaging Node March 26, 2010.
PDSMC March 29, Status of New Services at the PDS Imaging Node: Atlas II, Map-a-Planet, and the Unified Planetary Coordinates Database Lisa Gaddis.
InSight Archive Status Ed Guinness and Susie Slavney PDS Geosciences Node PDS Management Council Berkeley, California November 18-19, 2014.
Field Project Planning, Operations and Data Services Jim Moore, EOL Field Project Services (FPS) Mike Daniels, EOL Computing, Data and Software (CDS) Facility.
IPDA Update Dan Crichton Tom Stein August 2014 International Planetary Data Alliance.
2-3 April 2009PDS MC Rapid-prototyping tools. 2-3 April 2009PDS MC Rapid-prototyping tools Legend: Gray – Existing tool effort; White – Proposed tool.
MASSACHUSETTS INSTITUTE OF TECHNOLOGY NASA GODDARD SPACE FLIGHT CENTER ORBITAL SCIENCES CORPORATION NASA AMES RESEARCH CENTER SPACE TELESCOPE SCIENCE INSTITUTE.
PDSMC November 29-30, PDS Imaging Node PDS4 Migration Lisa Gaddis (USGS) Sue LaVoie (JPL) November 30, 2012 PDS Management Council Meeting UCLA.
Imaging Node Meeting Atlas II Status and Plans August 2, 2006.
PDS 2010 Project Update Dan Crichton MC Face-to-Face Washington DC March 25-26, 2010.
GEO ADC meeting, Sep 22-23, 2008 Slide # 1 AG AG Forest Mapping and Change Monitoring LoycheWilkie,Mette (FAO) Adam Gerrand (FAO) Ivan Petiteville,
Geosciences Node Ed Guinness MC Face-to-Face Meeting Washington, DC March 27-28, 2012.
Rings Node Mitch Gordon Mark Showalter MC Face-to-Face Meeting Westwood, California 26,27 August 2014.
Thomas C. Stein PDS Geosciences Node Washington University in St. Louis 1MS Supporting Active Surface Missions and Adding Value.
Planetary Science Archive PSA User Group Meeting #1 PSA UG #1  July 2 - 3, 2013  ESAC PSA Archiving Standards.
Rings Node Migration Plan Mark & Mitch PDSMC, UCLA November 28-29, 2012.
PDS4 Tool Development Strategy PDS Management Council Meeting November 18, 2014 Dan Crichton.
PDS4 and Build 5a Update Dan Crichton, Emily Law November
PDS Geosciences Node Page 1 Archiving Mars Mission Data Sets with the Planetary Data System Report to MEPAG Edward A. Guinness Dept. of Earth and Planetary.
Atmospheres Node Report Reta Beebe Nancy Chanover Lyle Huber Lynn Neakrase Jim Murphy Irma Trejo Matias Roybal Shannon Rees.
Label Design Tool Management Council F2F Washington, D.C. November 29-30, 2006
Data Standards and Build 3b Plans Steve Hughes MC Face-to-Face UCLA, Los Angeles, CA November 28-29, 2012.
PDS M/C August 2012 PPI Node Report PDS Management Council August 28-29, 2012 R. J. Walker S. P. Joy T.A. King J. Mafi.
PDS M/C November 2012 PPI Data Migration Planning PPI PDS4 Data Migration Planning PDS Management Council November 28, 2012 T. King.
1 PDS 4 Data Design WG Face-to-Face Summary PDS Management Council March 25, 2010.
Operations Report PDS Management Council Meeting Flagstaff, Arizona August 2006
Data Standards Development August 29, Topics 1.Current Status 2.What was delivered for Build 2c 3.How was IPDA supported 4.What mission support.
PDS/NSSDC Deliveries Dave Williams PDS Management Council Columbia, MD 3 April 2013.
PPI Node R.J. Walker, T.A. King, S.P. Joy, J.N. Mafi MC Face-to-Face Meeting Westwood, California 26 August 2014.
PDS Geosciences Node Page 1 Archive Status MRO and Phoenix Ed Guinness PDS Management Council August 13, 2007 Ed Guinness.
PDS Geosciences Node Page 1 Archiving LCROSS Ground Observation Data in the Planetary Data System Edward Guinness and Susan Slavney PDS Geosciences Node.
Geosciences Node Ed Guinness, Susie Slavney, Tom Stein, Ray Arvidson PDS Management Council UCLA August 26-27, 2014.
Software Development and Deployment PDS Management Council Face-to-Face Los Angeles, California August 26-27, 2014 Sean Hardman.
Development Report Engineering Node August 2006
System/SDWG Update Management Council Face-to-Face Flagstaff, AZ August 22-23, 2011 Sean Hardman.
Cassini Archive Tracking System (CATS) Report Engineering Node November 30, 2006
CD FY09 Tactical Plan Status FY09 Tactical Plan Status Report for Neutrino Program (MINOS, MINERvA, General) Margaret Votava April 21, 2009 Tactical plan.
PDS4 Mission Needs Assessment Reta Beebe Dan Crichton.
1 PDSMC F2F Summary: Lunar Mapping Project Discussion in Houston, TX August 6 & 7, 2007 Lisa Gaddis PDS Imaging Node PDSMC F2F UCLA August
Software Development and Deployment PDS Management Council Face-to-Face Berkeley, California November 18-19, 2014 Sean Hardman.
Small Bodies Node Ludmilla Kolokolova Carol Neese, Mike A’Hearn, Anne Raugh MC Face-to-Face Meeting Westwood, California 26,27 August 2014.
Dawn Archiving Status Carol Neese Eric Palmer Small Bodies Node PDS MC Face-to-Face Feb. 4-5, 2015.
Implementation Review1 Archive Ingest Redesign March 14, 2003.
Small Bodies Node Report Michael F. A’Hearn, Donald R. Davis, Ludmilla Kolokolova, & Carol Neese 28/8/12PDS Management Councilmfa 1.
MAVEN Archive Overview J. Mafi PDSMC Face-to-Face Berkeley, California 18 November 2014.
1 SUZAKU HUG 12-13April, 2006 Suzaku archive Lorella Angelini/HEASARC.
Planetary Data System (PDS) Tom Morgan November 24, 2014.
Tools Report Engineering Node March 2007
Radio Science PDS Function Report 25 March 2010 Dick Simpson Stanford University.
PDSMC March 27-28, PDS Imaging Node FY12 Mid-Year Report Lisa Gaddis (USGS) Sue LaVoie (JPL) March 27, 2012 PDS Management Council Meeting College.
PDS4 Deployment Planning (Discussion) PDS MC F2F Columbia, Maryland Dan Crichton August 28,
PDS4 Project Report PDS MC F2F UCLA Dan Crichton November 28,
PDS4 Project Report PDS MC F2F University of Maryland Dan Crichton March 27,
PDS Geosciences Node Page 1 PDS Geosciences Node Archiving Status Report Ray Arvidson PDS Management Council Washington, DC Nov , 2006.
IPDA PDS4 Report July 17, PDS4: The Next Generation PDS PDS4 is a PDS-wide project to upgrade from PDS version 3 to version 4 to address many.
NASA PLANETARY DATA SYSTEM ARCHIVING IPDA Steering Committee Reta Beebe, Dan Crichton Paris, France July
April 2, 2009PDS Management Council - PPI Node1 Planetary Plasma Interactions Node PDS Management Council Presentation April 2, 2009 Raymond Walker Steven.
SBN-UMD short report. . Identify Missions and Instruments where archive products are behind schedule; particularly, those where the identified issues.
Data Compression for PDS4
IPDA PDS4 Report PDS Team July 2015.
Costin Radulescu Steve Spohn 26 August, 2014
Helping Active Missions Convert to PDS4
Presentation transcript:

Imaging Node Lisa Gaddis/Sue LaVoie PDSMC Face-to-Face Meeting Westwood, CA - UCLA 26, 27 August 2014

Mission Highlights 2 Q1 ReleaseQ2 ReleaseQ3 ReleaseQ4 ReleaseFY14 Volume in TB Overall Volume in TB (end FY13) Overall Volume in TB (end FY14) CAS/ISS14.8 GB (10/1/13)13.6 GB (1/2/14)16.0 GB (4/1/14)12.5 GB (7/1/14) CAS/RADAR.2 GB (10/1/13).1 GB (1/2/14)1.9 GB (4/1/14)4.3 GB (7/1/14) CAS/VIMS8.2 GB (10/1/13)7.9 GB (1/2/14)13.7 GB (4/1/14)9.5 GB (7/1/14) MO/THEMIS67.0 GB (10/1/13)75 GB (1/2/14)200 GB (4/1/14)140 GB (7/1/14) MER/Cameras48 GB (11/14/13)88 GB (3/7/14)87.6 GB (5/23/14)43 GB (8/23/14) MRO/HiRISE2.5 TB (12/2/13)2.0 TB (3/1/14)5.5 TB (6/1/14)5.0 TB (9/1/14) MRO/MARCI35 GB (12/2/13)50 GB (3/1/14)57 GB (6/1/14)70 GB (9/1/14) MRO/CTX86 GB (12/2/13)148 GB (3/1/14)169 GB (6/1/14)200 GB (9/1/14) MSL/Haz/NavCAM817 GB (12/13/13)1.0 TB (3/17/14)n/a1416 GB (8/1/14) MSL/MARDI1.7 GB (12/13/13)1.9 GB (3/17/14)n/a5.0 GB (8/1/14) MSL/MastCAM85 GB (12/13/13)84.6 GB (3/17/14)n/a133 GB (8/1/14) MSL/MAHLI22 GB (12/13/13)16.6 GB (3/17/14)n/a52 GB (8/1/14) MESS/MDISn/a2.0 TB (3/7/14)n/a500 GB (8/15/14) LRO/LROC 24.0 TB (12/15/13)22.0 TB (3/15/14)19.6 TB (6/15/14)25.0 TB (9/15/14) LRO/LAMP290 GB (12/15/13)223 GB (3/15/14)286 GB (6/15/14)270 GB (9/15/14) CH/M3n/a Red text indicates volume estimates Imaging Node Data Holdings & Deliveries: July 2014 status

Mission Highlights 3 Active Missions ( work in addition to nominal releases ) Nominal on-time releases for Cassini, LRO, Messenger, MER, MRO, MSL and Odyssey MRO HiRISE: Created package of sample HiRISE superseded data and documentation for archive at NSSDC. Requested removal of HiRISE superseded data held at SDSC. Odyssey THEMIS: Preparing for data reprocessing (review of new volume structure & documentation, keyword updates, and preliminary validation of test volume); new data set version required, possible new peer review(s) MER cameras: OPGS/MIPL is upgrading product labels after adopting MSL’s automated pipeline, sample products distributed to users; Appendices to be added to the SIS to explain differences and clarify mosaic file naming conventions Cassini RADAR: Zebker shape model for Titan expected in 2015 MESSENGER MDIS: Peer reviews underway for high- & low-incidence monochrome global maps, low-phase color map, high-resolution regional mosaics (monochrome & color); DEM data product release delayed to FY15; need resolution of new radius used in products MSL Engineering Cameras: Mosaic data set volume first released on March 17 and is now in sync with rest of the project; Peer Review of MSL ‘Places’ dataset planned for November 2014 (pending ITAR/Export Control approval) MSL MAHLI, MARDI, MASTCAM (MMM): Team re-delivered reprocessed volumes 1-5 for all three instruments (15 volumes total) which were subsequently re-released at IN on August 1 along with regular Release #6 Past Missions MGS MOC RDRs posted online in Pre-Peer Review state

Mission Highlights 4 Developing missions Insight (PDS4): GEO is lead, Amy Culver is POC The archive development schedule slipped due to changes in the camera design and flight software updates The peer review has been deferred from 8/14 to 4/15 The ICD for the cameras has been updated to remove references to the ICC/IDC team, and is back in signature cycle SISes for both the camera data and archive bundle have been drafted and are undergoing internal review by Imaging, MIPL and the InSight camera representative The Imaging dictionary is in good shape to support the camera raw data products. Need the Geometry dictionary for landed data to be firm by 11/1/14 to adhere to current archive development schedule.

PDS4 Activities 5 Development InSight-focused activities (previous slide) Participated in DDWG Tiger Teams: Spectra, Cartography, Geometry Developed a draft Geometry dictionary with input from flight projects and NAIF; significant elements of this were incorporated into the current working model Collected feedback on Spectra, Display, Cartography and Imaging dictionaries; new versions of all to be released later in 2014 Continued development & maintenance of “Generate” tool, added suite of regression tests for local data dictionaries Data Migration Continued updates to previously migrated data products, associated with dictionary development and testing

PDS4 Activities 6 Staff time (WY) supporting DDWG & tiger teams Isbell (USGS): 0.07 FTE Rye (JPL): 0.07 FTE Staff time (WY) supporting IMG LDDs, InSight development, migration, testing & training Isbell (USGS): 0.15 FTE Rye (JPL): 0.08 FTE Culver (JPL): 0.15 FTE Staff time (WY) supporting CCB Hare (USGS): 0.1 FTE Notes: Year to date Rye’s funding comes from EN & IMG. Above represents all of her IMG time.

Miscellaneous NSSDC deliveries: NSSDC NAS (2x30 TB) back at NSSDC LRO-LROC EDRs (Releases 1-5) Security scans complete at NSSDC Ingestion step pending WAN upgrade at USGS Microwave system with dedicated 100 Mbps line for PDS servers; dish now installed System testing indicates ~120 Mpbs transfers Expected to be operational on or before Oct 1,

2 nd Planetary Data Workshop 8 Gaddis will write an unsolicited proposal in association with PDART (Sept 2014) or LDAP (Oct 2014) proposal Planned for Flagstaff, June or July 2015; every two years Avoids Senior Reviews, Geologic mappers meetings, etc. Partner with PDS nodes, USGS/Cartography, RPIFs LPI staff to provide logistical support Especially helpful for local logistics and facilities rental USGS procurement process has improved, but remains an uncertain partnership, so best to side-step it 2012 meeting report (USGS Open-File Report) now available: Workshop

9 Next 5 Years: Archive growth & data management remain significant About 110 TB/year – LROC is primary driver Major continual effort required for management of hardware & data PDS3 formats are dominant for active missions Challenges for PDS4 Significant PDS4-related work is added to ongoing work Detailed discipline and mission portions of the PDS4 model need significant work (e.g., cartography/map projection, calibration) Need a plan and schedule for node initiatives and collaboration Difficult to support users of both PDS3 & PDS4 data and services ~25% of IMG data may require manipulation for PDS4 compliance Risk in manipulating the archived data to conform to PDS4 standards Don’t want to disrupt ongoing missions (e.g., Cassini) & research Emphasis is on-demand processing & translation capabilities Tools for data providers & nodes “Generate” tool maintained and modified as needed by IMG Need training in PDS4 for data providers, PDS MI folks, etc.