E15 Data Processing Issue 6/18/121UVIS Team Meeting.

Slides:



Advertisements
Similar presentations
Information Technology IBM DB2 Content Manager “Lunch N Learn” 03/14/2007.
Advertisements

CIRS Ring Observations: Submm, Temp and Stellar Occultations Linda Spilker, Scott Edgington, Rich Achterberg, Stuart Pilorz, Shawn Brooks April 26, 2004.
Fall, 2006SW Eng Standalone Progs, Univ of Colorado Boulder 1 Wk 11 Glass Box Testing, Flow Graphs, Test Coverage SW Engineering of Standalone Programs.
Development and Production Environment Setup with Kentico CMS Karol Jarkovsky Consultant Kentico Software
 Mechanism for restoring a database quickly and accurately after loss or damage  RESPONSIBILITY OF ?????  Recovery facilities: Backup Facilities Backup.
Version 4 for Windows NEX T. Welcome to SphinxSurvey Version 4,4, the integrated solution for all your survey needs... Question list Questionnaire Design.
Presented by Joseph Galvan & Stacy Kemp BACKUPS.  Using database backups, a database administrator (DBA’s) can restore from the last backup or to a specific.
Implementing High Availability
Survey Methodology Survey data entry/cleaning EPID 626 Lecture 10.
University of Palestine software engineering department Testing of Software Systems Fundamentals of testing instructor: Tasneem Darwish.
Seattle Area Software Quality Assurance Group Release and Configuration Management, The Acceleration of Change and Its Contribution To Software Quality.
Chapter 7 Making Backups with RMAN. Objectives Explain backup sets and image copies RMAN Backup modes’ Types of files backed up Backup destinations Specifying.
Backup and Recovery Overview Supinfo Oracle Lab. 6.
25 June 2009 Dawn Conway, AMSR-E TLSCF Lead Software Engineer AMSR-E Team Leader Science Computing Facility.
Data Validation OPEN Development Conference September 19, 2008 Sushmita De Systems Analyst.
Recovering From Failures in Pro-E. Working In the Resolve Environment Pro/E provides an error resolution environment for recovering from changes that.
WP5 Impact for Space exploration Progress report for 2n d year LPI, KUL, SRC PAS, NOVELTIS, ROB Sergey Kuzin (LPI)
3/30/04 16:14 1 Lessons Learned CERES Data Management Presented to GIST 21 “If the 3 laws of climate are calibrate, calibrate, calibrate, then the 3 laws.
U:/msu/course/cse/103 Day 18, Slide 1 CSE 103 Day 18 If you are not enrolled in CSE 103, please save and log out by 10:10.
Science Operation Readiness Review ICESat SIPS (I-SIPS) Status N0v 30, 2001 David Hancock ICESat Science Ground System Manager
The Online World ONLINE DOCUMENTS. Online documents Online documents (such as text documents, spreadsheets, presentations, graphics and forms) are any.
Backing Up and Restoring Databases by Using the SQL Server 2000.
Doug Raiford Phage class: introduction to sequence databases.
Backup and Recovery - II - Checkpoint - Transaction log – active portion - Database Recovery.
9/13/2006 RMS Duplicate Retail Transactions. RMS9/13/2006 Background Duplicate Retail Transactions Types of duplicate transactions: –PaperFree duplicate.
+ UVIS Data Visualization UVIS Team Meeting Braunschweig, Deutschland June 18, 2012.
VA Primavera P6: Progress Reporter (PR) Department of Veterans Affairs Office of Information and Technology IT Workforce Development (ITWD) in collaboration.
06/28/10UVIS TEAM MEETING OPERATIONS UPDATE UVIS TEAM MEETING OPERATIONS UPDATE 1.
STUDY RESOURCES 1. OVERVIEW OF STUDY RESOURCES Study documents Study overview documents (project overview, data requirements.
get-back-bkf-files alexwaston14/file-repair-tool/ u/4/b/ pages/Bkffilerepairtool/
Your current Moodle 1.9 Minimum Requirements Ability to do a TEST RUN! Upgrading Moodle to Version 2 By Ramzan Jabbar Doncaster College for the Deaf By.
UVIS TEAM MEETING 7/ Instrument Status On/Off Cycle: 26 Hours On: ~43000 hours –~4500 hours since last shut down (probe relay) HDAC Filament Modulation:
McGraw-Hill/Irwin The Interactive Computing Series © 2002 The McGraw-Hill Companies, Inc. All rights reserved. Microsoft Excel 2002 Using Macros Lesson.
01/05/10UVIS TEAM MEETING OPERATIONS UPDATE UVIS TEAM MEETING OPERATIONS UPDATE.
UVIS Calibration Update Greg Holsclaw Jun 16,
Simulated GOLD Observations of Atmospheric Waves
Status Report of EDI on the CAA
AOL Customer Services For Instant Help Give a Ring on: Fix AOL Error 66 Dcvs.
Simple Solution Steps to Fix QuickBooks Error Code Skipped -111 Among the top accounting software used by small and medium sized business, QuickBooks.
XXM Status, Priorities, Plans, and Activities Icy Satellite Science
UVIS Performance Status
Operational Dataset Update Functionality Included in the NCAR Research Data Archive Management System Zaihua Ji Doug Schuster Steven Worley Computational.
Current DAPS Status Observations
UVIS TEAM MEETING OPERATIONS UPDATE
OSCAR/Surface – and all you ever wanted to know about it
XXM Status, Priorities, Plans, and Activities Icy Satellite Science
XM Status, Priorities and Plans, XXM Activities Icy Satellite Science
UVIS Calibration Update
UVIS TEAM MEETING OPERATIONS UPDATE
UVIS TEAM MEETING OPERATIONS UPDATE
UVIS Ops Team UVIS TEAM MEETING 6/23/08.
XM Status, Priorities and Plans, XXM Activities Icy Satellite Science
UVIS TEAM MEETING OPERATIONS UPDATE
Excellence – Impact - Innovation
Current DAPS Status Observations
Current DAPS Status EUV contains 3.3 gb in observations
Current DAPS Status Observations
Current DAPS Status Observations: FUV EUV HSP HDAC.
Current DAPS Status Observations
UVIS PRIME Requests T55-T61
Level 1 Processing Pipeline
Instrument Status On/Off Cycle: 26 Hours On: ~47000 hours
Team Name Names of team members
UVIS TEAM MEETING OPERATIONS UPDATE 6/8/09 UVIS TEAM MEETING
GEOMETER Update Get new version of GEOMETER from Team web site after August 8. Some new parameters now computed (illum angles for “near point” of non-intersecting.
February 11-13, 2019 Raleigh, NC.
Lateral X-rays with ESS
UVIS TEAM MEETING OPERATIONS UPDATE
Lateral Marks with ESS A test version is available in since the end of September. Several laboratories.
Software Testing Software Testing is a process of evaluating a system by manual or automatic means and verify that it satisfies specified requirements.
Presentation transcript:

E15 Data Processing Issue 6/18/121UVIS Team Meeting

Problem description No match between the FUV data and the minimum ray high from geometer. – several seconds discrepancy. Good match of the HSP data with geometer. We were expecting 379 integrations and only 371 could be found in DAPS. Manual processing the data with the (modified) ATLO code shows the code was skipping one integration every 38 integrations. 6/18/122UVIS Team Meeting

Problem Description The problem seems to have been introduced by a code fixe done 11/98 after ICO. The problem is not restricted to the E15 data set. The problem potentially affects all FUV and EUV data sets. 6/18/123UVIS Team Meeting

Problem Description The data processing code skips integrations. The frequency at which integrations are skipped depends on the instrument setup. For most of the 1-window data set it is 1 integration every 471 continuous integrations or 157 continuous integrations – The E15 set up was a 2-window data set 6/18/124UVIS Team Meeting

Which Data Sets Are Affected All the data set taken continuously with a short integration time can be affected: – Rolling IPHSURVEY (12.5 or 25 seconds integration time for 9 hours). – Some aurora imaging (8.0 seconds integration time for several hours). – All occultation data sets (1 second to 5 seconds integration time). 6/18/125UVIS Team Meeting

Examples Jupiter/Sigma Leo (C23, ) – 1 sec integration, 882 integrations, missing 1 integration (#471) UVIS_157SW_IPHSURVEY004_RIDER (S71, ) – 12.5 sec integration, 2585 integrations, missing 5 integrations (471, 942….) UVIS_157SA_AURSTARE001_PIE (S71, ) – 8 sec integration, 1087 integrations, missing 2 integrations (471, 942) 6/18/126UVIS Team Meeting

Examples UVIS_138SA_USUNOCC001_PRIME (S70, ) – 1 sec integration, 3349 integrations, 7 integrations missing 6/18/127UVIS Team Meeting

Since Last Meeting (1) A yearly list of affected data sets was provided last March (see backup slides) for 2004 to 2011 – Not included in the list are the IPHSURVEYs when the S/C is rolling (that is a large number of data set) – As expected: atmospheric occultation, Icy satellite occultation, some ring occultation, early system scan, some aurora scan – But also all the IMPACT 6/18/12UVIS Team Meeting8

Since Last Meeting (2) The code has been fixed Regression testing is in progress (looks Ok so far) Regression test step 1 6/18/12UVIS Team Meeting9 DAPS Test DB Selected un-affected level 0 files Compare level 1 data set Test successful if 1.Metadata identical 2.Data identical

Since Last Meeting (3) Regression testing step 2 6/18/12UVIS Team Meeting10 DAPS Test DB Selected affected level 0 files Compare level 1 data sets Test successful if 1.Metadata identical 2.Missing integrations are recovered

What’s Next Decide what to re-process Re-process as needed (DAPS) – Alain and Dave Re-deliver the PDS volumes that are affected – Dave 6/18/1211UVIS Team Meeting

Reprocessing Overview 1.Copy current DAPS database to a development database 2.On a sequence basis (or yearly basis) – Delete the affected data sets – Re-process the affected data sets – Verify the integrity of the database 3.When all done copy the development database to the DAPS database 6/18/12UVIS Team Meeting12

Backup Slides 6/18/12UVIS Team Meeting13

2004 6/18/12UVIS Team Meeting14

2005 (1) 6/18/12UVIS Team Meeting15

2005 (2) 6/18/12UVIS Team Meeting16

2006 (1) 6/18/12UVIS Team Meeting17

2006 (2) 6/18/12UVIS Team Meeting18

2007 6/18/12UVIS Team Meeting19

2008 (1) 6/18/12UVIS Team Meeting20

2008 (2) 6/18/12UVIS Team Meeting21

2009 6/18/12UVIS Team Meeting22

2010 6/18/12UVIS Team Meeting23

2011 6/18/12UVIS Team Meeting24