1. The algorithm for applying calibration to files is not documented. There is one hint in the SOFTWARE/CALIB/README file that the calibration files are.

Slides:



Advertisements
Similar presentations
1 jNIK IT tool for electronic audit papers 17th meeting of the INTOSAI Working Group on IT Audit (WGITA) SAI POLAND (the Supreme Chamber of Control)
Advertisements

Lectures on File Management
The Radiocommunication Data Dictionary (RDD) ITU-R SM.1413 Presented by David Barrett.
Html: getting started HTML is hyper text markup language. It is what web browsers look at on the Internet. HTML documents should be created in a simple.
Rosetta Magnetic Field PDS Review B. J. Anderson.
Tutorial 8: Developing an Excel Application
Macro Processor.
Chapter 10 Introduction to Arrays
Lecture 10: The FAT, VFAT, and NTFS Filesystems 6/17/2003 CSCE 590 Summer 2003.
Sets and Maps Chapter 9. Chapter 9: Sets and Maps2 Chapter Objectives To understand the Java Map and Set interfaces and how to use them To learn about.
Assignment 1 Pointers ● Be sure to use all tags properly – Don't use a tag for something it wasn't designed for – Ex. Do not use heading tags... for regular.
Guide To UNIX Using Linux Third Edition
Introduction to Unix (CA263) Introduction to Shell Script Programming By Tariq Ibn Aziz.
1 Chapter 2 Reviewing Tables and Queries. 2 Chapter Objectives Identify the steps required to develop an Access application Specify the characteristics.
Business Intelligence (3 of 3): Technically Speaking, This is How We Did It PRESENTED BY.
MS Access: Database Concepts Instructor: Vicki Weidler.
TrendReader Standard 2 This generation of TrendReader Standard software utilizes the more familiar Windows format (“tree”) views of functions and file.
Computer Science 1000 Spreadsheets II Permission to redistribute these slides is strictly prohibited without permission.
Objectives Learn what a file system does
Ch 51 Internal Commands COPY and TYPE. Ch 52 Overview Will review file-naming rules.
With Microsoft Access 2007 Volume 1© 2008 Pearson Prentice Hall1 PowerPoint Presentation to Accompany GO! with Microsoft ® Access 2007 Volume 1 Chapter.
Advanced Excel for Finance Professionals A self study material from South Asian Management Technologies Foundation.
Introduction to Shell Script Programming
Publishing a Macromedia Flash Movie – Lesson 131 Publishing a Macromedia Flash Movie Lesson 13.
1 Functions 1 Parameter, 1 Return-Value 1. The problem 2. Recall the layout 3. Create the definition 4. "Flow" of data 5. Testing 6. Projects 1 and 2.
Microsoft Access – Tutorial 2 Designing Databases In this tutorial, we will create a new database create a new table import tables from an existing database.
Engineering Practicum Baltimore Polytechnic Institute M. Scott Lab Reports Objective: Understand and be able to meet lab report requirements and expectations.
Discovering Computers Fundamentals Fifth Edition Chapter 9 Database Management.
Facility Reporting v. 1.0 Managing Clinical Staffing Reports on the Illinois Outcomes Website May 20, 2009.
Software Project Planning Defining the Project Writing the Software Specification Planning the Development Stages Testing the Software.
ISV Innovation Presented by ISV Innovation Presented by Business Intelligence Fundamentals: Data Cleansing Ola Ekdahl IT Mentors 9/12/08.
R-Alice Lutetia PDS/PSA Data Review Kurt Retherford.
SUSE Linux Enterprise Desktop Administration Chapter 6 Manage Software.
Event Data History David Adams BNL Atlas Software Week December 2001.
Indexed and Relative File Processing
Page 1 Non-Payroll Cost Transfer Enhancements Last update January 24, 2008 What are the some of the new enhancements of the Non-Payroll Cost Transfer?
© Janice Regan, CMPT 300, May CMPT 300 Introduction to Operating Systems Memory: Relocation.
Built-in Data Structures in Python An Introduction.
Microsoft Visual Basic 2005: Reloaded Second Edition Chapter 3 Variables, Constants, Methods, and Calculations.
Chapter 15 Introduction to PL/SQL. Chapter Objectives  Explain the benefits of using PL/SQL blocks versus several SQL statements  Identify the sections.
Computer Science 1000 Spreadsheets IV Permission to redistribute or use these slides is strictly prohibited without permission.
6 th Annual Focus Users’ Conference 6 th Annual Focus Users’ Conference Import Testing Data Presented by: Adrian Ruiz Presented by: Adrian Ruiz.
1 CSCD 326 Data Structures I Software Design. 2 The Software Life Cycle 1. Specification 2. Design 3. Risk Analysis 4. Verification 5. Coding 6. Testing.
1 Quality Attributes of Requirements Documents Lecture # 25.
Lesson 13 Databases Unit 2—Using the Computer. Computer Concepts BASICS - 22 Objectives Define the purpose and function of database software. Identify.
Session 1 Module 1: Introduction to Data Integrity
Page Layout You can quickly and easily format the entire document to give it a professional and modern look by applying a document theme. A document theme.
1 Work Orders. 2 Generating a Work Order There are two methods to generating a Work Order in the WYNNE STSTEM. First method: Option 11 – 12 – 13 * Open.
Sets and Maps Chapter 9. Chapter Objectives  To understand the Java Map and Set interfaces and how to use them  To learn about hash coding and its use.
Level 1-2 Trigger Data Base development Current status and overview Myron Campbell, Alexei Varganov, Stephen Miller University of Michigan August 17, 2000.
Introduction to Algorithmic Processes CMPSC 201C Fall 2000.
06/28/10UVIS TEAM MEETING OPERATIONS UPDATE UVIS TEAM MEETING OPERATIONS UPDATE 1.
UVIS Calibration Update Greg Holsclaw Jan 8,
Text2PTO: Modernizing Patent Application Filing A Proposal for Submitting Text Applications to the USPTO.
UVIS TEAM MEETING 7/ Instrument Status On/Off Cycle: 26 Hours On: ~43000 hours –~4500 hours since last shut down (probe relay) HDAC Filament Modulation:
Translation Lookaside Buffer
Development Environment
Using E-Business Suite Attachments
CVS revisions UML diagram
FITS Header Keywords for ground test data
File Management.
File Managements.
Variables ICS2O.
Current DAPS Status Observations
Microsoft Excel 2007 – Level 2
AGILENT TECHNOLOGIES RESTRICTED
Chapter 29: Program Security
3.1 Basic Concept of Directory and Sub-directory
Current DAPS Status Observations: FUV EUV HSP HDAC.
Current DAPS Status Observations
Presentation transcript:

1. The algorithm for applying calibration to files is not documented. There is one hint in the SOFTWARE/CALIB/README file that the calibration files are multiplicands of the data files for FUV/EUV. However, for HSP and HDAC channels there is no clue. There needs to be clear documentation that describes how the calibration files were created for each channel and how to apply them to the data files to achieve a calibrated data file. See UVIS.DOC, Calibration Data for a description of the calibration data products and how to use them See SOFTWARE/CALIB/README for a description of how to use the calibration data See CALIB/VERSION_1/D2000_278/EUV2000_278_17_21.LBL (et. al.), DESCRIPTION keyword for a description of a calibration product and how to use it. See UVIS.DOC, Computation of Calibration Data for the location of calibration procedures and data. Users will need to read the algorithm. -- I have added the following to sec : “HSP and HDAC do not currently have a calibration process.” Also, I will not generate HDAC and HSP calibration data files since they are trivial.

2. Make it clear that the user must have IDL to use the calibration and geometry IDL programs. What these programs do is not described anywhere. Even if you are including them just for information you should provide documentation. Users should not use the calibration algorithms and, hence, do not need IDL. See UVIS.DOC section Calibration Data, in particular, “Since these algorithms are used to generate calibration data, and since the calibration data are supplied, these algorithms are for reference only. “ Users should not use the geometry algorithm since all geometry values are contained in the labels, hence users do not need IDL. See UVIS.DOC, Computation of Pointing Geometry, in particular, “The geometry values included in the data object are computed using the geometry_engine.pro.” (ibid.) The preceding references also explain the purpose of the calibration and geometry algorithms. The mechanism for calibrating data is referenced on the preceding page -I have added the following text to the AAREADME.TXT file: “The files in this directory are used to produce the geometry keyword values contained in the data object labels. User’s should use these keyword values, the geometry programs are for reference only.” Also, “Users should use the calibration data contained under the CALIB/VERSION_n directory. These calibration programs are for reference only.” I will add this to SOFTWAREINFO.TXT

3.. Filenames are not inconsistent in SOFTWARE/CALIB/VERSION_1 directory. Duplicates. --I have removed the …_save and …_original files

4. Empty DOCUMENTATION directory under SOFTWARE. -- I have removed this until we have some documentation. 5. When first reading the DATA_OBJECT_READERS_README.TXT file, it sounds like a user needs to have java and IDL to use the utilities. Please make it clear in the first paragraph if the user has a choice between IDL and Java. -- I have changed “and” to “and optionally” 6. DOCUMENT directory does not contain TXT versions of files. I can probably convert UVIS.DOC to text but the Space Science Review article contains lots of mathematical symbols and diagrams so it probably is not convertible. 7. Index file incomplete. Only HDAC data, and some rows are full of N/As. No CUMINDEX file identified in AAREADME or included on volume. This is an error which will be fixed. 8. There is an additional README file in the READERS directory I have removed the extraneous README file.

9. Need documentation for the GEOMETRY directory. If this is software, why is it not in the software directory. Documentation describing geometry is contained in UVIS.DOC, Computation of Pointing Geometry and in the geometer_engine.pro code. The UVIS.DOC text can be copied to a README file. The volume directory is root/SOFTWARE/GEOMETRY I will put the stuff into SOFTWAREINFO.TXT 10. Directory D2000_279 has a file named EUV2000_279_01_56.LBL.Z. -- I have deleted it. 11. Why are the format descriptions embedded in the calibration file labels, but not the data file labels ? I have added a description of the wavelength mapping contained in the BAND_BIN_CENTER value to the SIS

-- I have added an appendix which gives definitions of UVIS label keywords 12a. … File format objects should be included in the SIS. 12b… What is the difference between a Qube and a Cube ? A cube is what the UVIS science team calls an EUV/FUV observation which has a spatial and spectral component. These cubes are stored in PDS Qube objects. 12c… Is there calibration for non HSP and HDAC data -- No. I have added the following statement to Sec 2.5.5: “HSP and HDAC do not currently have a calibration process.” 12d… Where are the algorithms that are used to apply the calibration described? These would be the ones used in the java and IDL code. There is no documentation in the CALIB directory as described in the SIS section 3.1. See UVIS.DOC, Calibration Data See SOFTWARE/CALIB/README See CALIB/VERSION_1/D2000_278/EUV2000_278_17_21.LBL (et. al.), DESCRIPTION keyword SIS Section 3.1 contains the statement: “These calibration routines are …for reference only.“ This means that the calibration routines are reference material. -- I have added this to SOFTWAREINFO.TXT as well

12e… When you provide updated calibration files will there be a version_n in the software/calib directory as well ? Yes, see UVIS.DOC sec Labeling and Identification, in particular, “For example, calibration data contained under …/VERSION_2…”. The current scenario for handling versioning will work for instrument evolution. In the case of large-volume regeneration of calibration data, for example, a hypothetical version 5 which applies to all data from 1999 to 2005 we will issue a CD which contains exclusively calibration data using the same organization and conventions as all other volumes 12f… section Change SOFTWARE/CALIBRATION to SOFTWARE/CALIB 12g… section Change PDS/CALIBRATION to PDS/CALIB -- done 12h File naming convention described does not match data on volume. Please make filenames unique. Calibration data have the same exact filenames and PRODUCT_IDs as their corresponding data files. PRODUCT_Ids must be unique. Filenames should be unique. PRODUCT_ID for calibration data will be changed. -- I have changed the example in the SIS to be consistent with the data files.

12i… section has question marks. -- These have been replaced with “5.6”. 12j… Please describe in section 2.5 how you plan to accomplish validation of the data for scientific content. Section 2.5 says: “There is no validation of the scientific content of these files.” What this means is that we cannot evaluate each observation to confirm that it contains meaningful data, we will confirm that the data was taken correctly and that it is formatted correctly. This will be replaced by the statement: “Ongoing scientific analysis will be used to identify any problems with scientific content of the PDS volume.” 12k … Appendix A ( Need to fill in the rest of the appendices ) o What component of the Science planning process does this relate to ? ODC_ID -- This has been defined in a new appendix containing keyword definitions o Why is PRODUCT_CREATION_TIME = UNK ? because the product has not been created yet. o Why no value for SPACECRAFT_CLOCK_STOP_COUNT, you have STOP_TIME. we compute STOP_TIME, we do not have a telemetry value corresponding to SPACECRAFT_CLOCK_STOP_COUNT o INSTRUMENT_HOST_NAME = "CASSINI ORBITER“ -- INSTRUMENT_HOST_NAME has been changed to “CASSINI ORBITER” o Where are the compression_type values described ? in the PDS data dictionary, -- also this has been defined in a new appendix containing keyword definitions

To describe the instrument configuration, the following, (except perhaps item 1), is needed in the labels. The Hydrogen Deuterium Absorption Cell setup is described by 6 parameters (1) Is channel used or not used in the setup (2) The integration time (in seconds) (3) The dwell time (in seconds) (4) The compression algorithm (no compression, sqrt_9, byte, sqrt_8) (5) The Hydrogen cell modulation table (this is a 16-entry table) DWELL_TIME = 1 COMPRESSION_TYPE = "NONE" D_LEVEL = (0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0) H_LEVEL = (0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0) The integration time for the HDAC is a constant seconds and, since it is always the same, is not included in the label

The High Speed Photometer set up is described by three parameters: (1) Is the channel used or not used in the setup (3) The integration time (in seconds) (3) The compression algorithm (no compression, sqrt_9, byte, sqrt_8) INTEGRATION_DURATION = 1 COMPRESSION_TYPE = "SQRT_9"

The Far Ultra-Violet channel set up is described by15 parameters: (1) Is the channel used or not the setup (2) The integration time (in seconds) (3) The compression algorithm (no compression, sqrt_9, byte, sqrt_8). (4) The entrance slit (hi_res, lo_res, occult) (5) The HVPS level (1 to 3) (6) The description of window 1(a set of 6 integer) (7) The description of window 2 (15) The description of window 10 INTEGRATION_DURATION = COMPRESSION_TYPE = "SQRT_9" HI_VOLTAGE_POWER_SUPPLY_STATE = 1 OCCULTATION_PORT_STATE = N/A SLIT_STATE = HIGH_RESOLUTION TEST_PULSE_STATE = ON UL_CORNER_LINE = 0 UL_CORNER_BAND = 0 LR_CORNER_LINE = 63 LR_CORNER_BAND = 1023 BAND_BIN = 1 LINE_BIN = 2