Data Processing Status

Slides:

Advertisements

Similar presentations

AMBER and MIDI from user’s point of view EuroSummer School Observation and data reduction with the Very Large Telescope Interferometer Goutelas, France.

Advertisements

The JMMC softwares to prepare AMBER observations AMBER Workshop - LAOG - 9 Nov 2004.

Romain G. Petrov Laboratoire LAGRANGE (OCA-UNS-CNRS) Avec S. Lagarde, F. Millour, M. Vannier, S. Rakshit (LAGRANGE), T. Elhalkouj (UCA Marrakech),

VISTA/WFCAM pipelines summit pipeline: real time DQC verified raw product to Garching standard pipeline: instrumental signature removal, catalogue production,

FMOS Observations and Data 14 January 2004 FMOS Science Workshop.

SIRTF-IRS software Fred Lahuis Leiden 18 Nov 2002 (presented by Ewine van Dishoeck and Adwin Boogert, c2d meeting Dec. 11, 2002)

HAWCPol / SuperHAWC Software & Operations J. Dotson July 28, 2007.

ART: Augmented Reality Table for Interactive Trading Card Game Albert H.T. Lam, Kevin C. H. Chow, Edward H. H. Yau and Michael R. Lyu Department of Computer.

Introduction to Spitzer and some applications Data products Pipelines Preliminary work K. Nilsson, J.M. Castro Cerón, J.P.U. Fynbo, D.J. Watson, J. Hjorth.

Numerical Grid Computations with the OPeNDAP Back End Server (BES)

Commissioning the NOAO Data Management System Howard H. Lanning, Rob Seaman, Chris Smith (National Optical Astronomy Observatory, Data Products Program)

Memorandam of the discussion on FMOS observations and data kicked off by Ian Lewis Masayuki Akiyama 14 January 2004 FMOS Science Workshop.

Model fitting: tutorial and introduction to the practice session EuroSummer School Observation and data reduction with the Very Large Telescope Interferometer.

Hunt for Molecules, Paris, 2005-Sep-20 Software Development for ALMA Robert LUCAS IRAM Grenoble France.

Introduction and Overview Questions answered in this lecture: What is an operating system? How have operating systems evolved? Why study operating systems?

STIS Closeout Plan Paul Goudfrooij 2005 HST Calibration Workshop, 10/26/2005.

Olivier Absil Chargé de Recherches FNRS AEOS group 3 rd ARC meeting – March 4 th, 2011 Imaging faint companions with interferometric closure phases 3 rd.

Round Table Discussion Of Spectroscopic Processing & Products for the Scientific Legacy Nov 16, 2012HST Spec Pipeline & Legacy Products Round Table Kaiser,

Reconstructing 3D mesh from video image sequences supervisor : Mgr. Martin Samuelčik by Martin Bujňák specifications Master thesis

IVC : a simulation and model-fitting tool for optical-IR interferometry Abstract I present a new software tool, called “Interferometry Visibility Computations”

MIDI: Data reduction Walter Jaffe, Rainer Köhler, William Cotton Olivier Chesneau, Thorsten Ratzka, Quynh Nhu Nguyen, Guy Perrin, Ch. Hummel and MIDI/ESO.

PACS Page 1 NHSC Data Processing Workshop – Pasadena Sept 10-14, 2012 SPIRE Spectrometer Data Reduction: Mapping Observations Nanyao Lu NHSC/IPAC (On behalf.

CarpePpt Version 3.1 August 2002 Copyright 2002, Regents of the University of Michigan Welcome to CarpePpt! 1.When opening Carpe.ppt, you should be notified.

ALMA Pipeline Heuristics Frederic Boone - LERMA Lindsey Davis - NRAO John Lightfoot - UKATC Dirk Muders - MPIfR Christine Wilson - McMaster Friedrich Wyrowski.

Tutorial T-10 Amber Data Reduction (practical point of view) EuroSummer School Observation and data reduction with the Very Large Telescope Interferometer.

Software Status  Last Software Workshop u Held at Fermilab just before Christmas. u Completed reconstruction testing: s MICE trackers and KEK tracker.

SCIOPS 2013 Reinhard Hanuschik, ESO Garching The VLT Quality Control Loop.

Data products of GuoShouJing telescope(LAMOST) pipeline and current problems LUO LAMOST Workshop.

SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA COS Pipeline Calibration Outline of CALCOS Processing Steps and Keywords Reference Files Associations.

SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA COS Pipeline Calibration Goals of CALCOS Association Table Input and Output Files High Level.

DEVELOPMENT OF A SPECTROPHOTOMETRIC DATA REDUCTION PIPELINE ARIZONA SPACE GRANT CONSORTIUM NAU/NASA SPACE GRANT RYAN BUCKINGHAM NORTHERN ARIZONA UNIVERSITY.

Herschel Open Time Cycle 1 DP workshop ESAC, March page 1 Spurs in HIFI data Colin Borys.

HARPS Data Flow System Christophe Lovis Geneva Observatory HARPS-N PDR, 6-7 December 2007, Cambridge MA.

PACS Hitchhiker’s Guide to Herschel Archive Workshop – Pasadena 6 th - 10 th Oct 2014 The PACS Spectrometer: Overview and Products Roberta Paladini NHSC/IPAC.

TB1: Data analysis Antonio Bulgheroni on behalf of the TB24 team.

Implementation of a Relational Database as an Aid to Automatic Target Recognition Christopher C. Frost Computer Science Mentor: Steven Vanstone.

MIDI design, performance, operations, and science Markus Schöller (INS)

MOS Data Reduction Michael Balogh University of Durham.

14 January Observational Astronomy SPECTROSCOPIC data reduction Piskunov & Valenti 2002, A&A 385, 1095.

Practical session on calibrators Euro Summer School Active Galactic Nuclei at the highest angular resolution: theory and observations Torun, Poland 27.

PACS Page 1 NHSC Data Processing Workshop – Pasadena Aug 26-30, 2013 SPIRE Spectrometer Data Reduction: Mapping Observations Nanyao Lu NHSC/IPAC (On behalf.

Page 1 NHSC PACS Web Tutorial PACS 301 nhsc.ipac.caltech.edu/helpdesk NHSC/PACS Web Tutorials Running the PACS Spectrometer pipeline for CHOP/NOD Mode.

CUPID (Bob Narron)GRITS - May 14, CUPID “Customizable User Pipeline for IRS Data” Abstract: The CUPID package will allow users to run the Spitzer.

Observations with AMBER  General overview  P2VM  OB preparation with P2PP P2PP / OB / templates Available templates for observation procedure Typical.

PACS ICC Readiness Review MPE, July 3/ Extended-DP 1/13 E. Sturm: Extended-DP Eckhard Sturm.

Jean-Marie Mariotti Center Doc : JMMC-PRE JMMC - AMBER Workshop 2007, Grenoble, 9 March 2007 AMBER Data Reduction Software Version 2.0 Gérard.

Bootstrap Tutorial Overview Objective Learn how to use the bootstrap for configuring the system. Requirements Installed Version of.

TARGET FINDING WITH SAM AND BANDMAX Course: Special Topics in Remote Sensing & GIS Mirza Muhammad Waqar Contact:

SINFONI data reduction using the ESO pipeline. Instrument design and its impact on the data (I) integral field spectrometer using mirrors brickwall pattern.

A.Zanichelli, B.Garilli, M.Scodeggio, D.Rizzo

Adaptive Median Filter

NRAO VLA Archive Survey

NHSC/PACS Web Tutorials

PESSTO Data Reduction PESSTO meeting 6/1/2018.

NAC flat fielding and intensity calibration

JWST Pipeline Overview

Database Systems Unit 16.

COS FUV Flat Fields and Signal-to-Noise Characteristics

Chapter 4 Threads.

Concluding Remarks Paolo Padovani Head, Virtual Observatory Project Office, ESO, Garching bei München, Germany & EURO-VO Facility Centre.

R-Alice PDS/PSA Data Review PRL & ESC1 phases

G. Li Causi1, S. Antoniucci2;1, E. Tatulli3

Overview and new developments in Herschel Data Processing

EE 596 Machine Vision HW 6 Assigned: Nov 20, 2013

The VIMOS IFU Pipeline Carlo Izzo.

Observational Astronomy

Coupled Horn-Schunck and Lukas-Kanade for image processing

Image Reduction and Analysis Facility

Img1 img3 img5.

Alignment, Scanning Malcolm Guthrie

Presentation transcript:

Data Processing Status amdlib: library for data reduction used during AMBER observations (amdlib 1.08): optimization of windows on detector Calibration of Spectral Displacement between interferometric pixels and photometry measurements Calibration of the pixel-to-visibility matrix Fringe sensing (looking for fringes) Coherencing and atmospheric piston estimation flux maximization in fibers Used in ESO pipeline (amdlib 1.02) for quality control Produces OI_FITS files Used in “at home” data reduction (amdlib 1.17), often in conjunction with user-friendly ammYorick

Data Processing Status 2 cosmetics OK Implements in C code algorithms devised by AMBER consortium: Handle raw data Load raw data Save raw data Handle calibration maps Load bad pixel map Load flat-field map Calibrate raw data Convert raw data to science data Perform spectral calibration Perform P2VM calibration Compute P2VM Save P2VM Load P2VM Extract visibilities Create IO-FITS file Products: Complex coherent fluxes, squared visibility, phase closures, differential phase, piston, spectra.

Visibilities OI-FITS File Calibrated Raw Data Science Data Raw Data amdlibPHOTOMETRY amdlibVIS amdlibVIS2 amdlibVIS3 Visibilities OI-FITS File amdlibWriteOiFile() amdlibRawData2ScienceData () amdlibRAW_DATA Calibrated Raw Data amdlibSCIENCE_DATA Science Data amdlibExtractVisibilities() amdlibCalibrateRawData () Raw Data amdlibLoadRawData() amdlibLoadRawFrames() Raw Image amdlibGluedImage2RawData() Raw Data File amdlibComputePiston () amdlibPISTON amdlibQUALITY_CONTROL Pistons amdlibLoadBadPixelMap() amdlibBAD_PIXEL_MAP Bad Pixel Map amdlibP2VM_MATRIX P2VM amdlibFLAT_FIELD_MAP Flat-Field Map amdlibLoadP2vm() P2VM File amdlibPIXEL_BIAS_DATA Pixel Bias Flat-Field Map File Bad Pixel Map File amdlibLoadFlatFieldMap() amdlibAMBER_WAVEDATA Wavelength table amdlibGeneratePixelBiasData()

Data Processing Status 3 Problems: V2 estimate still has a “bug” in the C version. Spectral calibration (NOT spectral matching of interferometry and photometry) is yet untractable in medium and high-resolution modes. Spectra are uncalibrated in flux.

Data Processing Status 4 Still a long way to calibrated V2 after amdlib: Take the numerous OI_FITS products (one per observation) Eventually optimize measurement by frame selection (not done in amdlib yet) Divide by calibrator Etc…  use, e.g. ammYorick  Wait until VLT(I) vibrations have been damped  Wait until all specialists agree on a definitive final complete ultimate unique data reduction method…

Data Processing Status 5 Plans: Deliver a new, final AMBER consortium product in January 2006 to ESO: standard interfaces frozen to enable further upgrades easily without bothering both OS and Pipe-Line processes Simpler, more easily maintainable code Done at LAOG by E. Altariba (CDD AMBER) and G. Zins (JMMC) Future versions are needed only for the community (not for observation or data quality at ESO) and could be developed and maintained by JMMC (TBC) These versions under CVS for everybody to participate and easy download and use. ammYorick too!