PACS ICC Readiness Review MPE, July 3/4 2008 Extended-DP 1/13 E. Sturm: Extended-DP Eckhard Sturm.

Slides:



Advertisements
Similar presentations
Characterisation of observations François Bonnarel, Mireille Louys, Anita Richards, Alberto Micol, Jonathan McDowell, Igor Chilingarian, et al.
Advertisements

best practice project management methodology ©Platinum Services Group Limited What is XPRODi ?
November 12, 2013Computer Vision Lecture 12: Texture 1Signature Another popular method of representing shape is called the signature. In order to compute.
4.5 Multimedia Production
JWST IFUs and Data Tool Development Plans Tracy Beck JWST NIRSpec Instrument Scientist.
The Data Mining Visual Environment Motivation Major problems with existing DM systems They are based on non-extensible frameworks. They provide a non-uniform.
Image Enhancement.
Bruno Altieri September # 1 PACS photometer pipeline overview Bruno Altieri (ESA/HSC)
® VisualPlex Exchange Project Definition Phase June 23, 2000 Prepared James M. Dutcher Oracle Consulting Services.
IT Project Management Cheng Li, Ph.D. August 2003.
ASI Review Padova ICC Contribution 1 WP3000 : Padova ICC Contribution Mattia Vaccari & Giulia Rodighiero & Gabriele Mainetti Department of Astronomy -
Feasibility Study.
HIFI Tutorial 3: Getting some basic science out A.P.Marston ESAC 27 June 2013.
Enterprise GIS Planning and Framework Jennifer Reek GIS Coordinator City of Brookfield, WI.
Mantid Scientific Steering Committee Nick Draper 10/11/2010.
ASI Review Padova ICC Contribution 1 WP3000 : Padova ICC Contribution Staff Alberto Franceschini (AF) [Professore Ordinario] Giulia Rodighiero (GR) [Ricercatore.
Astronomical Spectroscopy and the Virtual Observatory ESAC, March 2007 VO tools and cross-calibration Pedro García-Lario European Space Astronomy.
PACS NHSC SPIRE Point Source Spectroscopy Webinar 21 March 2012 David Shupe, Bernhard Schulz, Kevin Xu on behalf of the SPIRE ICC Extracting Photometry.
PACS Page 1 NHSC Data Processing Workshop – Pasadena Sept 10-14, 2012 SPIRE Spectrometer Data Reduction: Mapping Observations Nanyao Lu NHSC/IPAC (On behalf.
SPIRE Consortium Meeting La Palma, Oct. 1 – SPIRE FTS Pipeline Trevor Fulton Blue Sky Spectroscopy, Lethbridge, Canada.
Image Restoration using Iterative Wiener Filter --- ECE533 Project Report Jing Liu, Yan Wu.
Page 1 PACS NHSC Data Processing Workshop – Pasadena 26 th - 30 th Aug 2013 Overview of SPIRE Photometer Pipeline Kevin Xu NHSC/IPAC on behalf of the SPIRE.
Consortium Meeting La Palma October ICC Status Tanya Lim 1 SPIRE Consortium Meeting La Palma, Oct. 1 – ICC Status Tanya Lim RAL.
Mantid Development introduction Nick Draper 11/04/2008.
© Mahindra Satyam 2009 Configuration Management QMS Training.
Introduction to Making Multimedia
INFO 424 Team Project Practicum Week 2 - Launch report, Project tracking, Review report Glenn Booker Notes largely from Prof. Hislop.
PACS NHSC Data Processing Workshop – Pasadena 10 th - 14 th Sep 2012 SPIRE AOTs, Products and Quick Look Tools Bernhard Schulz NHSC/IPAC on behalf of the.
PACS Spectrometer Spatial Calibration plan in PV phase A.Contursi D. Lutz and U. Klaas.
PACS Hitchhiker’s Guider to Herschel Archive Workshop – Pasadena 6 th – 10 th Oct 2014 SPIRE Photometer Data Products Kevin Xu NHSC/IPAC on behalf of the.
PACS NHSC Data Processing Workshop – Pasadena 10 th - 14 th Sep 2012 Measuring Photometry from SPIRE Observations Presenter: David Shupe (NHSC/IPAC) on.
Data Analysis Software Development Hisanori Furusawa ADC, NAOJ For HSC analysis software team 1.
STEP 4 Manage Delivery. Role of Project Manager At this stage, you as a project manager should clearly understand why you are doing this project. Also.
ASI Review Padova ICC Contribution 1 WP3000 : Padova ICC Contribution Staff Alberto Franceschini (AF) [Professore Ordinario] Giulia Rodighiero (GR) [Ricercatore.
NASA Herschel Science Center - page 1 NHSC Cycle 1 Open Time Proposal Planning Workshop 3-4 June 2010 PACS Accepted Programs & Observations to Date B.
PACS NHSC Data Processing Workshop – Pasadena 10 th - 14 th Sep 2012 The SPIRE Destriper Bernhard Schulz NHSC/IPAC on behalf of the SPIRE ICC 1.
IDARI Workshop, Tartu, June 2005 NUI Galway Work Package 4 Administration Lorna Ryan The IDARI project is financed under the FP5 Quality of Life and Management.
Herschel Open Time Cycle 1 DP workshop ESAC, March page 1 Spurs in HIFI data Colin Borys.
PACS Hitchhiker’s Guide to Herschel Archive Workshop – Pasadena 6 th - 10 th Oct 2014 SPIRE Broad-Band Photometry Extraction Bernhard Schulz (NHSC/IPAC)
PACS Hitchhiker’s Guide to Herschel Archive Workshop – Pasadena 6 th - 10 th Oct 2014 The PACS Spectrometer: Overview and Products Roberta Paladini NHSC/IPAC.
Page 1 PACS NHSC Webinar: New SPIRE Features in HIPE th Nov 2012, Pasadena Update on SPIRE Photometer Pipeline Kevin Xu NHSC/IPAC on behalf of the.
David Adams ATLAS DIAL: Distributed Interactive Analysis of Large datasets David Adams BNL August 5, 2002 BNL OMEGA talk.
MOS Data Reduction Michael Balogh University of Durham.
Page 1 PACS NHSC Webinar: What’s New in HIPE 13 for SPIRE 19 th May 2015, Pasadena What’s New in HIPE 13 General Topics Bernhard Schulz (NHSC/IPAC) on.
 Establishing state-of-the-art coding, documentation, configuration management standards for the AWG.  Software development process comparable with CMMI.
Page 1 PACS GRITS 17 June 2011 Herschel Data Analysis Guerilla Style: Keeping flexibility in a system with long development cycles Bernhard Schulz NASA.
PACS Page 1 NHSC Data Processing Workshop – Pasadena Aug 26-30, 2013 SPIRE Spectrometer Data Reduction: Mapping Observations Nanyao Lu NHSC/IPAC (On behalf.
T Project Review Muuntaja I1 Iteration
NHSC HIFI DP workshop Caltech, 7-9 February page 1 Spurs in HIFI data.
Welcome to Software Project Management. CONVENTIONAL SOFTWARE MANAGEMENT The BEST and WORST thing about software is its flexibility. 1.Software development.
Research and Innovation REPORTING and PAYMENT (in practice) v
ASI Review Padova ICC Contribution 1 WP3000 : Padova ICC Contribution Staff Alberto Franceschini (AF) [Professore Ordinario] Giulia Rodighiero (GR) [Ricercatore.
PACS page 1 NHSC SPIRE Data Processing Webinars 7 th March 2012 PACS page 1 SPIRE Photometer Map Making C. Kevin Xu (NHSC/IPAC)
New SPIRE features in HIPE 9.1 NHSC; Nov 28, 2012 PACS Page 1 What’s New in HIPE 9.1 ( SPIRE FTS) Nanyao Lu NHSC/IPAC (on behalf of the SPIRE ICC)
Paul Alexander1 DS3 Deliverable Status 4 th SKADS Workshop, Lisbon, 2-3 October 2008 DS3 Deliverables Review.
6/6/ SOFTWARE LIFE CYCLE OVERVIEW Professor Ron Kenett Tel Aviv University School of Engineering.
In conclusion the intensity level of the CCD is linear up to the saturation limit, but there is a spilling of charges well before the saturation if.
Panorama Tools H2T2 Group Capstone Project. H2T2 Group TungNS Project Manager HoaHM DesignerHuongP DeveloperThoND Tester.
CARPE DIEM 4 th meeting Critical Assessment of available Radar Precipitation Estimation techniques and Development of Innovative approaches for Environmental.
1 NHSC PACS NHSC/PACS Web Tutorials Running PACS photometer pipelines PACS-403 (for Hipe 13.0) Level 1 to Level 2.5 processing: The Unimap pipeline Prepared.
PACS Hitchhiker’s Guide to Herschel Archive Workshop – Pasadena 6 th – 10 th Oct 2014 Overview of SPIRE Photometer Data Reduction Pipeline Kevin Xu NHSC/IPAC.
A.Zanichelli, B.Garilli, M.Scodeggio, D.Rizzo
Managing the Project Lifecycle
JWST Pipeline Overview
Data Processing Status
GIRO usage and GSICS Lunar Observation Dataset Policy S. Wagner
HIFI Hands-on Exercises
What’s New in HIPE 10.0 (SPIRE FTS)
Adaptive Filter A digital filter that automatically adjusts its coefficients to adapt input signal via an adaptive algorithm. Applications: Signal enhancement.
X-ray high resolution spectra in the VO: the case of XMM-Newton RGS
Presentation transcript:

PACS ICC Readiness Review MPE, July 3/ Extended-DP 1/13 E. Sturm: Extended-DP Eckhard Sturm

PACS ICC Readiness Review MPE, July 3/ PACS contributes in the area of - Image tools (visualization and analysis) - Cube Dataset tools (visualization and analysis) - PACS specific tools (visualization and analysis, level 1  level 2 pipeline) E. Sturm: Extended-DP 2/13

PACS ICC Readiness Review MPE, July 3/ } } HIFI SPIRE HIFI PACS E. Sturm: Extended-DP 3/13

PACS ICC Readiness Review MPE, July 3/ E. Sturm: Extended-DP 4/13

PACS ICC Readiness Review MPE, July 3/ Overall status Contract signed Statements of Work and Work Order #1 and #2 (corresponding to DP iteration 10 and 11) agreed and signed Delivery for WO #1 and #2 completed, including formal delivery notes, more detailed delivery reports, and a summary status report for #1 and #2. Acceptance process for WO 1 and 2 deliveries allmost finished Statement of Work and Work Order for #3 and #4 (DP iteration 12 and 13) overdue. PACS proposal planned to be finished by July 15 Payment requested and received so far: - 25% Advance Payment for WO1 received - 25% advance payment for WO2 requested - 100% travel costs for 2007 requested PACS Extended DP Status E. Sturm: Extended-DP 5/13

PACS ICC Readiness Review MPE, July 3/ Status work packages: URDs exist (1st versions) for all started generic WPs (image display and analysis, spectral cube display and analysis, Point Source extraction (PACS extension). PACS specific work (spectral cube builder, photometric map making) are being dealt with in the pipeline development working group (wiki pages for required functionality, algorithms, status; PACS pipeline description document) Work on some packages (spectral cube tools) was hampered by several circumstances (missing GUI guidelines, missing product definitions, missing interface definition to other non-PACS packages, missing functionality in framework DP, missing common test harness instructions, illness, etc.) and was behind schedule after WO1 and 2 delivery, but is catching up now. The status of each work package (work done, percentage of completion, etc.) at the end of WO1 and WO2 is described in the corresponding detailed delivery reports. Overall status as of today is ok, see the planning/recovery matrix (to be updated until July 15) E. Sturm: Extended-DP 6/13

PACS ICC Readiness Review MPE, July 3/ Status overview E. Sturm: Extended-DP 7/13

PACS ICC Readiness Review MPE, July 3/ Image visualisation and analysis Image (intensity) arithmetics: adding, subtracting, multiplying, dividing, modulo, log, exp, power, square, sqrt, absolute values,... Profile plotting: plotting the intensity along a straight line on an image Histogram: Image and area Aperture photometry –circular target aperture, annular/rectangular sky aperture –5 different sky estimation algorithms Contour plotting Smoothing and filtering Fourier Transforms: FFT, inverse FFT, DFT and inverse DFT Map construction: compose several images (with Wcs!) to one large mosaic –naive mapmaking –mapmaking based on the inverse problem theory Status: Prototype and definition of specific applications E. Sturm: Extended-DP 8/13

PACS ICC Readiness Review MPE, July 3/ E. Sturm: Extended-DP 9/13

PACS ICC Readiness Review MPE, July 3/ Cube visualisation and analysis Features –Extract a single pixel spectrum –Extract a averaged spectrum from a region –Filter the spectrum –Fit some model on the spectra –Extract sub-cube from the original –compute velocity position map –Send the spectra to Cassis –Save the individuals spectra Status: Prototype and definition of specific applications spectral Cube spectrum of the point under the mouse pointer result section, one tag per feature Alain Gueguen Pacs/MPE E. Sturm: Extended-DP 10/13

PACS ICC Readiness Review MPE, July 3/ –Collaboration between PACS and SPIRE on the definition of the user requirements –JAVA prototype, implementation of SussExtracor (Paper “Bayesian methods of astronomical source extraction” Richard S. Savage, Seb Oliver, 2007, ApJ 661, p –Status: Algorithms established for SPIRE. Definition and agreement of user requirements with PACS. Algorithms exchangeable, right now SussExtractor and DAOPHOT under testing E. Sturm: Extended-DP Herschel Point Source Extraction Tool 11/13

PACS ICC Readiness Review MPE, July 3/ E. Sturm: Extended-DP PACS Integral Field Spectroscopy to Cube –Combine spectra from line or range spectroscopy observations (25x16 spectra in time) into a set of 25 (spatial) spectra –Status: Definition of user requirements and discussion of algorithms. Prototypes for several steps (rebinning, clipping, projection)  See pipeline presentations PACS photometric observations to maps –Combine detector level-1 products representing the set of scans or rasters across the sky and combine into a MAP product (plus a noise map) which gives flux as a function of sky position –Status: Definition of user requirements and discussion of algorithms. Prototype of MADMAP implementation, and naive projection  See pipeline presentations PACS specific GUIs e.g. Mask Viewer e.g. Map Monitor (  See pipeline presentations 12/13

PACS ICC Readiness Review MPE, July 3/ Conclusions status of PACS E-DP WPs generally on track. Possible exception: Point Source Extraction, but this is not launch critical (as most of the E-DP effort is clearly not launch critical) level of Cross-Instrument feed-back on URDs very low. The procedure for this needs to be better formalized. A cross-instrument URD assessment was planned for the recent DPUG meeting on July 2 (yesterday), and a wiki page repository for extended DP URDs was created delivery process and acceptance testing are plagued by many „teething“ problems and take a very long time. For instance, the delivery formalities (form of delivery notes, formal contents, etc.) were clarified and agreed by all parties only very recently.  Streemlining necessary in order to not hamper other (more launch critical) areas. More experience/routine might help in the future. Co-locations of developers and acceptance testers during AT is certainly a good idea. Action Item from recent Steering group Meeting: AI290508/2: AMH/SO/ES/KJK/RS to write up and agree procedures for the different phases of a Work Order (Due: 9-Jul-08) E. Sturm: Extended-DP 13/13