6dF workshsopATNF May 30th 20021 6dF: Observing, data reduction & dataflow Q.A.Parker Macquarie University/AAO.

Slides:



Advertisements
Similar presentations
Testing Relational Database
Advertisements

26 January 2007 CAL 07 Garching 1 The VISTA Data Flow System Jim Lewis, Mike Irwin, Peter Bunclark, Simon Hodgkin Cambridge Astronomy Survey Unit.
GSMT Control Workshop Tucson, September 11-12, 2001 Pointing Control for a giant segmented mirror telescope Patrick Wallace Rutherford Appleton Laboratory.
Echelle Spectroscopy Dr Ray Stathakis, AAO. What is it? n Echelle spectroscopy is used to observe single objects at high spectral detail. n The spectrum.
RAVE MEETING BALTIMORE May 2008 Status of the 3 rd 6dF field plate and the new RAVE observing support model. Q.A.Parker (AAO/Mac.Uni) Fred Watson (AAO)
HORIZONT 1 ProcMan ® The Handover Process Manager Product Presentation HORIZONT Software for Datacenters Garmischer Str. 8 D München Tel ++49(0)89.
FMOS Observations and Data 14 January 2004 FMOS Science Workshop.
NOAO/Gemini Data workshop – Tucson,  Hosted by CADC in Victoria, Canada.  Released September 2004  Gemini North data from May 2000  Gemini.
Growth of Structure Measurement from a Large Cluster Survey using Chandra and XMM-Newton John R. Peterson (Purdue), J. Garrett Jernigan (SSL, Berkeley),
Physical design. Stage 6 - Physical Design Retrieve the target physical environment Create physical data design Create function component implementation.
SONG – Stellar Observations Network Group - The robotic software for the SONG network S.Frandsen 1, Eric Weiss 1, J. Skottfelt 2, M.F. Andersen 1, F.Grundahl.
Introduction to Spitzer and some applications Data products Pipelines Preliminary work K. Nilsson, J.M. Castro Cerón, J.P.U. Fynbo, D.J. Watson, J. Hjorth.
Spectroscopy Techniques and Projects at 1.2-m UK Schmidt Telescope
18 April 2007 Second Generation VLT Instruments 1 VIRCAM & CPL: Lessons Learned Jim Lewis and Peter Bunclark Cambridge Astronomy Survey Unit.
Data provenance in astronomy Bob Mann Wide-Field Astronomy Unit University of Edinburgh
A Primer on Image Acquisition and Data Reduction Using TheSky6, CCDSoft V5 and Microsoft Excel Thomas C. Smith Dark Ridge Observatory (DRO)
The Project AH Computing. Functional Requirements  What the product must do!  Examples attractive welcome screen all options available as clickable.
6dF Data Release 2 The good, the bad and the ugly Will Saunders AAO 27/04/05.
Naoyuki Tamura (University of Durham) Expected Performance of FMOS ~ Estimation with Spectrum Simulator ~ Introduction of simulators  Examples of calculations.
Commissioning the NOAO Data Management System Howard H. Lanning, Rob Seaman, Chris Smith (National Optical Astronomy Observatory, Data Products Program)
SNLS : Spectroscopy of Supernovae with the VLT (status) Grégory Sainton LPNHE, CNRS/in2p3 University Paris VI & VII Paris, France On behalf of the SNLS.
Memorandam of the discussion on FMOS observations and data kicked off by Ian Lewis Masayuki Akiyama 14 January 2004 FMOS Science Workshop.
® IBM Software Group © 2009 IBM Corporation Rational Publishing Engine RQM Multi Level Report Tutorial David Rennie, IBM Rational Services A/NZ
This page is intentionally blank. A new view of the Universe VIII Fred Watson (and the RAVErs) April 2005 A new view of the Universe VIII Fred Watson.
Data Management Subsystem: Data Processing, Calibration and Archive Systems for JWST with implications for HST Gretchen Greene & Perry Greenfield.
Matthew Fleenor Jim Rose Wayne Christiansen Dick Hunstead Clair Murrowood Michael Drinkwater Will Saunders University of North Carolina University of Sydney.
TVAC Electronic Call Sheet System Team HeatWave Summer 2007.
SDSS-KSG 08 Workshop1 The SDSS DR7 and KIAS SDSS mirror Won-Kee Park ARCSEC, Sejong University 2008 SDSS-KSG Workshop.
1 Overview of the Application Hosting Environment Stefan Zasada University College London.
Multi-slit spectroscopy In sky-noise dominated conditions (most interesting!) the use of slits is essential: eg: Faint object, extra-galactic, surveys:
Consortium Meeting La Palma October PV-Phase & Calibration Plans Sarah Leeks 1 SPIRE Consortium Meeting La Palma, Oct. 1 – PV Phase and.
Discussion - Survey Design Survey product equation: #fields = fld/nt x useable x (%xnights/yr) x years = 4 x 0.5 x (0.75 x 13 x 18) x 3 = 4 x 0.5 x 175.
The 6dF Galaxy Survey Design and Goals Matthew Colless The 6dFGS Workshop AAO, Sydney, May 2002.
The CoRoT ground-based complementary archive The CoRoT ground-based complementary archive Monica Rainer, Ennio Poretti M. Rosa Panzera, Angelo Mistò INAF.
The FMOS Facility for the SUBARU telescope Gavin Dalton Oxford/RAL.
The 6dF VPH Upgrade and other instrumental issues Will Saunders, Martin Ostreich, Allan Lankshear, Brendan Jones, Mick Kanonczuk, Kristin Fiegert, John.
N. Summary Phil Hinz Principal Investigator. Performance N-2.
By : Ramiro Torres GALAXY NGC INTRODUCTION: My discussion will cover the following: Brief description of the project. Object of Observation. How.
S. B. Holmes, P. Massey (Lowell Observatory) Detections Using data obtained with the MOSAIC 8k x 8k CCD at the 4-m Mayall telescope at KPNO, we have been.
HARPS Data Flow System Christophe Lovis Geneva Observatory HARPS-N PDR, 6-7 December 2007, Cambridge MA.
ADMIT: ALMA Data Mining Toolkit  Developed by University of Maryland, University of Illinois, and NRAO (PI: L. Mundy)  Goal: First-view science data.
The 6dF Galaxy Redshift Survey: Status Report and Data Release 2 Heath Jones ANU/AAO Will Saunders AAO Mike Read Edinburgh Matthew Colless AAO 100,000.
Multiobject Spectroscopy: Preparing and performing Michael Balogh University of Durham.
THE INTEGRATED PHOTONIC SPECTROGRAPH MULTIPLE OFF-AXIS INPUTS AND TELESCOPE RESULTS Nick Cvetojevic 1,2, Nemanja Jovanovic 1,2, Joss Bland-Hawthorn 3,
6dFGS data quality: comparison of pipeline and IRAF redshifts Lesa Moore Macquarie University AAO 6dF Workshop 2005.
The 6dF Galaxy Survey - The First Year Will Saunders Anglo-Australian Observatory.
The 6dF Galaxy Survey - The Target Samples Will Saunders Anglo-Australian Observatory.
Page 1 NHSC PACS Web Tutorial PACS 301 nhsc.ipac.caltech.edu/helpdesk NHSC/PACS Web Tutorials Running the PACS Spectrometer pipeline for CHOP/NOD Mode.
22 Copyright © 2008, Oracle. All rights reserved. Multi-User Development.
HIFI Tutorial 1: Running the HIFI Pipelines and Adaptations A.P.Marston ESAC 27 June 2013.
WS 9-1 ANSYS, Inc. Proprietary © 2009 ANSYS, Inc. All rights reserved. February 27, 2009 Inventory # Workshop 9 Taylor Impact Test – “What if” Study.
Competitive Science with the WHT for Nearby Unresolved Galaxies Reynier Peletier Kapteyn Astronomical Institute Groningen.
June 27-29, DC2 Software Workshop - 1 Tom Stephens GSSC Database Programmer GSSC Data Servers for DC2.
26th October 2005 HST Calibration Workshop 1 The New GSC-II and it’s Use for HST Brian McLean Archive Sciences Branch.
Millennium/Agresso Interface Yvonne Desmond, Gillian Donagher, Dublin Institute of Technology
GSPC -II Program GOAL: extend GSPC-I photometry to B = V ˜ 20 add R band to calibrate red second-epoch surveys HOW: take B,V,R CCD exposures centered at.
SINFONI data reduction using the ESO pipeline. Instrument design and its impact on the data (I) integral field spectrometer using mirrors brickwall pattern.
A.Zanichelli, B.Garilli, M.Scodeggio, D.Rizzo
JWST Science Policy & Science Parallels
Calibration meeting summary
NRAO VLA Archive Survey
NHSC/PACS Web Tutorials
Evaluation of 6dF Data Lesa Moore Macquarie University
Gustaaf van Moorsel September 9, 2003
Echidna: current status and expected performance
Amos Introduction In this tutorial, you will be briefly introduced to the student version of the SEM software known as Amos. You should download the current.
Rational Publishing Engine RQM Multi Level Report Tutorial
PFIS Commissioning - SSII
Presentation transcript:

6dF workshsopATNF May 30th dF: Observing, data reduction & dataflow Q.A.Parker Macquarie University/AAO

6dF workshsopATNF May 30th Talk outline Brief summary of observing procedure 6dF data reduction with 6dFdr & runz Dataflow

6dF workshsopATNF May 30th 20023

6dF workshsopATNF May 30th Current 6dF observing team: Malcolm Hartley (observing management) Paul Cass (6dFdr) Ken Russell Fred Watson Dionne James (Bessell BOM programme) Will Saunders (post commissioning development, observing) Other 6dfsag members/qap as required

6dF workshsopATNF May 30th Standard 6dF Observing process Selection of `tiles’ from latest tiling run sufficient to cover night/run Consistent directory structure and field naming conventions ensures no confusion of input files, configure files etc for each nights observations Potential targets cross-checked against SCOS image thumbnails to remove contaminants prior to configuration.fld files created for each `cleaned’ tile pointing – includes merging in of suitable Tycho-2 guide stars 6dfconfigure run on.fld files for given field plate (takes into account broken fibres etc)

6dF workshsopATNF May 30th Standard 6dF.fld file structure * comment line - 6dF field configuration file (an ascii file) LABEL target field number 1 xyz cluster UTDATE EQUINOX J CENTRE * end of required header info * these are fiducial star positions F F brightest star F F fiducial star * these are target object positions NGC P galaxy target ic P galaxy target PHR P galaxy target.. etc up to 200 say * these are checked blank sky positions * sky S blank sky (checked) sky S blank sky (checked).. etc up to 20 (say)

6dF workshsopATNF May 30th Observing process cont. Once field configuration has been tested the output configuration (.sds file) is input to the robot configure software Configuration typically takes an hour for a full 150 fibre field If possible first 2 fields will have been prepared earlier in the afternoon with the first ready to go before the end of astronomical twilight Availability of two field plates enables one to be configured whilst the other is being observed minutes are needed to mount each fibred 6dF field plate in the telescope, take dome flat-fields and arc frames and for acquiring the field on the sky. Acquire both 600V (1 hr) and 316R (0.5hr) observations for each field 5 fields per night have been achieved during the winter lunations and 3 are possible in the summer lunations

6dF workshsopATNF May 30th dF R-theta robot and field plate

6dF workshsopATNF May 30th Data acquisition via 6dF CICADA CICADA has been customised for 6dF in the following ways: A 6dF instrument configuration plug- in added An interface to the UK Schmidt TEL_CONTROL built as a TCS plug-in A FITS plug-in written to insert 6dF BINTABLE extensions describing the 6dF instrument configuration

6dF workshsopATNF May 30th

6dF workshsopATNF May 30th

6dF workshsopATNF May 30th dF commissioning data frame Night sky lines Blue regionRed region Emission lines

6dF workshsopATNF May 30th dFdr: creating 1-D calibrated spectra Directly analogous to 2dFdr – has same basic functionality and very similar GUI Specifically modified to work with 6dF data frames by Jeremy Bailey (AAO) After some development now offers a relatively stable platform for reduction on standard 6DFGRS data almost as a `black box’ Care needs to be taken with the observations to ensure trouble free processing through the 6dfdr package

6dF workshsopATNF May 30th Running 6dFdr Requires at least 1 Flat field frame, 1 arc frame and 3 or more data frames 6dfdr runs on Starlink sdf files so need to convert from cicada output fits images (tool available e.g. fits2ndf) Once 6dfdr is launched simply a question of going to `setup’ menu & select prefix identifying frames in the run Select the Flat field - reduce it - check tram line fitting is o.k. Select the Arc - reduce Arc Select data frames – reduce data frames Combine the individual reduced data frames Plot spectra from combined reduced frames to check o.k. Exit 6dfdr and cleanup all unwanted files

6dF workshsopATNF May 30th

6dF workshsopATNF May 30th

6dF workshsopATNF May 30th

6dF workshsopATNF May 30th

6dF workshsopATNF May 30th

6dF workshsopATNF May 30th

6dF workshsopATNF May 30th

6dF workshsopATNF May 30th R data

6dF workshsopATNF May 30th RUNZ: semi-automated Z determinations Modified version of the code developed principally by Will Sutherland for the 2dFGRS. Offers a convenient mechanism for interactive redshift estimation from 1-D 6dfdr reduced spectra Some extra functionality offered by WS/QAP Currently need to reduce the 600V and 316R data separately though are plans to splice the 2 slightly overlapping regions together after attempting flux-calibration Still needs modifications to make it run more smoothly with 6dfdr reduced data (was developed for and works better with a wider wavelength coverage than 600V and 316R provide alone).

6dF workshsopATNF May 30th

6dF workshsopATNF May 30th Can autofit to selected lines…

6dF workshsopATNF May 30th

6dF workshsopATNF May 30th

6dF workshsopATNF May 30th dF WWW interface & form of data product The www interface will provide access to the reduced survey data in the form of object parameters for each object together with their associated reduced 6dF spectra. For each observed object we would provide a minimum of: object ID & position (J2000 ra,dec) + optional l,b 2MASS J,H,K photometry (with errors), DENIS I-band magnitude (with error) classification/spectral type (e.g. galaxy, AGN, stellar contaminant etc) redshift, z error, optical magnitude structural image information from the SCOS optical parameter lists fully reduced 1-D spectra Basic ancillary information for each entry such as date of observation, grating, 6dF field plate, fibre number etc

6dF workshsopATNF May 30th Higher dispersion 600V data Additionally the velocity dispersions from the 600V data would include most of the above parameters plus measurements (with errors) of: velocity dispersion & line indices, galaxy diameters, distance estimates peculiar velocities. The www interface would permit all (or a selection) of the object parameters to be down-loaded including an option to down-load the associated 1-D spectra. The interface would also permit direct access to the raw/partially processed image frames via a suitable query system and survey field map. It is estimated that 3 months of software effort would be required to produce such an interface based On PERL scripts.

6dF workshsopATNF May 30th Dataflow to Database Final details still to be sorted Involves assimilation of reduced spectra AND redshift/peculiar velocity results into the current master results catalogue Results catalogue contains observed objects from the master input catalogue

6dF workshsopATNF May 30th WFAU 6dF involvement includes: Involvement in survey data products management commissioning support (qap - done) help with target catalogue construction (mar/qap done) archival of survey data products community access to the data products via development of suitable www interface keen scientific interest in survey exploitation (Andy Taylor, Dan Burkey, Andy Lawrence) PhD student (started Oct 2000)

6dF workshsopATNF May 30th Data and information flow in the 6DFGRS

6dF workshsopATNF May 30th

6dF workshsopATNF May 30th