Accessing APOGEE Data Jon Holtzman (NMSU) APOGEE team.

Slides:



Advertisements
Similar presentations
Accessing RAVE hardware for PLATO PIC Ulisse Munari Tomaz Zwitter.
Advertisements

ASPCAP Review Progress report and schedule Q2. SOFTWARE PACKAGES October 4-5, /14/2015.
NSF DUE ; Module 4.3. NSF DUE ; GeoTEd Partners Module name and number.
基于 LAMOST 巡天数据的大样 本 M 巨星搜寻和分类 钟靖 中国科学院上海天文台. M giants Red : surface temperature lower than 4000K Luminous: M J from to mag (Covey et al.2007)
Workshop: First look, Calibrations & RV standard IAP
The accuracy of Giraffe measurements of radial velocity in young clusters Richard Jackson – Keele University in collaboration with Rob Jeffries and Amy.
Spectroscopic Data ASTR 3010 Lecture 15 Textbook Ch.11.
Echelle spectra reduction with IRAF*
FMOS Observations and Data 14 January 2004 FMOS Science Workshop.
AEOS Telescope + Image-Slicer/ Spectrograph Data Reduction and Results for June 8, 2006.
WASP: getting started Peter Wheatley WASP getting started.
Processing Status June 2009 Mary Williams Padova Meeting, 11/06/09.
SONG – Stellar Observations Network Group - The robotic software for the SONG network S.Frandsen 1, Eric Weiss 1, J. Skottfelt 2, M.F. Andersen 1, F.Grundahl.
1 m – APOGEE Feed Jon Holtzman Diane Feuillet (NMSU)
6dF Data Release 2 The good, the bad and the ugly Will Saunders AAO 27/04/05.
APOGEE DR10 Everybody. Data taken from April 2011 through July 2012 – First year survey data all observed spectra, even if all visits not complete: summed.
Memorandam of the discussion on FMOS observations and data kicked off by Ian Lewis Masayuki Akiyama 14 January 2004 FMOS Science Workshop.
6e-1 Science Data Products Daryl Swade DMS Systems Engineer S&OC System Design Review #1.
Data Management Subsystem: Data Processing, Calibration and Archive Systems for JWST with implications for HST Gretchen Greene & Perry Greenfield.
STIS Closeout Plan Paul Goudfrooij 2005 HST Calibration Workshop, 10/26/2005.
The reduction and analysis of spectra of B stars
Round Table Discussion Of Spectroscopic Processing & Products for the Scientific Legacy Nov 16, 2012HST Spec Pipeline & Legacy Products Round Table Kaiser,
SDSS-KSG 08 Workshop1 The SDSS DR7 and KIAS SDSS mirror Won-Kee Park ARCSEC, Sejong University 2008 SDSS-KSG Workshop.
1 The Instant Data Warehouse Released 15/01/ Hello and Welcome!! Today I am very pleased to announce the release of the 'Instant Data Warehouse'.
1 Workshop First look, calibrations, reference sources IAP – 24 November CU6 structure 2.Aims of the workshop / open questions.
PACS Page 1 NHSC Data Processing Workshop – Pasadena Sept 10-14, 2012 SPIRE Spectrometer Data Reduction: Mapping Observations Nanyao Lu NHSC/IPAC (On behalf.
Telescope Guiding with a HyViSI H2RG Used in Guide Mode Lance Simms Detectors for Astronomy /2/09.
Dec 8, Line Widths/ Resolution (1) ThAr UNe Sky Solid: fiber 150 Open: fibers 10/290 Each point is median of results from lots of frames (few per.
Fuerteventura, Spain – May 25, 2013 Physical parameters of a sample of M dwarfs from high- resolution near-infrared spectra Carlos del Burgo Collaborators:
Table 1. Observation Parameters Searching for Radial Velocity Variations in  Carinae Rosina C. Iping (CUA/NASA/GSFC), George Sonneborn, Ted R. Gull (NASA/GSFC),
APOGEE-2 Data Infrastructure Jon Holtzman (NMSU) APOGEE team.
MAST Users Group – July 2009 MAST will provide the archive user interface for Kepler data, primarily light curves and target pixel data. ASB Staffing for.
High Precision Astrometry and Parallax from Spatial Scanning Part 2 Adam Riess and Stefano Casertano.
Discussion - Survey Design Survey product equation: #fields = fld/nt x useable x (%xnights/yr) x years = 4 x 0.5 x (0.75 x 13 x 18) x 3 = 4 x 0.5 x 175.
APOGEE-2 and Data Infrastructure Jon Holtzman (NMSU) APOGEE team (Steve Majewski, PI)
JWST Calibration Error Budget Jerry Kriss. 15 March 20072/14 JWST Flux & Wavelength Calibration Requirements SR-20: JWST shall be capable of achieving.
APOGEE DR12 Status/Discussion. Schedule Nominal DR12 deadline is July 31, i.e. tomorrow SDSS-III upper level management was consulted about a small delay.
Data products of GuoShouJing telescope(LAMOST) pipeline and current problems LUO LAMOST Workshop.
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA COS Pipeline Calibration Goals of CALCOS Association Table Input and Output Files High Level.
Software Project MassAnalyst Roeland Luitwieler Marnix Kammer April 24, 2006.
HARPS Data Flow System Christophe Lovis Geneva Observatory HARPS-N PDR, 6-7 December 2007, Cambridge MA.
PACS Hitchhiker’s Guide to Herschel Archive Workshop – Pasadena 6 th - 10 th Oct 2014 The PACS Spectrometer: Overview and Products Roberta Paladini NHSC/IPAC.
MOS Data Reduction Michael Balogh University of Durham.
Mantid Stakeholder Review Nick Draper 01/11/2007.
STATUS OF APOGEE DATA PRODUCTS, REDUCTION, AND ANALYSIS Jon Holtzman (NMSU) David Nidever (UVa) Ana Garcia-Perez (UVa) Carlos Allende-Prieto (IAC) Szabolcs.
Practical applications: CCD spectroscopy Tracing path of 2-d spectrum across detector –Measuring position of spectrum on detector –Fitting a polynomial.
HLA WFPC2 Source List Photometric Quality Checks Version: August 25, 2008 Brad Whitmore 1.Introduction 2.Comparison with Ground-based Stetson Photometry.
14 January Observational Astronomy SPECTROSCOPIC data reduction Piskunov & Valenti 2002, A&A 385, 1095.
PACS NHSC Data Processing Workshop Aug 26-30, 2013 Page 1 SPIRE Spectrometer Data: Calibration Updates, User Data Reprocessing, and Other Issues Nanyao.
1 SUZAKU HUG 12-13April, 2006 Suzaku archive Lorella Angelini/HEASARC.
APOGEE-2 SRD Mini-Review December 5, 2013 APOGEE-2 SRD Data and Pipeline Requirements Jon Holtzman New Mexico State.
Selection and Characterization of Interesting Grism Spectra Gerhardt R. Meurer The Johns Hopkins University Gerhardt R. Meurer The Johns Hopkins University.
The HST/STIS Next Generation Spectral Library Michael Gregg, U.C. Davis/IGPP-LLNL David Silva, ESO (NOAO) John Rayner, IfA Guy Worthey, Washington State.
Improved ACS Geometrical Distortion Correction Richard Hook TIPS Meeting, STScI, 18th December 2003.
GSPC -II Program GOAL: extend GSPC-I photometry to B = V ˜ 20 add R band to calibrate red second-epoch surveys HOW: take B,V,R CCD exposures centered at.
Double Star Active Archive - STAFF-DWP Data errors and reprocessing Keith Yearby and Hugo Alleyne University of Sheffield Nicole Cornilleau-Wehrlin LPP.
A. Ealet Berkeley, december Spectrograph calibration Determination of specifications Calibration strategy Note in
SINFONI data reduction using the ESO pipeline. Instrument design and its impact on the data (I) integral field spectrometer using mirrors brickwall pattern.
Adding the s-Process to APOGEE Stellar Populations: - Evolving the Line List - Pushing to the M-dwarfs Verne V. Smith (NOAO) Katia Cunha, Matthew Shetrone,
Single Object Slitless Spectroscopy Simulations
A.Zanichelli, B.Garilli, M.Scodeggio, D.Rizzo
CASE-FOMBS Follow-up of One Million Bright Stars
JWST Pipeline Overview
A “Field Guide” to WFPC2 HLA Image Anomalies
Data Warehouse.
Databases, Web Pages and Archives
UVIS Calibration Update
Spectroscopy Workshop
ASPCAP Review Progress report and schedule Software/data status
M. Kezunovic (P.I.) S. S. Luo D. Ristanovic Texas A&M University
Presentation transcript:

Accessing APOGEE Data Jon Holtzman (NMSU) APOGEE team

– We want NEED people to use APOGEE data, tools and documentation – Draft APOGEE DR10 documentation: Data interfaces: - flat files, esp. summary allStar and allVisit FITS tables - CAS interface: TESTDR10 - SAS API and web app: in development (internal research database and webapp available) – We want to improve Documentation Sample tasks Perhaps, modify/add conditions flag bits (short timescale only) APOGEE data

Exposures (maybe not of general interest?) – Data cubes (apR) – 2D images (ap2D) – Extracted spectra (ap1D) – Sky subtracted and telluric corrected (apCframe) Visit spectra – Combine multiple exposures at different dither positions – apVisit files: native wavelength scale, but with wavelength array Combined spectra – Combine multiple visits, requires relative RVs – apStar files: resampled spectra to log(lambda) scale Derived products from spectra – Radial velocities and scatter from multiple measurements (done during combination) – Stellar parameters/chemical abundances from best-fitting template Parameters: Teff, log g, microturbulence (fixed), [M/H], [alpha/M], [C/M], [N/M] Other abundances in progress but not yet implemented – aspcapStar files: stellar parameters of best-fit, pseudo-continuum normalized spectra and best fiitting templates APOGEE data

Data quality/issues: spectra Chip gaps and wavelength coverage: 3 detectors, small fiber-to-fiber shifts Sky subtraction: OH lines are very bright + imperfect modelling  very apparent residuals Telluric correction: not always optimal (small wavelength calibration issues? Persistence: fraction of one detector, can by nasty Littrow ghost: can affect some spectra “Incomplete” spectra: DR10 releases all data taken through July 2012, even if more data is coming Pixel bitmasks flag many of these features, if you look at them!

Star level bitmasks Targeting flags APOGEE_TARGET1, APOGEE_TARGET2: main survey vs ancillary, telluric, etc. STARFLAG: bitmask flagging potential conditions, e.g. LOW_SNR BAD_PIXELS VERY_BRIGHT_NEIGHBOR PERSIST_HIGH

Radial velocities Most APOGEE data taken with multiple visits (>=3) per star, to identify binaries Repeatability between visits suggests typical accuracy around 150 m/s Some degradation from previous software versions Key RV catalog parameters: VSCATTER : > 1km/s might suggest binarity for cooler stars SYNTHSCATTER: scatter between 2 RV determinations: cross-correlation of visits with combined spectrum and of visits with best matching template; > 1 km/s might suggest issues

Data quality/issues: ASPCAP Current ASPCAP runs are fits for 6 parameters: Teff, log g, [M/H], [alpha/M], [C/M], [N/M] Teff, log g, [M/H], and [alpha/M] have been “calibrated” using observations of clusters: systematic corrections have been applied to these parameters, and are nonzero for Teff, log g, and [M/H] Results for [C/M] and [N/M] are more challenging to verify, and are more suspect In flat fields, PARAM (calibrated parameters) vs FPARAM (fit parameters) In CAS database, TEFF, LOGG, METALS, ALPHAFE (calibrated) vs/ FIT_TEFF, FIT_LOGG, FIT_METALS, FIT_ALPHAFE (fit) Key catalog bitmasks ASPCAP_FLAG: bitmask flagging potential conditions, e.g., STAR_BAD STAR_WARN PARAMFLAG: details about nature of ASCPAP_FLAG bits

DR10: Data taken from April 2011 through July 2012 – First year survey data all observed spectra, even if all visits not complete: summed spectra of what is available release spectra and ASPCAP results – Commissioning data (through June 2011): degraded LSF (especially red chip). No ASPCAP – 170 fields (includes a few commissioning-only fields) – 710 plates (+ sky frames + calibration frames/monitors) – 40-50K stars Looking past DR10 – 250+ fields available as of May, currently being combined – Plan to have DR10-level reductions of all year 2 data around time of DR10 release Scope of Data

Data access: flat files SAS: “flat” files Datamodel: APOGEE_TARGET: targeting files include all _possible_ targets as well as selected ones APOGEE_DATA: raw data cubes APOGEE_REDUX: reduced data APOGEE_REDUX: currently corresponds to Embedded web pages provide a guide and some static plots Embedded web pages Versions / organization Identify via apred_version/apstar_version/aspcap_version/results_version apred_version : contains visit files (apVisit) organized by plate/MJD apstar_version – contains combined star files, organized by field location aspcap_version – raw ASPCAP results, organized by field location results_version – adds ASPCAP “calibrated” results and sets some additional data quality bits Current version is r3/s3/a3/v302; DR10 version likely to be v303?

Summary “wrap-up” files Main summary data files allStar-v302.fits: catalog data for all DR10 stars allStar-v302.fits allVisit-v302.fits: catalog data for all DR10 visits allVisit-v302.fits: These files are not overly large (~60000 star entries in allStar currently), so are really quite manageable Pay attention to bitmasks! allstar=mrdfits(‘allStar-v302.fits’,1) ; skip stars with STAR_BAD (bit 23) and NO_ASPCAP_RESULT (bit 31)set in aspcapflag badbits=(2L^23 or 2L^31) gd=where((allstar.aspcapflag and badbits) gt 0) plot,s[gd].teff,s[gd].logg,…. ; find giant binaries badbits=(2^23 or 2^31) gd=where(allstar.vscatter gt 1 and (allstar.aspcapflag and badbits) eq 0 and s.logg lt 3.8)

Data access: API Can get programmatic access to data via APOGEE API (soon)APOGEE API One particularly useful application: downloading subset of spectra Also basis for SAS web app: visual interface to spectra APOGEE API currently under development, available in next several months Database used by API is loaded, graphical spectrum access available via web app:

Data access: CAS Data from summary files (allStar, allVisit, allPlates has been loaded into CAS (TESTDR10, currently restricted access) tables apogeePlate, apogeeStar, apogeeVisit, aspcapStar Example: Example SELECT top 10 p.star,p.ra, p.dec, p.glon, p.glat, p.vhelio_avg, p.vscatter, a.teff,a.logg,a.metals, v.vhelio FROM apogeeStar p JOIN aspcapStar a on a.apstar_id = p.apstar_id JOIN apogeeVisit v on a.star = v.star WHERE (a.aspcap_flag & dbo.fApogeeAspcapFlag('STAR_BAD')) = 0 and p.nvisits > 6 order by a.star Object search through CAS Object search through CAS implemented in sky server

Data access ATTEMPT COMPLAIN ENJOY WRITE PAPERS