Astro-WISE. an Astronomical Wide-field Imaging System for Europe E v e r y o n e John P. McFarland OmegaCEN, Kapteyn Astronomical Institute Groningen,

Slides:



Advertisements
Similar presentations
Future Directions and Initiatives in the Use of Remote Sensing for Water Quality.
Advertisements

AstroWISE LC workshop 2008 VESUVIO/ beyond AstroWISE OmegaCEN NOVA – Kapteyn Institute – University Groningen 3 April 2008 VVvve VESUVIO/ beyond AstroWISE.
ASTRO-WISE Science “A new approach to astronomical archiving & researching for the data- flooded era” Gijs Verdoes Kleijn OmegaCEN, Kapteyn Astronomical.
"Een nieuwe blik op sterrenkunde" "Panoramische camera's en het Astro-Wise systeem" Gijs Verdoes Kleijn Kapteyn Astronomical Institute, University of Groningen.
GSMT Control Workshop Tucson, September 11-12, 2001 Pointing Control for a giant segmented mirror telescope Patrick Wallace Rutherford Appleton Laboratory.
2012 March 22RIA Workshop - Science with ORM and CAHA in the next decade.
Polarimetry Christoph Keller. Polarimetry Requirements Polarization sensitivity: amount of fractional polarization that can be detected above a (spatially.
Developing JWST Pipelines at STScI Robert Jedrzejewski.
VISTA/WFCAM pipelines summit pipeline: real time DQC verified raw product to Garching standard pipeline: instrumental signature removal, catalogue production,
1 Preliminary Design Review Tucson, Arizona August 29 th – September 2 nd, 2011 Data Management: Input Data Prepared by: Simon Krughoff ImSim Project:
All these Sky Pixels Are Yours The evolution of telescopes and CCD Arrays: The Coming Data Nightmare.
Lofar Survey workshop 8/3/2007 Lofar -Surveys and AstroWise OmegaCEN NOVA – Kapteyn Institute -RuG 8 March 2007 Lofar Survey Workshop OmegaCEN NOVA – Kapteyn.
NWO Meeting 24 May 04 a Virtual Survey System AstroWise- OmegaCAM – Lofar – Euro-VO a Virtual Survey System AstroWise- OmegaCAM – Lofar – Euro-VO Edwin.
XLDB -Lyon Aug 2009 Astro-WISE -> TarGet OmegaCEN – TarGet Kapteyn Astronomical Institute University of Groningen 28 August 2009 UU OmegaCEN – TarGet Kapteyn.
VO-lecture Valentijn 17/1/2007 Astro-Wise Wide Field imaging Facilitate: handling, calibration, quality control, pipelining, user tuned research, archiving,
VISTA pipelines summit pipeline: real time DQC verified raw product to Garching standard pipeline: instrumental signature removal, catalogue production,
The Astro-Wise Pipeline Conceptual Design Review Roeland Rengelink Requirements Development Framework Prototype.
Data Management Subsystem: Data Processing, Calibration and Archive Systems for JWST with implications for HST Gretchen Greene & Perry Greenfield.
Detector Monitoring as part of VLT Science and Data Flow Operations Wolfgang Hummel DMO/DFO/QC group Lander de Bilbao, SDD/pipeline group Andrea Modigliani,
Astro-Wise workshop Nov 2005 Astro-Wise workshop Lorentz center Nov 2005 Munchen, Napoli, Paris, Bonn, Bochum, Nijmegen, Leiden, Groningen Lorentz.
Dec 2, 2014 Hubble Legacy Archive and Hubble Source Catalog Rick White & Brad Whitmore Current teams: HLA: Michael Dulude, Mark Kyprianou, Steve Lubow,
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA COS Pipeline Language(s) We plan to develop CALCOS using Python and C Another programming language?
1 The EIS Experience: Lessons Learned May 12, 2005.
Raw data recipes SGDP Science Grade Data Products Wolfram Freudling DPD / SDP Group.
Rings Node Mitch Gordon Mark Showalter MC Face-to-Face Meeting Westwood, California 26,27 August 2014.
3rd September 2006SKADS Workshop 2006Mike Garrett 1 DS2 - Science & Data Simulations Mike Garrett (JIVE)
Paul Alexander & Jaap BregmanProcessing challenge SKADS Wide-field workshop SKA Data Flow and Processing – a key SKA design driver Paul Alexander and Jaap.
10 June 2002Towards an International VO - Garching bei Munchen 1 ASTRO-WISE An Astronomical Wide-field Imaging System for Europe Konrad Kuijken, Edwin.
Astro-WISE workshop 2008 Astro-WISE Astro-WISE workshop Lorentz center Leiden OmegaCEN NOVA – Kapteyn Institute – University Groningen 31 March – 4 April.
LSST: Preparing for the Data Avalanche through Partitioning, Parallelization, and Provenance Kirk Borne (Perot Systems Corporation / NASA GSFC and George.
AstroWise((G)A)VO Meeting 6 May 2004 ASTRO-WISE- federation OmegaCEN AstroWise a Virtual Survey System OmegaCAM – Lofar – AstroGrid –((G)A) VO AstroWise.
Astro-WISE workshop, 31/03 – 03/ Ewout Helmich Image Stacking in Astro-WISE ➢ Why this talk? ➢ Infrared data: lots of short exposures to stack.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Integration of Astro-WISE with Grid storage.
EURO-VO workshop 1 July 2005 A Virtual Survey SYSTEM Astro-Wise NOVA/Kapteyn – OA Capodimonte ESO – Terapix – US Munich/MPE National WFI datacenters NL-I-D-Fr/ESO.
EScience May 2007 From Photons to Petabytes: Astronomy in the Era of Large Scale Surveys and Virtual Observatories R. Chris Smith NOAO/CTIO, LSST.
Virtual Survey System sept 04 ASTRO-WISE- federation OmegaCEN AstroWise a Virtual Survey System OmegaCAM – Lofar – AstroGrid –((G)A) VO AstroWise a Virtual.
Prologue Major VO objective: “Data at your fingertips” (Lawrence) VO-user’s desire: “going backstage” –Data quality assessment by user (talk Gilmore)
Astro-WISE and pre-calibrated data and external catalogs For the Astro-WISE consortium Gijs Verdoes Kleijn John McFarland.
Photometric calibration in Astro-WISE For the Astro-WISE consortium: Gijs Verdoes Kleijn OmegaCEN/Kapteyn Groningen University (and Philippe Heraudeau,
1 Imaging Surveys: Goals/Challenges May 12, 2005 Luiz da Costa European Southern Observatory.
Slide 1 Archive Computing: Scalable Computing Environments on Very Large Archives Andreas J. Wicenec 13-June-2002.
Large Area Surveys - I Large area surveys can answer fundamental questions about the distribution of gas in galaxy clusters, how gas cycles in and out.
Pan-STARRS Seminar: IPPEugene Magnier Pan-STARRS Image Processing Pipeline An Overview IFA Pan-STARRS Seminar 735 October 6, 2004.
The European Hubble Space Telescope Legacy Archive Wolfram Freudling.
1 Leiden, November 20-21, 2001OAC ASTROWISE TEAM OAC WP4: OAC BeoWulf Hardware choice criteria : physical space problem flexible configuration cope with.
Today Multiple Lenses The Eye Magnifiers & Microscopes
WFC3 PIPELINE CDR Jim Rose October 16, 2001OPUS Science Data Processing Space Telescope Science Institute 1 of 13 Science Data Processing
Gijs Verdoes Kleijn Edwin Valentijn Marjolein Cuppen for the Astro-WISE consortium.
Frazer OwenNSF EVLA Mid-Project Review May 11-12, Transition to EVLA
Distance Estimation Ohad Eliyahoo And Ori Zakin. Introduction Current range estimation techniques require use of an active device such as a laser or radar.
Astro-Wise prompt ● awe is a shell with uses such as: – Python – data reduction (parallel, “dpu”) – interactive analysis (eclipse) – calculator – plotting.
Faculty meeting - 13 Dec 2006 The Hubble Legacy Archive Harald Kuntschner & ST-ECF staff 13 December 2006.
Short Description of ‘The SIKKEMA* Set’ Gert Sikkema, Kapteyn Institute, Groningen * Surname of a Phd student who has now quite some experience with the.
26th October 2005 HST Calibration Workshop 1 The New GSC-II and it’s Use for HST Brian McLean Archive Sciences Branch.
Distributed parallel processing analysis framework for Belle II and Hyper Suprime-Cam MINEO Sogo (Univ. Tokyo), ITOH Ryosuke, KATAYAMA Nobu (KEK), LEE.
Metadata for the SKA - Niruj Mohan Ramanujam, NCRA.
The secondary standards programme for OmegaCAM at the VST Gijs Verdoes Kleijn, Ronald Vermeij & Edwin Valentijn For the Astro-Wise consortium OmegaCEN.
Future LBO Developments
NOVA submm R&D program A. Baryshev, R. Hesper, A. Khudchenko, J. Barkhof, M. Bekema, P. Dmitriev, K. Rudakov, V. Koshelets, F.P. Mena, R. Finger // SRON/RuG/NOVA/IREE/TUD/UCHILE.
From LSE-30: Observatory System Spec.
A Difference Imaging Tool
The Hubble Legacy Archive (HLA) Slitless Spectroscopy Project
Optical Survey Astronomy DATA at NCSA
Mark Hunten NOAO MI Program
ASTRO-WISE workshop Nov 03
Software & Hardware for Wavefront Estimation Pipeline Development Te-Wei Tsai Software Engineer Joint Technical Meeting March 6, 2017.
Observing with Modern Observatories (the data flow)
Solve the equation: 6 x - 2 = 7 x + 7 Select the correct answer.
Workshop s43 Dynamic Geometry Session C.
copyright Robert J. Marks II
Presentation transcript:

Astro-WISE

an Astronomical Wide-field Imaging System for Europe E v e r y o n e John P. McFarland OmegaCEN, Kapteyn Astronomical Institute Groningen, NL 20 November 2006LC2006 Workshop

Other Data Sources ● No real OmegaCAM data yet ● Vast amounts of public archive data ● Plenty of sky to analyze and calibrate ● Feed the Information System ● Support Everyone in Astro-WISE

Data Sources ● Current Optical Data Sources – OmegaCAM (test data only) – WFI – WFC (one config) – MDM8K – SUP (one config) ● Potential Data Sources – HST ACS, VIMOS, MOSAIC I & II, IMACS, MegaCAM,..., VISTA, Pan-STARRS, LSST

Multi-Config ● Originally only one configuration supported – Chip geometry (NAXIS1, NAXIS2) – Focal plane geometry (astrometry) – Header layout (keywords) ● Multiple configurations needed – Dynamic instrument lay-outs – Software changes – Hardware changes

HeaderTranslator ● Raw data interface to AWE ● Makes all data uniform ● Front-end for multiple configurations – Feed signature to HeaderTranslator – Use dictionaries to return correct configuration – Adaptive RawFrame.make() ● Remaps chip geometry ● Masks invalid regions with non-numbers – Bring all configurations to uniformity

Geometry Remapping

PyFitsIO ● Non-number aware replacement to Eclipse ● Uses NumArray and PyFits instead of qfits ● Currently performance limited – Impending system upgrades will help solve this – NumPy and SciPy’s Weave library ● /

Summary ● Astro-WISE is ready ● Single configurations fully supported ● Multiple configurations will be supported – Need PyFitsIO