ASTRO-WISE workshop Nov 03

Slides:

Advertisements

Similar presentations

Edwin A. Valentijn Prof Astronomical Information Technology Target- OmegaCEN – Kapteyn University of Groningen e-science platform 29 October2013 Target.

Advertisements

ASTRO-WISE Science “A new approach to astronomical archiving & researching for the data- flooded era” Gijs Verdoes Kleijn OmegaCEN, Kapteyn Astronomical.

"Een nieuwe blik op sterrenkunde" "Panoramische camera's en het Astro-Wise systeem" Gijs Verdoes Kleijn Kapteyn Astronomical Institute, University of Groningen.

VISTA/WFCAM pipelines summit pipeline: real time DQC verified raw product to Garching standard pipeline: instrumental signature removal, catalogue production,

1Lou Somers Software Engineering Projects 2IP35 Autumn 2014

Lofar Survey workshop 8/3/2007 Lofar -Surveys and AstroWise OmegaCEN NOVA – Kapteyn Institute -RuG 8 March 2007 Lofar Survey Workshop OmegaCEN NOVA – Kapteyn.

NWO Meeting 24 May 04 a Virtual Survey System AstroWise- OmegaCAM – Lofar – Euro-VO a Virtual Survey System AstroWise- OmegaCAM – Lofar – Euro-VO Edwin.

KIDS: mapping the universe with weak lensing Konrad Kuijken, Leiden.

XLDB -Lyon Aug 2009 Astro-WISE -> TarGet OmegaCEN – TarGet Kapteyn Astronomical Institute University of Groningen 28 August 2009 UU OmegaCEN – TarGet Kapteyn.

VO-lecture Valentijn 17/1/2007 Astro-Wise Wide Field imaging Facilitate: handling, calibration, quality control, pipelining, user tuned research, archiving,

WFAU Tapes === Store 6 x dual PCs 3GHz Xeons 6 x 1 Tbyte local disks 2 Tbyte ingest buffer 10 Tbytes of raw 20 Tbytes of processed WFCAM archive storage.

The Astro-Wise Pipeline Conceptual Design Review Roeland Rengelink Requirements Development Framework Prototype.

Hunt for Molecules, Paris, 2005-Sep-20 Software Development for ALMA Robert LUCAS IRAM Grenoble France.

Astro-Wise workshop Nov 2005 Astro-Wise workshop Lorentz center Nov 2005 Munchen, Napoli, Paris, Bonn, Bochum, Nijmegen, Leiden, Groningen Lorentz.

EVLA Computing Overview Gareth Hunt EVLA Advisory Committee 2002 June

KIDS requirements Dave Wilman for the KIDS team The KIDS operational plan and the role of AstroWise. List focussed on open questions: discussion required!

OmegaCAM: The 16k x 16k Survey Camera for the VST Calibration, Data Analysis Strategy and Software Calibration, Data Analysis Strategy and Software Erik.

Markus Dolensky, ESO Technical Lead The AVO Project Overview & Context ASTRO-WISE ((G)A)VO Meeting, Groningen, 06-May-2004 A number of slides are based.

Astro-WISE & Grid Fokke Dijkstra – Donald Smits Centre for Information Technology Andrey Belikov – OmegaCEN, Kapteyn institute University of Groningen.

10 June 2002Towards an International VO - Garching bei Munchen 1 ASTRO-WISE An Astronomical Wide-field Imaging System for Europe Konrad Kuijken, Edwin.

CRISP & SKA WP19 Status. Overview Staffing SKA Preconstruction phase Tiered Data Delivery Infrastructure Prototype deployment.

Astro-WISE workshop 2008 Astro-WISE Astro-WISE workshop Lorentz center Leiden OmegaCEN NOVA – Kapteyn Institute – University Groningen 31 March – 4 April.

AstroWise((G)A)VO Meeting 6 May 2004 ASTRO-WISE- federation OmegaCEN AstroWise a Virtual Survey System OmegaCAM – Lofar – AstroGrid –((G)A) VO AstroWise.

EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Integration of Astro-WISE with Grid storage.

EURO-VO workshop 1 July 2005 A Virtual Survey SYSTEM Astro-Wise NOVA/Kapteyn – OA Capodimonte ESO – Terapix – US Munich/MPE National WFI datacenters NL-I-D-Fr/ESO.

Virtual Survey System sept 04 ASTRO-WISE- federation OmegaCEN AstroWise a Virtual Survey System OmegaCAM – Lofar – AstroGrid –((G)A) VO AstroWise a Virtual.

1 Groningen, November 2003 ASTROWISE OAC TEAM The ASTRO-WISE project: status at OAC The OAC AW team: J.M. Alcalà, F. Getman, A. Grado, M. Pavlov,

Prologue Major VO objective: “Data at your fingertips” (Lawrence) VO-user’s desire: “going backstage” –Data quality assessment by user (talk Gilmore)

Astro-WISE and pre-calibrated data and external catalogs For the Astro-WISE consortium Gijs Verdoes Kleijn John McFarland.

1 HST Pipeline Project Review March 14, Summary – Priorities Get H/W installed and available to users Transition Development and Testing groups.

Software Development and Deployment PDS Management Council Face-to-Face Los Angeles, California August 26-27, 2014 Sean Hardman.

1 Leiden, November 20-21, 2001OAC ASTROWISE TEAM OAC WP4: OAC BeoWulf Hardware choice criteria : physical space problem flexible configuration cope with.

EURO-VO: GRID and VO Lofar Information System Design OmegaCEN Kapteyn Institute TARGET- Computing Center University Groningen Garching, 10 April 2008 Lofar.

N. RadziwillEVLA Advisory Committee Meeting May 8-9, 2006 NRAO End to End (e2e) Operations Division Nicole M. Radziwill.

Data Processing & Quality Control Group [ Faculty Meeting Sept Data Processing & Quality Control Quality Control Group head: Reinhard.

The OmegaCAM photometric systems. OmegaCAM calibration plan (1) Basic OmegaCAM terminology : ● Key bands vs User bands ● Key band -> User band transformation.

Surveys with OmegaCAM / VST KIDS Koen Kuijken, Leiden.

Gijs Verdoes Kleijn Edwin Valentijn Marjolein Cuppen for the Astro-WISE consortium.

Astro-WISE. an Astronomical Wide-field Imaging System for Europe E v e r y o n e John P. McFarland OmegaCEN, Kapteyn Astronomical Institute Groningen,

PDS4 Project Report PDS MC F2F University of Maryland Dan Crichton March 27,

Scenario use cases Szymon Mueller PSNC. Agenda 1.General description of experiment use case. 2.Detailed description of use cases: 1.Preparation for observation.

The secondary standards programme for OmegaCAM at the VST Gijs Verdoes Kleijn, Ronald Vermeij & Edwin Valentijn For the Astro-Wise consortium OmegaCEN.

April 1, 2008Patrick Bos / Kapteyn Astronomical Institute 1 Dwarf galaxies in the ACS Virgo Cluster Survey a bachelor research project by Patrick Bos supervised.

The OmegaWhite Survey Paul Groot Radboud Universiteit Nijmegen.

SOC 110 Week 1 Individual Group Communication Competencies Survey and Summary Complete the University Material: Group Communication Competencies Survey.

WEB 434 Week 5 Virtual Organization Paper And Presentation Check this A+ tutorial guideline at Week-5-Virtual-Organization-Paper-And-Presentation.

CMGT 411 Week 4 DQ 3 What is the definition of metrics? What metrics are used within an organization to monitor and report on organizational security?

CMGT 411 Week 5 DQ 2 What metrics are used within your organization to monitor and report on organizational security? Check this A+ tutorial guideline.

BSHS 382 Week 3 DQ 2 Check this A+ tutorial guideline at 382/BSHS-382-Week-3-DQ-2 How can you avoid bias when selecting.

BSHS 401 Week 5 Individual Documenting and Monitoring Check this A+ tutorial guideline at 401/BSHS-401-Week-5-Individual-

BIS 303 Week 3 DQ 2 What is your organization’s policy regarding the replacement or upgrading of hardware and software? Are there scheduled replacements.

BIS 320 Week 1 DQ 1 Think about functional areas within an organization, such as payroll, human resources, and sales. How are software and hardware used.

ACC 220 Week 8 Checkpoint Flexible Budgets Check this A+ tutorial guideline at Checkpoint-Flexible-Budgets.

LSST Commissioning Overview and Data Plan Charles (Chuck) Claver Beth Willman LSST System Scientist LSST Deputy Director SAC Meeting.

USM Photometric Redshifts for Astro-wise

LSST Commissioning Overview and Data Plan Charles (Chuck) Claver Beth Willman LSST System Scientist LSST Deputy Director SAC Meeting.

QC workshop Goals: implement QC tools and have a demo of what we have reached by end of the week (i.e. Thursday) Learn each other new developpements.

Data Processing Status

Artem Petrosyan (JINR), Danila Oleynik (JINR), Julia Andreeva (CERN)

VO – NOVA/NL wp3/wp5 Optical SURVEYS Lofar VST-OMEGACAM:

EGEE NA4 Lofar Lofar Information System Design OmegaCEN

Astrometric Calibration

Calibration CSL Monitor

3.2 Virtualisation.

IST 6161 Enthusiastic Studysnaptutorial.com

Scheduling Toolkit Observation Scheduling Boyd Waters, NRAO

PCC Update 04/22/09 Implementation Phase 1

Click to add title Planning for LSST Verification George Angeli LSST All Hands Meeting Tucson August 15, 2016.

User interaction and workflow management in Grid enabled e-VLBI experiments Dominik Stokłosa Poznań Supercomputing and Networking Center, Supercomputing.

GLAST Large Area Telescope

Presentation transcript:

ASTRO-WISE workshop 17-20 Nov 03 Calibration pipelines Photo-metric pipeline Edwin A. Valentijn AstroWise Workshop 17Nov 03 Groningen

Welcome From small work visit to small workshop Flexible- meet – smell Status – OmegaCAM+VST delays; MegaCAM ingest WFI in AstroWise system AstroWise Prototype OK Q4 2003 class definitions We are half way; on schedule; system is open for advanced user/developers AstroWise Workshop 17Nov 03 Groningen

VST AstroWise Workshop 17Nov 03 Groningen

This week Calibration pipelines + QC Leading to Class definitions Photometry, bias, ff, fringe Leading to Class definitions Understanding how to build from Classes onwards OmegaCAM: ESO- DMD no – ++archive OmegaCAM: Astro-Wise very strict WFI : Astro-Wise inherits CDF INT : Astro-Wise inherits AstroWise Workshop 17Nov 03 Groningen

practical Virgo cluster for users Michiel Tempelaar Agenda Documentation High Performance Computing AstroWise Workshop 17Nov 03 Groningen

VST - Virtual Survey Telescope AstroWise Workshop 17Nov 03 Groningen

Calibration procedures Sanity checks Image pipeline Source pipeline Calibration procedures Quality control AstroWise Workshop 17Nov 03 Groningen

AstroWise Pipelines Bias pipeline Photometric pipeline Image pipeline Flatfield pipeline Source pipeline AstroWise Workshop 17Nov 03 Groningen

Monitoring Photometric Calibration u’ g’ r’ i’ AstroWise Workshop 17Nov 03 Groningen

Schedule Hardware Software OmegaCEN: 3Tbyte + servers + 8 node cluster operational ۷ OAC , USM , Terapix + CVS federation ۷ Software Design – review Q2 2002- ۷ Design – formalized July 2003 ۷ WFI +INT Prototype operational Q2 2003 ۷ Basic operations – Q4 2003 Evaluate and prepare for mass production 2004 Qualify and populate 2005 Deliver survey system – satellites AstroWise Workshop 17Nov 03 Groningen