An Overview of the TERAPIX pipeline

Slides:

Advertisements

Similar presentations

Computing Infrastructure

Advertisements

HEPiX, CASPUR, April 3-7, 2006 – Steve McDonald TRIUMF Steven McDonald & Konstantin Olchanski TRIUMF Network & Computing Services

INSTALLING LINUX.  Identify the proper Hardware  Methods for installing Linux  Determine a purpose for the Linux Machine  Linux File Systems  Linux.

VOCAL System Requirements and Scalability. System Recommendations The recommended hardware system to support the VOCAL system is: 700 MHz, Pentium III.

COMPUTER SYSTEM CAN BE DIVIDED INTO : 1- General Computer 2- Special Computer.

ASKAP Central Processor: Design and Implementation Calibration and Imaging Workshop 2014 ASTRONOMY AND SPACE SCIENCE Ben Humphreys | ASKAP Software and.

VISTA/WFCAM pipelines summit pipeline: real time DQC verified raw product to Garching standard pipeline: instrumental signature removal, catalogue production,

Title US-CMS User Facilities Vivian O’Dell US CMS Physics Meeting May 18, 2001.

Lesson 5-Accessing Networks. Overview Introduction to Windows XP Professional. Introduction to Novell Client. Introduction to Red Hat Linux workstation.

Cosmos Data Products Version Peter Capak (Caltech) May, 23, 2005 Kyoto Cosmos Meeting.

Selecting New Hardware What’s Most Important. Quality, Quality, Quality! Assume you are purchasing for 3 to 6 years Assume you are purchasing for 3 to.

Machine Emulation & Developer Workstation Environment – Microsoft’s VirtualPC Dan Dyer Metrolist, Inc.

Information Technology Ms. Abeer Helwa. Computer Generations First Generation (Vacuum Tubes) -They relied on the machine language to perform operations.

Online Databases Status Oracle 8i Servers, release Platform: Compaq Tru64 UNIX V5.1 (Rev. 732) Production DB d0onprd, on d0olc, 64 users, 34Gb.

1 CHAPTER 2 COMPUTER HARDWARE. 2 The Significance of Hardware  Pace of hardware development is extremely fast. Keeping up requires a basic understanding.

Technology Expectations in an Aeros Environment October 15, 2014.

The Astro-Wise Pipeline Conceptual Design Review Roeland Rengelink Requirements Development Framework Prototype.

Online Systems Status Review of requirements System configuration Current acquisitions Next steps... Upgrade Meeting 4-Sep-1997 Stu Fuess.

Software for PhotoDetectors CAD modeling, design and circuit simulation, optimization REPUBLIC OF SERBIA MINISTRY OF SCIENCE AND TECHNOLOGY University.

Quark Xpress8 Extension EasyPlace Submitted By: Bhawna Nigam Enrollment no

Characterisation Data Model applied to simulated data Mireille Louys, CDS and LSIIT Strasbourg.

Course ILT Basics of information technology Unit objectives Define “information technology” (IT), distinguish between hardware and software, and identify.

1 Workshop First look, calibrations, reference sources IAP – 24 November CU6 structure 2.Aims of the workshop / open questions.

Paul Scherrer Institut 5232 Villigen PSI HEPIX_AMST / / BJ95 PAUL SCHERRER INSTITUT THE PAUL SCHERRER INSTITUTE Swiss Light Source (SLS) Particle accelerator.

Hosting on a managed server hosted by TAG  No technical support required  Full backup of database and files  RAID 5 system means that if a hard drive.

Introduction to U.S. ATLAS Facilities Rich Baker Brookhaven National Lab.

Canadian Virtual Observatory David Schade Canadian Astronomy Data Centre Pat Dowler, Daniel Durand, Luc Simard, Norm Hill, Severin Gaudet.

3SAQS Technical Workshop February 25 th, 2015 Data Warehouse Current and Future Development Intermountain West Data Warehouse.

2-3 April 2001HEPSYSMAN Oxford Particle Physics Site Report Pete Gronbech Systems Manager.

Integra32 System - Training Course

April 2001 OPTICON workshop in Nice 1 PSF-fitting with SExtractor Emmanuel BERTIN (TERAPIX)

April 2001 OPTICON workshop in Nice 1 The PSF homogenization problem in large imaging surveys Emmanuel BERTIN (TERAPIX)

CSU - DCE Webmaster I Scaling Issues - Fort Collins, CO Copyright © XTR Systems, LLC Web Site Scaling Issues (or Size Really Does Matter) Instructor:

Data Processing of the 2010 Population and Housing Census September 2008, Bangkok, Thailand National Statistical Office, Thailand.

The Computer System CS 103: Computers and Application Software.

1 Leiden, November 20-21, 2001OAC ASTROWISE TEAM OAC WP4: OAC BeoWulf Hardware choice criteria : physical space problem flexible configuration cope with.

ClinicalSoftwareSolutions Patient focused.Business minded. Slide 1 Opus Server Architecture Fritz Feltner Sept 7, 2007 Director, IT and Systems Integration.

EVLA Data Processing PDR E2E Data Archive System John Benson, NRAO July 18, 2002.

January 30, 2016 RHIC/USATLAS Computing Facility Overview Dantong Yu Brookhaven National Lab.

Introduction To Computers

CHROME O/S. INTRODUCTION The chrome o/s is a new way of accessing the internet it uses a Linux based operating system that only uses internet.

Library Management System. Aim : To develop a project titled “LIBRARY MANAGEMENT” and is developed to maintain the operation done in a library. To develop.

© 2013 TmaxSoft Co., Ltd. All Rights Reserved.

Our New Submit Server. chtc.cs.wisc.edu One thing out of the way... Your science is King! We need rules to facilitate resource sharing. Given good reasons.

Compute and Storage For the Farm at Jlab

bitcurator-access-webtools Quick Start Guide

ALICE Computing Data Challenge VI

SOAR Data Reduction Pipelines

The Beijing Tier 2: status and plans

JSOC Status at SDO PSR-1 January 21-22, 2009 GSFC

SAP ECC 6.0 DEVELOPMENT ABAP ABAP DICTIONARY & Advanced Editor Abap

SDI (Satellite Data Ingestor)

Rosetta Science Ground Segment Overview

W3 Status Analyzer.

PC Farms & Central Data Recording

OUHEP STATUS Hardware OUHEP0, 2x Athlon 1GHz, 2 GB, 800GB RAID

Vanderbilt Tier 2 Project

Existing Perl/Oracle Pipeline

הכרת המחשב האישי PC - Personal Computer

Imaging data obtained with the

JDAT Production Hardware

הכרת המחשב האישי PC - Personal Computer

المحور 3 : العمليات الأساسية والمفاهيم

מבוא לטכנולוגיית מידע בארגון

Chapter 3 Hardware and software 1.

GIRO APPLICATION Current status and NEXT STEPS

GCSE OCR 4 Storage Computer Science J276 Unit 1

Chapter 3 Hardware and software 1.

Understanding input, output and storage devices

Presentation transcript:

An Overview of the TERAPIX pipeline Emmanuel BERTIN (TERAPIX) April 2001 OPTICON workshop in Nice

OPTICON workshop in Nice The people On site: Yannick Mellier (PI): getting money and scientific analysis Gilles Missonnier: Hardware, system manager and webmaster Mario Radovich (OC): Software development and scientific analysis (image processing, astrometric and photometric calibrations) Emmanuel Bertin: Software development and scientific analysis (image resampling and source extraction) Pierre Didelon: Software development (Pipeline database) Bertrand Morin: Software development (Pipeline database) Abroad: Francois Bonnarel (CDS): Catalog Archive Jean-Charles Cuillandre (CFHT): on-site prereduction Daniel Durand & David Schade (Co-I): Image archive April 2001 OPTICON workshop in Nice

OPTICON workshop in Nice The current hardware April 2001 OPTICON workshop in Nice

OPTICON workshop in Nice The current hardware 4+2 COMPAQ Alpha workstations (2 XP1000 for processing, with 1-2GB of RAM) 100Mb/s fast-ethernet link 4+ TB of disk-space (RAID5 arrays) DLT7000 and DDS3 tape readers 5 Linux PCs and 4 X-terminals April 2001 OPTICON workshop in Nice

OPTICON workshop in Nice Layout of the pipeline April 2001 OPTICON workshop in Nice

OPTICON workshop in Nice Software modules April 2001 OPTICON workshop in Nice

Image prereduction: Prerepix April 2001 OPTICON workshop in Nice

Warping and co-addition April 2001 OPTICON workshop in Nice

Visualization software: Panorapix April 2001 OPTICON workshop in Nice

Simulation software: SkyMaker April 2001 OPTICON workshop in Nice

Simulation software:Stuff Photometric redshift derived with HyperZ April 2001 OPTICON workshop in Nice

Software development: status in December 2000 April 2001 OPTICON workshop in Nice

Public software release April 2001 OPTICON workshop in Nice

OPTICON workshop in Nice Pipeline database Based on Objectivity (Object-oriented) Still in development (more details this afternoon) April 2001 OPTICON workshop in Nice

OPTICON workshop in Nice In the works Disk-space /Input-output Automatic masking of image defects Defringing (depending on the instrument) PSF homogenization Pipeline database April 2001 OPTICON workshop in Nice