Douglas L. Tucker (FNAL) SISPI Meeting 22 February 2007 Sky Camera DB Inputs.

Slides:



Advertisements
Similar presentations
Storing Data: Disk Organization and I/O
Advertisements

Storing Data: Disks and Files: Chapter 9
Mr Greenhalgh S4 Computing Int 1 Things you could do with knowing before the Exam…
Introduction to Computer Hardware and Software. Definition of a Computer “A computer is an electronic device, operating under the control of instructions.
All these Sky Pixels Are Yours The evolution of telescopes and CCD Arrays: The Coming Data Nightmare.
NOAO/Gemini Data workshop – Tucson,  Hosted by CADC in Victoria, Canada.  Released September 2004  Gemini North data from May 2000  Gemini.
HAWCPol / SuperHAWC Software & Operations J. Dotson July 28, 2007.
Sept. 18, 2008SLUO 2008 Annual Meeting Science Opportunities with LSST David L. Burke SLAC/KIPAC.
1 Basics of Digital Imaging Digital Image Capture and Display Kevin L. Lorick, Ph.D. FDA, CDRH, OIVD, DIHD.
Software Development, Programming, Testing & Implementation.
Migrating to EPiServer CMS 5 Johan Björnfot -
Nat 4/5 - Software Design and Development – Low Level Operations - 1 National 4/5 – Computing Science Information Systems Design and Development Media.
Images you see on your screen are made up of these things called pixels. A screen will show over 1 million pixels and then a computer has to do what it.
FILING SYSTEMS Research Data Management. Filing is more than saving files, it’s making sure you can find them later in your project. Naming Directory.
Biostatistics Analysis Center Center for Clinical Epidemiology and Biostatistics University of Pennsylvania School of Medicine Minimum Documentation Requirements.
Records Survey and Retention Schedule Recertification 2011.
Computer Basics An overview of computer hardware ICT Tools: Computer Basics.
What is it a scanner? An optical input device that uses light- sensing equipment to capture an image on paper or some other subject. The image is translated.
Detecting Near-Duplicates for Web Crawling Manku, Jain, Sarma
“Think. Learn. Succeed.” Ver 1.2 Methods for Knowledge Management & Digital Preservation The Theory and Practice of Digital History Carl A. Young, M.A.
Calibration Plan for Early DES Data
MASSACHUSETTS INSTITUTE OF TECHNOLOGY NASA GODDARD SPACE FLIGHT CENTER ORBITAL SCIENCES CORPORATION NASA AMES RESEARCH CENTER SPACE TELESCOPE SCIENCE INSTITUTE.
Unit 1 – Improving Productivity Instructions ~ 100 words per box.
MWA Data Capture and Archiving Dave Pallot MWA Conference Melbourne Australia 7 th December 2011.
1 DES Photometric Calibration Strategy Douglas L. Tucker (FNAL) Filter and Calibrations Strategy Workshop 4 April 2008.
Intruder Alert System By: Jordan Tymburski Rachita Bhatia.
1 The Photometric Calibration of the DES Douglas L. Tucker (FNAL) Joint DOE/NSF Review of DES January 2008.
Pachon Sky Camera Christopher Stubbs Chuck Claver Jan 25, 2014.
Archive Access Tool Review of SSS Readiness for EVLA Shared Risk Observing, June 5, 2009 John Benson Scientist.
The Case for a New CONCAM3 Robert J. Nemiroff for the CONCAM Collaboration.
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA COS Pipeline Calibration Goals of CALCOS Association Table Input and Output Files High Level.
1 The DES Calibrations Effort Douglas L. Tucker (DES Calibrations Scientist) DES NSF/DOE Review, 8-9 June 2009 The DES Calibrations Effort has connections.
This document gives one example of how one might be able to “fix” a meteorological file, if one finds that there may be problems with the file. There are.
All-Dome - All-Sky Time-Lapse Movies For Planetaria.
Data Archives: Migration and Maintenance Douglas J. Mink Telescope Data Center Smithsonian Astrophysical Observatory NSF
HARPS Data Flow System Christophe Lovis Geneva Observatory HARPS-N PDR, 6-7 December 2007, Cambridge MA.
ADMIT: ALMA Data Mining Toolkit  Developed by University of Maryland, University of Illinois, and NRAO (PI: L. Mundy)  Goal: First-view science data.
Thessaloniki, Oct 3rd 2009 Cool dusty galaxies: the impact of the Herschel mission Michael Rowan-Robinson Imperial College London.
1 Small Telescopes and the Photometric Calibration of the Sloan Digital Sky Survey (SDSS) Douglas Tucker.
Status of Cloud Cameras Roger Clay, Paul Davidson, Bruce Dawson, Andrew Smith and Neville Wild University of Adelaide Malargue, 11 November 2002.
Page 1 NHSC PACS Web Tutorial PACS 301 nhsc.ipac.caltech.edu/helpdesk NHSC/PACS Web Tutorials Running the PACS Spectrometer pipeline for CHOP/NOD Mode.
Computing & Information Sciences Kansas State University Wednesday, 08 Nov 2006CIS 560: Database System Concepts Lecture 32 of 42 Monday, 06 November 2006.
1 SUZAKU HUG 12-13April, 2006 Suzaku archive Lorella Angelini/HEASARC.
ICOM 6005 – Database Management Systems Design Dr. Manuel Rodríguez-Martínez Electrical and Computer Engineering Department Lecture 7 – Buffer Management.
After viewing information about the Elements and Principles of Design from the powerpoint presentations, type the Element or Principle that you thing best.
Computer Performance. Hard Drive - HDD Stores your files, programs, and information. If it gets full, you can’t save any more. Measured in bytes (KB,
CAA Database Overview Sinéad McCaffrey. Metadata ObservatoryExperiment Instrument Mission Dataset File.
Digital Image Data Base Archiving Artwork Electronically.
April / 2010 UFOCapture 1 UFOCaptureV2 Time-Shift-Motion-Detect-Video-Recording software for complete records of un-expected events.
Making a Difference with Azure Storage Solutions Dudu Sinai.
AGENDA 1.Importance of backups and backup strategy 2.Full DB backup and Restore 3.Filegroup Backup and restore 4.File Backup and Restore 5.Page restore.
1 Douglas L. Tucker (FNAL) Cloud Camera Review 3 January 2008 DES Sky Camera (Cloud Camera)
The CORNISH data reduction pipeline. Architecture - Overview AIPS Tasks Obit Tasks ObitTalk / Python Control Scripts MySQL Database Book-keeping Raw Data.
Photometric Walkthrough Mobile Application (PWMA)
UFOCaptureV2 Time-Shift-Motion-Detect-Video-Recording software for complete records of un-expected events April / 2010 UFOCapture.
Observation of RR Lyrae Variable RS Boo Results and Future Work
SOAR Data Reduction Pipelines
NHSC/PACS Web Tutorials
Calibrating the METEOSAT SEVIRI solar channels using lunar observations Sébastien Wagner (1) Bartolomeo Viticchie (1), Tom Stone (2), Tim Hewison(1), Gary.
MODIS SST Processing and Support for GHRSST at OBPG
GRAPHICS Source:
Lesson 1 The Computer Mohamed Zaki Principal Lecturer
instructor Sami Aleswi Faculty of Computing and Information Technology
Storage Devices and Data Capacity
Announcements HR Diagram lab will be extended for one week. I’ll talk about it today. Homework: Chapter 9 # 1, 2 & 3 Next week is a Dark Sky Night. If.
Transp Course 2014 Overview.
Objective- To graph a relationship in a table.
Overview of Computer system
Commissioning Data – Who and Why?
Auxiliary Devices Weather Station
Presentation transcript:

Douglas L. Tucker (FNAL) SISPI Meeting 22 February 2007 Sky Camera DB Inputs

Purpose An All-Sky Camera is needed in order to: Provide real-time estimates of the sky conditions for survey strategy E.g.: “Should the next target be a photometric calibration field, a science target, or something else?” Provide a measure of the photometric quality of an image E.g.: “This image was obtained under such-and-such conditions; is it good enough to be used for photometric calibrations?” Detect even light cirrus for the above purposes under a full range of moon phases (no moon to full moon)

Functional Overview The Sky Camera system should*: 1.Image the full sky at a wavelength of ~10 microns once every 30 seconds throughout the course of nightly operations of the Blanco 4.0m telescope. 2.Process the images in real-time. 3.Output in real-time a GIF version of the processed image to a webpage. 4.Output in real-time a quantitative diagnostic indicating the cloudiness of the sky (e.g., the rms of the pixel values from the most recent processed image) to a web-accessible graph and to an archival database. 5.Create and animation based upon the processed images from the past hour to detect cloud movement, and output this animation to a webpage. 6.Create an animation based upon the full night’s processed images at the end of each night. 7.Archive the raw and processed FITS images, processed GIF files, and the full-night animation to a web-accessible directory. * Based upon the functionality of the APO IRSC, which, in its current incarnation has been operationg successfully since 2001.

APO IRSC Output Clear Cloudy

Proposed SkyCam DB Inputs SkyCam table in DB: Date & Time Stamp (UT/TAI) mean sky brightness std dev of sky brightness “photometricity” flag (0/1) (or threshold value of the std dev of sky brightness considered photometric) name of associated SkyCam FITS images (raw and processed)

Slides from 26 April 2006 talk

Purpose An All-Sky Camera is needed in order to: Provide real-time estimates of the sky conditions for survey strategy E.g.: “Should the next target be a photometric calibration field, a science target, or something else?” Provide a measure of the photometric quality of an image E.g.: “This image was obtained under such-and-such conditions; is it good enough to be used for photometric calibrations?” Detect even light cirrus for the above purposes under a full range of moon phases (no moon to full moon)

Functional Overview The Sky Camera system should*: 1.Image the full sky at a wavelength of ~10 microns once every 30 seconds throughout the course of nightly operations of the Blanco 4.0m telescope. 2.Process the images in real-time. 3.Output in real-time a GIF version of the processed image to a webpage. 4.Output in real-time a quantitative diagnostic indicating the cloudiness of the sky (e.g., the rms of the pixel values from the most recent processed image) to a web-accessible graph and to an archival database. 5.Create and animation based upon the processed images from the past hour to detect cloud movement, and output this animation to a webpage. 6.Create an animation based upon the full night’s processed images at the end of each night. 7.Archive the raw and processed FITS images, processed GIF files, and the full-night animation to a web-accessible directory. * Based upon the functionality of the APO IRSC, which, in its current incarnation has been operationg successfully since 2001.

APO IRSC Output Clear Cloudy

The APO IRSC Hardware Design of the current APO IRSC, commissioned in 2001 A photograph of the APO IRSC

Disk Space Needs Image size: 320 pixels x 240 pixels 16-bit FITS images 150KB per FITS image 1 FITS image every 30 seconds 12 hours per night operation 1440 FITS images per night 1440 FITS images/night x 150KB / FITS image = 211MB / night Saving all images in GIF and animated GIF format as well as FITS format could conceivably triple the diskspace requirements Ancillary files (like nightly QA plots and logs) may only add an additional 1 MB per night or so to the archive 3 x 211MB / night ~ 630 MB / night Annual storage requirements ~ 630 MB /night x 365 nights ~ 225 GB

SkyCam Cost Estimate* Raytheon “Thermal Eye” 300D 10-micron camera$8,000 Video-to-optical fiber converters (E.g., Opticomm MMV-110 Mini XMT, RCV pair) 2x$275 Frame grabber (E.g., Hauppauge WinTV 191) $100 Pentium Desktop with 1-GB RAM and 250 GB HD$3,000 External 250 GB HD (backup)$ inch-diameter hyperbolic mirror (machined aluminum) ??? Camera support structure and enclosure??? TOTAL$11,900 +??? *Based upon information from the APO IRSC documentation page,

Timeline Finalize design and start obtaining quotes for materialsMar 1, 2007 Start constructing SkyCam and writing SkyCam softwareSep 1, 2007 Start commissioning SkyCam and SkyCam softwareMar 1, 2008 Complete commissioning SkyCam and SkyCam softwareSep 1, 2008 Start DESSep 1, 2009