FASR Calibration and Data Management Issues Gordon Hurford Space Sciences Lab University of California, Berkeley 9 Feb 2006 FASR Development Meeting.

Slides:



Advertisements
Similar presentations
The Science of Solar B Transient phenomena – this aim covers the wide ranges of explosive phenomena observed on the Sun – from small scale flaring in the.
Advertisements

Use of the Frequency Agile Solar Radiotelescope for Space Weather A New Solar-dedicated Radio Facility Dale E. Gary, NJIT; Stephen M. White, U Maryland.
SKADS: Array Configuration Studies Implementation of Figures-of-Merit on Spatial-Dynamic-Range Progress made & Current status Dharam V. Lal & Andrei P.
OVSA Expansion Software Overview Gordon Hurford Kickoff Meeting NJIT 25-Oct-2010.
Searching for Transients with LOFAR/CS1 Casey Law (Amsterdam)
A rough guide to radio astronomy and its use in lensing studies Simple stuff other lecturers may assume you know (and probably do)
EOVSA Data Volume / Data Rates Gordon Hurford Nov 8, 2011 EOVSA Technical Design Meeting - NJIT.
The Transient Radio Sky to be Revealed by the SKA Jim Cordes Cornell University AAS Meeting Washington, DC 8 January 2002.
Advances in Plasma Astrophysics, Giardini-Naxos, 6-10 Sept D Modeling of Solar Flaring Loops New Interactive Solar Flare Modeling and Advanced Radio.
FASR-A 6 Gb/s x 2 x GB/s 400 GB/day 50 GB/day ~1 GB/day X xxx FASR Data Analysis Plan 22-May-2005 Simplified Data Pipeline.
Inverse Problems in Solar Imaging Spectroscopy - Future Applications G.J. Hurford Space Sciences Lab University of California, Berkeley Vienna 20 July.
HMI – Synoptic Data Sets HMI Team Meeting Jan. 26, 2005 Stanford, CA.
Transient Science with the Allen Telescope Array Geoff Bower Berkeley.
What does do? Mini-project for CSE 260 Qian Peng 15 November 2001 Ref.
The Frequency Agile Solar Radiotelescope Current Status & Plans T. S. Bastian NRAO.
2005 May 22FASR Science Sims Meeting 1 / 13 FASR Science Simulations AGU/SPD Splinter Meeting 22 May 2005.
Advanced Technology Center 1 HMI Rasmus Larsen / Processing Modules Stanford University HMI Team Meeting – May 2003 Processing Module Development Rasmus.
The FASR Reference Instrument Tim Bastian 1, Dale E. 2, Steven M. Gross 4, Gordon J.
OVSA Expansion Pipeline Imaging. Log-spiral array: “uv” distribution Left: sampling of Right: inner region of spatial Fourier plane sampled spatial Fourier.
Radio Measurements of the Height of Strong Coronal Magnetic Fields Above Spots at the Limb Jeff Brosius (Catholic Univ.) Stephen White (Univ. of MD)
4th LOFAR solar KSP meeting Potsdam4th LOFAR KSP meeting Potsdam 2010 November 8-9 4th LOFAR KSP meeting Potsdam 2010 November 8-9 NRH and LOFAR Scientific.
Science Data Products – HMI Magnetic Field Images Pipeline 45-second Magnetic line-of-sight velocity on full disk Continuum intensity on full disk Vlos.
Monday 13 th November GSY/050388/ © BAE SYSTEMS All Rights Reserved ESA Space Weather Applications Pilot Project Service Development.
ALMA Proposal Preparation and Submission Eelco van Kampen European ALMA Regional Centre (ESO, Garching) Thanks to Liz Humphrys, Andy Biggs and Paola Andreani.
J.M. Wrobel - 25 June 2002 PROPOSALS 1 PROPOSAL WRITING TUTORIAL Outline 30 minutes: Lecture on Generic Issues 60 minutes: Small Groups Write Proposals.
ATST Science Requirements ScienceTeam. Outline/Scope State Requirements – focus on top level No attempt to give detailed explanation or justification.
Dale E. Gary Professor, Physics, Center for Solar-Terrestrial Research New Jersey Institute of Technology 1 03/15/2012Preliminary Design Review.
ALMA Proposal Preparation and Submission Liz Humphreys European ALMA Regional Centre ESO, Garching Thanks to Andy Biggs, Paola Andreani, Eelco van Kampen.
21 st Century VLBI Mike Garrett (JIVE) Astro-lunch, 16 April
Solar observation modes: Commissioning and operational C. Vocks and G. Mann 1. Spectrometer and imaging modes 2. Commissioning proposals 3. Operational.
Intraday variability of Sgr A* at radio wavelengths: A Day in the Life of Sgr A* Doug Roberts Northwestern University Adler Planetarium & Astronomy Museum.
Molecular Gas and Dust in SMGs in COSMOS Left panel is the COSMOS field with overlays of single-dish mm surveys. Right panel is a 0.3 sq degree map at.
Andreas Horneffer Status of MKSP LOFAR Observations.
IVC : a simulation and model-fitting tool for optical-IR interferometry Abstract I present a new software tool, called “Interferometry Visibility Computations”
S.T. MyersEVLA Advisory Committee Meeting September 6-7, 2007 EVLA Algorithm Research & Development Steven T. Myers (NRAO) CASA Project Scientist with.
ALMA Software B.E. Glendenning (NRAO). 2 ALMA “High Frequency VLA” in Chile Presently a European/North American Project –Japan is almost certainly joining.
EOVSA Data and Database System Gordon Hurford and Jim McTiernan EOVSA Prototype Readiness Review 24-Sept-2012.
NASSP Masters 5003F - Computational Astronomy Lecture 16 Calibration Self-calibration VLBI Spectroscopic interferometry.
Data system and modeling Thomas Zurbuchen University of Michigan
Radio and X-ray Diagnostics of Energy Release in Solar Flares Thesis Committee: Tim Bastian (NRAO, thesis advisor), Dale Gary (NJIT), Zhi-Yun Li (UVa),
1 Distribution Statement “A” (Approved for Public Release, Distribution Unlimited)5/15/2012 Advanced Radio Frequency Mapping (RadioMap) Dr. John Chapin.
Stephen White Space Vehicles Directorate Air Force Research Laboratory Solar Radio Bursts with LWA-1: DRX Observations.
ASKAP Capabilities John Reynolds on behalf of the SEIC and ASKAP team.
● Radio telescope arrays – km diameter – Resolution arcmin to micro-arcsec at radio wavelengths ● Similar (baseline/ wavelength) for other regimes.
FASR Software Considerations Gordon Hurford SSL AUI – August 2007.
EOVSA Data and Database System J. McTiernan EOVSA CoDR 25-April-2011.
Observing Strategies at cm wavelengths Making good decisions Jessica Chapman Synthesis Workshop May 2003.
The Far-Infrared Universe: from the Universe’s oldest light to the birth of its youngest stars Jeremy P. Scott, on behalf of Locke D. Spencer Physics and.
Digital Packaging Processor - Overview Gordon Hurford Nov 7, 2011 EOVSA Technical Design Meeting - NJIT.
Rick Perley 2 Nov 2001 EVLA Correlator Conceptual Design Review 1 Science Drivers for the EVLA Correlator Rick Perley EVLA Project Scientist 2 Nov 2001.
A real-time software backend for the GMRT : towards hybrid backends CASPER meeting Capetown 30th September 2009 Collaborators : Jayanta Roy (NCRA) Yashwant.
A Sample IHY 2007 Instrumentation Proposal J. Kasper, B. Thompson, N. Fox.
Jan URSI1 Fast Switching Phase Compensation for ALMA Mark Holdaway NRAO/Tucson Other Fast Switching Contributors: Frazer Owen Michael Rupen Chris.
Dec 1, FIELDS Top Level Requirements Review S. Harris (UCB)
EOVSA Pipeline Processing System J. McTiernan EOVSA Prototype Review 24-Sep-2012.
Scientific Interests in OVSA Expanded Array Haimin Wang.
Solar observations with single LOFAR stations C. Vocks 1. Introduction: Solar Radio radiation 2. Observations with single LOFAR stations 3. Spectrometer.
THE ALMA ORION BAND 6 SCIENCE VERIFICATION DATA SPECTRAL LINE SURVEY - CONTENT AND DISCOVERY AVAILABLE FOR ALL SCIENCE Anthony J. Remijan ALMA Program.
EOVSA Data and Database System J. McTiernan EOVSA Technical DesignMeeting 7-Nov-2011.
Solar X-ray Imager (SXI) Current and Future Requirements 22 May 2001 Steve Hill Solar Causes and Effects... Operational Requirements Improvements for GOES-R+
MHD model in HMI pipeline HMI/AIA science team meeting Sep , 2009 Stanford, CA HMI/AIA science team meeting Sep , 2009 Stanford, CA.
1/20 Radio interferometric imaging of spatial structure that varies with time and frequency Urvashi Rau ( NRAO ) Wednesday Lunch Talk 29 Aug 2012 Outline.
NRAO VLA Archive Survey
Observing Strategies for the Compact Array
LOFAR Beam Formed (BF) Data & Pipeline Overview September 9, 2010
Oxford Algorithms Workshop
Gustaaf van Moorsel September 9, 2003
Wide-field, high sensitivity VLBI
Transition Region and Coronal Explorer (TRACE)
Slit and Slot Interchange
Presentation transcript:

FASR Calibration and Data Management Issues Gordon Hurford Space Sciences Lab University of California, Berkeley 9 Feb 2006 FASR Development Meeting

Calibration – FASR-Specific Science Drivers (1) FASR quantitative science is largely based on spatially- resolved continuum spectroscopy  typically derived from image cubes (spatial/spectral MEM ?)  Closely spaced frequencies  Image fidelity  Relative Photometry, Tb (freq)  Image dynamic range impacts effective spectral range Solar science often involves comparison with other datasets.  Absolute positions to <~1 arcsecond

Calibration – FASR-Specific Science Drivers (2) Observational continuity –Solar features evolve on timescales from seconds to days. –Calibration data gaps highly undesirable Particularly problematic for flare studies (timescales of seconds to 10s of minutes) Calibration data sources Solar signal dominates Tsys Target sources much stronger than calibration sources

Approaches to phase calibration (1) Phase-stable design –BUT tropospheric and ionospheric effects are still problematic Redundant baselines + solar limbs (eg Nobeyama) – not applicable to FASR Frequent phase calibrator observations –Introduces serious data gaps –Minimizing gaps drives sensitivity requirements –A fallback option?

Approaches to phase calibration (2) Solar self-cal –Exploit strength of ‘target’ to provide continuous self-calibration How to determine absolute source position –Tropospheric wedge has only limited impact on imaging spectroscopy. –Absolute positions need be known ‘only’ to ~ 1 arcsec. –Absolute positions defined by 2 tropospheric + 2 ionospheric ‘sky- wedge’ parameters

‘ Sky-wedge’ Calibration Options Subarray-based –Subarray continuously or intermittently monitors calibrators to define skywedge –Dedicated antenna subset with lower noise receivers? Active region continuity Active regions evolve slowly and traverse disk at known rates Can interpolate their true positions between pre-dawn and post- dusk calibrations ?

Calibration Issues Identification of other ‘tall pole’ calibration issues that may drive design New insights into FASR calibration issues? Quantify implications of the conventional calibration option (in progress). Test feasibility/performance of other calibration options (subarray and solar continuity) using archival data or test observations with VLA. –Do either of these options provide a viable basis for FASR phase calibration?

Data Management – Science Drivers Sun is a time-variable, unpredictable object Analysis topics/targets not known in advance ~12-hour not 24-hour observing day Diverse (and interferometrically naïve) user community Typical data products –Light curves at multiple frequencies –Dynamic spectra –Maps at multiple times, frequencies and targets –Spectra at multiple times –Parametric maps (eg magnetic field or coronal density)

Data Management – User Community Space weather community –‘ Real-time’ high-level standardized data products, delivered transparently –No user involvement in analysis Solar community –Quick-look standardized high-level data products to support other studies –High level data products with user-specified parameters to match external datasets –No user user knowledge of interferometry Solar radio community Access to lower level data for custom analyses

X xxx FASR Data Flow

FASR-A 0.1 GB/s 4 TB/day 50 GB/day ~1 GB/day X xxx Simplified Data Pipeline Interim Database Semi-calibrated visibilities, housekeeping data, etc Time and frequency resolution are scientifically uncompromised Transient – designed to be overwritten every hrs. 4 Tbytes / day (FASR-A) (100ms,1%)

FASR-A 0.1 GB/s 4 TB/day 50 GB/day ~1 GB/day X xxx Simplified Data Pipeline Interim  Application Databases Magnetography bursts general purpose etc FREQUENCY TIME

FASR-A 0.1 GB/s 4 TB/day 50 GB/day ~1 GB/day X xxx Application Databases Set of parallel databases for magnetography, bursts, etc Time and frequency resolution tailored to specific applications Fully calibrated Starting point for generation of high level data products ~50 Gbytes / day Simplified Data Pipeline

FASR-A 0.1 GB/s 4 TB/day 50 GB/day ~1 GB/day X xxx Simplified Data Pipeline Interim Database Semi-calibrated visibilities, housekeeping data, etc Time and frequency resolution are scientifically uncompromised Transient – designed to be overwritten every hrs. 4 Tbytes / day (FASR-A) (100ms,1%) 200 Tbytes / day (FASR-B) (10ms,0.1%) 120 Tbytes / day (FASR-C) (10 ms 0.1%)

FASR-A 0.1 GB/s 4 TB/day 50 GB/day ~1 GB/day X xxx Simplified Data Pipeline Interim Database Semi-calibrated visibilities, housekeeping data, etc Time and frequency resolution are scientifically uncompromised Transient – designed to be overwritten every hrs. 4 Tbytes / day (FASR-A) (100ms,1%) 200 Tbytes / day (FASR-B) (10ms,0.1%) 120 Tbytes / day (FASR-C) (10 ms 0.1%) Need careful science justification for time and spectral resolution Need close to real time data selection for FASR B,C

THE END