LOFAR Beam Formed (BF) Data & Pipeline Overview September 9, 2010

Slides:



Advertisements
Similar presentations
Ben Barsdell Matthew Bailes Christopher Fluke David Barnes.
Advertisements

Searching for Transients with LOFAR/CS1 Casey Law (Amsterdam)
Pulsars with LWA1 Paul S. Ray and Sean Cutchin Naval Research Laboratory 2012 July 26 Basic research in radio astronomy at NRL is supported by NRL/ONR.
SKAMP - the Molonglo SKA Demonstrator M.J. Kesteven CSIRO ATNF, T. J. Adams, D. Campbell-Wilson, A.J. Green E.M. Sadler University of Sydney, J.D. Bunton,
The Transient Radio Sky to be Revealed by the SKA Jim Cordes Cornell University AAS Meeting Washington, DC 8 January 2002.
Netherlands Institute for Radio Astronomy 1 ASTRON is part of the Netherlands Organisation for Scientific Research (NWO) From LOFAR design to SKA1 System.
Transient Science with the Allen Telescope Array Geoff Bower Berkeley.
What does do? Mini-project for CSE 260 Qian Peng 15 November 2001 Ref.
Sascha D-PAD Sparse Aperture Array.
4th LOFAR solar KSP meeting Potsdam4th LOFAR KSP meeting Potsdam 2010 November 8-9 4th LOFAR KSP meeting Potsdam 2010 November 8-9 NRH and LOFAR Scientific.
Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array Digital Signal Processing.
Solar dynamic spectra C. Vocks and G. Mann 1. Spectrum of the quiet Sun: First results 2. How to obtain spectra: Beamformed data 3. Single station spectra.
Assessment of RFI measurements for LOFAR Mark Bentum, Albert-Jan Boonstra, Rob Millenaar ASTRON, The Netherlands Telecommunication Engineering, University.
2009 Jun 24The Solar Science Data Center F. Breitling 1 The Solar Science Data Center F. Breitling, G. Mann, C. Vocks, H. Enke 2 nd Workshop of the Solar.
Dale E. Gary Professor, Physics, Center for Solar-Terrestrial Research New Jersey Institute of Technology 1 03/15/2012Preliminary Design Review.
PULSARS & TRANSIENT SOURCES Pushing the Envelope with SKA Jim Cordes, Cornell 28 Feb 2000  Frontiers of Neutron Star Science  Complete census of transient.
Abstract Pulsars are highly magnetized, rotating neutron stars that emit a beam of electromagnetic radiation. The radiation can only be observed when the.
2nd LOFAR KSP meeting Potsdam 2009 July Experience of NRH observations: which benefit for LOFAR KSP ? A. Kerdraon Observatoire de Paris - LESIA -
Solar observation modes: Commissioning and operational C. Vocks and G. Mann 1. Spectrometer and imaging modes 2. Commissioning proposals 3. Operational.
Andreas Horneffer Status of MKSP LOFAR Observations.
Design and performance of fast transient detectors Cathryn Trott, Nathan Clarke, J-P Macquart ICRAR Curtin University.
HAH 2007/05/09 Connecting LOFAR to the GRID Hanno Holties, ASTRON IVOA - OGF Astro-RG Work Shop Manchester, 9th May 2007.
Solar System Physics Group Heliospheric physics with LOFAR Andy Breen, Richard Fallows Solar System Physics Group Aberystwyth University Mario Bisi Center.
THE LWA SOFTWARE LIBRARY Jayce Dowell – LWA Users’ Meeting – July 27, 2012.
Netherlands Institute for Radio Astronomy 1 ASTRON is part of the Netherlands Organisation for Scientific Research (NWO) LOFAR Operations and Schedule.
© ASTRON On the Fly LOFAR Station Correlator André W. Gunst.
Real-time Acquisition and Processing of Data from the GMRT Pulsar Back- ends Ramchandra M. Dabade (VNIT, Nagpur) Guided By, Yashwant Gupta.
ASKAP Capabilities John Reynolds on behalf of the SEIC and ASKAP team.
GSB : A real-time Software back-end for the GMRT Jayanta Roy National Centre for Radio Astrophysics Pune, India 12 th December 2008 Collaborators.
Adaptive Filters for RFI Mitigation in Radioastronomy
Observing Strategies at cm wavelengths Making good decisions Jessica Chapman Synthesis Workshop May 2003.
Ramesh Bhat Centre for Astrophysics & Supercomputing Swinburne University of Technology Time Domain Astronomy Meeting, Marsfield, 24 October 2011 Searching.
JABAK Pulsar Data Analysis Introduction/Purpose When we arrived in Green bank, we did not know what a pulsar was. Now we know their identifying qualities.
Pulsar Data analysis Desh, Anish RRI MWA Meeting Canberra, January
Rick Perley 2 Nov 2001 EVLA Correlator Conceptual Design Review 1 Science Drivers for the EVLA Correlator Rick Perley EVLA Project Scientist 2 Nov 2001.
The Allen Telescope Array Douglas Bock Radio Astronomy Laboratory University of California, Berkeley Socorro, August 23, 2001.
A real-time software backend for the GMRT : towards hybrid backends CASPER meeting Capetown 30th September 2009 Collaborators : Jayanta Roy (NCRA) Yashwant.
A Sample IHY 2007 Instrumentation Proposal J. Kasper, B. Thompson, N. Fox.
Philippe Picard 2 nd SKADS Workshop October 2007 Station Processing Philippe Picard Observatoire de Paris Meudon, 11th October 2007.
M.P. RupenCorrelator Connectivity Scheme Review 31 July Correlator Specifications Michael P. Rupen.
Solar observations with single LOFAR stations C. Vocks 1. Introduction: Solar Radio radiation 2. Observations with single LOFAR stations 3. Spectrometer.
Ben Stappers (ASTRON) LOFAR 101 Pizza Lunch. LOFAR Technical Concept LOFAR is a very large distributed radio telescope: LOFAR is a very large distributed.
PATTERN RECOGNITION STRATEGIES DETECTION OF FAST TRANSIENTS AS “DATA TRIAGE” Jet Propulsion Laboratory California Institute of Technology David Thompson,
1 ASTRON is part of the Netherlands Organisation for Scientific Research (NWO) Netherlands Institute for Radio Astronomy Astronomy at ASTRON George Heald.
SAGE meeting Socorro, May 22-23, 2007 WIDAR Correlator Overview Michael P. Rupen Project Scientist for WIDAR & Software.
Andreas Horneffer for the LOFAR-CR Team
4th Solar KSP Meeting Potsdam 2010 November 08
Multi-beaming & Wide Field Surveys
Detecting UHE cosmic-rays and neutrinos hitting the Moon
The Low Frequency Array (LOFAR)
FRB Backend First Light
Mid Frequency Aperture Arrays
The LOFAR Transients Key Project
The UniBoard Generic Hardware for Radio Astronomy Signal Processing
Andreas Horneffer for the LOFAR Cosmic Ray KSP
Phased Array Feeds Wim van Cappellen
S. Bhatnagar: ASTRON, Dwingeloo, June 29th 2010
MWA “burst mode”: Nov 2008 Solar 32 T Observations
Pulsar Timing with ASKAP Simon Johnston ATNF, CSIRO
Erin W Gunner H Anna D Shane C Carly L Shane S. Mentor: Sean
Science from Surveys Jim Condon NRAO, Charlottesville.
Pulsar and Transient Science with the 12m Antenna
RFI Flagging in the Imaging Pipeline
Rick Perley National Radio Astronomy Observatory
Radio Astronomy Spectrum Management in practice – Australia (ATNF)
Some Illustrative Use Cases
Gustaaf van Moorsel September 9, 2003
Observations of pulsar microstructure with the GMRT
Radio Observatory Report
Correlator Growth Path
Presentation transcript:

LOFAR Beam Formed (BF) Data & Pipeline Overview September 9, 2010 Anastasia Alexov & The Pulsar Working Group & ASTRON SW Group

Transient Science Pulsar/Beam-Formed Pipeline has many scientific applications. The following areas of study set the requirements on processing for each of the modes: Known pulsars - channelization, Stokes Parameters, dedispersion, folding, Radio Frequency Interference (RFI) excision Pulsar/fast transient survey - channelization, dedispersion [10,000 trial Dispersion Measures (DMs)], RFI excision, searching Planets, Sun, flare stars - channelization, RFI excision, dynamic spectra, Stokes Parameters Pulsar SOHO Sun

LOFAR “Beams” Low Band Antennas (LBA): 10-80MHz High Band Antennas (HBA): 100-240MHz One to N Stations can be use to observe Imaging and high time resolution observations can be done simultaneously High time resolution observing mode will be widely used for Transient Science: Forming multiple beams is a difficult observing mode Beam-formed modes trade spatial resolution for time resolution Pulsar Pipeline effort can be applied to other high timing resolution pipelines Tied-Array (Pencil) Beams Stations Element Station

LOFAR “Beams” Show Movie

Beam-Formed Data Flow On-Line TAB Pipeline BF Writer BF Offline

Beam-Formed Pipeline Data Flow On-Line TAB Pipeline BF Writer BF Offline Pipeline

BF -> to -> H5 Writer (bf2h5) Tied-Array (Pencil) Beams BF Raw and BF TAB data  HDF5 BF file Need online (BG/P TAB data) and single-station (raw data only) versions of bf2h5 BF H5 Structure: Sub-Array Pointing Station Beams Element Beams Stations

Data Packaging Options: One Table per Subband (1D) [Shown] One Table for all Subbands (ND) One Array per Subband (1D) One Array for all Subbands (ND)

Beam-Formed Data Sizes (Challenging)