4th Solar KSP Meeting Potsdam 2010 November 08

Slides:



Advertisements
Similar presentations
Digital FX Correlator Nimish Sane Center for Solar-Terrestrial Research New Jersey Institute of Technology, Newark, NJ EOVSA Technical Design Meeting.
Advertisements

National Radio Astronomy Observatory June 13/14, 2005 EVLA Phase II Proposal Review EVLA Phase II Computing Development Bryan Butler (EVLA System Engineer.
Optimization of Compact Array Configurations to Minimize Side-Lobes for Two Cases: The New E-configuration for the EVLA and Phased Array for the LWA Station.
Searching for Transients with LOFAR/CS1 Casey Law (Amsterdam)
Image Analysis Jim Lovell ATNF Synthesis Imaging Workshop May 2003.
EOVSA Data Volume / Data Rates Gordon Hurford Nov 8, 2011 EOVSA Technical Design Meeting - NJIT.
Image Analysis Jim Lovell ATNF Synthesis Imaging Workshop September 2001.
Netherlands Institute for Radio Astronomy 1 ASTRON is part of the Netherlands Organisation for Scientific Research (NWO) From LOFAR design to SKA1 System.
Solar corona observations at decameter wavelengths Artem Koval Institute of Radio Astronomy Kharkov, Ukraine.
LOFAR Self-Calibration Using a Blackboard Software Architecture ADASS 2007Marcel LooseASTRON, Dwingeloo.
Distributed Processing of Future Radio Astronomical Observations Ger van Diepen ASTRON, Dwingeloo ATNF, Sydney.
4th LOFAR solar KSP meeting Potsdam4th LOFAR KSP meeting Potsdam 2010 November 8-9 4th LOFAR KSP meeting Potsdam 2010 November 8-9 NRH and LOFAR Scientific.
Calibration with CASA Masaaki Hiramatsu 平松正顕 (ASIAA/NTHU) ALMA User Workshop, Feb 8-10, 2010.
Astro Space Locator Imaging Software Alexey Rudnitskiy, Victor Zuga On behalf of Astro Space Center (ASC LPI) Department Of Data Processing Alexey Rudnitskiy,
Solar dynamic spectra C. Vocks and G. Mann 1. Spectrum of the quiet Sun: First results 2. How to obtain spectra: Beamformed data 3. Single station spectra.
Assessment of RFI measurements for LOFAR Mark Bentum, Albert-Jan Boonstra, Rob Millenaar ASTRON, The Netherlands Telecommunication Engineering, University.
2009 Jun 24The Solar Science Data Center F. Breitling 1 The Solar Science Data Center F. Breitling, G. Mann, C. Vocks, H. Enke 2 nd Workshop of the Solar.
LOFAR Key Science Project Cosmic Magnetism in the Nearby Universe (MKSP) LOFAR Key Science Project Cosmic Magnetism in the Nearby Universe (MKSP)
2nd LOFAR KSP meeting Potsdam 2009 July Experience of NRH observations: which benefit for LOFAR KSP ? A. Kerdraon Observatoire de Paris - LESIA -
COMPUTER MODELS FOR SKY IMAGE ANALYSIS OF THE INASAN ZVENIGOROD OBSERVATORY Sergei Pirogov ( Institute of Astronomy, Russian Academy of Sciences) VIIth.
Random Media in Radio Astronomy Atmospherepath length ~ 6 Km Ionospherepath length ~100 Km Interstellar Plasma path length ~ pc (3 x Km)
EVLA Early Science: Shared Risk Observing EVLA Advisory Committee Meeting, March 19-20, 2009 Claire Chandler Deputy AD for Science, NM Ops.
Solar observation modes: Commissioning and operational C. Vocks and G. Mann 1. Spectrometer and imaging modes 2. Commissioning proposals 3. Operational.
1 The OSKAR Simulator (Version 2!) AAVP Workshop, ASTRON, 15 th December 2011 Fred Dulwich, Ben Mort, Stef Salvini.
TAUCHI – Tampere Unit for Computer-Human Interaction Visualizing gaze path for analysis Oleg Špakov MUMIN workshop 2002, Tampere.
MWA Data Capture and Archiving Dave Pallot MWA Conference Melbourne Australia 7 th December 2011.
ALMA Software B.E. Glendenning (NRAO). 2 ALMA “High Frequency VLA” in Chile Presently a European/North American Project –Japan is almost certainly joining.
Which dipoles to use to optimize survey speed? –What tapering? –Trade-off between sensitivity, FOV and low side-lobe levels –Station beam stability, pointing.
Netherlands Institute for Radio Astronomy 1 ASTRON is part of the Netherlands Organisation for Scientific Research (NWO) LOFAR Operations and Schedule.
Interferometry Discuss Group & Python Tutorial Adam Leroy & Scott Schnee (NRAO) February 28, 2014.
Correlator Growth Path EVLA Advisory Committee Meeting, March 19-20, 2009 Michael P. Rupen Project Scientist for WIDAR.
Development and Commissioning of LOFAR for Astronomy (DCLA) Huub Röttgering Leiden Observatory.
EVLA Software Bryan Butler. 2007May22EVLA SAGE Meeting2 Requirements and Goals of EVLA Software Maximize scientific throughput of the instrument At a.
The North American ALMA Science Center North America’s ALMA Regional Center The North American ALMA Science Center acts as the gateway to ALMA for North.
Advanced Technologies in Education Virtual Observatory 1 Virtual Observatory: D-Space Project Athens, 14 November 2004 Elena Tavlaki Head of Research Programs.
Мulti-frequency VLA observations of M87. Observations’ parameters Test VLA observations (configuration D) of M87 (RA=12:28, Dec=12:40) took place on November.
Investigation of different types radio sources by IPS method at 111MHz S.A.Tyul’bashev Pushchino Radio Astronomy Observatory, Astro Space Center of P.N.Lebedev.
Sanjay BhatnagarEVLA Advisory Committee Meeting May 8-9, EVLA Algorithm Research & Development Progress & Plans Sanjay Bhatnagar CASA/EVLA.
Centre of Excellence for All-sky Astrophysics MWA Project: Centre of Excellence for All-sky Astrophysics Centre of Excellence for All-sky.
Observing Strategies at cm wavelengths Making good decisions Jessica Chapman Synthesis Workshop May 2003.
NASSP Masters 5003F - Computational Astronomy Lecture 14 Reprise: dirty beam, dirty image. Sensitivity Wide-band imaging Weighting –Uniform vs Natural.
ASKAP: Setting the scene Max Voronkov ASKAP Computing 23 rd August 2010.
14 June, 2004 EVLA Overall Design Subsystems II Tom Morgan 1 EVLA Overall Software Design Final Internal Review Subsystems II by Tom Morgan.
Digital Packaging Processor - Overview Gordon Hurford Nov 7, 2011 EOVSA Technical Design Meeting - NJIT.
Recent progress in EVLA-specific algorithms EVLA Advisory Committee Meeting, March 19-20, 2009 S. Bhatnagar and U. Rau.
A Sample IHY 2007 Instrumentation Proposal J. Kasper, B. Thompson, N. Fox.
EVLA Data Processing PDR E2E Data Archive System John Benson, NRAO July 18, 2002.
Solar observations with single LOFAR stations C. Vocks 1. Introduction: Solar Radio radiation 2. Observations with single LOFAR stations 3. Spectrometer.
Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array Using CASA to Simulate.
VGOS GPU Based Software Correlator Design Igor Surkis, Voytsekh Ken, Vladimir Mishin, Nadezhda Mishina, Yana Kurdubova, Violet Shantyr, Vladimir Zimovsky.
SAGE meeting Socorro, May 22-23, 2007 WIDAR Correlator Overview Michael P. Rupen Project Scientist for WIDAR & Software.
Anita Richards and members of MERLIN, RadioNet and AstroGrid teams. ● 'Old' radio archive access ● Source lists, fixed images or visibility data ● Most.
A Total Recall of Data Usage for the MWA Long Term Archive
The Low Frequency Array (LOFAR)
NRAO VLA Archive Survey
AAVS1 Calibration Aperture Array Design & Construction Consortium
S. Likhachev (1), L, Kogan(2), E. Fomalont(2), F. Owen(2)
EVLA Availability - or - When Can I Use It?
An FP5 RTD programme Participants: University of Manchester: UK
Methods of transfer of ultra-stable frequencies to radio telescope
EGEE NA4 Lofar Lofar Information System Design OmegaCEN
Imaging and Calibration Challenges
LOFAR Beam Formed (BF) Data & Pipeline Overview September 9, 2010
HERA Imaging and Closure
Prototype Correlator Testing
Shared Risk Science with the EVLA
EVLA Algorithm Research & Development
Sample Problem c =    c  =  3.00  108 m/s  = 6.0  /s
Correlator Growth Path
RFI Flagging in the LOFAR Imaging Pipeline
Presentation transcript:

4th Solar KSP Meeting Potsdam 2010 November 08 Solar Imaging with the Standard Imaging Pipeling Frank Breitling Astrophysikalisches Institut Potsdam

Solar Imaging with the Standard Imaging Pipeline, Frank Breitling Overview Introduction to the pipeline Status of solar imaging New results Conclusions 2010 Nov 8, Potsdam 4th Solar KSP Workshop Solar Imaging with the Standard Imaging Pipeline, Frank Breitling

The LOFAR Standard Imaging Pipeline Components OLAP: Online Application Processing (Blue Gene/P correlator) DP3/DPPP: Default Pre-Processing Pipeline (for flagging and averaging) BBS: BlackBoard Selfcal (calibration) CImager: Imagers Control via parset files 2010 Nov 8, Potsdam 4th Solar KSP Workshop Solar Imaging with the Standard Imaging Pipeline, Frank Breitling

Solar Imaging with the Standard Imaging Pipeline, Frank Breitling Details Data format Measurements Sets (MS) from CASA Batch processing DPPP BBS Imagers (LOFAR wiki: http://www.lofar.org/wiki/doku.php?id=software:standard_imaging_pipeline) (Cookbook: http://www.mpa-garching.mpg.de/~fdg/LOFAR_cookbook/LOFAR_Cookbook_v2.3.pdf) Interactive Processing CASA (Common Astronomy Software Applications (http://casa.nrao.edu/ CASA Cookbook) 2010 Nov 8, Potsdam 4th Solar KSP Workshop Solar Imaging with the Standard Imaging Pipeline, Frank Breitling

First solar observations Date: 2010-06-09 10:17:00, 11:41:00, 13:40:00, 15:40:00 Duration: 4 x 10 Min Frequency range: ~120-180 MHz LOFAR stations: 20 core (CS) + 3 remote (RS) stations, i.e.: RS106HBA, RS306HBA, RS503HBA, (CS001-7, CS021, CS030, CS103)xHBA0+1 Total data volume: 1.5 TB 2010 Nov 8, Potsdam 4th Solar KSP Workshop Solar Imaging with the Standard Imaging Pipeline, Frank Breitling

Solar Imaging with the Standard Imaging Pipeline, Frank Breitling 2010 Nov 8, Potsdam 4th Solar KSP Workshop Solar Imaging with the Standard Imaging Pipeline, Frank Breitling

Solar Imaging with the Standard Imaging Pipeline, Frank Breitling LOFAR: 135 MHz Nancy RH: 150.9 MHz 2010 Nov 8, Potsdam 4th Solar KSP Workshop Solar Imaging with the Standard Imaging Pipeline, Frank Breitling

Details about data - SB105 (msinfo) # of visibilities: 194025 Phase center: +05:05:09.0, +24:09:52.0 Frequency range (MHz): 135.449 -- 135.645 Wavelength range (m): 2.213 -- 2.210 Observation time span: 2010-06-09T10:17:00 -- 10:27:00 Duration (min): 10 time bin / integration: 1.00663 # of channels: 256 channel width (KHz): 0.8 # of polarizations: 4 # of antennas: 25 2010 Nov 8, Potsdam 4th Solar KSP Workshop Solar Imaging with the Standard Imaging Pipeline, Frank Breitling

Problems during data analysis Imperfect calibration Clock offsets => Clock offsets (from Olaf) Station microsec CS001HBA0 0 CS001HBA1 0.01 CS002HBA0 1.913 CS002HBA1 1.903 CS003HBA0 1.913 CS003HBA1 1.9 CS004HBA0 1.893 CS004HBA1 1.9 CS005HBA0 1.887 CS005HBA1 1.9 CS007HBA0 1.887 CS007HBA1 1.9 CS006HBA0 1.887 CS006HBA1 1.893 CS021HBA0 -0.014 CS021HBA1 -0.01 CS030HBA0 -0.007 CS030HBA1 -0.007 CS032HBA0 -0.003 CS032HBA1 0.01 CS103HBA0 -0.025 CS103HBA1 -0.025 RS106HBA -0.12 RS306HBA 0 RS503HBA 0.007 2010 Nov 8, Potsdam 4th Solar KSP Workshop Solar Imaging with the Standard Imaging Pipeline, Frank Breitling

Solar Imaging with the Standard Imaging Pipeline, Frank Breitling BBS Sky Model # (Name, Type, Ra, Dec, I, Q, U, V, ReferenceFrequency='60e6', SpectralIndexDegree='0', SpectralIndex:0='0.0', MajorAxis, MinorAxis, Orientation) = format # The above line defines the field order and is required. Sun, GAUSSIAN, 14:18:17.00, -13.49.12.0, 60000.00, 0.0, 0.0, 0.0,81.5e6, 0, 0., 4000.0, 4000.0, 0.0 TauA.neb, GAUSSIAN, 05:34:32.00, +22.00.52.00, 1888.55, 0.0, 0.0, 0.0,81.5e6, 0, -0.299, 420.0, 290.0, 0.0 3C123, POINT, 04:37:04.72, +29.40.15.6, 454.97 3C133, POINT, 05:02:58.58, +25.16.22.7, 44.67 Now reduced to only 4 sources Sun is strongly dominating 3C sources from “The VLA Low-Frequency Sky Survey” catalog (http://www.cv.nrao.edu/4mass/VLSSlist.shtml) Sun coordinates from (http://www.jgiesen.de/astro/astroJS/sunriseJS/index.htm) 2010 Nov 8, Potsdam 4th Solar KSP Workshop Solar Imaging with the Standard Imaging Pipeline, Frank Breitling

Solar Imaging with the Standard Imaging Pipeline, Frank Breitling Model Images with BBS blmax: 60m 125m 250m 500m 1000m all 2010 Nov 8, Potsdam 4th Solar KSP Workshop Solar Imaging with the Standard Imaging Pipeline, Frank Breitling

Solar Imaging with the Standard Imaging Pipeline, Frank Breitling UV Coverage 60m 125m 250m 500m 1000m all 2010 Nov 8, Potsdam 4th Solar KSP Workshop Solar Imaging with the Standard Imaging Pipeline, Frank Breitling

Core stations without clock offsets Use only core stations CS002-CS007 (Baselines <400m) 2010 Nov 8, Potsdam 4th Solar KSP Workshop Solar Imaging with the Standard Imaging Pipeline, Frank Breitling

SB184: 150.885-151.068 MHz Nancy Radio Heliograph frequency 150.9 MHz Dirty image Model image 2010 Nov 8, Potsdam 4th Solar KSP Workshop Solar Imaging with the Standard Imaging Pipeline, Frank Breitling

Solar Imaging with the Standard Imaging Pipeline, Frank Breitling SB184: 150.885-151.068 MHz 2010-06-09T15:40:00 - 15:50:00 Dirty image Model image 2010 Nov 8, Potsdam 4th Solar KSP Workshop Solar Imaging with the Standard Imaging Pipeline, Frank Breitling

Data volume problem Data is difficult to Data analysis find on offline cluster copy and archive Data analysis consumes a lot of CPU takes very long Obtain Use Subbands ~200 ~5 Channels 256 32 Total data volume 1.5 TB 1.5 GB We have to emphasize more that we want small data samples!!! 2010 Nov 8, Potsdam 4th Solar KSP Workshop Solar Imaging with the Standard Imaging Pipeline, Frank Breitling

Conclusion / Outlook First solar images with the Standard Imaging Pipeline Quality needs improvement Analysis needs to be extended to more subbands 7 new solar observation were taken on 2010-10-29,30 Should only request 10 subbands for next observations Olaf will spend the next days at the AIP for data analysis Many problems have been and will be discussed at the LOFAR Forum Thanks for your attention 2010 Nov 8, Potsdam 4th Solar KSP Workshop Solar Imaging with the Standard Imaging Pipeline, Frank Breitling

Solar Imaging with the Standard Imaging Pipeline, Frank Breitling References User Software Group: http://usg.lofar.org/ LOFAR User Forum: http://usg.lofar.org/forum/index.php LOFAR Interface Control Documents (ICDs) http://usg.lofar.org/wiki/doku.php?id=documents:lofar_data_products Documentation for the Standard Imaging Pipeline http://www.lofar.org/wiki/doku.php?id=software:standard_imaging_pipeline The LOFAR Imaging Cookbook http://www.mpa-garching.mpg.de/~fdg/LOFAR_cookbook/LOFAR_Cookbook_v2.3.pdf Frank Breitling <fbreitling at aip.de> http://www.aip.de/People/fbreitling/ 2010 Nov 8, Potsdam 4th Solar KSP Workshop Solar Imaging with the Standard Imaging Pipeline, Frank Breitling