Developments for real-time software correlation e-VLBI Y. Koyama, T. Kondo, M. Kimura, M. Sekido, M. Hirabaru, and M. Harai Kashima Space Research Center,

Slides:



Advertisements
Similar presentations
e-VLBI Deployments with Research Internet
Advertisements

Lesson 9 Types of Storage Devices.
Types Of Storage Device
The CVN Real Time Correlator Zhang Xiuzhong, Chen Zhong Shanghai Astronomical Observatory China 4th e-VLBI Workshop Sydney
National and International Networking Infrastructure and Research June 13, 2003 Mari Maeda NSF/CISE/ANIR.
Baseband processing, e-VLBI, and SKA simulations Steven Tingay Swinburne University of Technology MNRF Symposium, 8 June, 2004.
Current plan for e-VLBI demonstrations at iGrid2005 and SC2005 Yasuhiro Koyama *1, Tetsuro Kondo *1, Hiroshi Takeuchi *1, Moritaka Kimura, Masaki Hirabaru.
Ongoing e-VLBI Developments with K5 VLBI System Hiroshi Takeuchi, Tetsuro Kondo, Yasuhiro Koyama, and Moritaka Kimura Kashima Space Research Center/NICT.
E-VLBI Development at Haystack Observatory Alan Whitney Chet Ruszczyk Kevin Dudevoir Jason SooHoo MIT Haystack Observatory 24 March 2006 EVN TOG meeting.
E-VLBI Development at Haystack Observatory Alan Whitney Chet Ruszczyk MIT Haystack Observatory 10 Jan 2006 IVS General Meeting Concepion, Chile.
Electronic Transmission of Very- Long Baseline Interferometry Data National Internet2 day, March 18, 2004 David LapsleyAlan Whitney MIT Haystack Observatory,
E-VLBI Development at Haystack Observatory 5 th Annual e-VLBI Workshop Haystack Observatory 20 September 2006 Alan R. Whitney Kevin Dudevoir Chester Ruszczyk.
Goals of a New VLBI Data System Low cost Based primarily on unmodified COTS components Modular, easily upgradeable Robust operation, low maintenance.
2012 DiFX user’s meeting, Sydney, Australia USNO Software Correlator: Status Report Outline USNO/WACO Background USNO Prototype Software Correlator (UPSC)
VSOP-2 Ground Link Station - Tracking Station Requirements - National Astronomical Observatory of Japan Y. Kono.
Current LBA Developments Chris Phillips CSIRO ATNF 13/7/2005.
E-VLBI developments with the K5 VLBI system Koyama Yasuhiro *1, Kondo Tetsuro *1, Kimura Moritaka *1, Takeuchi Hiroshi *1, and Masaki Hirabaru *2 *1 Kashima.
Masaki Hirabaru NICT The 3rd International HEP DataGrid Workshop August 26, 2004 Kyungpook National Univ., Daegu, Korea High Performance.
E-VLBI: Connecting the Global Array of Radio Telescopes through High-Speed Networks Participating U.S. organizations: MIT Haystack Observatory MIT Lincoln.
Trial on the Efficient Use of Trunk Communcation Lines for VLBI in Japan Noriyuki Kawaguchi NATIONAL Astronomial Observatory,Japan eVLBI Workshop
VDIF (VLBI Data Interchange Format) as a common data format in e-VLBI era. M. Sekido (NICT) M.Kettenis(ATNF), C.Phillips(JIVE), A.Whitney(MIT/Haystack),
Masaki Hirabaru Internet Architecture Group GL Meeting March 19, 2004 High Performance Data transfer on High Bandwidth-Delay Product Networks.
Kondo, T. *1*2 and T. Hobiger *2 Kondo, T. *1*2.
Geodetic Networks: The Supporting Framework Terrestrial Reference Frame is ‘Critical Infrastructure’ for all Earth science research and applications. Global.
Data GRID Activity in Japan Yoshiyuki WATASE KEK (High energy Accelerator Research Organization) Tsukuba, Japan
The Internet Hall of Fame Induction Memorial Party for the late Dr. Masaki Hirabaru Shigeki Goto JPNIC Wednesday 4 March,
e-VLBI: Overview and Update Alan R. Whitney MIT Haystack Observatory.
1 Masaki Hirabaru and Yasuhiro Koyama APEC-TEL APGrid Workshop September 6, 2005 e-VLBI: Science over High-Performance Networks.
E-VLBI over TransPAC Masaki HirabaruDavid LapsleyYasuhiro KoyamaAlan Whitney Communications Research Laboratory, Japan MIT Haystack Observatory, USA Communications.
Hirabaru, Koyama, and Kimura NICT APAN NOC Meeting January 20, 2005 e-VLBI updates.
High Bandwidth Data Acquisition and Network Streaming in VLBI Jan Wagner, Guifré Molera et al. TKK / Metsähovi Radio Observatory.
Masaki Hirabaru CRL, Japan APAN Engineering Team Meeting APAN 2003 in Busan, Korea August 27, 2003 Common Performance Measurement Platform.
VLBI/eVLBI with the 305-m Arecibo Radio Telescope Chris Salter Tapasi Ghosh Emmanuel Momjian Arun Venkataraman Jon Hagen.
1 Gbps Disk-Based VLBI Observation for Future East Asia VLBI Observations Kiyoaki Wajima 18 March 2009 동아시아 VLBI 워크샵 Yamaguchi University Introduction.
E-VLBI: Creating a Global Radio Telescope via High-Speed Networks Alan R. Whitney MIT Haystack Observatory SLAC Data Management Workshop 17 March 2004.
E-VLBI and End-to-End Performance Masaki HirabaruYasuhiro KoyamaTetsuro Kondo NICT KoganeiNICT Kashima
Masaki Hirabaru Tsukuba WAN Symposium 2005 March 8, 2005 e-VLBI and End-to-End Performance over Global Research Internet.
E-VLBI Activity in NICT National Institute of Information and Communications Technology (NICT) Kashima Space Research Center M. Sekido, 、 Y. Koyama, M.
VTP: VDIF Transport Protocol Chris Phillips, Alan Whitney, Mamoru Sekido & Mark Kettenis November 2011.
Possible Engineering Support for Dual Polarization and Ultra Wide Band Observation with EAVN N. Kawaguchi National Astronomical Observatory East Asia VLBI.
Masaki Hirabaru Network Performance Measurement and Monitoring APAN Conference 2005 in Bangkok January 27, 2005 Advanced TCP Performance.
NASA Tests e-VLBI concept from the Madrid Deep Space Network to JPL Thom Stone Principal Computer Scientist CSC-NASA Ames Research Center.
Status and future of East Asia VLBI network H.Kobayashi(NAOJ) East Asia VLBI
Masaki Hirabaru NICT Koganei 3rd e-VLBI Workshop October 6, 2004 Makuhari, Japan Performance Measurement on Large Bandwidth-Delay Product.
Update on the Software Correlator Nico Kruithof, Huseyin Özdemir, Yurii Pydoprihora, Ruud Oerlemans, Mark Kettenis, JIVE.
76-m Lovell Telescope Jodrell Bank, UK Even big telescopes see no more detail than the naked eye High bandwidth data transfer - the future of European.
The current status of K5 eVLBI intensive session Takashima, Kazuhiro; Machida,Morito; Fujisaku, Junichi; Kokado, Kensuke; Shigematsu, Hiromi Geographical.
EVLBI at Wettzell R. Dassing G. Kronschnabl. Wettzell is a Fundamentalstation for Geodesy (i.e. all relevant geodetic measurement systems are collocated.
Sep. 17, 2002BESIII Review Meeting BESIII DAQ System BESIII Review Meeting IHEP · Beijing · China Sep , 2002.
The Mark 5B VLBI Data System Alan Whitney MIT Haystack Observatory 10 Jan 2006 IVS General Meeting Concepion, Chile.
Giga-bit Geodesy e-VLBI at 22GHz Hiroshi Takaba Gifu University, Japan.
Demonstration of 16Gbps/station broadband-RF VLBI system Alan Whitney for the VLBI2010 development team MIT Haystack Observatory 22 October st Intl.
VLBI Oct Development Status of Broadband VLBI System (Gala-V) -(II) M.Sekido (1), K.Takefuji (1), H.Ujihara (1), M.Tsutsumi.
1 Masaki Hirabaru Network Architecture Group PL Meeting New Generation Network Research Center July 26, 2006 A Role of Network Architecture in e-VLBI.
TOW 2003 Correlator Class Kerry Kingham US Naval Observatory Arno Mueskens University of Bonn Mike Titus MIT Haystack Observatory.
Masaki Hirabaru NICT APAN JP NOC Meeting August 31, 2004 e-VLBI for SC2004 bwctl experiment with Internet2.
E. Momjian, T. Ghosh, C. Salter, & A. Venkataraman (NAIC-Arecibo Observatory) eVLBI with the 305 m Arecibo Radio Telescope ABSTRACT Using the newly acquired.
Geodetic Networks: The Supporting Framework Terrestrial Reference Frame is ‘Critical Infrastructure’ for all Earth science research and applications. Global.
E-VLBI: A Brief Overview Alan R. Whitney MIT Haystack Observatory.
Possible eVLBI connection between Eastern Asian Observatories Noriyuki KAWAGUCHI National Astronomical Observatory, Japan eVLBI Workshop
1 Masaki Hirabaru and Yasuhiro Koyama PFLDnet 2006 Febrary 2, 2006 International e-VLBI Experience.
Radio Astronomy Applications Group Kashima Space Research Center IUGG2003, Sapporo (C) ISAS Orbit Determination of The NOZOMI Spacecraft using Differential.
Masaki Hirabaru and Yasuhiro Koyama NICT APAN NOC Meeting November 22, 2004 Report on e-VLBI Demonstration in SC2004.
Data-Acquisition and Transport – Looking Forward to 2010 and Beyond Definition of ‘Data-Acquisition and Transport’ Continuum of Transport Options Limitations.
Broadband Interfacing eMerlin-JIVE (1-10Gbps) Onsala-Jodrell Bank (
1 Date Uniboard Application for Korean VLBI Network (KVN) Jae-Hwan Yeom, MiYoung Jung & Bong Won Sohn.
E-VLBI – Creating a Global Radio-Telescope Array via High-Speed Networks Alan R. Whitney MIT Haystack Observatory Optical Waves: Who Needs Them and Why?
e-VLBI Deployments with Research Internet
VTP: VDIF Transport Protocol
Orbit Determination of The NOZOMI Spacecraft using Differential VLBI Technique According to the ISAS announcement the NOZOMI has completed its final Earth.
Presentation transcript:

Developments for real-time software correlation e-VLBI Y. Koyama, T. Kondo, M. Kimura, M. Sekido, M. Hirabaru, and M. Harai Kashima Space Research Center, NICT, Japan

e-VLBI in the beginning Key Stone Project ( ) Koganei Miura Tateyama 100km Kashima ATM Data Transfer Unit Realtime Collelator OC48(ATM) Realtime e-VLBI at 256Mbps (1998~) Automated Observations & Processing

VLBI Systems : From K3 to K5 K3 System K4 System 1983~ Longitudinal Recorder Open Reel Tapes Hardware Correlator 1990~ Rotary Head Recorder Cassette Tapes Hardware Correlator e-VLBI with ATM K3 Correlator (Center) K3 Recorder (Right) K4 Terminal K4 Correlator K5 System K5 Data Acquisition Terminal 2000~ PC based system Hard Disks Software Correlator e-VLBI with IP

Reports from NICT (1/3) Developments of K5/VSSP32 system –Supports 1024Mbps Observations Mode –4 Systems have been deployed 1 at Tsukuba and 3 at Kashima –currently causes spontaneous data error (once every ~150 seconds) need to develop a way to flag bad data in the K5 to Mark5 file format conversion K5/VSSP32 Unit (~32Msample/ch·sec, ~4ch, ~8bits)

Concept of the K5 System K3K4K5 Data RecordersMagnetic Tapes Longitudinal Recorders Magnetic Tapes Rotary Head Recorders Hard Disks e-VLBITelephone LineATMIP CorrelatorsHardware Software 1983~1990~2002~ M96 Recorder, K3 Formatter, K3 VC, K3 Correlator DIR-1000, -L -M, DFC1100, DFC2100, K4 VC (Type-1, 2), TDS784, ADS1000, GBR1000, GBR2000D, K4 Correlator, KSP Correlators, GICO, GICO2 IP-VLBI (K5/VSSP, K5/VSSP32), PC-VSI (K5/VSI), ADS1000, ADS2000, ADS3000

Global e-VLBI in Practice Rapid UT1 Estimation – – Kashima 34mWestford 18m Baseline Length : 9502km Estimated UT1 (variation of the Earth’s rotation) in 4.5 hours. Software Correlation (20 CPUs). Observed data were recorded on hard disks and then transferred. K5 system was used at Kashima and Mark5 system was used at Westford. It has become routine operation for IVS (International VLBI Service) sessions.

Distributed Software Correlation Correlation Master Table / Database SQLSQL Client PCs Linux/FreeBSD Clients Server Master Server

JGNII Symposium 2005 in Osaka Osaka, Japan Run a program at Kashima and Haystack to generate fake data Data were transferred to Osaka in real-time (~400Mbps) and the data were processed for cross correlation processing with distributed software correlator program MIT Haystack NICT Kashima Abilene (10G) JGN II Int’l (10G) Tokyo JGN II (1G/10G) 1G/2.5G JGN II (10G) Osaka Venue 10G #1 #2 #3 #4 GEN-AGEN-B A B AB TT SX T x4 Raid Fiber Channel LCD NE (Network Emulator) NE T x4 SX x2 Fiber Channel TT LCD Measure-BMeasure-A

Another recent event at Kashima Emperor and Empress of Japan visited Kashima and they learned about e-VLBI (June 5, 2005) Demonstration software was developed. The software was designed to be useful for actual operation, too.

Developments of Software Correlator for VERA # Stations5 AlgorismFX Speed0.5~1.0 x 1Gbps x 5 stations OutputFITS, CODA Modes1024Msps x 2bits x 1ch 256Msps x 2bits x 2ch 32Msps x 2bits x 16ch Freq. 32/256/512/1024Msps PP1 sec ~ 0.01 sec Size19 inch rack x 20U Cost~20MYen (180K$) Mitaka FX Correlator

Data Transfer Test at FX Correlator (Mitaka, NAO) VSI

Remaining Challenges Real-time inter-operability between different systems (K5, Mark5, EVN System, etc.). Efficient distributed processing (GRID). Large scale (~40 stations) e-VLBI for VLBI2010. Higher speed for better sensitivity.

K5-Mark5 real-time correlation (near future plan) VSI-E Software Correlator vtp (receiver) vtp (sender) Mark5 System ADS2000 K5 System