Shatskaya M, Abramov A., Fedorov N., Kostenko V., Likhachev S., Seliverstov S., Sichev D. Astro Space Center, P. Lebedev Physical Institute, RAS, Moscow,

Slides:



Advertisements
Similar presentations
Dominik Stoklosa Poznan Supercomputing and Networking Center, Supercomputing Department EGEE 2007 Budapest, Hungary, October 1-5 Workflow management in.
Advertisements

Connecting Academic Networks The ORIENT, TEIN and GÉANT Projects: International Research Networks John Chevers, DANTE International eVLBI Workshop Shanghai,
Dominik Stokłosa Pozna ń Supercomputing and Networking Center, Supercomputing Department INGRID 2008 Lacco Ameno, Island of Ischia, ITALY, April 9-11 Workflow.
SensMax People Counting Solutions Visitors counting makes the most efficient use of resources - people, time and money, which leads to higher profits in.
A new Network Concept for transporting and storing digital video…………
High Performance Computing Course Notes Grid Computing.
“An integrator view on storage consolidation & Information Lifecycle Management (ILM)” Ulrik Van Schepdael - Marketing Manager Belgacom Network & System.
First e-EVN Science and Future Astronomy projects via EXPReS Michael Garrett Joint Institute for VLBI in Europe e-VLBI Workshop, Sydney, 13 July 2005.
Planning for the Virtual Observatory Tara Murphy … with input from other Aus-VO members …
Surveillance camera in terms of business. Index *surveillance systems * Types of control systems * Elements of control systems * Types of monitoring camera.
Unit 3—Part A Computer Memory
Dinna LeDuff Cottrell Chief Information Officer Stennis Space Center August 18, 2010 Stellar Stars: Reflections of a Center CIO.
E-VLBI Development at Haystack Observatory Alan Whitney Chet Ruszczyk Kevin Dudevoir Jason SooHoo MIT Haystack Observatory 24 March 2006 EVN TOG meeting.
Electronic Transmission of Very- Long Baseline Interferometry Data National Internet2 day, March 18, 2004 David LapsleyAlan Whitney MIT Haystack Observatory,
E-VLBI Development at Haystack Observatory 5 th Annual e-VLBI Workshop Haystack Observatory 20 September 2006 Alan R. Whitney Kevin Dudevoir Chester Ruszczyk.
Poznań city, PSNC - who are we? Poznań city, PSNC - who are we? Introduction into Virtual Laboratory Introduction into Virtual Laboratory VLab architecture.
E-VLBI: Connecting the Global Array of Radio Telescopes through High-Speed Networks Participating U.S. organizations: MIT Haystack Observatory MIT Lincoln.
Marcin Okoń Pozna ń Supercomputing and Networking Center, Supercomputing Department e-Science 2006, Amsterdam, Dec Virtual Laboratory as a Remote.
School of EECS, Peking University Microsoft Research Asia UStore: A Low Cost Cold and Archival Data Storage System for Data Centers Quanlu Zhang †, Yafei.
09-Sept-2004 NeSC UKLight Town Meeting Peter Clarke, UKLight Town Meeting Welcome, background and & programme for the day Peter Clarke.
1 ASTER DATA Transfer System Earth Remote Sensing Data Analysis Center Kunjuro Omagari ERSDAC 23th APAN Meeting.
Date donald smits center for information technology Centre of Information Technology RUG Robert Janz Centre of Information Technology University.
MWA Data Capture and Archiving Dave Pallot MWA Conference Melbourne Australia 7 th December 2011.
E-VLBI over TransPAC Masaki HirabaruDavid LapsleyYasuhiro KoyamaAlan Whitney Communications Research Laboratory, Japan MIT Haystack Observatory, USA Communications.
User views from outside of Western Europe MarkoBonac, Arnes, Slovenia.
High Data Rate Transfer for HEP and VLBI Ralph Spencer, Richard Hughes-Jones and Simon Casey The University of Manchester Netwrokshop33 March 2005.
Mark A. Magumba Storage Management. What is storage An electronic place where computer may store data and instructions for retrieval The objective of.
The LHC Computing Grid – February 2008 The Worldwide LHC Computing Grid Dr Ian Bird LCG Project Leader 25 th April 2012.
High Rate Internet Data Transfer for eVLBI Ralph Spencer, Richard Hughes-Jones and Simon Casey The University of Manchester All Hands Sept 2005.
VLBI/eVLBI with the 305-m Arecibo Radio Telescope Chris Salter Tapasi Ghosh Emmanuel Momjian Arun Venkataraman Jon Hagen.
VLBI Storage Manager (VSM) Matteo Stagni – Mauro Nanni 0.
Research Networks and Astronomy Richard Schilizzi Joint Institute for VLBI in Europe
The International Space Environment Service (ISES) Joe Kunches Secretary for Space Weather, ISES Space Weather Week 2005 April 6,2005.
4th e-VLBI workshop, Sydney, July 2005, A. Szomoru, JIVE e-VLBI and EXPReS Arpad Szomoru.
NASA Tests e-VLBI concept from the Madrid Deep Space Network to JPL Thom Stone Principal Computer Scientist CSC-NASA Ames Research Center.
E-VLBI FP6 Proposal. Outline Background The Call Content of Proposal & Aim Possible Participants Overall preparation plan.
76-m Lovell Telescope Jodrell Bank, UK Even big telescopes see no more detail than the naked eye High bandwidth data transfer - the future of European.
上海天文台 Shanghai Astronomical Observatory 4th IVS General Meeting Spacecraft Tracking with Chinese VLBI Network Xiuzhong Zhang and Chinese VLBI Network Team.
The LHC Computing Grid – February 2008 The Challenges of LHC Computing Dr Ian Bird LCG Project Leader 6 th October 2009 Telecom 2009 Youth Forum.
RadioAstron space VLBI mission: early results. XXVIII GA IAU, Beijing, August RadioAstron space VLBI mission: early results. XXVIII GA IAU, Beijing,
Les Les Robertson LCG Project Leader High Energy Physics using a worldwide computing grid Torino December 2005.
Google and Large Scientific Datasets or How To Move 100TB Jon Trowbridge Google Space Telescope Science Institute March 15, 2007.
Westerbork Netherlands Dedicated Gbit link Onsala Sweden Gbit link Jodrell Bank UK Dwingeloo DWDM link Cambridge UK MERLIN Medicina Italy Chalmers University.
E. Momjian, T. Ghosh, C. Salter, & A. Venkataraman (NAIC-Arecibo Observatory) eVLBI with the 305 m Arecibo Radio Telescope ABSTRACT Using the newly acquired.
1 eVLBI Developments at Jodrell Bank Observatory Ralph Spencer, Richard Hughes- Jones, Simon Casey, Paul Burgess, The University of Manchester.
Netherlands Institute for Radio Astronomy 1 ASTRON is part of the Netherlands Organisation for Scientific Research (NWO) Kurgan high-school students visit,
2007 April 17EXPReS Annual ReviewSlide #: 1. EXPReS Annual Review April 17 EXPReS Project Team JIVE, Coordinating Institution.
PRESENTATION DATEEXPReS- TITLE OF YOUR PRESENTATIONSlide #1 What is EXPReS? EXPReS = Express Production Real-time e-VLBI Service Three year project (March.
Dominique Boutigny December 12, 2006 CC-IN2P3 a Tier-1 for W-LCG 1 st Chinese – French Workshop on LHC Physics and associated Grid Computing IHEP - Beijing.
NSF International Research Network Connections (IRNC) Program: TransLight/StarLight Maxine D. Brown and Thomas A. DeFanti Electronic Visualization Laboratory.
Pinger and IEPM-BW activity at FNAL By Frank Nagy FTP/CCF Computing Division Fermilab.
SPIE, Orlando, May 2006, A. Szomoru, JIVE VLBI in Transition Arpad Szomoru Joint Institute for VLBI in Europe.
EInfrastructures: Usage Policy Mike Garrett Joint Institute for VLBI in Europe (JIVE, Dwingeloo, The Netherlands) eInfrastructure meeting, Dublin, April.
Presentation Title Presentation subtitle Your name Your title, organisation.
What is FABRIC? Future Arrays of Broadband Radio-telescopes on Internet Computing Huib Jan van Langevelde, JIVE Dwingeloo.
Distributed Correlation in Fabric Kiwi Team PSNC.
VGOS GPU Based Software Correlator Design Igor Surkis, Voytsekh Ken, Vladimir Mishin, Nadezhda Mishina, Yana Kurdubova, Violet Shantyr, Vladimir Zimovsky.
SA1: overview, first results
Shatskaya M, Abramov A. , Fedorov N. , Kostenko V. , Likhachev S
Building the Square Kilometer Array – a truly global project
e-VLBI: Creating a Global Radio Telescope via High-Speed Networks
The Institute of Applied Astronomy of the Russian Academy of Sciences Operating experience of Data Transmission and Buffer System. Research of.
eInfrastructures: Usage Policy
The Most Visited Countries
Potential NASA Funding Sources
EXPReS Annual Review April 17
Electrification Products
Astro Space Center of Lebedev Physical Institute, Moscow
User interaction and workflow management in Grid enabled e-VLBI experiments Dominik Stokłosa Poznań Supercomputing and Networking Center, Supercomputing.
LHCb thinking on Regional Centres and Related activities (GRIDs)
Presentation transcript:

Shatskaya M, Abramov A., Fedorov N., Kostenko V., Likhachev S., Seliverstov S., Sichev D. Astro Space Center, P. Lebedev Physical Institute, RAS, Moscow, Russia Data Processing Center for Space VLBI Projects Implementation

Data processing center for space VLBI project Radioastron. Now working project. Data processing center for space VLBI project Millimetron. Future project.

Objectives of Data Processing Center  Organization of service information exchange.  Collection and storage of all scientific information of observations.  Processing of scientific observation data. Radioastron project

Expected July 2011 Nowadays 2014 Ground Telescopes540 Ground Telescopes Worked Simultaneously 2-3Up to 30 Tracking stationsPushchinoPushchino + Green Bank Number of observations per month Volume of information, TB per month Radioastron project

At the launchNowadays Storage100 TB1 PB on line 2 PB off line DAS Direct Attached Storage NAS Network Attached Storage Dividing of processes of data collecting and archiving and processing Internet Channel100 Mb/s600 Mb/s Internal Network1 Gb/s10 Gb/s Radioastron project

Exterior View of Data Processing Center Radioastron project

Structure of Data Processing Center Radioastron project

- On-line storage system for collecting information - 600TB; - On-line storage system for data processing - 80TB; - On-line storage system for processing results - 120TB; - The archive of data on hard drives TB; - Archive tapes for 2000 TB; - Reserve storage 20 TB in Pushchino; The total storage capacity is about 5PB! - Computer system with performance 1TF/s; - 1Gb/s and 10Gbit/c network infrastructure, - and 600 Mbit/s Internet channel. Main Components of DPC Radioastron project

Archive on HDD Total amount of data today is more than 1100TB Radioastron project

Channels of communication Radioastron project

Scientific Data Transferring 100 GB – 1 hour Pushchino tracking station – 1 Gb/s direct channel – immediately after observations Green Bank tracking station and all ground telescopes – via Internet speed - from 4 to 300Mb/s On HDD if it is possible On HDD from Kalyasin and Evpatory We have suitable situation with almost all telescopes Radioastron project

Transferring of Imaging Observations Imaging observations from Bonn and JIVE One observation 40 TB We need a few hundreds Mbit/s at least GEANT TCP UDP Direct channel Radioastron project

Space telescope Ground telescopes Tracking station Control stations Data processing center Tracking headquarters Scientific centers and users Ballistic center Center of experiment planning Data Processing Center of Millimetron Project

Millimetron: Amount of Expected Information Maximum from tracking stations: 1,2 Gb/s * 3600s * 24hours * 365days * 5years ~ 23,7 PB From ground telescopes 2,4 Gb/s * 3600s * 10 hours * 365 days * 5 years ~ 19,2 PB Total amount from tracking stations and 3 ground telescopes: 23,7 + 19,2 * 3 = 81,3 PB According to Technical Documentation 5 ПБ on-line = 4 PB for row data + 1 PB after correlator 200 PB archive = 100 PБ the first copy PБ the second copy

Data Center for Millimetron Project Appropriate room or special building with protection from leaking and fire-extinguishing system Redundant power supply Independent power supply (diesel generator) Uninterruptible power supply Air-conditioning on N + 1 systems Video surveillance and monitoring of all systems Room for operators Communication channels

Data Center for Millimetron Project Computer equipment - repositories, supercomputer, archive, communications Buffer storages on Tracking Stations 1,2 Gb/s * 3600s * 16 hours * 14 days ~120 TB Buffer storage on ground telescopes 2,4 Gb/s * 3600s * 16 hours * 14 days ~ 240 TB

The structure and functions of ASC Data Processing Center for Radioastron project are fully adequate to the data processing requirements of the Radioastron Mission. When we created data processing center for the Radioastron project, we got experience of working, transferring and storage of large volumes of data. The experience will be useful for our next project "Millimetron“. Conclusions

THANK YOU

Scientific Data Transferring from Ground Telescopes Effelsberg Germany Arecibo Puerto Rico GBT USA Medicina Italy Westerbork Netherlands Yebes Spain Badary Russia Zelenchuk Russia Svetloe Russia Usuda Japan

Urumqi China Tidbinbilla Australia Shanghai China Parks Australia Onsala Sweden Noto Italy Jodrell Bank UK ATCA Australia Hart Africa Robledo Spain Torun Poland Scientific Data Transferring from Ground Telescopes

Noto Италия Jodrell Bank Великобритания Hart ЮАР Effelsberg Германия Arecibo Пуэрто-Рико GBT США Medicina Италия Westerbork Нидерланды Yebes Испания Бадары Россия Zelenchuk Россия Svetloe Россия