18-19 July, 2002Correlator Backend System OverviewTom Morgan 1 Correlator Backend System Overview Tom Morgan, NRAO.

Slides:

Advertisements

Similar presentations

Network II.5 simulator ..

Advertisements

Controller Tests Stephen Kaye Controller Test Motivation Testing the controller before the next generation helps to shake out any remaining.

System Area Network Abhiram Shandilya 12/06/01. Overview Introduction to System Area Networks SAN Design and Examples SAN Applications.

Higher Computing Computer Systems S. McCrossan Higher Grade Computing Studies 7. Systems Software 1 System Software This software is used to provide the.

A new Network Concept for transporting and storing digital video…………

CS-334: Computer Architecture

IBM RS6000/SP Overview Advanced IBM Unix computers series Multiple different configurations Available from entry level to high-end machines. POWER (1,2,3,4)

Team Morphing Architecture Reconfigurable Computational Platform for Space.

I/O Hardware n Incredible variety of I/O devices n Common concepts: – Port – connection point to the computer – Bus (daisy chain or shared direct access)

Fiber Channel Video Controller Students: Tsachy Kapchitz Michael Grinkrug Supervisor: Alex Gurovich in cooperation with: Elbit Systems המעבדה למערכות ספרתיות.

Soft Timers: Efficient Microsecond Software Timer Support For Network Processing Mohit Aron and Peter Druschel Rice University Presented by Reinette Grobler.

CPSC 231 Secondary storage (D.H.)1 Learning Objectives Understanding disk organization. Sectors, clusters and extents. Fragmentation. Disk access time.

COEN 180 NAS / SAN. NAS Network Attached Storage (NAS) Each storage device has its own network interface. Filers: storage device that interfaces at the.

Hardware and Software Basics. Computer Hardware  Central Processing Unit - also called “The Chip”, a CPU, a processor, or a microprocessor  Memory (RAM)

Hardware Overview Net+ARM – Well Suited for Embedded Ethernet

The Prototype Correlator Sonja Vrcic Socorro, 5. December, 2006.

Introduction to Interconnection Networks. Introduction to Interconnection network Digital systems(DS) are pervasive in modern society. Digital computers.

Chapter 7 AC 800M Hardware Course T314.

 What is an operating system? What is an operating system?  Where does the OS fit in? Where does the OS fit in?  Services provided by an OS Services.

Operating System Review September 10, 2012Introduction to Computer Security ©2004 Matt Bishop Slide #1-1.

Chapter 3: Operating-System Structures System Components Operating System Services System Calls System Programs System Structure Virtual Machines System.

EVLA Computing Overview Gareth Hunt EVLA Advisory Committee 2002 June

Hadoop Hardware Infrastructure considerations ©2013 OpalSoft Big Data.

14-15 May,2002 EVLA Correlator Backend Functional Design Tom Morgan 1 Backend Preliminary Functional Design.

Cluster Computers. Introduction Cluster computing –Standard PCs or workstations connected by a fast network –Good price/performance ratio –Exploit existing.

Circuit & Packet Switching. ► Two ways of achieving the same goal. ► The transfer of data across networks. ► Both methods have advantages and disadvantages.

Silberschatz, Galvin and Gagne  Operating System Concepts Chapter 3: Operating-System Structures System Components Operating System Services.

Multiple Processor Systems Chapter Multiprocessors 8.2 Multicomputers 8.3 Distributed systems.

Overall Data Processing Architecture Review EVLA Monitor and Control Interfaces July , 2002EVLA Data Processing PDR Bill Sahr.

PARALLEL COMPUTING overview What is Parallel Computing? Traditionally, software has been written for serial computation: To be run on a single computer.

Management of the LHCb DAQ Network Guoming Liu * †, Niko Neufeld * * CERN, Switzerland † University of Ferrara, Italy.

Implementing Memory Protection Primitives on Reconfigurable Hardware Brett Brotherton Nick Callegari Ted Huffmire.

Long Term Transition Plan Gareth Hunt EVLA M&C PDR 2002 May 15.

Silberschatz, Galvin and Gagne  Operating System Concepts Chapter 13: I/O Systems I/O Hardware Application I/O Interface Kernel I/O Subsystem.

14 June, 2004 EVLA Overall Design Subsystems II Tom Morgan 1 EVLA Overall Software Design Final Internal Review Subsystems II by Tom Morgan.

Sep. 17, 2002BESIII Review Meeting BESIII DAQ System BESIII Review Meeting IHEP · Beijing · China Sep , 2002.

Short introduction Pulsar Parkes. Outline PDFB – Single beam pulsar timing system CASPER – Single beam pulsar coherent dedispersion system.

Configuration Mapper Sonja Vrcic Socorro,

Copyright © 2009 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Principles of Parallel Programming First Edition by Calvin Lin Lawrence Snyder.

Input/Output Problems Wide variety of peripherals —Delivering different amounts of data —At different speeds —In different formats All slower than CPU.

Correlator GUI Sonja Vrcic Socorro, April 3, 2006.

Management of the LHCb DAQ Network Guoming Liu *†, Niko Neufeld * * CERN, Switzerland † University of Ferrara, Italy.

Parallel IO for Cluster Computing Tran, Van Hoai.

CPSC 231 Secondary storage (D.H.)1 Learning Objectives Understanding disk organization. Sectors, clusters and extents. Fragmentation. Disk access time.

Cluster Computers. Introduction Cluster computing –Standard PCs or workstations connected by a fast network –Good price/performance ratio –Exploit existing.

LonWorks Introduction Hwayoung Chae.

System Components Operating System Services System Calls.

© 2002, Cisco Systems, Inc. All rights reserved..

1 بسم الله الرحمن الرحيم MEMORY AND I/O. Introduction to 8086 Microprocessor 8086 Pin Configuration Pin Configuration 8086 Architecture & Modes 2.

Data Acquisition, Diagnostics & Controls (DAQ)

Computer Applications

Software Overview Sonja Vrcic

I/O SYSTEMS MANAGEMENT Krishna Kumar Ahirwar ( )

Operating Systems (CS 340 D)

CS 286 Computer Organization and Architecture

Correlator – Backend System Overview

Dump Control, Delay Models

Storage Networking Protocols

Common computer terminology

Computer Fundamentals

I/O Systems I/O Hardware Application I/O Interface

Backend System Requirements

Five Key Computer Components

Networks Networking has become ubiquitous (cf. WWW)

Introduction to Operating Systems

Chapter 13: I/O Systems I/O Hardware Application I/O Interface

Chapter 13: I/O Systems.

Cluster Computers.

Presentation transcript:

18-19 July, 2002Correlator Backend System OverviewTom Morgan 1 Correlator Backend System Overview Tom Morgan, NRAO

18-19 July, 2002Correlator Backend System OverviewTom Morgan 2 Correlator e2e BackendM & C Major Systems

18-19 July, 2002Correlator Backend System OverviewTom Morgan 3 Backend Components

18-19 July, 2002Correlator Backend System OverviewTom Morgan 4 Backend Processing Verify Correlator Output Assemble Lag Sets from Lag Frames Apply Normalizations and Corrections FFT Integrate Noise Reduction/Excision

18-19 July, 2002Correlator Backend System OverviewTom Morgan 5 Initial Data Rates 64 Correlator Chips per Baseline Board (16 Sub- bands x 4 Polarization Products) x 2048 Lags x 8 Bytes per Lag = 1 Mbyte per CC per Dump 0.1 sec Dump Interval => 10 Mbytes/sec per Baseline Board 160 Baseline Boards => 1.6 Gbytes/sec Aggregate Sustained Input Rate 64:1 Reduction (6.4 sec Integration Time) on Backend => 25 Mbytes /sec Aggregate Sustained Output Rate

18-19 July, 2002Correlator Backend System OverviewTom Morgan 6 Data Rate Limiting Factors Connection Technology and Switch Speeds Memory and Disk Storage Capacities Processor Speeds Archive Size and Filling Rates Ultimately a $ Limitation

18-19 July, 2002Correlator Backend System OverviewTom Morgan 7 Correlator to Backend Interface 160 (27-32 Antennas) Minimum to 336 (48 Antennas) Correlator Connections ~50 Backend Connections Initial Maximum Aggregate Transfer Rate of 1.6 Gbytes/sec Gbit/sec Switch

18-19 July, 2002Correlator Backend System OverviewTom Morgan 8 Backend to e2e Interface Initial Maximum Aggregate Transfer Rate of 25 Mbytes/sec ~ 50 Backend Connections Formatted as AIPS++ Measurement Sets Avoid Inter-processor Data Movement on the Backend Minimize Overheads on the Backend Backend has Provision for Backup Storage of Output on Disk

18-19 July, 2002Correlator Backend System OverviewTom Morgan 9 e2e Connection Modes Network Based Message Passing Channel Based I/O Backend Driven e2e Driven

18-19 July, 2002Correlator Backend System OverviewTom Morgan 10 Message Passing Backend Output Transfer via Network Packets High Speed Ethernet

18-19 July, 2002Correlator Backend System OverviewTom Morgan 11 Channel I/O Backend Output Data Transfer via Direct File Read/Write or Memory Copy Fiber Channel, SCSI …

18-19 July, 2002Correlator Backend System OverviewTom Morgan 12 Backend Driven Backend System Runs Software that does Transfers If Message Passing: Backend Sends Data to an e2e Based Process and Retains a Copy until Receipt is Acknowledged If Channel I/O: Backend does Direct FileWrites into the Archive

18-19 July, 2002Correlator Backend System OverviewTom Morgan 13 e2e Driven e2e System Runs Software that does Transfers If Message Passing: e2e Runs Processes on Backend Nodes and Accesses Files or Memory for Data If Channel I/O: e2e does File Read/Write or Memory Copy from Either End

18-19 July,2002Correlator Backend System OverviewTom Morgan 14 Development Schedule 2Q 2002 – 4 Node Test Cluster 3Q 2002 – 8+ Node Cluster 4Q 2002 – Functional Prototype 3Q 2003 – Activate e2e Connection 4Q 2003 – Full Functionality 3Q 2004 – First Prototype Correlator Boards 4Q 2004 – Earliest BE Connect to Correlator Hardware