1 CSE 591-S04 (lect 14) Interconnection Networks (notes by Ken Ryu of Arizona State) l Measure –How quickly it can deliver how much of what’s needed to.

Slides:



Advertisements
Similar presentations
Comparison Of Network On Chip Topologies Ahmet Salih BÜYÜKKAYHAN Fall.
Advertisements

Shantanu Dutt Univ. of Illinois at Chicago
Data Communications and Networking
Computer Network Topologies
What is a network? A network consists of two or more computers that are linked in order to share resources (such as printers and CD-ROMs) , exchange.
1 Lecture 23: Interconnection Networks Topics: communication latency, centralized and decentralized switches (Appendix E)
Interconnection Networks 1 Interconnection Networks (Chapter 6) References: [1,Wilkenson and Allyn, Ch. 1] [2, Akl, Chapter 2] [3, Quinn, Chapter 2-3]
Mesh Networks A.k.a “ad-hoc”. Definition A local area network that employs either a full mesh topology or partial mesh topology Full mesh topology- each.
NUMA Mult. CSE 471 Aut 011 Interconnection Networks for Multiprocessors Buses have limitations for scalability: –Physical (number of devices that can be.
1 Lecture 24: Interconnection Networks Topics: communication latency, centralized and decentralized switches (Sections 8.1 – 8.5)
Interconnection Network Topologies
1 Lecture 25: Interconnection Networks Topics: communication latency, centralized and decentralized switches, routing, deadlocks (Appendix E) Review session,
Chapter 5 Array Processors. Introduction  Major characteristics of SIMD architectures –A single processor(CP) –Synchronous array processors(PEs) –Data-parallel.
Interconnect Network Topologies
Interconnection Networks. Applications of Interconnection Nets Interconnection networks are used everywhere! ◦ Supercomputers – connecting the processors.
Computer Science Department
Interconnect Networks
Network Topologies Topology – how nodes are connected – where there is a wire between 2 nodes. Routing – the path a message takes to get from one node.
PPC Spring Interconnection Networks1 CSCI-4320/6360: Parallel Programming & Computing (PPC) Interconnection Networks Prof. Chris Carothers Computer.
CSE Advanced Computer Architecture Week-11 April 1, 2004 engr.smu.edu/~rewini/8383.
Dynamic Interconnect Lecture 5. COEN Multistage Network--Omega Network Motivation: simulate crossbar network but with fewer links Components: –N.
Parallel Computer Architecture and Interconnect 1b.1.
1 Dynamic Interconnection Networks Miodrag Bolic.
Switches and indirect networks Computer Architecture AMANO, Hideharu Textbook pp. 92~13 0.
Lecture 3 Innerconnection Networks for Parallel Computers
شبکه های میان ارتباطی 1 به نام خدا دکتر محمد کاظم اکبری مرتضی سرگلزایی جوان
Anshul Kumar, CSE IITD CSL718 : Multiprocessors Interconnection Mechanisms Performance Models 20 th April, 2006.
Computer Science and Engineering Parallel and Distributed Processing CSE 8380 January Session 4.
Anshul Kumar, CSE IITD ECE729 : Advanced Computer Architecture Lecture 27, 28: Interconnection Mechanisms In Multiprocessors 29 th, 31 st March, 2010.
Birds Eye View of Interconnection Networks
1 Computer Communication & Networks Lecture 21 Network Layer: Delivery, Forwarding, Routing Waleed.
1 Interconnection Networks. 2 Interconnection Networks Interconnection Network (for SIMD/MIMD) can be used for internal connections among: Processors,
McGraw-Hill©The McGraw-Hill Companies, Inc., 2004 Connecting Devices CORPORATE INSTITUTE OF SCIENCE & TECHNOLOGY, BHOPAL Department of Electronics and.
NETWORKS.
Computer Science and Engineering Copyright by Hesham El-Rewini Advanced Computer Architecture.
Data Communications and Networks Chapter 1 - Classification of network topologies Data Communications and Network.
Interconnect Networks Basics. Generic parallel/distributed system architecture On-chip interconnects (manycore processor) Off-chip interconnects (clusters.
Super computers Parallel Processing
Computer Science and Engineering Copyright by Hesham El-Rewini Advanced Computer Architecture CSE 8383 February Session 9.
Computer Science and Engineering Copyright by Hesham El-Rewini Advanced Computer Architecture CSE 8383 February Session 10.
INTERCONNECTION NETWORKS Work done as part of Parallel Architecture Under the guidance of Dr. Edwin Sha By Gomathy Gowri Narayanan Karthik Alagu Dynamic.
Introduction Computer networks: – definition – computer networks from the perspectives of users and designers – Evaluation criteria – Some concepts: –
1 Lecture 24: Interconnection Networks Topics: communication latency, centralized and decentralized switches, routing, deadlocks (Appendix F)
Spring EE 437 Lillevik 437s06-l22 University of Portland School of Engineering Advanced Computer Architecture Lecture 22 Distributed computer Interconnection.
Computer Networks Part 2
COMP8330/7330/7336 Advanced Parallel and Distributed Computing Tree-Based Networks Cache Coherence Dr. Xiao Qin Auburn University
Interconnection Networks Communications Among Processors.
INTERCONNECTION NETWORK
Network Connected Multiprocessors
Overview Parallel Processing Pipelining
Networks Network:end-node and router C 2 B 1 3 D 5 A 4 6 E 7 Router F
Auburn University COMP8330/7330/7336 Advanced Parallel and Distributed Computing Interconnection Networks (Part 2) Dr.
Dynamic connection system
Lecture 23: Interconnection Networks
Connection System Serve on mutual connection processors and memory .
Refer example 2.4on page 64 ACA(Kai Hwang) And refer another ppt attached for static scheduling example.
NTHU CS5421 Cloud Computing
Multiprocessors Interconnection Networks
Mesh-Connected Illiac Networks
Static Interconnection Networks
High Performance Computing & Bioinformatics Part 2 Dr. Imad Mahgoub
Interconnection Networks Contd.
Embedded Computer Architecture 5SAI0 Interconnection Networks
Wide Area Networks (WANs), Routing, and Shortest Paths
Birds Eye View of Interconnection Networks
Types of topology. Bus topology Bus topology is a network type in which every computer and network device is connected to single cable. When it has exactly.
Static Interconnection Networks
Wide Area Networks (WANs), Routing, and Shortest Paths
Topology What are the consequences of using fewer than n2 connections?
Multiprocessors and Multi-computers
Presentation transcript:

1 CSE 591-S04 (lect 14) Interconnection Networks (notes by Ken Ryu of Arizona State) l Measure –How quickly it can deliver how much of what’s needed to the right place reliably and at good cost and value l Performance Metrics –latency: time for the first bits to arrive –bandwidth: sustained volume of communication –connectivity: how far is the furthest neighbor –hardware cost: can we afford to build this thing? –reliability: can links fail and the system still run? –functionality: “for free” features combining messages fault tolerance l Options –topology –operation mode (synchronous or asynchronous) –switching strategy (circuit, store-and-forward, cut- through) –control strategy (central or distributed)

2 CSE 591-S04 (lect 14) Static Connection Topologies (1) l Topology determines –degree, connections, distance (latency) –routing, cost-performance l Fully Connected Nodes l Star l Tree

3 CSE 591-S04 (lect 14) Static Connection Topologies (2) l Mesh and Ring l Hypercube l Shuffle Exchange

4 CSE 591-S04 (lect 14) Multistage Switching Networks l several stages between source and destination l provide different options in –cost –wires –blocking probability l can be combined into many hybrid options

5 CSE 591-S04 (lect 14) Omega Networks l log n (M) stages for M nodes and n by n cross bars l message block if the required output link is not available

6 CSE 591-S04 (lect 14) Benes networks l additional stages to reduce blocking l can route any disjoint src/dest pairs wo blocking –but must know requests in advance

7 CSE 591-S04 (lect 14) Dynamic (Fat) Trees l Tree: Disproportionate share of traffic l Idea: more resources near the root –Charles Leiserson l Used in CM-5 –More switches near the root – l Theory –Given a size, the best network of the size –Proof : Leiserson’s Fat tree paper

8 CSE 591-S04 (lect 14) Interconnection: Combining l Try to reduce hot spots in a communication network –combine requests for the same location really cache line l Use topology of the network to match comm ops –broadcast flood network - everyone sends to everyone else form a broadcast tree –reduction put arithmetic operations into switches CM-5 fast hardware for and,or,min,max