Presentation is loading. Please wait.

Presentation is loading. Please wait.

Application Specific Massive Parallelism Systolic and Instruction Systolic Computing Heiko Schröder, 2003 LOCOMAP.

Published by Modified over 9 years ago

Similar presentations

Presentation on theme: "Application Specific Massive Parallelism Systolic and Instruction Systolic Computing Heiko Schröder, 2003 LOCOMAP."— Presentation transcript:

1 Application Specific Massive Parallelism Systolic and Instruction Systolic Computing Heiko Schröder, 2003 LOCOMAP

2 Heiko Schröder, 2003 Parallel control structures 2 Flynn’s taxonomy... SA --- Systolic Array SIMD --- Single Instruction Multiple Data ISA --- Instruction Systolic Array MIMD --- Multiple Instruction Multiple Data SPMD --- Single Program MD

3 Heiko Schröder, 2003 Parallel control structures 3 parallel merge initial situation: 1.) sort columns (odd-even-transposition sort) 2.) sort rows (odd-even-transposition sort) sorted !!!! x1x2 x3 x4 x5 x6 x7 x17 x18 y1 y2 y3 y4 y5 y6 y7 y17 y18...

4 Heiko Schröder, 2003 Parallel control structures 4 0-1 principle The 0-1 principle states that if all sequences of 0 and 1 are sorted properly than this is a correct sorter. The sorter must be based on moving data. initially 0s 1s after vertical sort 0s 1s after horizontal sort 0s 1s

5 Heiko Schröder, 2003 Parallel control structures 5 MIMD (clocked) min maxTime: 2n

6 Heiko Schröder, 2003 Parallel control structures 6 systolic merge 1 3 3 4 5 5 6 7 9 8 8 7 4 4 3 2

7 Heiko Schröder, 2003 Parallel control structures 7 systolic merge 1 3 3 4 5 5 6 7 9 8 8 7 4 4 3 2

8 Heiko Schröder, 2003 Parallel control structures 8 systolic merge 1 3 3 4 5 5 6 7 9 8 8 7 4 4 3 2

9 Heiko Schröder, 2003 Parallel control structures 9 systolic merge 1 3 3 4 5 5 6 7 9 8 8 7 4 4 3 2

10 Heiko Schröder, 2003 Parallel control structures 10 systolic merge 1 3 3 4 5 5 6 7 9 8 8 7 4 4 3 2

11 Heiko Schröder, 2003 Parallel control structures 11 1 3 3 4 5 5 6 7 4 4 3 2 9 8 8 7 systolic merge

12 Heiko Schröder, 2003 Parallel control structures 12 systolic merge 1 3 3 4 5 5 6 7 4 4 3 2 9 8 8 7

13 Heiko Schröder, 2003 Parallel control structures 13 systolic merge 1 3 3 4 4 4 3 2 5 5 6 7 9 8 8 7

14 Heiko Schröder, 2003 Parallel control structures 14 systolic merge 1 3 3 4 4 4 3 2 5 5 6 7 9 8 8 7

15 Heiko Schröder, 2003 Parallel control structures 15 systolic merge 1 3 3 2 4 4 3 4 5 5 6 7 9 8 8 7

16 Heiko Schröder, 2003 Parallel control structures 16 systolic merge 1 3 3 2 4 4 3 4 5 5 6 7 9 8 8 7

17 Heiko Schröder, 2003 Parallel control structures 17 systolic merge 1 3 3 2 4 4 3 4 5 5 6 7 9 8 8 7

18 Heiko Schröder, 2003 Parallel control structures 18 systolic merge 1 3 2 3 4 3 4 4 5 5 6 7 9 8 8 7

19 Heiko Schröder, 2003 Parallel control structures 19 1 3 2 3 4 3 4 4 5 5 6 7 9 8 8 7 systolic merge

20 Heiko Schröder, 2003 Parallel control structures 20 1 2 3 3 3 4 4 4 5 5 6 7 9 8 8 7 systolic merge

21 Heiko Schröder, 2003 Parallel control structures 21 1 2 3 3 3 4 4 4 5 5 6 7 9 8 8 7 systolic merge

22 Heiko Schröder, 2003 Parallel control structures 22 1 2 3 3 3 4 4 4 5 5 6 7 9 8 8 7 systolic merge

23 Heiko Schröder, 2003 Parallel control structures 23 1 2 3 3 3 4 4 4 5 5 6 7 8 9 7 8 systolic merge

24 Heiko Schröder, 2003 Parallel control structures 24 1 2 3 3 3 4 4 4 5 5 6 7 8 9 7 8 systolic merge

25 Heiko Schröder, 2003 Parallel control structures 25 1 2 3 3 3 4 4 4 5 5 6 7 8 7 9 8 systolic merge

26 Heiko Schröder, 2003 Parallel control structures 26 systolic merge 1 2 3 3 3 4 4 4 5 5 6 7 8 7 9 8

27 Heiko Schröder, 2003 Parallel control structures 27 sorted !!! systolic merge 1 2 3 3 3 4 4 4 5 5 6 7 7 8 8 9 Time: 4n-3 Period: n Area: 3n-2

28 Heiko Schröder, 2003 Parallel control structures 28 Systolic convolution w6w6 w5w5 w4w4 w3w3 w2w2 w1w1 *x3x3 *x2x2 *x1x1 x6x6 *x5x5 *x4x4 *x3x3 *x2x2 *x1x1 x6x6 *x5x5 *x4x4 *x3x3 *x2x2 *x1x1 x6x6 *x5x5 *x4x4 *x3x3 *x2x2 *x1x1 x6x6 *x5x5 *x4x4 *x3x3 *x2x2 *x1x1 x6x6 *x5x5 *x4x4 *x3x3 *x2x2 *x1x1 x6x6 *x5x5 *x4x4 *x3x3 *x2x2 *x1x1 x6x6 *x5x5 *x4x4 time Result stream(s)

29 Heiko Schröder, 2003 Parallel control structures 29 Characteristics of SAs Extremely high cost-performance no flexibility -- long development time Suitable for special signal processing tasks ???

30 Heiko Schröder, 2003 Parallel control structures 30 ISA merge x1 x8 y1 y8... Period: 4n-4 Time: 6n-6

31 Heiko Schröder, 2003 Parallel control structures 31 ISA merge x1 x8 y1 y8...

32 Heiko Schröder, 2003 Parallel control structures 32 ISA merge x1 x8 y1 y8...

33 Heiko Schröder, 2003 Parallel control structures 33 ISA merge x1 x8 y1 y8...

34 Heiko Schröder, 2003 Parallel control structures 34 ISA merge x1 x8 y1 y8...

35 Heiko Schröder, 2003 Parallel control structures 35 ISA merge x1 x8 y1 y8...

36 Heiko Schröder, 2003 Parallel control structures 36 ISA merge x1 x8 y1 y8...

37 Heiko Schröder, 2003 Parallel control structures 37 ISA merge x1 x8 y1 y8...

38 Heiko Schröder, 2003 Parallel control structures 38 ISA merge x1 x8 y1 y8...

39 Heiko Schröder, 2003 Parallel control structures 39 ISA merge x1 x8 y1 y8...

40 Heiko Schröder, 2003 Parallel control structures 40 ISA merge x1 x8 y1 y8...

41 Heiko Schröder, 2003 Parallel control structures 41 ISA merge x1 x8 y1 y8...

42 Heiko Schröder, 2003 Parallel control structures 42 ISA merge x1 x8 y1 y8...

43 Heiko Schröder, 2003 Parallel control structures 43 ISA merge x1 x8 y1 y8...

44 Heiko Schröder, 2003 Parallel control structures 44 ISA merge x1 x8 y1 y8...

45 Heiko Schröder, 2003 Parallel control structures 45 ISA merge x1 x8 y1 y8...

46 Heiko Schröder, 2003 Parallel control structures 46 46 Principle of the ISA Communication- Register

47 Heiko Schröder, 2003 Parallel control structures 47 C := CN

48 Heiko Schröder, 2003 Parallel control structures 48 48 Interface Processors Interface Processors North Interface Processors West ISA..

49 Heiko Schröder, 2003 Parallel control structures 49 49 Architecture of Systola 1024 Interface processors ISA RAM NORTH program memory host computer bus Controller RAM WEST

50 Heiko Schröder, 2003 Parallel control structures 50 Hough transform on the ISA good line detection method shear Fast tomography fast cryptography

51 Heiko Schröder, 2003 Parallel control structures 51 robot vision projector CCD stereo vision

52 Heiko Schröder, 2003 Parallel control structures 52 1.measuring a set of parallel rays Computerized Tomography: Parallel Projections 1. 2. 2. for a number of different angles 3. 3.reconstruction of the 2D-picture 4. 4.3D-reconstruction out of many 2D-pictures High-Speed Implementation on the ISA

53 Heiko Schröder, 2003 Parallel control structures 53 Radon Transform Image Domain Radon Tr. Radon Domain Inverse Radon Tr. High-Speed Implementation on the ISA

54 Heiko Schröder, 2003 Parallel control structures 54 Implementation of Backprojection

55 Heiko Schröder, 2003 Parallel control structures 55 ISA merge 1 3 3 4 5 5 6 7 9 8 8 7 4 4 3 2 C:=min{C, CE} C:=max{C, CW} Period: 4n-4 Time: 6n-6

56 Heiko Schröder, 2003 Parallel control structures 56 ISA merge 1 3 3 4 5 5 6 7 9 8 8 7 4 4 3 2

57 Heiko Schröder, 2003 Parallel control structures 57 ISA merge 1 3 3 4 5 5 6 7 9 8 8 7 4 4 3 2

58 Heiko Schröder, 2003 Parallel control structures 58 ISA merge 1 3 3 4 5 5 6 7 9 8 8 7 4 4 3 2

59 Heiko Schröder, 2003 Parallel control structures 59 ISA merge 1 3 3 4 5 5 6 7 9 8 8 7 4 4 3 2

60 Heiko Schröder, 2003 Parallel control structures 60 ISA merge 1 3 3 4 5 5 6 7 4 8 8 7 9 4 3 2

61 Heiko Schröder, 2003 Parallel control structures 61 ISA merge 1 3 3 4 5 5 6 7 4 8 8 7 9 4 3 2

62 Heiko Schröder, 2003 Parallel control structures 62 ISA merge 1 3 3 4 4 5 6 7 5 4 8 7 9 8 3 2

63 Heiko Schröder, 2003 Parallel control structures 63 ISA merge 1 3 3 4 4 5 6 7 5 4 8 7 9 8 3 2

64 Heiko Schröder, 2003 Parallel control structures 64 ISA merge 1 3 3 4 4 4 6 7 5 5 3 7 9 8 8 2

65 Heiko Schröder, 2003 Parallel control structures 65 ISA merge 1 3 3 4 4 4 6 7 5 5 3 7 9 8 8 2

66 Heiko Schröder, 2003 Parallel control structures 66 ISA merge 1 3 3 4 4 4 3 7 5 5 6 2 9 8 8 7

67 Heiko Schröder, 2003 Parallel control structures 67 ISA merge 1 3 3 4 4 4 3 7 5 5 6 2 9 8 8 7

68 Heiko Schröder, 2003 Parallel control structures 68 ISA merge 1 3 3 4 4 4 3 2 5 5 6 7 9 8 8 7

69 Heiko Schröder, 2003 Parallel control structures 69 ISA merge 1 3 3 4 4 4 3 2 5 5 6 7 9 8 8 7

70 Heiko Schröder, 2003 Parallel control structures 70 ISA merge 1 3 3 2 4 4 3 4 5 5 6 7 9 8 8 7

71 Heiko Schröder, 2003 Parallel control structures 71 ISA merge 1 3 3 2 4 4 3 4 5 5 6 7 9 8 8 7

72 Heiko Schröder, 2003 Parallel control structures 72 ISA merge 1 3 2 3 4 3 4 4 5 5 6 7 9 8 8 7

73 Heiko Schröder, 2003 Parallel control structures 73 ISA merge 1 3 2 3 4 3 4 4 5 5 6 7 9 8 8 7

74 Heiko Schröder, 2003 Parallel control structures 74 ISA merge 1 2 3 3 3 4 4 4 5 5 6 7 9 8 8 7

75 Heiko Schröder, 2003 Parallel control structures 75 ISA merge 1 2 3 3 3 4 4 4 5 5 6 7 9 8 8 7

76 Heiko Schröder, 2003 Parallel control structures 76 ISA merge 1 2 3 3 3 4 4 4 5 5 6 7 9 8 8 7

77 Heiko Schröder, 2003 Parallel control structures 77 ISA merge 1 2 3 3 3 4 4 4 5 5 6 7 8 9 7 8

78 Heiko Schröder, 2003 Parallel control structures 78 ISA merge 1 2 3 3 3 4 4 4 5 5 6 7 8 9 7 8

79 Heiko Schröder, 2003 Parallel control structures 79 ISA merge 1 2 3 3 3 4 4 4 5 5 6 7 8 7 9 8

80 Heiko Schröder, 2003 Parallel control structures 80 ISA merge 1 2 3 3 3 4 4 4 5 5 6 7 8 7 9 8

81 Heiko Schröder, 2003 Parallel control structures 81 ISA merge 1 2 3 3 3 4 4 4 5 5 6 7 7 8 8 9

82 Heiko Schröder, 2003 Parallel control structures 82 ISA merge 1 2 3 3 3 4 4 4 5 5 6 7 7 8 8 9

83 Heiko Schröder, 2003 Parallel control structures 83 ISA merge 1 2 3 3 3 4 4 4 5 5 6 7 7 8 8 9

84 Heiko Schröder, 2003 Parallel control structures 84 ISA merge 1 2 3 3 3 4 4 4 5 5 6 7 7 8 8 9

85 Heiko Schröder, 2003 Parallel control structures 85 ISA merge 1 2 3 3 3 4 4 4 5 5 6 7 7 8 8 9

86 Heiko Schröder, 2003 Parallel control structures 86 Use of the ISA Areas of application for ISA: automatic optical quality control real time signal processing computer graphics /visualization linear equations Cryptography --> Tele-medicine ? Bio-informatics Special features: fast aggregate functions (sum, carry) fast local communication no local memory typical improvement over PC: Factor 20-30

87 Heiko Schröder, 2003 Parallel control structures 87 Future of massively parallel architectures Amdahl’s Law: Special purpose --- general purpose ? Flexibility: SIMD --- ISA --- MIMD Physical laws: Mesh/torus --- hypercube et.al. Hybrid-networks ! Reconfigurable tori ! Optical computing !

88 ? ? ? ?

Download ppt "Application Specific Massive Parallelism Systolic and Instruction Systolic Computing Heiko Schröder, 2003 LOCOMAP."

Similar presentations

© 2009 Fakultas Teknologi Informasi Universitas Budi Luhur Jl. Ciledug Raya Petukangan Utara Jakarta Selatan 12260 Website:

© 2009 Fakultas Teknologi Informasi Universitas Budi Luhur Jl. Ciledug Raya Petukangan Utara Jakarta Selatan Website:
Systolic Arrays & Their Applications

Systolic Arrays & Their Applications
PIPELINE AND VECTOR PROCESSING

PIPELINE AND VECTOR PROCESSING
Prepared 7/28/2011 by T. O’Neil for 3460:677, Fall 2011, The University of Akron.

Prepared 7/28/2011 by T. O’Neil for 3460:677, Fall 2011, The University of Akron.
SE-292 High Performance Computing

SE-292 High Performance Computing
EECC756 - Shaaban #1 lec # 1 Spring 2003 3-11-2003 Systolic Architectures Replace single processor with an array of regular processing elements Orchestrate.

EECC756 - Shaaban #1 lec # 1 Spring Systolic Architectures Replace single processor with an array of regular processing elements Orchestrate.
Taxanomy of parallel machines. Taxonomy of parallel machines Memory – Shared mem. – Distributed mem. Control – SIMD – MIMD.

Taxanomy of parallel machines. Taxonomy of parallel machines Memory – Shared mem. – Distributed mem. Control – SIMD – MIMD.
Parallel Architectures: Topologies Heiko Schröder, 2003.

Parallel Architectures: Topologies Heiko Schröder, 2003.
Heiko Schröder, 2003 Parallel Architectures 1 Various communication networks State of the art technology Important aspects of routing schemes Known results.

Heiko Schröder, 2003 Parallel Architectures 1 Various communication networks State of the art technology Important aspects of routing schemes Known results.
1 Introduction to Data Parallel Architectures Sima, Fountain and Kacsuk Chapter 10 CSE462.

1 Introduction to Data Parallel Architectures Sima, Fountain and Kacsuk Chapter 10 CSE462.
Parallel Architectures: Topologies Heiko Schröder, 2003.

Parallel Architectures: Topologies Heiko Schröder, 2003.
Intro Test 2 – Chapters 3,4 & Word Sample Questions SPRING 2005.

Intro Test 2 – Chapters 3,4 & Word Sample Questions SPRING 2005.
Tuesday, September 12, 2006 Nothing is impossible for people who don't have to do it themselves. - Weiler.

Tuesday, September 12, 2006 Nothing is impossible for people who don't have to do it themselves. - Weiler.
Chapter 5: Computer Systems Organization Invitation to Computer Science, Java Version, Third Edition.

Chapter 5: Computer Systems Organization Invitation to Computer Science, Java Version, Third Edition.
Applications of Systolic Array FTR, IIR filtering, and 1-D convolution. 2-D convolution and correlation. Discrete Furier transform Interpolation 1-D and.

Applications of Systolic Array FTR, IIR filtering, and 1-D convolution. 2-D convolution and correlation. Discrete Furier transform Interpolation 1-D and.
Programming SA --- Systolic Array SIMD --- Single Instruction Multiple Data ISA --- Instruction Systolic Array MIMD --- Multiple Instruction Multiple Data.

Programming SA --- Systolic Array SIMD --- Single Instruction Multiple Data ISA --- Instruction Systolic Array MIMD --- Multiple Instruction Multiple Data.

Heiko Schröder, 1998 ROUTING ? Sorting? Image Processing? Sparse Matrices? Reconfigurable Meshes !

Heiko Schröder, 1998 ROUTING ? Sorting? Image Processing? Sparse Matrices? Reconfigurable Meshes !
Parallel Processing Group Members: PJ Kulick Jon Robb Brian Tobin.

Parallel Processing Group Members: PJ Kulick Jon Robb Brian Tobin.
Introduction to Parallel Processing Ch. 12, Pg

Introduction to Parallel Processing Ch. 12, Pg

Similar presentations

Ads by Google