Presentation is loading. Please wait.

Presentation is loading. Please wait.

Dynamic Programming An algorithm design paradigm like divide-and-conquer “Programming”: A tabular method (not writing computer code) Divide-and-Conquer.

Published byAngelo Impson Modified over 9 years ago

Similar presentations

Presentation on theme: "Dynamic Programming An algorithm design paradigm like divide-and-conquer “Programming”: A tabular method (not writing computer code) Divide-and-Conquer."— Presentation transcript:

1 Dynamic Programming An algorithm design paradigm like divide-and-conquer “Programming”: A tabular method (not writing computer code) Divide-and-Conquer (DAC): subproblems are independent Dynamic Programming (DP): subproblems are not independent Overlapping subproblems: subproblems share sub-subproblems In solving problems with overlapping subproblems A DAC algorithm does redundant work – Repeatedly solves common subproblems A DP algorithm solves each problem just once – Saves its result in a table BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)1

2 Optimization Problems DP typically applied to optimization problems In an optimization problem – There are many possible solutions (feasible solutions) – Each solution has a value – Want to find an optimal solution to the problem A solution with the optimal value (min or max value) – Wrong to say “the” optimal solution to the problem There may be several solutions with the same optimal value BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)2

3 Development of a DP Algorithm 1. Characterize the structure of an optimal solution 2. Recursively define the value of an optimal solution 3. Compute the value of an optimal solution in a bottom-up fashion 4. Construct an optimal solution from the information computed in Step 3 BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)3

4 Example: Matrix-chain Multiplication BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)4

5 Matrix-chain Multiplication: An Example Parenthesization BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)5

6 Cost of Multiplying two Matrices BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)6

7 Matrix-chain Multiplication Problem BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)7

8 Counting the Number of Parenthesizations BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)8

9 Number of Parenthesizations BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)9

10 The Structure of an Optimal Parenthesization Step 1: Characterize the structure of an optimal solution A i..j : matrix that results from evaluating the product A i A i+1 A i+2  A j An optimal parenthesization of the product A 1 A 2  A n – Splits the product between A k and A k  1, for some 1 ≤ k<n (A 1 A 2 A 3  A k ) · (A k+1 A k+2... A n ) – i.e., first compute A 1..k and A k+1..n and then multiply these two The cost of this optimal parenthesization Cost of computing A 1..k + Cost of computing A k+1..n + Cost of multiplying A 1..k · A k+1..n BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)10

11 Step 1: Characterize the Structure of an Optimal Solution BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)11

12 The Structure of an Optimal Parenthesization BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)12

13 Step 2: Define Value of an Optimal Sol. Recursively(m ij =?) BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)13

14 Step 2: Recursive Equation for m ij BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)14

15 Step 2: m ij = MIN{m ik + m k+1, j +p i-1 p k p j } BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)15

16 Computing the Optimal Cost (Matrix-Chain Multiplication) BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)16

17 Computing the Optimal Cost (Matrix-Chain Multiplication) BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)17

18 Algorithm for Computing the Optimal Costs BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)18

19 Algorithm for Computing the Optimal Costs BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)19

20 Algorithm for Computing the Optimal Costs BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)20 l  2 for i  1 to n - 1 m[i, i  1]  compute m[i, i  1] for k  i to i do {m[1, 2], m[2, 3], …, m[n-1, n]}.. (n-1) values l  3 for i  1 to n - 2 m[i, i  2]  compute m[i, i  2] for k  i to i  1 do {m[1, 3], m[2, 4], …, m[n-2, n]}.. (n-2) values l  4 for i  1 to n - 3 m[i, i  3]  compute m[i, i  3] for k  i to i  2 do {m[1, 4], m[2, 5], …, m[n-3, n]}.. (n-3) values

21 BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)21

22 BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)22

23 BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)23

24 BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)24

25 BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)25

26 BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)26

27 BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)27

28 Constructing an Optimal Solution BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)28

29 Constructing an Optimal Solution BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)29

30 Constructing an Optimal Solution BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)30

31 Example: Recursive Construction of an Optimal Solution BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)31

32 Example: Recursive Construction of an Optimal Solution BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)32

33 Example: Recursive Construction of an Optimal Solution BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)33 return A 6

34 Elements of Dynamic Programming When should we look for a DP solution to an optimization problem? Two key ingredients for the problem –Optimal substructure –Overlapping subproblems BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)34

35 Optimal Substructure BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)35

36 Optimal Substructure BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)36

37 Optimal Substructure BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)37

38 Overlapping Subproblems BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)38

39 Overlapping Subproblems BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)39

40 Overlapping Subproblems BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)40

41 Recursive Matrix-chain Order BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)41

42 Running Time of RMC BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)42

43 BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)43

44 BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)44

45 Memoized Recursive Algorithm Offers the efficiency of the usual DP approach while maintaining top-down strategy Maintains an entry in a table for the soln to each subproblem Each table entry contains a special value to indicate that the entry has yet to be filled in When the subproblem is first encountered its solution is computed and then stored in the table Each subsequent time that the subproblem encountered the value stored in the table is simply looked up and returned The approach assumes that –The set of all possible subproblem parameters are known –The relation between the table positions and subproblems is established BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)45

46 Memoized Recursive Algorithm BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)46

47 Elements of Dynamic Programming: Summary BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)47

48 Elements of Dynamic Programming: Summary BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)48

49 Longest Common Subsequence BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)49

50 Longest Common Subsequence BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)50

51 Longest Common Subsequence BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)51

52 Characterizing a Longest Common Subsequence BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)52

53 Longest Common Subsequence Algorithm BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)53

54 A Recursive Solution to Subproblems BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)54

55 A Recursive Solution to Subproblems BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)55

56 Computing the Length of an LCS BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)56

57 Computing the Length of an LCS BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I) 57

58 Computing the Length of an LCS BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)58

59 Constructing an LCS BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)59

60 Constructing an LCS BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)60

61 Longest Common Subsequence BIL741: Advanced Analysis of Algorithms I (İleri Algoritma Çözümleme I)61 This improvement works if we only need the length of an LCS

Download ppt "Dynamic Programming An algorithm design paradigm like divide-and-conquer “Programming”: A tabular method (not writing computer code) Divide-and-Conquer."

Similar presentations

Welcome to our presentation

Welcome to our presentation
Dynamic Programming ACM Workshop 24 August 2011. Dynamic Programming Dynamic Programming is a programming technique that dramatically reduces the runtime.

Dynamic Programming ACM Workshop 24 August Dynamic Programming Dynamic Programming is a programming technique that dramatically reduces the runtime.
Dynamic Programming Introduction Prof. Muhammad Saeed.

Dynamic Programming Introduction Prof. Muhammad Saeed.
Dynamic Programming.

Dynamic Programming.
Multiplying Matrices Two matrices, A with (p x q) matrix and B with (q x r) matrix, can be multiplied to get C with dimensions p x r, using scalar multiplications.

Multiplying Matrices Two matrices, A with (p x q) matrix and B with (q x r) matrix, can be multiplied to get C with dimensions p x r, using scalar multiplications.
Algorithm Design Methodologies Divide & Conquer Dynamic Programming Backtracking.

Algorithm Design Methodologies Divide & Conquer Dynamic Programming Backtracking.
Dynamic Programming.

Dynamic Programming.
Analysis of Algorithms Dynamic Programming. A dynamic programming algorithm solves every sub problem just once and then Saves its answer in a table (array),

Analysis of Algorithms Dynamic Programming. A dynamic programming algorithm solves every sub problem just once and then Saves its answer in a table (array),
Introduction to Algorithms

Introduction to Algorithms
CSC 252 Algorithms Haniya Aslam

CSC 252 Algorithms Haniya Aslam
Chapter 15 Dynamic Programming Lee, Hsiu-Hui Ack: This presentation is based on the lecture slides from Hsu, Lih-Hsing, as well as various materials from.

Chapter 15 Dynamic Programming Lee, Hsiu-Hui Ack: This presentation is based on the lecture slides from Hsu, Lih-Hsing, as well as various materials from.
Dynamic Programming Part 1: intro and the assembly-line scheduling problem.

Dynamic Programming Part 1: intro and the assembly-line scheduling problem.
UMass Lowell Computer Science 91.503 Analysis of Algorithms Prof. Karen Daniels Fall, 2006 Lecture 1 (Part 3) Design Patterns for Optimization Problems.

UMass Lowell Computer Science Analysis of Algorithms Prof. Karen Daniels Fall, 2006 Lecture 1 (Part 3) Design Patterns for Optimization Problems.
Dynamic Programming Carrie Williams. What is Dynamic Programming? Method of breaking the problem into smaller, simpler sub-problems Method of breaking.

Dynamic Programming Carrie Williams. What is Dynamic Programming? Method of breaking the problem into smaller, simpler sub-problems Method of breaking.
CPSC 311, Fall 2009: Dynamic Programming 1 CPSC 311 Analysis of Algorithms Dynamic Programming Prof. Jennifer Welch Fall 2009.

CPSC 311, Fall 2009: Dynamic Programming 1 CPSC 311 Analysis of Algorithms Dynamic Programming Prof. Jennifer Welch Fall 2009.
UMass Lowell Computer Science 91.503 Analysis of Algorithms Prof. Karen Daniels Spring, 2009 Design Patterns for Optimization Problems Dynamic Programming.

UMass Lowell Computer Science Analysis of Algorithms Prof. Karen Daniels Spring, 2009 Design Patterns for Optimization Problems Dynamic Programming.
Dynamic Programming1. 2 Outline and Reading Matrix Chain-Product (§5.3.1) The General Technique (§5.3.2) 0-1 Knapsack Problem (§5.3.3)

Dynamic Programming1. 2 Outline and Reading Matrix Chain-Product (§5.3.1) The General Technique (§5.3.2) 0-1 Knapsack Problem (§5.3.3)
Design and Analysis of Algorithms - Chapter 81 Dynamic Programming Dynamic Programming is a general algorithm design technique Dynamic Programming is a.

Design and Analysis of Algorithms - Chapter 81 Dynamic Programming Dynamic Programming is a general algorithm design technique Dynamic Programming is a.
CSC401 – Analysis of Algorithms Lecture Notes 12 Dynamic Programming

CSC401 – Analysis of Algorithms Lecture Notes 12 Dynamic Programming
UMass Lowell Computer Science 91.503 Analysis of Algorithms Prof. Karen Daniels Fall, 2002 Lecture 1 (Part 3) Tuesday, 9/3/02 Design Patterns for Optimization.

UMass Lowell Computer Science Analysis of Algorithms Prof. Karen Daniels Fall, 2002 Lecture 1 (Part 3) Tuesday, 9/3/02 Design Patterns for Optimization.

Similar presentations

Ads by Google