1. Closures of Relations: Transitive Closure and Partitions
Sunday, December 09, 2018
Closures of Relations: Transitive Closure and Partitions
Sections 8.4 and 8.5
© by A-H. Esfahanian. All Rights Reserved.

2. Concept of “closure”
The natural numbers N (counting numbers) are not closed under subtraction: when we close them under subtraction, we get Z, the integers (positive and negative).
When we close Z under the operation of division, we get Q, the rational numbers.
“Closing” a relation has important applications.

3. Sunday, December 09, 2018
Transitive closure
Computing the transitive closure of a digraph is an important problem in many computer science applications:
Evaluation of recursive database queries.
Analysis of reachability (connectivity) of transition graphs in communication networks.
Construction of parsing automata in compilers. 3
© by A-H. Esfahanian. All Rights Reserved. 3

4. Introduction Closure of relation properties
Sunday, December 09, 2018
Introduction
Closure of relation properties
When a property does not hold for a relation, how could we minimally augment the relation so that the property would hold?
© by A-H. Esfahanian. All Rights Reserved.

5. Reflexive Closure Example: Consider the relation
Sunday, December 09, 2018
Reflexive Closure
Example: Consider the relation
R = {(1,1), (1,2), (2,1), (3,2)} on set {1,2,3}
Is it reflexive?
How can we produce a reflective relation containing R that is as small as possible?
© by A-H. Esfahanian. All Rights Reserved.

6. Reflexive Closure – cont.
Sunday, December 09, 2018
Reflexive Closure – cont.
When a relation R on a set A is not reflexive:
How to minimally augment R (adding the minimum number of ordered pairs) to make it a reflexive relation?
The reflexive closure of R.
The reflexive closure of R can be formed by adding all of the pairs of the form (a,a) to R. In other words we should find:
R = { (1,1), (1,2), (2,1), (3,2) } U { (1,1), (2,2), (3,3) }
© by A-H. Esfahanian. All Rights Reserved.

7. Reflexive Closure – Cont.
Sunday, December 09, 2018
Reflexive Closure – Cont.
The diagonal relation on A is:
 = {(a,a) | a  A}.
The reflexive closure of R is then:
R  .
Properties:
R  (R  );
R   is reflexive;
 S (R  S  S is reflexive)  (R  )  S.
In zero-one matrix notation: MR  M
Turn on all the diagonal bits!
© by A-H. Esfahanian. All Rights Reserved.

8. Example Consider R = {(a,b)ZZ | a < b}
Sunday, December 09, 2018
Example
Consider R = {(a,b)ZZ | a < b}
The reflexive closure of relation R is:
R  
= {(a,b)ZZ | a < b}  {(a,a) | a Z}
= {(a,b)ZZ | a  b}
© by A-H. Esfahanian. All Rights Reserved.

9. Symmetric Closure (optional)
Sunday, December 09, 2018
Symmetric Closure (optional)
Example: Consider R ={(1,1), (1,2), (2,2), (2,3), (3,1), (3,2)}
R is not symmetric; the pairs missing are: (2,1), (1,3).
If we add those, we obtain the new relation:
{(1,1), (1,2), (1,3), (2,1), (2,2), (2,3), (3,1), (3,2)}.
The new relation is symmetric.
© by A-H. Esfahanian. All Rights Reserved.

10. Symmetric Closure (optional)
Sunday, December 09, 2018
Symmetric Closure (optional)
When a relation R on a set A is not symmetric:
How to minimally augment R (adding the minimum number of ordered pairs) to have a symmetric relation?
The symmetric closure of R.
© by A-H. Esfahanian. All Rights Reserved.

11. Symmetric Closure (optional)
Sunday, December 09, 2018
Symmetric Closure (optional)
The inverse of R is:
R-1 = {(b,a) | (a, b)  R}.
The symmetric closure of R is then:
R  R-1.
Properties:
R  (R  R-1);
R  R-1 is symmetric;
 S (R  S  S is symmetric)  (R  R-1)  S.
In zero-one matrix notation: MR  MRt
© by A-H. Esfahanian. All Rights Reserved.

12. Example (optional) Consider R = {(a,b)ZZ | a < b}
Sunday, December 09, 2018
Example (optional)
Consider R = {(a,b)ZZ | a < b}
The symmetric closure of relation R is:
R  R-1
= {(a,b)ZZ | a < b}  {(a,b)ZZ | b < a}
= {(a,b)ZZ | a  b}
© by A-H. Esfahanian. All Rights Reserved.

13. Transitive Closures Consider R = {(1,3), (1,4), (2,1), (3,2)}.
Sunday, December 09, 2018
Transitive Closures
Consider R = {(1,3), (1,4), (2,1), (3,2)}.
R is not transitive;
What are the missing terms?
Few are: (1,2), (2,3), (2,4), (3,1).
If we add those, we obtain the new relation:
{(1,2), (1,3), (1,4), (2,1), (2,3), (2,4), (3,1), (3,2)}.
Is the above relation transitive?
No, it is not. Missing terms such as (1,1), (2,2)…
Transitive closure is more complicated to build.
© by A-H. Esfahanian. All Rights Reserved.

14. Transitive Closure When a relation R on a set A is not transitive:
Sunday, December 09, 2018
Transitive Closure
When a relation R on a set A is not transitive:
How to minimally augment R (adding the minimum number of ordered pairs) to have a transitive relation?
The transitive closure of R.
© by A-H. Esfahanian. All Rights Reserved.

15. Paths in Directed Graphs
Sunday, December 09, 2018
Paths in Directed Graphs
Definition: A path from a to b in a digraph G is a sequence of 1 or more adjacent arcs
(a,x1), (x1,x2), (x2,x3), …, (xn-1, b).
Denoted: a, x1, x2, x3, …, xn-1, b
Has length n.
If a = b, the path is called a circuit or a cycle, since the path returns to its start.
Does a path appear to be “transitive”?
© by A-H. Esfahanian. All Rights Reserved.

16. Example  a path of length 2 from 1 to 2: arcs (1,3), (3,2).
Sunday, December 09, 2018
Example
 a path of length 2 from 1 to 2: arcs (1,3), (3,2).
 a path of length 3 from 3 to 4: (3,2), (2,1), (1,4).
There are no paths from
4 to 1
4 to 2
4 to 3 1 2 4 3
© by A-H. Esfahanian. All Rights Reserved.

17. Sunday, December 09, 2018
Paths in Relations
There is a path from a to b in R if there is a sequence of elements: x1, x2, …, xn-1 with (a,x1)R, (x1,x2)R, …, (xn-1, b)R.
Example. R = {(1,3), (1,4), (2,1), (3,2)}
 a path in R (len. 2) from 1 to 2: (1,3), (3,2)R.
 a path in R (len. 3) from 3 to 4: (3,2), (2,1), (1,4)R.
There is no path in R from 4 to 1, nor to 2, nor to 3.
© by A-H. Esfahanian. All Rights Reserved.

18. Theorem 1 Theorem: Let R be a relation on a set A.
Sunday, December 09, 2018
Theorem 1
Theorem: Let R be a relation on a set A.
 a path in R of length n from a to b  (a,b) Rn.
Proof
© by A-H. Esfahanian. All Rights Reserved.

19. R* ={(a,b) |  a path in R from a to b}.
Sunday, December 09, 2018
Transitive Closure
Definition: Let R be a relation on a set A.
The connectivity relation is the relation R* defined as:
R* ={(a,b) |  a path in R from a to b}.
From the above definition of R* and the previous theorem, R* can be written as:
R* = k=1 Rk.
We used this notion of “connectivity” in the graphics Fill algorithm.
Also, we used it the airplane flights example.
© by A-H. Esfahanian. All Rights Reserved.

20. Transitive Closure – Cont.
Sunday, December 09, 2018
Transitive Closure – Cont.
Theorem 2 The transitive closure of R is R*.
Proof:
R  R*, because if there is an edge from a to b then there is a path from a to b.
R* is transitive, because if  a path from a to b and  a path from b to c then  a path from a to c.
S (R  S  S is transitive)  R*  S.
Proof. Let S be a transitive relation, and assume RS.
So R* S* because RS.
Also k Sk  S, because S is transitive (see last theorem of sect. 6.1) SoS*  S. Therefore, R* S.
© by A-H. Esfahanian. All Rights Reserved.

21. Transitive Closure – Cont.
Sunday, December 09, 2018
Transitive Closure – Cont.
Lemma: Let A be a set with n elements, and R be a relation on A.
If there is a path in R from a to b (with ab), then there is such a path with length  n-1.
R* = R  R2  R3  …  Rn.
© by A-H. Esfahanian. All Rights Reserved.

22. Transitive Closure – Cont.
Sunday, December 09, 2018
Transitive Closure – Cont.
Theorem: Let MR be the zero-one matrix of relation R on a set with n elements.
The zero-one matrix of the transitive closure R* is:
MR* = MR  MR[2]  MR[3]  …  MR[n].
© by A-H. Esfahanian. All Rights Reserved.

23. Transitive Closure - Example
Sunday, December 09, 2018
Transitive Closure - Example
Find the matrix MR* of the transitive closure of R:
MR =
Solution:
MR[2] =
MR[3] =
MR*= MRMR[2]MR[3] = 3 1 2
© by A-H. Esfahanian. All Rights Reserved.

24. Algorithm 1 for TC Procedure for computing transitive closure: A = MR;
Sunday, December 09, 2018
Algorithm 1 for TC
Procedure for computing transitive closure:
A = MR;
B = A;
For i=2 to n do the following:
A = A o MR; // Boolean product
B = B  A; // Join operation
© by A-H. Esfahanian. All Rights Reserved.

25. Transitive Closure - Example
Sunday, December 09, 2018
Transitive Closure - Example
Find the matrix MR* of the transitive closure of R:
MR =
Solution:
B1= A1= MR =
Ak=Ak-1o MR Bk=Bk-1Ak
A2=MR[2]= B2=
A3=MR[3]=
MR*=B3= 3 1 2
© by A-H. Esfahanian. All Rights Reserved.

26. Transitive Closure – optional
Sunday, December 09, 2018
Transitive Closure – optional
Toward a more efficient algorithm (Warshall’s)
Definition: Let R be a relation on S={v1,v2,…, vn}.
The interior vertices of a path of length m from a to b: a, x1, x2, x3, …, xm-1, b are:
x1, x2, x3, …, xm-1.
© by A-H. Esfahanian. All Rights Reserved.

27. Transitive Closure – optional
Sunday, December 09, 2018
Transitive Closure – optional
Warshall’s Alg. iteratively constructs 0-1 matrices:
W0 = MR;
W1=[w[1]ij], where w[1]ij=1   a path from vi to vj
with interior vertices in {v1};
W2=[w[2]ij], where w[2]ij=1   a path from vi to vj
with interior vertices in {v1,v2}…
Wk=[w[k]ij], where w[k]ij=1   a path from vi to vj
with interior vertices in {v1,v2, …, vk}…
MR* = Wn.
© by A-H. Esfahanian. All Rights Reserved.

28. Transitive Closure - Example
Sunday, December 09, 2018
Transitive Closure - Example
Find the matrix MR* of the transitive closure of R:
MR =
Solution: W0 = MR
W1 =
W2 =
MR* = W3 = 3 1 2
© by A-H. Esfahanian. All Rights Reserved.

29. Transitive Closure – optional
Sunday, December 09, 2018
Transitive Closure – optional
Lemma: Let R be a relation on S={v1,v2,…,vn}, and let Wk=[w[k]ij] be the 0-1 matrix | w[k]ij=1   a path from vi to vj with interior vertices in {v1, v2, …, vk}.
Then
i,j,kn w[k]ij = w[k-1]ij  (w[k-1]ikw[k-1]kj).
© by A-H. Esfahanian. All Rights Reserved.

30. Algorithm 2 - Warshall’s Algorithm
Sunday, December 09, 2018
Algorithm 2 - Warshall’s Algorithm
Procedure for computing transitive closure:
W = MR;
For k=1 to n do the following:
For i=1 to n do the following:
For j=1 to n do the following:
wij = wij  (wik  wkj);
// That is, at step k: add row k to all other rows which have 1 as intersection with kth column.
© by A-H. Esfahanian. All Rights Reserved.

31. Warshall’s Algorithm - Example
Sunday, December 09, 2018
Warshall’s Algorithm - Example
Find the matrix MR* of the transitive closure of R:
MR =
Solution: W0 = MR
Add row 1 to row 3:
W1 =
Add row 2 to row 3:
W2 =
Add row 3 to row 1:
MR* = W3 =
© by A-H. Esfahanian. All Rights Reserved.

32. Conclusions: transitive closure
Sunday, December 09, 2018
Conclusions: transitive closure
Computing the transitive closure of a digraph is an important problem in many computer science applications:
Evaluation of recursive database queries.
Analysis of reachability (connectivity) of transition graphs in communication networks.
Construction of parsing automata in compilers.
© by A-H. Esfahanian. All Rights Reserved.

33. Equivalence relations
These are reflexive, symmetric, and transitive. They partition the set of all elements into equivalence classes.

34. Examples
Locations(points, cities) connected by bi directional roads. All cities connected to each other form an equivalence class – points on Mackinaw Is.
People related by speaking the same FIRST language (assuming you can only have one).
The real numbers related by absolute value: (5,5)(-5,5)(-π, π) …
The set of all students partitioned according to major, assuming each student has ONE major.

35. Example: the integers mod m
a R b = { (a, b) | a ≡ b (mod m) }
If m=5 then we have 5 classes induced by R
[0]R = { 0, 5, -5, 10, -10, 15, -15, …}
[1]R = { 1, -1, 6, -6, 11, -11, …}
[2]R = { 2, -2, 7, -7, 12, -12, …}
[3]R = { 3, -3, 8, -8, 13, -13, …}
[4]R = { 4, -4, 9, -9, 14, -14, …}
Note that every integer belongs to one and only one of these classes – R partitions Z.

36. Example: pixel adjacency partitions a binary image into “blobs” or “objects”
15 subsets of pixels. Within each subset, pixels are connected by a path through neighbors. Pixels in each subset are not connected to pixels in any other subset. (Connecting paths are not allowed to go through background pixels.)

37. Functions induce equivalence classes
f ( student ) = major (assume only one major); classes are f-1 (CS), f-1 (EE), f-1 (MTH), …
g ( person ) = first_language (assume one)
h ( x ) = 5
sin ( x ) = 0.707
weight ( person ) = 165 pounds
c ( student ) = 1 iff student is in CSE260 Section 2 Fall 2009