1 Relational Algebra Operators Expression Trees Bag Model of Data.

Slides:



Advertisements
Similar presentations
1 Relational Algebra Operators Expression Trees Bag Model of Data Source: Slides by Jeffrey Ullman.
Advertisements

1 Relational Algebra Basic Operations Algebra of Bags.
IS698: Database Management Min Song IS NJIT. The Relational Data Model.
1 Relational Algebra 1 Basic Operations. 2 What is an “Algebra” uMathematical system consisting of: wOperands --- variables or values from which new values.
1 Relational Algebra* and Tuple Calculus * The slides in this lecture are adapted from slides used in Standford's CS145 course.
Tallahassee, Florida, 2014 COP4710 Database Systems Relational Algebra Fall 2014.
1 Introduction to SQL Select-From-Where Statements Multirelation Queries Subqueries.
1 Relational Algebra. Motivation Write a Java program Translate it into a program in assembly language Execute the assembly language program As a rough.
SQL CSET 3300.
1 Relational Algebra Lecture #9. 2 Querying the Database Goal: specify what we want from our database Find all the employees who earn more than $50,000.
Algebraic and Logical Query Languages Spring 2011 Instructor: Hassan Khosravi.
1 Lecture 12: Further relational algebra, further SQL
1 Database Systems Relations as Bags Grouping and Aggregation Database Modification.
1 Introduction to SQL Multirelation Queries Subqueries Slides are reused by the approval of Jeffrey Ullman’s.
Relational Operations on Bags Extended Operators of Relational Algebra.
Relational Algebra on Bags A bag is like a set, but an element may appear more than once. –Multiset is another name for “bag.” Example: {1,2,1,3} is a.
Winter 2002Arthur Keller – CS 1805–1 Schedule Today: Jan. 17 (TH) u Relational Algebra. u Read Chapter 5. Project Part 1 due. Jan. 22 (T) u SQL Queries.
Fall 2001Arthur Keller – CS 1806–1 Schedule Today (TH) Bags and SQL Queries. u Read Sections Project Part 2 due. Oct. 16 (T) Duplicates, Aggregation,
Relational Operations on Bags Extended Operators of Relational Algebra.
1 Relational Algebra Basic operators Relational algebra expression tree.
1 More SQL Extended Relational Algebra Outerjoins, Grouping/Aggregation Insert/Delete/Update.
Relational Algebra Basic Operations Algebra of Bags.
Databases 1 Seventh lecture. Topics of the lecture Extended relational algebra Normalization Normal forms 2.
1 More SQL Extended Relational Algebra Outerjoins, Grouping/Aggregation Insert/Delete/Update.
Databases 1 First lecture. Informations Lecture: Monday 12:15-13:45 (3.716) Practice: Thursday 10:15-11:45 (2-519) Website of the course:
1 Relational Algebra & SQL. 2 Why SQL & Relational Algebra? uSQL is a very-high-level language. wSay “what to do” rather than “how to do it.” wAvoid a.
Constraints on Relations Foreign Keys Local and Global Constraints Triggers Following lecture slides are modified from Jeff Ullman’s slides
RELATIONAL DATA MODEL 1. 2 What is a Data Model? 1.Mathematical representation of data. wExamples: relational model = tables; semistructured model = trees/graphs.
1 Relational Algebra Basic Operations Algebra of Bags.
“Core” Relational Algebra A small set of operators that allow us to manipulate relations in limited but useful ways. The operators are: 1.Union, intersection,
Databases : Relational Algebra 2007, Fall Pusan National University Ki-Joune Li These slides are made from the materials that Prof. Jeffrey D. Ullman distributes.
From Professor Ullman, Relational Algebra.
Database Management Systems Chapter 5 The Relational Algebra Instructor: Li Ma Department of Computer Science Texas Southern University, Houston October,
1 Relational Algebra Operators Expression Trees. 2 What is an “Algebra” uMathematical system consisting of: wOperands --- variables or values from which.
1 Lecture 2 Relational Algebra Based on
Winter 2002Judy Cushing5–1 Schedule Today: Jan. 23 (Wed) u Relational Algebra. u Read Chapter 5. u Project Part 2 due Friday 5pm, Judy’s mailbox in Lab.
Chapter 5 Notes. P. 189: Sets, Bags, and Lists To understand the distinction between sets, bags, and lists, remember that a set has unordered elements,
SCUHolliday - coen 1785–1 Schedule Today: u Relational Algebra. u Read Chapter 5 to page 199. Next u SQL Queries. u Read Sections And then u Subqueries,
Extended Operators in SQL and Relational Algebra Zaki Malik September 11, 2008.
Databases : Relational Algebra - Complex Expression 2007, Fall Pusan National University Ki-Joune Li These slides are made from the materials that Prof.
More Relation Operations 2015, Fall Pusan National University Ki-Joune Li.
More Relation Operations 2014, Fall Pusan National University Ki-Joune Li.
1 Algebra of Queries Classical Relational Algebra It is a collection of operations on relations. Each operation takes one or two relations as its operand(s)
1 CSCE Database Systems Anxiao (Andrew) Jiang The Database Language SQL.
1 Lecture 6 Introduction to SQL part 4 Slides from
Relational Algebra BASIC OPERATIONS 1 DATABASE SYSTEMS AND CONCEPTS, CSCI 3030U, UOIT, COURSE INSTRUCTOR: JAREK SZLICHTA.
Relational Algebra Database Systems.
SCUHolliday - coen 1787–1 Schedule Today: u Subqueries, Grouping and Aggregation. u Read Sections Next u Modifications, Schemas, Views. u Read.
More SQL (and Relational Algebra). More SQL Extended Relational Algebra Outerjoins, Grouping/Aggregation Insert/Delete/Update.
1 Relational Algebra Basic Operations Algebra of Bags.
1 Introduction to Database Systems, CS420 Relational Algebra.
1 Database Design: DBS CB, 2 nd Edition Relational Algebra: Basic Operations & Algebra of Bags Ch. 5.
1. Chapter 2: The relational Database Modeling Section 2.4: An algebraic Query Language Chapter 5: Algebraic and logical Query Languages Section 5.1:
Summary of Relational Algebra
Basic Operations Algebra of Bags
CPSC-310 Database Systems
Slides are reused by the approval of Jeffrey Ullman’s
COP4710 Database Systems Relational Algebra.
Outerjoins, Grouping/Aggregation Insert/Delete/Update
Schedule Today: Next After that Subqueries, Grouping and Aggregation.
Database Design and Programming
IST 210: Organization of Data
Operators Expression Trees Bag Model of Data
More Relation Operations
Basic Operations Algebra of Bags
Schedule Today: Next And then Relational Algebra.
5.1 Relational Operations on Bags
More SQL Extended Relational Algebra Outerjoins, Grouping/Aggregation
Instructor: Zhe He Department of Computer Science
Presentation transcript:

1 Relational Algebra Operators Expression Trees Bag Model of Data

2 Announcement uProject 1 due today uHomework 3 out, due 5/17 uRecitation given by Yi Qiao, 5-6pm for the remaining of the quarter

3 What is an “Algebra” uMathematical system consisting of: wOperands --- variables or values from which new values can be constructed. wOperators --- symbols denoting procedures that construct new values from given values.

4 What is Relational Algebra? uAn algebra whose operands are relations or variables that represent relations. uOperators are designed to do the most common things that we need to do with relations in a database. wThe result is an algebra that can be used as a query language for relations.

5 Roadmap uThere is a core relational algebra that has traditionally been thought of as the relational algebra. uBut there are several other operators we shall add to the core in order to model better the language SQL --- the principal language used in relational database systems.

6 Core Relational Algebra uUnion, intersection, and difference. wUsual set operations, but require both operands have the same relation schema. uSelection: picking certain rows. uProjection: picking certain columns. uProducts and joins: compositions of relations. uRenaming of relations and attributes.

7 Selection uR1 := SELECT C (R2) wDenoted as σ C (R2) wC is a condition (as in “if” statements) that refers to attributes of R2. wR1 is all those tuples of R2 that satisfy C.

8 Example Relation Sells: barbeerprice Joe’sBud2.50 Joe’sMiller2.75 Sue’sBud2.50 Sue’sMiller3.00 JoeMenu := SELECT bar=“Joe’s” (Sells): barbeerprice Joe’sBud2.50 Joe’sMiller2.75

9 Projection uR1 := PROJ L (R2) wDenoted as pi L (R2) wL is a list of attributes from the schema of R2. wR1 is constructed by looking at each tuple of R2, extracting the attributes on list L, in the order specified, and creating from those components a tuple for R1. wEliminate duplicate tuples, if any.

10 Example Relation Sells: barbeerprice Joe’sBud2.50 Joe’sMiller2.75 Sue’sBud2.50 Sue’sMiller3.00 Prices := PROJ beer,price (Sells): beerprice Bud2.50 Miller2.75 Miller3.00

11 Product uR3 := R1 * R2 wPair each tuple t1 of R1 with each tuple t2 of R2. wConcatenation t1t2 is a tuple of R3. wSchema of R3 is the attributes of R1 and then R2, in order. wBut beware attribute A of the same name in R1 and R2: use R1.A and R2.A.

12 Example: R3 := R1 * R2 R1(A,B ) R2(B,C ) R3(A,R1.B,R2.B,C )

13 Theta-Join uR3 := R1 JOIN C R2 wTake the product R1 * R2. wThen apply SELECT C to the result. uAs for SELECT, C can be any boolean- valued condition. wHistoric versions of this operator allowed only A  B, where  is =, <, etc.; hence the name “theta-join.”

14 Example Sells(bar,beer,price )Bars(name,addr ) Joe’sBud2.50Joe’sMaple St. Joe’sMiller2.75Sue’sRiver Rd. Sue’sBud2.50 Sue’sCoors3.00 BarInfo := Sells JOIN Sells.bar = Bars.name Bars BarInfo(bar,beer,price,name,addr ) Joe’sBud2.50Joe’sMaple St. Joe’sMiller2.75Joe’sMaple St. Sue’sBud2.50Sue’sRiver Rd. Sue’sCoors3.00Sue’sRiver Rd.

15 Natural Join uA frequent type of join connects two relations by: wEquating all attributes of the same name, and wProjecting out one copy of each pair of equated attributes. uCalled natural join. uDenoted R3 := R1 JOIN R2.

16 Example Sells(bar,beer,price )Bars(bar,addr ) Joe’sBud2.50Joe’sMaple St. Joe’sMiller2.75Sue’sRiver Rd. Sue’sBud2.50 Sue’sCoors3.00 BarInfo := Sells JOIN Bars Note Bars.name has become Bars.bar to make the natural join “work.” BarInfo(bar,beer,price,addr ) Joe’sBud2.50Maple St. Joe’sMilller2.75Maple St. Sue’sBud2.50River Rd. Sue’sCoors3.00River Rd.

17 Renaming uThe RENAME operator gives a new schema to a relation. uR1 := RENAME R1(A1,…,An) (R2) makes R1 be a relation with attributes A1,…,An and the same tuples as R2. uSimplified notation: R1(A1,…,An) := R2.

18 Example Bars(name, addr ) Joe’sMaple St. Sue’sRiver Rd. R(bar, addr ) Joe’sMaple St. Sue’sRiver Rd. R(bar, addr) := Bars

19 Building Complex Expressions uCombine operators with parentheses and precedence rules. uThree notations, just as in arithmetic: 1.Sequences of assignment statements. 2.Expressions with several operators. 3.Expression trees.

20 Sequences of Assignments uCreate temporary relation names. uRenaming can be implied by giving relations a list of attributes. uExample: R3 := R1 JOIN C R2 can be written: R4 := R1 * R2 R3 := SELECT C (R4)

21 Expressions in a Single Assignment uExample: the theta-join R3 := R1 JOIN C R2 can be written: R3 := SELECT C (R1 * R2) uPrecedence of relational operators: 1.[SELECT, PROJECT, RENAME] (highest). 2.[PRODUCT, JOIN]. 3.INTERSECTION. 4.[UNION, DIFFERENCE] wBut you can always insert parentheses to force the order you desire.

22 Expression Trees uLeaves are operands --- either variables standing for relations or particular, constant relations. uInterior nodes are operators, applied to their child or children.

23 Example uUsing the relations Bars(name, addr) and Sells(bar, beer, price), find the names of all the bars that are either on Maple St. or sell Bud for less than $3.

24 As a Tree: BarsSells SELECT addr = “Maple St.” SELECT price<3 AND beer=“Bud” PROJECT name RENAME R(name) PROJECT bar UNION

25 Other Forms of Expressions uRelational Algebra Expression in single assignment uA sequence of assignment uBoth to be discussed in the class with special symbols

26 Example uUsing Sells(bar, beer, price), find the bars that sell two different beers at the same price. uStrategy: by renaming, define a copy of Sells, called S(bar, beer1, price). The natural join of Sells and S consists of quadruples (bar, beer, beer1, price) such that the bar sells both beers at this price.

27 The Tree Sells RENAME S(bar, beer1, price) JOIN PROJECT bar SELECT beer != beer1

28 Schemas for Results uUnion, intersection, and difference: the schemas of the two operands must be the same, so use that schema for the result. uSelection: schema of the result is the same as the schema of the operand. uProjection: list of attributes tells us the schema.

29 Schemas for Results --- (2) uProduct: schema is the attributes of both relations. wUse R.A, etc., to distinguish two attributes named A. uTheta-join: same as product. uNatural join: union of the attributes of the two relations. uRenaming: the operator tells the schema.

30 Relational Algebra on Bags uA bag (or multiset ) is like a set, but an element may appear more than once. uExample: {1,2,1,3} is a bag. uExample: {1,2,3} is also a bag that happens to be a set.

31 Why Bags? uSQL, the most important query language for relational databases, is actually a bag language. uSome operations, like projection, are much more efficient on bags than sets.

32 Operations on Bags uSelection applies to each tuple, so its effect on bags is like its effect on sets. uProjection also applies to each tuple, but as a bag operator, we do not eliminate duplicates. uProducts and joins are done on each pair of tuples, so duplicates in bags have no effect on how we operate.

33 Example: Bag Selection R(A,B ) SELECT A+B<5 (R) =AB 12

34 Example: Bag Projection R(A,B ) PROJECT A (R) =A 1 5 1

35 Example: Bag Product R(A,B )S(B,C ) R * S =AR.BS.BC

36 Example: Bag Theta-Join R(A,B )S(B,C ) R JOIN R.B<S.B S =AR.BS.BC

37 Bag Union uAn element appears in the union of two bags the sum of the number of times it appears in each bag. uExample: {1,2,1} UNION {1,1,2,3,1} = {1,1,1,1,1,2,2,3}

38 Bag Intersection uAn element appears in the intersection of two bags the minimum of the number of times it appears in either. uExample: {1,2,1,1} INTER {1,2,1,3} = {1,1,2}. uWhat about {1,2} INTER {1,2,1,3} ?

39 Bag Difference uAn element appears in the difference A – B of bags as many times as it appears in A, minus the number of times it appears in B. wBut never less than 0 times. uExample: {1,2,1,1} – {1,2,3} = {1,1}.

40 Beware: Bag Laws != Set Laws uSome, but not all algebraic laws that hold for sets also hold for bags. uExample: the commutative law for union (R UNION S = S UNION R ) does hold for bags. wSince addition is commutative, adding the number of times x appears in R and S doesn’t depend on the order of R and S.

41 Example of the Difference uSet union is idempotent, meaning that S UNION S = S. uHowever, for bags, if x appears n times in S, then it appears 2n times in S UNION S. uThus S UNION S != S in general. uWhat about S INTERSECTION S ?

42 The Extended Algebra 1.DELTA = eliminate duplicates from bags. 2.TAU = sort tuples. 3.Extended projection : arithmetic, duplication of columns. 4.GAMMA = grouping and aggregation. 5.Outerjoin : avoids “dangling tuples” = tuples that do not join with anything.

43 Duplicate Elimination uR1 := DELTA(R2). uR1 consists of one copy of each tuple that appears in R2 one or more times.

44 Example: Duplicate Elimination R = (AB ) DELTA(R) =AB 12 34

45 Sorting uR1 := TAU L (R2). wL is a list of some of the attributes of R2. uR1 is the list of tuples of R2 sorted first on the value of the first attribute on L, then on the second attribute of L, and so on. wBreak ties arbitrarily. uTAU is the only operator whose result is neither a set nor a bag.

46 Example: Sorting R = ( AB ) TAU B (R) =[(5,2), (1,2), (3,4)]

47 Extended Projection uUsing the same PROJ L operator, we allow the list L to contain arbitrary expressions involving attributes, for example: 1.Arithmetic on attributes, e.g., A+B. 2.Duplicate occurrences of the same attribute.

48 Example: Extended Projection R = ( AB ) PROJ A+B,A,A (R) =A+BA1A

49 Aggregation Operators uAggregation operators are not operators of relational algebra. uRather, they apply to entire columns of a table and produce a single result. uThe most important examples: SUM, AVG, COUNT, MIN, and MAX.

50 Example: Aggregation R = ( AB ) SUM(A) = 7 COUNT(A) = 3 MAX(B) = 4 AVG(B) = 3

51 Grouping Operator uR1 := GAMMA L (R2). L is a list of elements that are either: 1.Individual (grouping ) attributes. 2.AGG(A ), where AGG is one of the aggregation operators and A is an attribute.

52 Applying GAMMA L (R) uGroup R according to all the grouping attributes on list L. wThat is: form one group for each distinct list of values for those attributes in R. uWithin each group, compute AGG(A ) for each aggregation on list L. uResult has one tuple for each group: 1.The grouping attributes and 2.Their group’s aggregations.

53 Example: Grouping/Aggregation R = ( ABC ) GAMMA A,B,AVG(C) (R) = ?? First, group R by A and B : ABC Then, average C within groups: ABAVG(C)

54 Outerjoin uSuppose we join R JOIN C S. uA tuple of R that has no tuple of S with which it joins is said to be dangling. wSimilarly for a tuple of S. uOuterjoin preserves dangling tuples by padding them with a special NULL symbol in the result.

55 Example: Outerjoin R = ( AB )S = ( BC ) (1,2) joins with (2,3), but the other two tuples are dangling. R OUTERJOIN S =ABC NULL NULL67