1. 2004-02-17 SLIDE 1IS 257 – Spring 2004 Database Design: From Conceptual Design to Physical Relational Implementation University of California, Berkeley School of Information Management and Systems SIMS 257: Database Management

2. 2004-02-17 SLIDE 2IS 257 – Spring 2004 Lecture Outline Review –Access Methods –Indexes and What to index –Parallel storage systems (RAID) –Integrity constraints Design to Relational Implementation

3. 2004-02-17 SLIDE 3IS 257 – Spring 2004 Internal Model Access Methods Many types of access methods: –Physical Sequential –Indexed Sequential –Indexed Random –Inverted –Direct –Hashed Differences in –Access Efficiency –Storage Efficiency

4. 2004-02-17 SLIDE 4IS 257 – Spring 2004 Indexed Sequential: Two Levels Address 789…789… Key Value 385 678 805 001 003. 150 705 710. 785 251. 385 455 480. 536 605 610. 678 791. 805 Address 1212 Key Value 150 385 Address 3434 Key Value 536 678 Address 5656 Key Value 785 805

5. 2004-02-17 SLIDE 5IS 257 – Spring 2004 Indexed Random Address Block Number 2132121321 Actual Value Adams Becker Dumpling Getta Harty Becker Harty Adams Getta Dumpling

6. 2004-02-17 SLIDE 6IS 257 – Spring 2004 Btree F | | P | | Z | R | | S | | Z |H | | L | | P |B | | D | | F | Devils Aces Boilers Cars Minors Panthers Seminoles Flyers Hawkeyes Hoosiers

7. 2004-02-17 SLIDE 7IS 257 – Spring 2004 Inverted Address Block Number 123…123… Actual Value CH 145 CS 201 CS 623 PH 345 CH 145 101, 103,104 CS 201 102 CS 623 105, 106 Adams Becker Dumpling Getta Harty Mobile Student name Course Number CH145 cs201 ch145 cs623

8. 2004-02-17 SLIDE 8IS 257 – Spring 2004 When to Use Indexes Rules of thumb –Indexes are most useful on larger tables –Specify a unique index for the primary key of each table –Indexes are most useful for attributes used as search criteria or for joining tables –Indexes are useful if sorting is often done on the attribute –Most useful when there are many different values for an attribute –Some DBMS limit the number of indexes and the size of the index key values –Some indexes will not retrieve NULL values

9. 2004-02-17 SLIDE 9IS 257 – Spring 2004 RAID Provides parallel disks (and software) so that multiple pages can be retrieved simultaneously RAID stands for “Redundant Arrays of Inexpensive Disks” –invented by Randy Katz and Dave Patterson here at Berkeley Some manufacturers have renamed the “inexpensive” part

10. 2004-02-17 SLIDE 10IS 257 – Spring 2004 RAID Technology Parallel Writes Disk 2Disk 3Disk 4Disk 1 1 2 3 4 5 6 7 8 9 10 11 12 * * Parallel Reads Stripe One logical disk drive

11. 2004-02-17 SLIDE 11IS 257 – Spring 2004 Raid 0 Parallel Writes Disk 2Disk 3Disk 4Disk 1 1 2 3 4 5 6 7 8 9 10 11 12 * * Parallel Reads Stripe One logical disk drive

12. 2004-02-17 SLIDE 12IS 257 – Spring 2004 RAID-1 Parallel Writes Disk 2Disk 3Disk 4Disk 1 1 1 2 2 3 3 4 4 5 5 6 6 * * Parallel Reads Stripe

13. 2004-02-17 SLIDE 13IS 257 – Spring 2004 RAID-2 Writes span all drives Disk 2Disk 3Disk 4Disk 1 1a 1b ecc ecc 2a 2b ecc ecc 3a 3b ecc ecc * * Reads span all drives Stripe

14. 2004-02-17 SLIDE 14IS 257 – Spring 2004 RAID-3 Writes span all drives Disk 2Disk 3Disk 4Disk 1 1a 1b 1c ecc 2a 2b 2c ecc 3a 3b 3c ecc * * Reads span all drives Stripe

15. 2004-02-17 SLIDE 15IS 257 – Spring 2004 Raid-4 Disk 2Disk 3Disk 4Disk 1 1 2 3 ecc 4 5 6 ecc 7 8 9 ecc * * Stripe Parallel Writes Parallel Reads

16. 2004-02-17 SLIDE 16IS 257 – Spring 2004 RAID-5 Parallel Writes Disk 2Disk 3Disk 4Disk 1 1 2 3 4 5 6 7 8 9 10 11 12 ecc ecc * * Parallel Reads Stripe

17. 2004-02-17 SLIDE 17IS 257 – Spring 2004 Integrity Constraints The constraints we wish to impose in order to protect the database from becoming inconsistent. Five types –Required data –attribute domain constraints –entity integrity –referential integrity –enterprise constraints

18. 2004-02-17 SLIDE 18IS 257 – Spring 2004 Review Database Design Process Normalization

19. 2004-02-17 SLIDE 19IS 257 – Spring 2004 Database Design Process Conceptual Model Logical Model External Model Conceptual requirements Conceptual requirements Conceptual requirements Conceptual requirements Application 1 Application 2Application 3Application 4 Application 2 Application 3 Application 4 External Model External Model External Model Internal Model

20. 2004-02-17 SLIDE 20IS 257 – Spring 2004 Today: New Design Today we will build the COOKIE database from needs (rough) through the conceptual model, logical model and finally physical implementation in Access.

21. 2004-02-17 SLIDE 21IS 257 – Spring 2004 Cookie Requirements Cookie is a bibliographic database that contains information about a hypothetical union catalog of several libraries. Need to record which books are held by which libraries Need to search on bibliographic information –Author, title, subject, call number for a given library, etc. Need to know who publishes the books for ordering, etc.

22. 2004-02-17 SLIDE 22IS 257 – Spring 2004 Cookie Database There are currently 6 main types of entities in the database –Authors (Authors) –Books (bibfile) –Local Call numbers (callfile) –Libraries (libfile) –Publishers (pubfile) –Subject headings (subfile) –Additional entities Links between subject and books (indxfile) Links between authors and books (AU_BIB)

23. 2004-02-17 SLIDE 23IS 257 – Spring 2004 AUTHORS author -- The author’s name (We do not distinguish between Personal and Corporate authors) Au_id – a unique id for the author

24. 2004-02-17 SLIDE 24IS 257 – Spring 2004 AUTHORS Authors Author AU ID

25. 2004-02-17 SLIDE 25IS 257 – Spring 2004 BIBFILE Books (BIBFILE) contains information about particular books. It includes one record for each book. The attributes are: –accno -- an “accession” or serial number –title -- The title of the book –loc -- Location of publication (where published) –date -- Date of publication –price -- Price of the book –pagination -- Number of pages –ill -- What type of illustrations (maps, etc) if any –height -- Height of the book in centimeters

26. 2004-02-17 SLIDE 26IS 257 – Spring 2004 Books/BIBFILE Books accno Title Loc Date Price Pagination Height Ill

27. 2004-02-17 SLIDE 27IS 257 – Spring 2004 CALLFILE CALLFILE contains call numbers and holdings information linking particular books with particular libraries. Its attributes are: –accno -- the book accession number –libid -- the id of the holding library –callno -- the call number of the book in the particular library –copies -- the number of copies held by the particular library

28. 2004-02-17 SLIDE 28IS 257 – Spring 2004 LocalInfo/CALLFILE CALLFILE Copies accno libid Callno

29. 2004-02-17 SLIDE 29IS 257 – Spring 2004 LIBFILE LIBFILE contain information about the libraries participating in this union catalog. Its attributes include: –libid -- Library id number –library -- Name of the library –laddress -- Street address for the library –lcity -- City name –lstate -- State code (postal abbreviation) –lzip -- zip code –lphone -- Phone number –mop - suncl -- Library opening and closing times for each day of the week.

30. 2004-02-17 SLIDE 30IS 257 – Spring 2004 Libraries/LIBFILE LIBFILE Libid SatCl SatOp FCl FOp ThCl ThOpWClWOpTuClTuOp Mcl MOp Suncl SunOp lphone lzip lstatelcity laddress Library

31. 2004-02-17 SLIDE 31IS 257 – Spring 2004 PUBFILE PUBFILE contain information about the publishers of books. Its attributes include –pubid -- The publisher’s id number –publisher -- Publisher name –paddress -- Publisher street address –pcity -- Publisher city –pstate -- Publisher state –pzip -- Publisher zip code –pphone -- Publisher phone number –ship -- standard shipping time in days

32. 2004-02-17 SLIDE 32IS 257 – Spring 2004 Publisher/PUBFILE PUBFILE pubid Ship Publisher pphone pzip pstate pcity paddress

33. 2004-02-17 SLIDE 33IS 257 – Spring 2004 SUBFILE SUBFILE contains each unique subject heading that can be assigned to books. Its attributes are –subcode -- Subject identification number –subject -- the subject heading/description

34. 2004-02-17 SLIDE 34IS 257 – Spring 2004 Subjects/SUBFILE SUBFILE Subject subid

35. 2004-02-17 SLIDE 35IS 257 – Spring 2004 INDXFILE INDXFILE provides a way to allow many- to-many mapping of subject headings to books. Its attributes consist entirely of links to other tables –subcode -- link to subject id –accno -- link to book accession number

36. 2004-02-17 SLIDE 36IS 257 – Spring 2004 Linking Subjects and Books INDXFILE accno subid

37. 2004-02-17 SLIDE 37IS 257 – Spring 2004 AU_BIB AU_BIB provides a way to allow many to many mapping between books and authors. It also consists only of links to other tables –AU_ID – link to the AUTHORS table –ACCNO – link to the BIBFILE table

38. 2004-02-17 SLIDE 38IS 257 – Spring 2004 Linking Authors and Books AU_BIB accno AU ID

39. 2004-02-17 SLIDE 39IS 257 – Spring 2004 Some examples of Cookie Searches Who wrote Microcosmographia Academica? How many pages long is Alfred Whitehead’s The Aims of Education and Other Essays? Which branches in Berkeley’s public library system are open on Sunday? What is the call number of Moffitt Library’s copy of Abraham Flexner’s book Universities: American, English, German? What books on the subject of higher education are among the holdings of Berkeley (both UC and City) libraries? Print a list of the Mechanics Library holdings, in descending order by height. What would it cost to replace every copy of each book that contains illustrations (including graphs, maps, portraits, etc.)? Which library closes earliest on Friday night?

40. 2004-02-17 SLIDE 40IS 257 – Spring 2004 Cookie ER Diagram AU_ID BIBFILE pubid LIBFILE INDXFILE accno SUBFILE libid CALLFILE pubid PUBFILE subcodeaccnosubcode libid accno AUTHORS AU_BIB accno AU ID Author Note: diagram contains only attributes used for linking

41. 2004-02-17 SLIDE 41IS 257 – Spring 2004 What Problems? What sorts of problems and missing features arise given the previous ER diagram?

42. 2004-02-17 SLIDE 42IS 257 – Spring 2004 Problems Identified Subtitles, parallel titles? Edition information Series information lending status material type designation Genre, class information Better codes (ISBN?) Missing information (ISBN) Authority control for authors Missing/incomplete data Data entry problems Ordering information Illustrations Subfield separation (such as last_name, first_name) Separate personal and corporate authors

43. 2004-02-17 SLIDE 43IS 257 – Spring 2004 Problems (Cont.) Location field inconsistent No notes field No language field Zipcode doesn’t support plus-4 No publisher shipping addresses No (indexable) keyword search capability No support for multivolume works No support for URLs –to online version –to libraries –to publishers

44. 2004-02-17 SLIDE 44IS 257 – Spring 2004 Original Cookie ER Diagram AU_ID BIBFILE pubid LIBFILE INDXFILE accno SUBFILE libid CALLFILE pubid PUBFILE subcodeaccnosubcode libid accno AUTHORS AU_BIB accno AU ID Author Note: diagram contains only attributes used for linking

45. 2004-02-17 SLIDE 45IS 257 – Spring 2004 nameid BIBFILE pubid LIBFILE INDXFILE accno SUBFILE libid CALLFILE pubid PUBFILE subcodeaccnosubcode libid accno AUTHFILE AUTHBIB authtype accno nameid name Cookie2: Separate Name Authorities

46. 2004-02-17 SLIDE 46IS 257 – Spring 2004 Cookie 3: Keywords nameid BIBFILE pubid LIBFILE INDXFILE accno SUBFILE libid CALLFILE pubid PUBFILE subcodeaccnosubcode libid accno AUTHFILE AUTHBIB authtype accno nameid name KEYMAP TERMS accnotermid

47. 2004-02-17 SLIDE 47IS 257 – Spring 2004 Cookie 4: Series nameid BIBFILE pubid LIBFILE INDXFILE accno SUBFILE libid CALLFILE pubid PUBFILE subcodeaccnosubcode libid accno AUTHFILE AUTHBIB authtype accno nameid name KEYMAP TERMS accnotermid SERIES seriesid ser_title

48. 2004-02-17 SLIDE 48IS 257 – Spring 2004 Cookie 5: Circulation nameid BIBFILE pubid LIBFILE accno libid CALLFILE pubid PUBFILE libid accno INDXFILE SUBFILE subcodeaccno subcode AUTHFILE AUTHBIB authtype accno nameid name KEYMAP TERMS accnotermid SERIES seriesid ser_title CIRC circidcopynumpatronid PATRON circid

49. 2004-02-17 SLIDE 49IS 257 – Spring 2004 Logical Model: Mapping to Relations Take each entity –BIBFILE –LIBFILE –CALLFILE –SUBFILE –PUBFILE –INDXFILE And make it a table...

50. 2004-02-17 SLIDE 50IS 257 – Spring 2004 Implementing the Physical Database... For each of the entities, we will build a table… Start up access… Use “New” in Tables… Loading data Entering data Data entry forms

51. 2004-02-17 SLIDE 51IS 257 – Spring 2004 Next Time Relational Operations Relational Algebra Relational Calculus Introduction to SQL