2. An Introduction to Database and Database Designing R C Goyal Principal Scientist IASRI, New Delhi

3. Databases Before the Use of Computers Data kept in books, ledgers, card files, folders, and file cabinets Long response time Labor-intensive Often incomplete or inaccurate

4. Data & Information Data known facts that can be recorded and that has implicit meaning Information processed data Meaningless data becomes information when it is processed and presented to the decision maker in a meaningful way

5. Database A set of data that is required for a specific purpose or is fundamental to a system, project, enterprise, or business. A formally structured collection of data.setdatasystem A database may consist of one or more data banks and be geographically distributed among several repositories. In automated information systems, the database is manipulated using a database management system.informationdatabase management system

6. File Mgmt vs. Database Mgmt File Management Each data entity is in a separate file system for creating, retrieving and manipulating files. Database Management Same file but data elements are integrated and shared among different files Program controls the structure of a database and access to data

7. Database Management for Strategic Advantage We live in the Information Age Information used to make organizations more productive and competitive Databases used to support business operations Databases used across a range of applictions Personal, department, enterprise, web

8. Technical Advantages of Database Management Reduced data redundancy Improved data integrity More program independence Increased user productivity Increased security

9. Disadvantages of DBMS Cost issues Implementation & maintenance issues Security issues Privacy issues

10. Features of DBMS Database Engine heart of DBMS stores, retrieves and updates data enforces business rules Data dictionary holds definitions of all of the data tables Describes the data type, allows DBMS to keep track of data, helps user find data they need

11. Features of DBMS…Cont. Query processor Enables users to store and retrieve data Use English command that use such words as SELECT, DELETE, MODIFY Report generator Formats and prints reports after user uses query processor

12. Features of DBMS…Cont. Forms generator Application generator Access security Setup access privileges to protect data from unauthorized access and sabotage System recovery

13. Database Development Cycle Database planning System Definition Requirements collection and analysis Database design DBMS selection Application design Prototyping Implementation Data Conversion and loading Testing Operational Maintenance

14. Database Planning Systems Definition Requirements Collection and analysis Database Design DBMS Selection Application Design Implementation Data Conversion and loading Testing Evaluation & Maintenance Prototyping Database Life Cycle Source: http://www.cs/ucf.edu/courses/cgs2545/CH02/index.htm

15. Database Planning Current systems evaluation Development of standards Technological feasibility Operational feasibility Economical feasibility

16. Requirements Collection and Analysis identifying management information requirements, determining information requirements by functional area, and establishing hardware and software requirements Systems definition Data dictionary Metadata

17. Database Design Conceptual design Logical design Physical design

18. Database design methodology A structured approach that uses procedures, techniques, tools, and documentation aids to support and facilitate the process of design. *Conceptual database design *Logical database design *Physical database design

19. Critical Success Factors in Database Design Work interactively with the users as much as possible. Follow a structured methodology throughout the data modelling process. Incorporate structural and integrity considerations into the data models. Combine conceptualisation, normalisation, and transaction validation techniques into the data modelling methodology.

20. Design Considerations - Tips Planning Tables Queries Forms Reports Macros Modules General

21. Tips - Planning Before you start up the computer to build a database, PLAN ON PAPER!!! Gather all of the paper forms you use to collect your data Interview the people who will be using the database, from those who conduct the field work to those who analyze the data Think about what you want to get back out of your database, not just about how to get data in Steal - see if it’s been done before

22. Tips - Tables Normalize, normalize, normalize Use field properties to help maintain data integrity When possible limit the possible entries in a field to a lookup list (domain) Choose your key fields carefully Index fields that you will search often Many-to-many relationships in Access Steal - link to existing tables

23. Normalization The process of breaking down large tables into smaller ones by removing all unnecessary or duplicate fields, eliminating redundant data, and making sure that each table represents only one thing.

24. Why Normalize? If you don’t normalize, you may run into anomalies (unexpected results) Deletion anomaly - deleting a record unexpectedly removes a value we wanted to keep Insertion anomaly - we can’t add a record because we don’t know the value of all of the required fields Change anomaly - one change must be applied to many records in a single table

25. Non-normalized Table Typical flat-file table Contains all data in one record. Contains repeating fields. Contains information on more than one thing.

26. First Normal Form Eliminate repeating fields within tables. Create a separate table for each set of related data. Identify each set of related data with a primary key.

27. First Normal Form No Repeating Fields: Class# is now a single field instead of repeating for each class a student takes. Now multiple records for each student because >1 record is needed to accommodate all classes for each student Non-normalized Table

28. Second Normal Form Create separate tables for values that apply to multiple records. Relate these tables with a foreign key.

29. Second Normal Form Eliminate Redundant Data: no longer repeating student name, advisor, and adv-room for each class Students: Classes:

30. Third Normal Form Eliminate fields that do not depend on the key. AdvRoom is independent of the key field (Student#). It does not depend on the student, it depends on the advisor. Students:

31. Third Normal Form Eliminate Data Not Dependent on Key: remove AdvName from the Students table and create a separate table describing the advisors with its own primary key (AdvID). Relate Advisors to Students using AdvID. Students : Advisors:

32. Deletion Anomalies If we delete student Rajat, we lose the only records for advisor Goyal

33. Insertion Anomalies If we want to add a new student we have to know what class they are in (it’s part of the key)

34. Change Anomalies If student Rajat switches to advisor Gupta, we have to change three records instead of just one

35. Field Properties Data Type - text, integer, double, boolean, etc. Field Size - for text fields Input Mask - a pattern for entering data Default Values - auto-entered for new records Validation Rule - limits values entered Required? - force entry of data

36. Relationships One to One One to Many Many to One Many to Many

37. Many-to-Many Relationship Exist between two tables when: for one record in the first table, there can be many corresponding records in the second table and… for one record in the second table, there can be many corresponding records in the first table

38. Many-to-Many Relationship One student can take many classes, and one class can be taken by many students. Students StudentID Name Address City State Zip WorkPhone HomePhone Classes ClassNumber StudentID Subject InstructorID Days Time Comments  

39. Tips - Queries Take advantage of action queries to handle batch record operations Use queries to present calculated values rather than storing the calculated values in your tables Remember that null never equals another null Joining two tables on a field that may contain a null value may not give you the results you expect Searching for duplicate values will not return two records that have a null Realize that you can link a table to itself

40. DBMS Selection *Costs *Features and Tools *Underlying model *Portability *DBMS hardware requirements *Organisational requirements

41. Implementation The physical realisation of the database and application designs the detailed model is converted to the appropriate implementation model, the data dictionary is built, the database is populated, application programs are developed and users are trained

42. Data Conversion and Loading & Testing Transferring any existing or new data into the new database and converting any existing applications to run on the new database Finding errors

43. Database Evaluation Interviewing and polling users to determine whether any data needs are unmet.

44. Operational maintenance preventive maintenance (backup) corrective maintenance (recovery)1 adaptive maintenance regular monitoring & periodical check up

45. Recent Developments Affecting Database Design and Use Data Mining (On-Line Analytical Processing) Drill down from summary data to detailed data Data Warehouses/Data Marts Integrates many large databases into one repository Linking Web Site Applications to Organizational Databases Users have Web view to organizational database Improves customer contact and service Adds security as a concern

46. Data Warehouses Data warehouses are used to organize information for quick and effective queries

47. Data Warehouses and Database In the data warehouse, data are organized around major subjects Data in the warehouse are stored as summarized rather than detailed raw data Data in the data warehouse cover a much longer time frame than in a traditional transaction-oriented database Data warehouses are organized for fast queries Data warehouses are usually optimized for answering complex queries, known as OLAP

48. Data Warehouses and Database Data warehouses allow for easy access via data-mining software called software Data warehouses include multiple databases that have been processed so that data are uniformly defined, containing what is referred to as “clean” data Data warehouses usually contain data from outside sources

49. Data Mining Statistical analysis Decision trees Neural networks Fuzzy logic Clustering

50. Data Mining Patterns Data mining patterns that decision makers try to identify include Associations, patterns that occur together Sequences, patterns of actions that take place over a period of time Clustering, patterns that develop among groups of people Trends, the patterns that are noticed over a period of time

51. Web Based Databases and XML Web-based databases are used for sharing data Extensible markup language (XML) is used to define data used primarily for business data exchange over the Web An XML document contains only data and the nature of the data Continue………………………………..