Database Technology Session II 10:15 - 11:00 Dr S Sudarshan & Dr D B Phatak IIT Bombay.

Slides:



Advertisements
Similar presentations
Database System Concepts and Architecture
Advertisements

Database Architectures and the Web
IiWAS2002, Bandung, Indonesia Teaching and Learning Databases Dr. Stéphane Bressan National University of Singapore.
Database Concepts Lec. 5. What Is a Database? Data are unprocessed raw facts that include text, number, images, audio, and video. Information is processed.
ICOM 6005 – Database Management Systems Design Dr. Manuel Rodríguez-Martínez Electrical and Computer Engineering Department Lecture 16 – Intro. to Transactions.
Technical Architectures
1 Database Systems (Part I) Introduction to Databases I Overview  Objectives of this lecture.  History and Evolution of Databases.  Basic Terms in Database.
Introduction to Databases
©Silberschatz, Korth and Sudarshan1.1Database System Concepts Chapter 1: Introduction Purpose of Database Systems View of Data Data Models Data Definition.
1 Lecture 31 Introduction to Databases I Overview  Objectives of this lecture  History and Evolution of Databases  Basic Terms in Database and definitions.
The Architecture of Transaction Processing Systems
Chapter 9: The Client/Server Database Environment
1 Recap Database: –collection of data central to some enterprise that is managed by a Database Management System –reflection of the current state of the.
1 Introduction Introduction to database systems Database Management Systems (DBMS) Type of Databases Database Design Database Design Considerations.
Copyright © 2011 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Chapter 2 Overview of Database Languages and Architectures.
1 © Prentice Hall, 2002 The Client/Server Database Environment.
Operating Systems.
Database Management Systems (DBMS)
Lecture The Client/Server Database Environment
The Client/Server Database Environment
IT – DBMS Concepts Relational Database Theory.
Database System Concepts and Architecture Lecture # 3 22 June 2012 National University of Computer and Emerging Sciences.
 Introduction Introduction  Purpose of Database SystemsPurpose of Database Systems  Levels of Abstraction Levels of Abstraction  Instances and Schemas.
Introduction. 
The Worlds of Database Systems Chapter 1. Database Management Systems (DBMS) DBMS: Powerful tool for creating and managing large amounts of data efficiently.
Chapter 2 Database System Architecture. An “architecture” for a database system. A specification of how it will work, what it will “look like.” The “ANSI/SPARC”
Lecture On Database Analysis and Design By- Jesmin Akhter Lecturer, IIT, Jahangirnagar University.
Lecture On Database Analysis and Design By- Jesmin Akhter Lecturer, IIT, Jahangirnagar University.
1 Introduction to Database Systems. 2 Database and Database System / A database is a shared collection of logically related data designed to meet the.
Dr. Mohamed Osman Hegazi 1 Database Systems Concepts Database Systems Concepts Course Outlines: Introduction to Databases and DBMS. Database System Concepts.
Database Design and Management CPTG /23/2015Chapter 12 of 38 Functions of a Database Store data Store data School: student records, class schedules,
The Client/Server Database Environment Ployphan Sornsuwit KPRU Ref.
Database Architectures Database System Architectures Considerations – Data storage: Where do the data and DBMS reside? – Processing: Where.
Lecture # 3 & 4 Chapter # 2 Database System Concepts and Architecture Muhammad Emran Database Systems 1.
DISTRIBUTED COMPUTING Introduction Dr. Yingwu Zhu.
1 CS 430 Database Theory Winter 2005 Lecture 2: General Concepts.
SYS364 Database Design Continued. Database Design Definitions Initial ERD’s Normalization of data Final ERD’s Database Management Database Models File.
CS525: Big Data Analytics MapReduce Computing Paradigm & Apache Hadoop Open Source Fall 2013 Elke A. Rundensteiner 1.
Introduction.  Administration  Simple DBMS  CMPT 454 Topics John Edgar2.
ASET 1 Amity School of Engineering & Technology B. Tech. (CSE/IT), III Semester Database Management Systems Jitendra Rajpurohit.
ICOM 6005 – Database Management Systems Design Dr. Manuel Rodríguez-Martínez Electrical and Computer Engineering Department Lecture 16 – Intro. to Transactions.
Hands-On Microsoft Windows Server 2008 Chapter 7 Configuring and Managing Data Storage.
Introduction to Core Database Concepts Getting started with Databases and Structure Query Language (SQL)
©Silberschatz, Korth and Sudarshan 1.1 Database System Concepts قواعد البيانات Data Base قواعد البيانات CCS 402 Mr. Nedal hayajneh E- mail
CS 325 Spring ‘09 Chapter 1 Goals:
Introduction to DBMS Purpose of Database Systems View of Data
Databases and DBMSs Todd S. Bacastow January 2005.
DBMS & TPS Barbara Russell MBA 624.
Chapter 9: The Client/Server Database Environment
Netscape Application Server
An Introduction to database system
Chapter 1: Introduction
Chapter 1: Introduction
Database System Concepts and Architecture
Unit 1: INTRODUCTION Database system, Characteristics Database Users
The Client/Server Database Environment
Chapter 1: Introduction
The Client/Server Database Environment
The Client/Server Database Environment
Chapter 9: The Client/Server Database Environment
Copyright © 2011 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Chapter 2 Database System Concepts and Architecture.
Chapter 2 Database Environment Pearson Education © 2009.
Data, Databases, and DBMSs
Database Environment Transparencies
Introduction to DBMS Purpose of Database Systems View of Data
Chapter 1: Introduction
Chapter 1: Introduction
Chapter 1: Introduction
Database System Architectures
Chapter 1: Introduction
Presentation transcript:

Database Technology Session II 10: :00 Dr S Sudarshan & Dr D B Phatak IIT Bombay

Dr. Sudarshan & Phatak, IIT BombayData Base Technologies2 OVERVIEW u Storage devices u Files and Index Structures u Legacy Systems and Cobol u Relational Databases and SQL u Transactions and ACID properties u System Architectures u Security and Audit

Dr. Sudarshan & Phatak, IIT BombayData Base Technologies3 Storage Devices u Main memory –volatile, lost on power failure –expensive and relatively small u Hard disk –non-volatile, reasonably fast access –relatively cheap, and large –main storage system for databases –Mean time to Failure: ~5 years

Dr. Sudarshan & Phatak, IIT BombayData Base Technologies4 RAID Systems u Goal: improve storage reliability u Data stored on multiple disks – if one disk fails, data still available on others u Essential for safety of data u Hardware RAID –expensive, very high availability –for 24x7 applications (24 hrs X 7 days/wk) u Software RAID –cheaper, use if some downtime is allowable

Dr. Sudarshan & Phatak, IIT BombayData Base Technologies5 Storing Data on Disks u Byte: unit of information –one character u File: –sequence of bytes u File system: –stores multiple files – organizes files into directories/folders

Dr. Sudarshan & Phatak, IIT BombayData Base Technologies6 File Structure u Information stored within large files u Sequential files –sorted on a key (e.g., account number) u Index needed for efficient access –e.g. find information of account 2345 –similar to library card catalogs

Dr. Sudarshan & Phatak, IIT BombayData Base Technologies7 Traditional File Processing u COBOL: –Common Business Oriented language u Files contain sequence of records, –e.g. Record per account u Complex program for each task –e.g. withdrawal, deposit, average balance, … u File structures often very complex –motivated by efficiency, but become hard to understand

Dr. Sudarshan & Phatak, IIT BombayData Base Technologies8 SEGMENT OF A SAMPLE COBOL PROGRAM Open Input SALARYTABLE-FILE. Perform Varying I from 1 to 11. Move zero to GROUPTOT [I]. END-PERFORM. PROCESS-NEXT. Read EMPTAB-FILE At End Go To End-job Add salary to Group tot [K]. Go to Process-Next. END-JOB

Dr. Sudarshan & Phatak, IIT BombayData Base Technologies9 PROGRAMMING PARADIGMS u 4 GL: What to do –Set processing u 3 GL: How to do (Algorithm) –Record by Record Processing u 2 GL: Algorithm at the lowest level –Details of Individual Operations

Dr. Sudarshan & Phatak, IIT BombayData Base Technologies10 Relational Databases u Motivation: –simplify storage structures –easy to use language for queries/updates –efficiency is job of system »automatic optimization u Legacy systems –Systems built using COBOL and older data models –Still in wide use, but declining usage

Dr. Sudarshan & Phatak, IIT BombayData Base Technologies11 Relational Databases Provide: u Tabular Data model: simple, yet powerful u A Standard Query Language: SQL u Mature Products with Reliable, Fault- Tolerant Operations available u Good Performance –High number of transactions per second –Parallel operation for scalability (handle growth) u Distributed and Replicated Data Bases –Interoperation, High availability

Dr. Sudarshan & Phatak, IIT BombayData Base Technologies12 Relational Model: Tabular Data Account Transactions

Dr. Sudarshan & Phatak, IIT BombayData Base Technologies13 Querying the Database using SQL u select name, balance from account where name = “D. B. Phatak” u insert into transactions values (3/5/99, cash, 5000, -, 14000) u select acct-num, avg(balance) from transactions where date between 1/4/99 and 30/4/99 groupby acct-num

Dr. Sudarshan & Phatak, IIT BombayData Base Technologies14 Transactions: ACID Properties u Transactions: – e.g. Debit/credit u Problems: –Failures (e.g., power, disk storage) –Concurrent transactions u Solution: –Support for ACID properties

Dr. Sudarshan & Phatak, IIT BombayData Base Technologies15 ACID Properties u Atomicity: Transaction appears to either run completely or not at all -- no partial state u Consistency: Integrity checks (e.g., balance >= 0) u Isolation: Locks on data so that transactions do not step on each others toes u Durability: Data/updates are never lost

Dr. Sudarshan & Phatak, IIT BombayData Base Technologies16 Database Application Classes u OLTP: Online Transaction Processing –supports many small transactions u Decision Support –Summaries/aggregates –OLAP: Online Analytical Processing

Dr. Sudarshan & Phatak, IIT BombayData Base Technologies17 Performance Issues u Important for high volume systems –e.g., internet banking u Sizing / Performance tuning –deciding on CPUs, memory size, disk size, number of disks, etc –tuning transaction code »to reduce disk I/O »to reduce lock conflicts between concurrent transactions u Scalability via parallelism –Smoothly handling more traffic as the business grows

Dr. Sudarshan & Phatak, IIT BombayData Base Technologies18 Access Security u Authentication –Identifying who a person is –Passwords »widely used, but quite insecure –Smart cards, biometrics, etc »More on this later u Access privileges –who is allowed to do what u Audit trail –Trace back what happened

Dr. Sudarshan & Phatak, IIT BombayData Base Technologies19 Authorization Mechanisms u Privileges –e.g., read table, update table, insert row in table, delete row from table, privilege to grant privileges u Each user given specific set of privileges he/she needs u Roles –privileges given to roles »(e.g., teller, manager) – users authorized to play roles

Dr. Sudarshan & Phatak, IIT BombayData Base Technologies20 Audit Trails u Database keeps track of all transactions in an audit table –what the transaction did, and who ran it u Mechanisms for tracing back what transactions affected a particular entity (such as an account)

Dr. Sudarshan & Phatak, IIT BombayData Base Technologies21 MORE ON SECURITY u Encryption, Session Key u Data Encryption Standard (DES-3) –Shared Private key u RSA, DH Algorithms –Public/Private key

Dr. Sudarshan & Phatak, IIT BombayData Base Technologies22 SQL u SQL is Intergalactic Dataspeak u Strong Data Definition Language (DDL) – Domain Definitions – Integrity Constraints u Security & Access Control Provided – Views, Permissions u Interactive Queries

Dr. Sudarshan & Phatak, IIT BombayData Base Technologies23 SQL u Embedded SQL: –Use of SQL commands from within 3GL programs (programs in C/COBOL/…) u Open Data Base Connectivity (ODBC): –Standard for client server interconnectivity, using C language u JDBC: Like ODBC, for Java language u SQL Standards: 86, 89, 92, SQL-3 Draft

Dr. Sudarshan & Phatak, IIT BombayData Base Technologies24 SQL u No Standards for User Interface – Screens (Forms & Menus) – Reports u Special Tools Available – Native to Product – Independent Vendors

Dr. Sudarshan & Phatak, IIT BombayData Base Technologies25 DATABASE SERVERS u Major players –Oracle, IBM DB2, Microsoft SQL Server, Informix, Sybase, Ingress u Wide range of performance, features, and price

Dr. Sudarshan & Phatak, IIT BombayData Base Technologies26 Database Architectures u Centralized –Dumb terminals connected to single server u Client Server –Smarter client machines connect to server –Main work still done at server u Parallel Servers –Work divided between multiple CPUs u Distributed –Multiple independent databases in cooperation

Dr. Sudarshan & Phatak, IIT BombayData Base Technologies27 EVOLUTION OF CLIENT SERVER COMPUTING u Multiple Computers to Independently Handle Component Tasks of an Application u Need to Partition Tasks Judiciously

Dr. Sudarshan & Phatak, IIT BombayData Base Technologies28 TWO TIER PARTITIONING

Dr. Sudarshan & Phatak, IIT BombayData Base Technologies29 CLIENT - SERVER TERMINOLOGY u Service: Provided by the Server – Each Client Is a Consumer u Shared Resources : Managed by Server u Client : Initiator of a Request

Dr. Sudarshan & Phatak, IIT BombayData Base Technologies30 SERVERS u File Servers : Novell u Database Servers : SQL u Transaction Servers : OLTP – TP lite (Stored Procedures) – TP heavy (TP monitors)

Dr. Sudarshan & Phatak, IIT BombayData Base Technologies31 SERVER FUNCTIONS u Wait for Requests u Handle Concurrent Transactions u Take care of VIP requests –Assign priorities u Authentication, Authorisation u Audit trails

Dr. Sudarshan & Phatak, IIT BombayData Base Technologies32 CLIENT FUNCTIONS u Typically Processes Running on Front-end Machine (PC) u Provide User Interface u Support Graphics, Multimedia

Dr. Sudarshan & Phatak, IIT BombayData Base Technologies33 THREE TIER C/S u Tier One : Client u Tier Two : Application Server u Tier Three: Database Server

Dr. Sudarshan & Phatak, IIT BombayData Base Technologies34 MORE C/S TERMINOLOGY u Thin or Fat Client u Fat Server u n-Tier Architecture u OOUI