Data and Context Context and structuring helps users understand data Manufacturer Name Engine Displacement (cc) Transmission (Speed) Production Suzuki GSXX11330000 Hayabusa 16 Valve 1340 6 2008 Honda CBR1100 Blackbird 1137 1996 BMW KK11220000SS 1157 2004 Context and structuring helps users understand data ISE230

Data & Information (1) Data: Facts, text, numbers, graphics, images, sound, and video segments that have meaning in the user’s environment Structured: numbers, text, dates Unstructured: images, video, documents AR Border 11174 BC Lara 11953 GA Gooch 8900 JH Kallis 10277 R Dravid 10823 RT Ponting 11345 SM Gavaskar 10122 SR Tendulkar 12773 SR Waugh 10927 ISE230

Data & Information (2) Information: data processed to increase knowledge in the person using the data Player Cntr Mat Inns NO Runs HS Ave 100 50 SR Tendulkar India 159 261 27 12773 248* 54.58 42 53 BC Lara WI 131 232 6 11953 400* 52.88 34 48 RT Ponting Aus 136 229 26 11345 257 55.88 38 AR Border 156 265 44 11174 205 50.56 63 SR Waugh 168 260 46 10927 200 51.06 32 R Dravid 134 233 10823 270 52.53 57 JH Kallis SA 221 33 10277 189* 54.66 31 51 SM Gavaskar 125 214 16 10122 236* 51.12 45 GA Gooch Eng 118 215 8900 333 42.58 20 Metadata: Descriptions of the properties or characteristics of the data, including data types, field sizes, allowable values, and data context ISE230

Summarized Data Graphical displays turn data into useful information that managers can use for decision making and interpretation ISE230

Database versus DBMS Database: Repository of Information/Data A usually large collection of data organized especially for rapid search and retrieval. Database Management System DBMS is a program that lets one or more computer users create and access data in a database. E.g. SQL Server, Oracle, MySQL etc. Makes it easy for you to manipulate large amounts of data. Frees you from thinking about details. Enables you to focus on your challenges. ISE230

Data Models Data Model: collection of concepts for describing data Schema: description of a particular collection of data, using the a given data model, like a blueprint that describes the layout of the data: what kinds of fields are present and how they are organized. Relational model of data is the most widely used model today. Main Concept: relation; basically a table with rows and columns. Every relation has a schema which describes the columns. ISE230 10

File Processing vs. DBMS (1) Player Country Mat Inns NO Runs HS Ave 100 50 SR Tendulkar India 159 261 27 12773 248* 54.58 42 53 BC Lara WI 131 232 6 11953 400* 52.88 34 48 RT Ponting Aus 136 229 26 11345 257 55.88 38 AR Border 156 265 44 11174 205 50.56 63 SR Waugh 168 260 46 10927 200 51.06 32 R Dravid 134 233 10823 270 52.53 57 JH Kallis SA 221 33 10277 189* 54.66 31 51 SM Gavaskar 125 214 16 10122 236* 51.12 45 GA Gooch Eng 118 215 8900 333 42.58 20 What is more suited application/structure to store this data? Text file in Notepad Slide in a PowerPoint presentation MS Excel document ISE230

File Processing vs. DBMS (2) Program‐Data Dependence All programs maintain metadata for each file they use Limited Data Sharing No centralized control of data Lengthy Development Times Programmers must design their own file formats Excessive Program Maintenance 80% of information systems budget Duplication of Data Different systems/programs have separate copies of the same data ISE230

Data Duplication Duplicate Data ISE230

Problems with Data Redundancy/Duplication Waste of space to have duplicate data Causes more maintenance headaches The biggest problem: Changes in one file could cause inconsistencies Compromise in data integrity ISE230

The Database Approach Central repository of shared data Data is managed by a controlling agent Stored in a standardized, convenient form Requires a Database Management System (DBMS) ISE230

Case Study – Qatar Petroleum QP is the largest operator in the state of Qatar QP had accumulated a tremendous amount of well log data in its 50 years of operation. Problems in manual indexing Lost data Difficulty in accessing data Inaccuracy of the stored logs caused by lack of validation Solution Web user interface on top of latest database integration (Schlumberger InfoStream) Results: Interpretation cycle reduced to 30% to 35% ISE230

The Range of Database Applications Backend for traditional “database” applications Personal databases Workgroup databases Departmental/divisional databases Enterprise database Multimedia database Scientific database Backend for large Websites Backend for Web services ISE230

Oracle Industry Applications ISE230 18

Pure Database Jobs in Pakistan ISE230 19

…and abroad SE230 20 I

Database Management System A software system that is used to create, maintain, and provide controlled access to user databases Order Filing System Central database Invoicing System DBMS Contains employee, order, inventory, pricing, and customer data Payroll System DBMS manages data resources like an operating system manages hardware resources ISE230

Elements of the Database Approach Data models Graphical system capturing nature and relationship of data Enterprise Schema–high‐level entities and relationships for the organization Project Schema–more detailed view, matching data structure in database or data warehouse Use of Internet Technology Client‐server, 3‐tier architectures, and distributed databases Database Applications Application programs used to perform database activities (create, read, update, and delete) for database users ISE230

Components of the Database Environment Data and Database Administrator System Developers End Users Case Tools Application Programming User Interface Repository DBMS Database ISE230

Components of the Database Environment CASE Tools–computer‐aided software engineering Repository–centralized storehouse of metadata Database Management System (DBMS) –software for managing the database Database–storehouse of the data Application Programs–software using the data User Interface–text and graphical displays to users Data/Database Administrators–personnel responsible for maintaining the database System Developers–personnel responsible for designing databases and software End Users–people who use the applications and databases ISE230

Functionality of DBMS Administrators and developers sees SQL, which has two components: Data Definition Language (DDL) Data Manipulation Language (DML) Behind the scenes the DBMS has: Query optimizer Query engine Storage management Transaction Management (concurrency, recovery) ISE230

New Trends in DB Systems Object‐relational databases Main memory database systems Extensible Markup Language (XML) Relational databases with XML support Middleware between XML and relational databases Native XML database systems Data integration Peer to peer, stream data management Semantic triple stores ISE230

Conclusion Summary Essential Reading What is Next? DBMS used to maintain, query large datasets. Benefits include recovery from system crashes, concurrent access, quick application development, data integrity and security. Levels of abstraction give data independence. A DBMS typically has a layered architecture. Essential Reading Modern Database Management (8th Ed.), Chapter 1 What is Next? Entity‐Relationship Model ISE230