DWH-Ahsan Abdullah 1 Data Warehousing Lab Lect-2 Lab Data Set Virtual University of Pakistan Ahsan Abdullah Assoc. Prof. & Head Center for Agro-Informatics.

Slides:



Advertisements
Similar presentations
ZEIT2301 Design of Information Systems Multi-Table Queries in SQL School of Engineering and Information Technology Dr Kathryn Merrick.
Advertisements

Lecture-19 ETL Detail: Data Cleansing
Data Warehousing 1 Lecture-25 Need for Speed: Parallelism Methodologies Virtual University of Pakistan Ahsan Abdullah Assoc. Prof. & Head Center for Agro-Informatics.
DWH-Ahsan Abdullah 1 Data Warehousing Lecture-5 Types & Typical Applications of DWH Virtual University of Pakistan Ahsan Abdullah Assoc. Prof. & Head Center.
Metadata Management – Our Journey Thus Far
DWH-Ahsan Abdullah 1 Data Warehousing Lab Lect-1 DTS: Introduction Virtual University of Pakistan Ahsan Abdullah Assoc. Prof. & Head Center for Agro-Informatics.
Lecture-33 DWH Implementation: Goal Driven Approach (1)
Dr Derek Peacock14/08/20151 Database Design 1:1 Relationships Dr Derek Peacock.
Databases. Objectives Define what a database is. Understand the difference between a flat and relational database Design and create a relational database.
Lecture-1 Introduction and Background
Relational Database Need to Knows. What is a database? Data - is just a pile of numbers or stats. A business "organises" the data to be meaningful and.
ACCOUNTS It is important to activate ( and check your WIU regularly. Financial Aid information, mid-term and semester grades,
Ahsan Abdullah 1 Data Warehousing Lecture-12 Relational OLAP (ROLAP) Virtual University of Pakistan Ahsan Abdullah Assoc. Prof. & Head Center for Agro-Informatics.
Ahsan Abdullah 1 Data Warehousing Lecture-17 Issues of ETL Virtual University of Pakistan Ahsan Abdullah Assoc. Prof. & Head Center for Agro-Informatics.
Architecture for a Database System
Distribution of Marks For Second Semester Internal Sessional Evaluation External Evaluation Assignment /Project QuizzesClass Attendance Mid-Term Test Total.
Ahsan Abdullah 1 Data Warehousing Lecture-11 Multidimensional OLAP (MOLAP) Virtual University of Pakistan Ahsan Abdullah Assoc. Prof. & Head Center for.
Data Warehousing 1 Lecture-24 Need for Speed: Parallelism Virtual University of Pakistan Ahsan Abdullah Assoc. Prof. & Head Center for Agro-Informatics.
DWH-Ahsan Abdullah 1 Data Warehousing Lecture-37 Case Study: Agri-Data Warehouse Virtual University of Pakistan Ahsan Abdullah Assoc. Prof. & Head Center.
1 Data Warehousing Lecture-13 Dimensional Modeling (DM) Virtual University of Pakistan Ahsan Abdullah Assoc. Prof. & Head Center for Agro-Informatics Research.
More on relational databases, including 1 to 1, 1 to many and many to many relationships Please use speaker notes for additional information!
Ahsan Abdullah 1 Data Warehousing Lecture-7De-normalization Virtual University of Pakistan Ahsan Abdullah Assoc. Prof. & Head Center for Agro-Informatics.
DWH-Ahsan Abdullah 1 Data Warehousing Lecture-4 Introduction and Background Virtual University of Pakistan Ahsan Abdullah Assoc. Prof. & Head Center for.
Ahsan Abdullah 1 Data Warehousing Lecture-18 ETL Detail: Data Extraction & Transformation Virtual University of Pakistan Ahsan Abdullah Assoc. Prof. &
Ahsan Abdullah 1 Data Warehousing Lecture-9 Issues of De-normalization Virtual University of Pakistan Ahsan Abdullah Assoc. Prof. & Head Center for Agro-Informatics.
Data Warehousing 1 Lecture-28 Need for Speed: Join Techniques Virtual University of Pakistan Ahsan Abdullah Assoc. Prof. & Head Center for Agro-Informatics.
Data Warehousing Lecture-1 1. Introduction and Background 2.
1 Data Warehousing Lecture-14 Process of Dimensional Modeling Virtual University of Pakistan Ahsan Abdullah Assoc. Prof. & Head Center for Agro-Informatics.
Presented By: Gail Rose-Innes Camps Bay High School ICT & CAT Department Microsoft Access 2010.
Ahsan Abdullah 1 Data Warehousing Lecture-20 Data Duplication Elimination & BSN Method Virtual University of Pakistan Ahsan Abdullah Assoc. Prof. & Head.
DWH-Ahsan Abdullah 1 Data Warehousing Lecture-2 Introduction and Background Virtual University of Pakistan Ahsan Abdullah Assoc. Prof. & Head Center for.
Ahsan Abdullah 1 Data Warehousing Lecture-10 Online Analytical Processing (OLAP) Virtual University of Pakistan Ahsan Abdullah Assoc. Prof. & Head Center.
Chapter 1 1 Lecture # 1 & 2 Chapter # 1 Databases and Database Users Muhammad Emran Database Systems.
E-R model for Exercise #1 Comments: 1. There is a lot of process, or data flow information in this description that will not be modeled in the E-R diagram,
Data Warehousing Lecture-31 Supervised vs. Unsupervised Learning Virtual University of Pakistan Ahsan Abdullah Assoc. Prof. & Head Center for Agro-Informatics.
Ahsan Abdullah 1 Data Warehousing Lecture-16 Extract Transform Load (ETL) Virtual University of Pakistan Ahsan Abdullah Assoc. Prof. & Head Center for.
ABCTools Ken Barbour NC DPI Symposium What is ABCTools? PC-based application Data management tool Reporting tool Historical Audits Exit Standards.
1 Data Warehousing Lecture-15 Issues of Dimensional Modeling Virtual University of Pakistan Ahsan Abdullah Assoc. Prof. & Head Center for Agro-Informatics.
Data Warehousing Lecture-30 What can Data Mining do? Virtual University of Pakistan Ahsan Abdullah Assoc. Prof. & Head Center for Agro-Informatics Research.
DWH-Ahsan Abdullah 1 Data Warehousing Lecture-29 Brief Intro. to Data Mining Virtual University of Pakistan Ahsan Abdullah Assoc. Prof. & Head Center.
DWH-Ahsan Abdullah 1 Data Warehousing Lecture-22 DQM: Quantifying Data Quality Virtual University of Pakistan Ahsan Abdullah Assoc. Prof. & Head Center.
School of Computer and Information Sciences SPRING Advising, Scheduling, and Registration.
Introduction to Databases CISC Where would you find info about yourself stored in a computer? College Physician’s office Library Grocery Store Dentist’s.
School of Computer and Information Sciences Transfer Advising, Scheduling, and Registration.
Copyright© 2014, Sira Yongchareon Department of Computing, Faculty of Creative Industries and Business Lecturer : Dr. Sira Yongchareon ISCG 6425 Data Warehousing.
Ahsan Abdullah 1 Data Warehousing Lecture-6Normalization Virtual University of Pakistan Ahsan Abdullah Assoc. Prof. & Head Center for Agro-Informatics.
Students Data To be Submitted to IT team by 30 th January, 2009.
Ahsan Abdullah 1 Data Warehousing Lecture-8 De-normalization Techniques Virtual University of Pakistan Ahsan Abdullah Assoc. Prof. & Head Center for Agro-Informatics.
1 Family Education Rights & Privacy Act (FERPA) Training University of Kentucky Registrar’s Office.
DWH-Ahsan Abdullah 1 Data Warehousing Lecture-21 Introduction to Data Quality Management (DQM) Virtual University of Pakistan Ahsan Abdullah Assoc. Prof.
2b. Create an Access Database Lingma Acheson Department of Computer and Information Science IUPUI CSCI N207 Data Analysis with Spreadsheets 1.
Lecture-3 Introduction and Background
Introduction to Database Systems
The Relational Model.
Creates the file on disk and opens it for writing
Databases Chapter 16.
Introduction to Computing
Lecture-32 DWH Lifecycle: Methodologies
Fall/Spring Enrollment
Hierarchy of Data in a Database
CIS 336 STUDY Lessons in Excellence-- cis336study.com.
Creates the file on disk and opens it for writing
Lecture-38 Case Study: Agri-Data Warehouse
CS4222 Principles of Database System
Database Management System
Lecture-35 DWH Implementation: Pitfalls, Mistakes, Keys
A paired-samples t-test compares the means of two related sets of data to see if they differ statistically. IQ Example We may want to compare the IQ scores.
The Power of Partnership in Addressing STEM Outcomes
Database Management Systems
JTLS 6.0 View Data Files In Excel
Presentation transcript:

DWH-Ahsan Abdullah 1 Data Warehousing Lab Lect-2 Lab Data Set Virtual University of Pakistan Ahsan Abdullah Assoc. Prof. & Head Center for Agro-Informatics Research FAST National University of Computers & Emerging Sciences, Islamabad

DWH-Ahsan Abdullah 2 Multi-Campus University

DWH-Ahsan Abdullah 3 Degree Programs

DWH-Ahsan Abdullah 4 Disciplines for BS

DWH-Ahsan Abdullah 5 Disciplines for MS

DWH-Ahsan Abdullah 6 The need  Head Office wants a central data repository for decision support i.e. a DWH

DWH-Ahsan Abdullah 7 Students Record Keeping & Mgmt.

DWH-Ahsan Abdullah 8 Data from Lahore Campus

DWH-Ahsan Abdullah 9 Data from Lahore Campus: Sample

DWH-Ahsan Abdullah 10 Lahore: Header of Student Table  SID  St_Name  Father_Name

DWH-Ahsan Abdullah 11 Lahore: Header of Student Table  Gender  Address  [Date of Birth]  [Reg Date]

DWH-Ahsan Abdullah 12 Lahore: Header of Student Table  [Reg Status]  [Degree Status]  [Last Degree]

DWH-Ahsan Abdullah 13 Lahore: Header of Course Reg. Table  SID  Degree  Semester  Course  Marks  Discipline

DWH-Ahsan Abdullah 14 Lahore: Facts About Data

DWH-Ahsan Abdullah 15 Data from Karachi Campus

DWH-Ahsan Abdullah 16 Data from Karachi Campus: Sample

DWH-Ahsan Abdullah 17 Karachi: Header of Student Table  St_ID  Name  Father  DoB  M/F  DoReg  RStatus  DStatus  Address  Qualification

DWH-Ahsan Abdullah 18 Karachi: Header of Course Reg. Table  SID:  Courses  Score  Sem  Disp Degree (BS/MS) is missing because separate books are maintained, but the issue is critical while loading data Degree (BS/MS) is missing because separate books are maintained, but the issue is critical while loading data

DWH-Ahsan Abdullah 19 Karachi: Facts About Data

DWH-Ahsan Abdullah 20 Data from Islamabad Campus

DWH-Ahsan Abdullah 21 Data from Islamabad Campus: Sample

DWH-Ahsan Abdullah 22 Islamabad: Header of Student Table  Roll Num  Name  Father  Reg Date  Reg Status  Degree Status  Date of Birth  Education  Gender  Address

DWH-Ahsan Abdullah 23 Islamabad: Header of Course Reg. Table  Roll Num:  Course  Marks  Discipline  Session Degree (BS/MS) is missing, whereas same table contains records for both. Only way to differentiate is through discipline attribute. Degree (BS/MS) is missing, whereas same table contains records for both. Only way to differentiate is through discipline attribute.

DWH-Ahsan Abdullah 24 Islamabad: Facts About Data

DWH-Ahsan Abdullah 25 Exercise

DWH-Ahsan Abdullah 26 Problems with Adhoc Approach

DWH-Ahsan Abdullah 27 LAHORE KARACHI ISLAMABAD PESHAWAR Text Files Excel Book MS-ACCESS Text Files Uses Problem-1: Non-Standard data sources

DWH-Ahsan Abdullah 28 Problem-2: Non-standard attributes

DWH-Ahsan Abdullah 29 Problem-3: Non Normalized database

DWH-Ahsan Abdullah 30 Notepad: Issues

DWH-Ahsan Abdullah 31 MS-Excel: Issues

DWH-Ahsan Abdullah 32 MS-Access: Issues

DWH-Ahsan Abdullah 33 Problem Statement

DWH-Ahsan Abdullah 34 Data from Peshawar Campus  Data at Peshawar campus is stored in Text files  To store data regarding one complete batch 2 text files are used  Lhr_Student_batch (Student record)  Lhr_Detail_batch (Course Reg. record)  22 text files for 11 BS batches  8 text files for 4 MS batches

DWH-Ahsan Abdullah 35 Data from Peshawar Campus: Sample

DWH-Ahsan Abdullah 36 Peshawar: Header of Student Table  Reg#: Student identity  Name: Student name  Father: Father name  Address: Permanent address  Date of Birth: Date of Birth  lastDeg: Last degree achieved  Reg Date: Date of Enrollment  Reg Status: Status of Enrollment (A/T)  Degree Status: Status of Degree (C/I)

DWH-Ahsan Abdullah 37 Peshawar: Header of Course Reg. Table  Reg#:  Courses: Course code  Score: Out of 100  Program: CS/TC/SE/CE  Sem: Fall/Spring  Year: YYYY e.g We need to identify semester session (fall04) through combination of Sem and Year We need to identify semester session (fall04) through combination of Sem and Year