Still a Toddler but growing fast

Slides:



Advertisements
Similar presentations
Business Intelligence Simon Pease. Experience with BI Developing end-to-end BI prototype for Plan International Developing end-to-end BI prototype for.
Advertisements

5 th Annual Conference on Technology & Standards April 28 – 30, 2008 Hyatt Regency Washington on Capitol Hill The Application of BI in Higher.
OLAP Services Business Intelligence Solutions. Agenda Definition of OLAP Types of OLAP Definition of Cube Definition of DMR Differences between Cube and.
Data Warehousing M R BRAHMAM.
Data Warehousing - 3 ISYS 650. Snowflake Schema one or more dimension tables do not join directly to the fact table but must join through other dimension.
COMP 578 Data Warehousing And OLAP Technology Keith C.C. Chan Department of Computing The Hong Kong Polytechnic University.
Data Warehousing at Notre Dame October 7, 2004 Dale Carter, Manager, Decision Support Jared Barnard, Database Administrator.
Microsoft Business Intelligence (BI). About Me Creating solutions for 20 years Traveling consultant at Glenture. Principal Consultant in Microsoft BI.
Components of the Data Warehouse Michael A. Fudge, Jr.
Jeremy Brinkman Director of Administrative Systems University of Northwestern Ohio Great Lakes Users’ Group Conference August 10-11,
Agenda Common terms used in the software of data warehousing and what they mean. Difference between a database and a data warehouse - the difference in.
OM. Brad Gall Senior Consultant
DATA WAREHOUSING IN SQL SERVER 2005/2008 BUSINESS INTELLIGENCE.
Data Warehouse Student Data User Group Meeting 1/29/2015.
Microsoft Business Intelligence Environment Overview.
Chapter 6 SAS ® OLAP Cube Studio. Section 6.1 SAS OLAP Cube Studio Architecture.
DATA DASHBOARDS USING MICROSOFT BI Dheeraj Chowdhury Group Leader Digital Media NSW Department of Education and Communities Curriculum and Learning Innovation.
 Business Intelligence Anthony DeCerbo Meaghan Duffy Steve Smith Warren Scoville.
BI Terminologies.
Carey Probst Technical Director Technology Business Unit - OLAP Oracle Corporation.
REPORTING RIGHT NOW WITH ARGOS JESSICA ASHBROOK – LANSING COMMUNITY COLLEGE BRIAN STEVENS – EVISIONS ACCOUNT EXECUTIVE.
CS 157B: Database Management Systems II April 3 Class Meeting Department of Computer Science San Jose State University Spring 2013 Instructor: Ron Mak.
Building Dashboards SharePoint and Business Intelligence.
Intro to Datazen.
What is OLAP?.
CS 157B: Database Management Systems II April 10 Class Meeting Department of Computer Science San Jose State University Spring 2013 Instructor: Ron Mak.
1 Copyright © 2008, Oracle. All rights reserved. I Course Introduction.
1 Copyright © 2009, Oracle. All rights reserved. I Course Introduction.
1 Copyright © 2009, Oracle. All rights reserved. Oracle Business Intelligence Enterprise Edition: Overview.
1 Copyright © 2008, Oracle. All rights reserved. Repository Basics.
Develop Business Intelligence Application with Microsoft SharePoint 2013 Author: Vo Duy Anh.
Extending and Creating Dynamics AX OLAP Cubes
It’s time to refresh your data in Power BI!
SQL Server Analysis Services Fundamentals
Serve as Director Funded by the Louisiana Department of Transportation and Development Developed LaCrash application to electronically capture crash.
Once Upon a Time: The Story of a Successful BI Implementation
Better Informed Academic Planning Using Student Flow Models
Let’s Build a Tabular Model in Azure
What’s new in SQL Server 2017 for BI?
Introduction to SQL Server Analysis Services
Data Warehousing CIS 4301 Lecture Notes 4/20/2006.
Data warehouse and OLAP
6/19/2018 © 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks.
Summit Nashville /23/ :38 PM
Data Warehouse.
Applying Data Warehouse Techniques
What is business intelligence?
Oracle Analytic Views Enhance BI Applications and Simplify Development
Introduction to tabular models
Introduction to tabular models
SQL Server Analysis Services Fundamentals
SQL Server Analysis Services Fundamentals
Enhance BI Applications and Simplify Development
TechEd /24/2018 6:19 AM © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered.
Data Warehouse Overview September 28, 2012 presented by Terry Bilskie
Applying Data Warehouse Techniques
DataMart (Data Warehouse) Tool:
Applying Data Warehouse Techniques
Data Modeling and Prototyping
Building your First Cube with SSAS
Power BI with Analysis Services
Applying Data Warehouse Techniques
Let’s Build a Tabular Model in Azure
Dashboard in an Hour Using Power BI
Analysis Services Analysis Services vs. the Data Warehouse vs. OLTP DB
Analytics, BI & Data Integration
Applying Data Warehouse Techniques
Implementing a Distributed Enterprise Architecture to Deliver BI
Implementing ETL solution for Incremental Data Load in Microsoft SQL Server Ganesh Lohani SR. Data Analyst Lockheed Martin
Data Modeling and Prototyping
Presentation transcript:

Still a Toddler but growing fast Fall 2013 Still a Toddler but growing fast It is all about the Process: The Users; The Sponsors; The Requirements; The Data; The Models; The Presentation layer; The Technology Fall 2015 Fall 2017 East Carolina University – Enterprise Analytics Ruben Villasmil - villasmilr@ecu.edu Beyond

The Users Office of the Provost Enrollment Services Institutional Planning, Assessment and Research Registrar Office Deans, Associate Deans Dean of Graduate School Director of Admissions Graduate School Program Directors UG Admissions Office Current Executive Summary Dashboard Total Registered Students equals SDM “career feed” Students for Open Enrollment Term

The Sponsors Registrar Office: Initial Commissioning – Fall 2013 – Ongoing Additions Dean of Graduate School: Key Functional User - Spring 2015 College of Arts and Sciences: Commissioning of Course Section – Spring 2016 College Of Business: Commissioning of Tailored Dashboard - Spring 2017 The Requirements (The need for the Dashboards): Collect and surface early registration and enrollment data Be able to compare enrollment to previous years and drill down to specific categories to include programs Collect and surface section enrollment data for Course Planning Surface ongoing operational data after census

The Requirements (Time Line) Initial Requirements Fall 2013 Data Collection Built Hist. Data Parameter Based reports Spring 2014 Setup SharePoint 2013 Infrastructure Reqd. For other ITCS projects Summer 2014 Leverage SharePoint Infrastructure Created 1st OLAP cube Prototype-Demo 1st Dashboard Fall 2014 Updated Dashboard Dean Of Graduate School Presents single dashboard to Dean’s Meeting Spring 2015 Go Live Dashboards (5 views) May 2015 Course Section Snapshots Course Section Based Cube Summer Cube Spring 2016 Updated Look and Feel all Dashboards New Summary Dashboard based on tabular technology Summer 2016 Sql Svr 2016 Infrastructure Real Time Section Enrollment Tabular Model and Dashboard Spring 2017 COB Dashboard Degreeworks Planner Dashboard WD Dashboards Summer 2017 Power BI On Premises Mobile Reports Fall 2017 Spring 2018 Who Knows NEXT 2018

The Data Over 100 million records and growing. (It does not include our Enterprise Operational Data Store ODS records : 1.8 Billion records)

The Data (Cont’d) Registration Snapshots * Live Since January 2014 : Collected over 50 million records: Includes enrollment data after census day Data is snapshot every morning at 6 am : About 30,000 records. Rebuilt registration history for Fall and Spring from Fall 2010 to Spring 2014: Over 22 million records rebuilt up to census day for each term. Developed Oracle Procedure to mine the registration audit table : Academic period , date and “time of date“ Procedure returns registered students and metadata necessary to build student record. Data accuracy 99.5% of original data (Based on summary comparisons of existing emails. Multiple Data Points). Residency and program information only elements unable to match 100%. Course Registration Data snapshot at the section level: Began collecting data on Spring 2016. Rebuilt CRN data for prior two years using same methodology as Registration Snapshot. Historical and newly collected data at the section level: Over 5+ million records. Admissions Application Snapshots Live since April 2015 - Over 21 million records collected. Data is collected 365 days prior to Beginning of Term (BoT) up to 10 days after (BoT) Note *: Registration Snapshot is similar to a combination of the SDM Career, Career program and Basic student feed

The Data (Cont’d) History Daily Controlled ETL to Load and Process data. Uses same infrastructure as Ellucian ODS (OWB/ODI) SSAS OLAP cube. Refreshes every day to Re-calculate the latest day Summary Table: Additional Attributes added. Program Crosswalks Appends the data for the latest day collected. (Select count(*) N, a, b, c, d from snapshots group by a, b, c, d). Recycles itself (via OWB/ODI ETL) at the beginning of a new registration term

The Data – Multi-Dimensional Model (Cont’d) Our Approach: SSAS OLAP cube: Avoid the “STAR” MS tools allow the cube to be built from physical Fact tables and Physical Dimensions (STAR Schema model) or from Edited Queries. We use a single “Edited Query” for each cube. Benefits: Avoid the need for physical dimensions, related sequences and triggers in the Oracle side. Consideration must be given to the amount of data to be processed to avoid performance Issues when processing the cube. Select from summary table Added attribute “latest” logic via case statement

The Data – Multi-Dimensional Model (Cont’d) Key attributes: “Days from Census” and “Registration Day”. Allows dashboard data to be presented from different perspectives. Model allows for natural hierarchies that are not time based. Allows previous and previous – n values. OLAP Data surfaced via Sql. Server Management Studio Dashboard surfacing OLAP data via Excel Services “Latest” attribute value is used to default the dashboard.

The Data – Multi-Dimensional Model : Currently 3 OLAP Cubes 18 Dimensions Multiple Measure Groups 20 Dimensions 10 measures 20 Dimensions 10 measures

The Data – Tabular Model Section Enrollment Cube You can import data from multiple sources, and then enrich the model by adding relationships, calculated tables and columns, measures, KPIs, hierarchies. Key benefits: - Easy to build - Allows for direct queries to Enterprise Data - Measures based on DAX - Data is surfaced to client tools same as Multi-Dimensional models Tabular Model The Summary Dashboard is based on a Tabular Model That combines the data from the Registration and Section Enrollment Cubes Registration Cube

The Presentation Layer Evolving : From parameter based reports to Interactive dashboards and Mobile Reports

The Presentation Layer (Cont’d) From Email Subscription Based Daily Report (Prior to Spring 2014) To a Parameter Based Report comparing current and previous Year data

The Presentation Layer (Cont’d) From Parameter Based Reports To Interactive Dashboards Using SharePoint 2013 Excel Services

(No credit hour information) The Presentation Layer (Cont’d) Summary Dashboard Ver. 1.0 Summer 2015 (No credit hour information) Summary Dashboard Ver. 2.0 Summer 2016

The Presentation Layer (Cont’d) From Dashboards Based on MS Excel Services To Dashboards on MS Power BI On-Premises Server and Mobile Reports Dashboards based on MS Power BI; Mobile Reports

The Technology MS BI Stack Architecture Oracle Data Appliance Oracle OWB/ODI tools and Ellucian ODS Software ECU Enterprise Data Warehouse (EDW): Oracle Data Appliance (RAC based) With Oracle Data Guard Physical Stand by (back-up site). Oracle OWB/ODI tools and MS SSIS tools for Loading into EDW Special Thanks to Keith Washer our BI Infrastructure Architect

Live Dashboards Dashboards based on MS Power BI; Mobile Reports