Data Warehousing in the age of Big Data (2)

Slides:



Advertisements
Similar presentations
1 Use or disclosure of data contained on this sheet is subject to the restriction on the title page of this proposal or quotation. An Introduction to Data.
Advertisements

Data Warehouse Architecture Sakthi Angappamudali Data Architect, The Oregon State University, Corvallis 16 th May, 2005.
Chapter 9 DATA WAREHOUSING Transparencies © Pearson Education Limited 1995, 2005.
Data Warehouse/Data Mart Components Concepts Characteristics.
Enterprise Business Processes and Reporting (IS 6214) MBS MIMAS 19 th Jan 2011 Fergal Carton Business Information Systems.
Components and Architecture CS 543 – Data Warehousing.
DATA WAREHOUSING.
Business Intelligence System September 2013 BI.
Data Warehouse Toolkit Introduction. Data Warehouse Bill Inmon's paradigm: Data warehouse is one part of the overall business intelligence system. An.
Components of the Data Warehouse Michael A. Fudge, Jr.
© 2003, Prentice-Hall Chapter Chapter 2: The Data Warehouse Modern Data Warehousing, Mining, and Visualization: Core Concepts by George M. Marakas.
Plan Introduction What is Cloud Computing?
Streams – DataStage Integration InfoSphere Streams Version 3.0
Understanding Data Warehousing
Best Practices for Data Warehousing. 2 Agenda – Best Practices for DW-BI Best Practices in Data Modeling Best Practices in ETL Best Practices in Reporting.
K E Y : SW Service Use Big Data Information Flow SW Tools and Algorithms Transfer Application Provider Visualization Access Analytics Curation Collection.
Right In Time Presented By: Maria Baron Written By: Rajesh Gadodia
Plan  Introduction  What is Cloud Computing?  Why is it called ‘’Cloud Computing’’?  Characteristics of Cloud Computing  Advantages of Cloud Computing.
DATA MINING IN CLOUD COMPUTING Xxxxxxx -11/27/ DSCI 5240.
Datawarehouse A sneak preview. 2 Data Warehouse Approach An old idea with a new interest: Cheap Computing Power Special Purpose Hardware New Data Structures.
Data Warehouse. Group 5 Kacie Johnson Summer Bird Washington Farver Jonathan Wright Mike Muchane.
K E Y : SW Service Use Big Data Information Flow SW Tools and Algorithms Transfer Transformation Provider Visualization Access Analytics Curation Collection.
 Understand the basic definitions and concepts of data warehouses  Describe data warehouse architectures (high level).  Describe the processes used.
Two-Tier DW Architecture. Three-Tier DW Architecture.
Advanced Database Concepts
Banner ODS/EDW 1. OLTP Our Banner database instance is currently 350+ Gbytes in size and is comprised of several hundred tables that house Student, HR,
Superhero Power BI Peter Myers Bitwise Solutions.
Business Intelligence Overview. What is Business Intelligence? Business Intelligence is the processes, technologies, and tools that help us change data.
An Introduction To Big Data For The SQL Server DBA.
Abstract MarkLogic Database – Only Enterprise NoSQL DB Aashi Rastogi, Sanket V. Patel Department of Computer Science University of Bridgeport, Bridgeport,
Slide 1 Data Warehousing in CIM  2000 YourNameHere Data Warehousing in Computer Integrated Manufacturing Steve Daino IEM 5303.
Oracle Exalytics Business Intelligence Machine Eshaanan Gounden – Core Technology Team.
1 Cloud-Native Data Warehousing Bob Muglia. 2 Scenarios with affinity for cloud Gartner 2016 Predictions: By 2018, six billion connected things will be.
© 2013 Cloud Technology Partners, Inc. / Confidential 1 The Many Faces of PaaS Platform as a Service Decisions Mike Kavis 10/08/2013.
نمايندگي استان يزد. نمايندگي استان يزد طراحی کسب و کار الکترونیکی ارائه کننده : محسن افسر قره باغ.
Overview of Data Warehousing (DW) and OLAP
01-Business intelligence
Power BI Solutions for California Colleges
Introduction to Oracle Forms Developer and Oracle Forms Services
CLOUD ARCHITECTURE Many organizations and researchers have defined the architecture for cloud computing. Basically the whole system can be divided into.
Connected Infrastructure
EMC: Redefining ERP and ROI with a Virtualized SAP HANA® Deployment
Data Platform Modernization
Information Systems in Organizations
Introduction to Oracle Forms Developer and Oracle Forms Services
SQL 2016 new Hosting Offers Secure Database Hybrid HyperScale
Introduction to Oracle Forms Developer and Oracle Forms Services
Internet2 Cloud Integration Plans
Chapter 13 The Data Warehouse
Connected Infrastructure
Introduction to Data Warehousing
Data Warehousing and Data Mining By N.Gopinath AP/CSE
Data Warehouse.
Operationalize your data lake Accelerate business insight
Immersion Workshop Agenda
In-Class Activity… Cloud Computing.
Business Intelligence
Data Platform Modernization
Components of the Data Warehouse Michael A. Fudge, Jr.
انباره داده Data Warehouse
Logical Data Warehousing and Tableau 10
Data science and machine learning at scale, powered by Jupyter
An Introduction to Data Warehousing
3 Cloud Computing.
PRESENTER GUIDANCE: These charts provide data points on how IBM BaaS mid-market benefits a client with the ability to utilize a variety of backup software.
Data Warehousing Concepts
Big DATA.
Analytics, BI & Data Integration
AVAIL General Services, LLC.
Presentation transcript:

Data Warehousing in the age of Big Data (2) 2017. 5

Enterprise Data Warehouse Platform

Transactional systems (= OLTP systems) Source database The data life cycle is not more than a day or a week at a maximum Operational data store (ODS) optional architecture component and is used for operational reporting purposes an aggregation of the data from the transactional systems Staging area To gather data for data quality and data preparation exercises for loading data into the data warehouse.

Cloud Computing & DW Another option to create and deploy data warehouses, especially for small and midsize business groups to leverage cloud computing for both data and visualization infrastructure including analytics and reporting Benefits Cloud computing services are provided over the Internet and can be accessed from anywhere in the world. Cloud computing reduces business latencies when developing or testing applications. Cloud computing can simplify and reduce process complexities. Cloud computing abstracts the complexities of underlying infrastructure and creates simple plug and-play architecture. Cloud computing can provide an adequately secure environment to host any data deemed critical by the organization. Cloud computing provides you a complete platform and frees IT to keep the business running.

Clouding Computing & DW on-demand services 서버운영 서비스개발 환경 응용SW제공

Integration of Big Data & DW: data layer useful for data processing DW상에서의 분석, 탐사 결과 그 자체도 포함 correlation analysis cluster analysis prediction analysis … metadata integration analytics for exploration mining of unstructured data.

Integration of Big Data & DW: technology layer Different types of technologies that will be used to architect the next-generation data warehouse for supporting data processing of structured, semi-structured, and unstructured or Big Data.

Integration of Big Data & DW: integration layer analytics processing in the next-generation data warehouse platform contextualization !

Integration of Big Data & DW: integration layer

Integration of Big Data & DW: integration layer

Integration of Big Data & DW: visualization 추가 필요 domain 간 연관성 파악 ex) Tableau