Workload Management BMO Financial Group Case Study IRMAC, January 2008 Sorina Faur, Database Development Manager.

Slides:



Advertisements
Similar presentations
An Overview of IBM Cognos 8 BI John Saldua Sr. Director, Management Reporting and Administrative Systems.
Advertisements

Presentationto BPM Partners Conference Tim Swindell 19 th April 2005.
SERVING CORPORATES AND INDIVIDUALS ©2012 BUSINESS REPORTING MANAGEMENT SERVICES, INC WELCOME.
Essbase Reporting Jim Kubik Senior Sales Consultant.
Data Warehousing M R BRAHMAM.
Advance Analytics Capabilities
Enter Date in Title Master Workload Management HBC Case Study IRMAC, January 2008 Shelley Perrior -DBA team lead.
WebSphere -DB2 Integration Web Browser Web Server (Apache) WebSphere –JSP/Servlet/EJB DB2 JDBC, SQL HTTP.
Metodi Quantitativi per Economia, Finanza e Management Lezione n°2.
Business Intelligence Dr. Mahdi Esmaeili 1. Technical Infrastructure Evaluation Hardware Network Middleware Database Management Systems Tools and Standards.
CS2032 DATA WAREHOUSING AND DATA MINING
Copyright © 2008 SAS Institute Inc. All rights reserved. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks.
Data Warehousing: Defined and Its Applications Pete Johnson April 2002.
Data Management Capabilities and Past Performance Dr. Srinivas Kankanahalli.
Workload management in data warehouses: Methodology and case studies presentation to Information Resource Management Association of Canada January 2008.
ACL Solutions for Continuous Auditing and Monitoring John Verver CA, CISA, CMC Vice President, Professional Services & Product Strategy ACL Services Ltd.
INTRODUCTION ON SAS ( Statistical Analysis Software) BY- R ajat PaL.
Russ Houberg Senior Technical Architect, MCM KnowledgeLake, Inc.
What is Business Intelligence Business Intelligence (BI) encompasses the processes, tools, and technologies required to transform enterprise data into.
LOGO Business Intelligence System Mr. Natapong Wongprommoon Solution Architect G-ABLE Company Limited
Customer Relationship Management Wagner & Zubey 11 Copyright (c) 2006 Prentice-Hall. All rights reserved. Copyright 2007 Thomson Publishing: All Rights.
Corporate Profile Contact Arvind Verma
Efficient BI Solution Presented by: Leo Khaskin, PowerCubes Lab Value of Information as Business Asset.
COGNOS INC. Eddie Haizlip Danny Roach Greg Sparks.
BIG DATA OFF-SHORE SERVICES:. Off-Shore “Big Data” Center: Modern Facilities in Bangalore’s Central Business District 60,000 Sqft. Space  Capacity for.
Chapter 1 Course Orientation. Outline Definition of data source management Definition of data source management Importance data source management to organization.
SharePoint 2010 Business Intelligence Module 2: Business Intelligence.
Chapter 5 Lecture 2. Principles of Information Systems2 Objectives Understand Data definition language (DDL) and data dictionary Learn about popular DBMSs.
M icrosoft Data Warehousing - SQL Server State of the Technology Presentation by Sujata Angara Nakul Johri Sang Ho Park.
Copyright © 2003, SAS Institute Inc. All rights reserved. Company confidential - for internal use only 1 Know Your Customers SAS® Banking Intelligence.
IBM Start Now Business Intelligence Solutions. Agenda Overview of BI Who will buy and why Start Now BI solution Benefit to customer.
OBJECTARENA Staffing/Professional Services. OBJECTARENA Staffing Offering | December, 2007 © 2007 OBJECTARENA INC 2 OA Education offering World Wide.
Dashboard & Scorecard Case Study. Introduction Hagemeyer Case Study – Background – Situation – Strategic CPM Vision – Solution – Benefits Assimil8 Overview.
Object Arena overview  OAOT is a premier provider of outsourced Information Technology (IT) services supporting Several Fortune 500 companies on a global.
ISQS 3358 Business Intelligence 1 ISQS 3358, Business Intelligence Introduction Zhangxi Lin Texas Tech University 1.
© Evoque Technologies Introduction to Evoque Technologies Who we are | Resources | Service Offerings | Methodologies.
Business Intelligence Zamaneh Jahed. What is Business Intelligence? Business Intelligence (BI) is a broad category of applications and technologies for.
Faster and Smarter Data Warehouses with Oracle OLAP 11g.
Data warehousing and online analytical processing- Ref Chap 4) By Asst Prof. Muhammad Amir Alam.
Managing Knowledge in Business Intelligence Systems Dr. Jan Mrazek.
 Business Intelligence Anthony DeCerbo Meaghan Duffy Steve Smith Warren Scoville.
Data Warehousing Lecture-2 Introduction and Background 1.
5 - 1 Copyright © 2006, The McGraw-Hill Companies, Inc. All rights reserved.
Datawarehouse A sneak preview. 2 Data Warehouse Approach An old idea with a new interest: Cheap Computing Power Special Purpose Hardware New Data Structures.
Agenda  What is Business Intelligence ?  Why do organisations use it?  BI tools overview.
Unlocking the Business Value of Information for Competitive Advantage
© 2009 IBM Corporation Maximize Cost Savings While Improving Visibility Into Lines of Business Wendy Tam, CDC Product Marketing Manager
SAM for SQL Workloads Presenter Name.
SQL Server 2008 Analysis Services. END USER TOOLS & PERFORMANCE MANAGEMENT APPS Excel PerformancePoint Server BI PLATFORM SQL Server Reporting Services.
Presenter : Ahmed M. Mosa User Group : SQLHero. Overview  Where is BI in market trend  Information Overload  Business View  BI Stages  BI Life Cycle.
Data Warehousing 101 Howard Sherman Director – Business Intelligence xwave.
Deploying BI to the Enterprise Toronto Area Users Group Sept Tim Quigg inbusiness solutions.
D E P A R T M E N T O F COMPUTER SCIENCE AND SYSTEMS ANALYSIS SCHOOL OF ENGINEERING & APPLIED SCIENCE O X F O R D O H I O MIAMI UNIVERSITY Business Intelligence.
1 Copyright © Oracle Corporation, All rights reserved. Business Intelligence and Data Warehousing.
MBA/1092/10 MBA/1093/10 MBA/1095/10 MBA/1114/10 MBA/1115/10.
The Concepts of Business Intelligence Microsoft® Business Intelligence Solutions.
Moving To Business Objects XI – Release 2 Presented to Business Objects User Group Rich Strout October 20, 1006.
© 2009 Oracle Corporation – Proprietary and Confidential Agenda Reporting Overview Performance Workspace Dashboards Reports Drill thru Smartview Excel.
Data Management Capabilities and Past Performance
Workload-Management für komplexe Data Warehousing Umgebungen
Object Arena overview Object Arena is a premier provider of outsourced Information Technology (IT) services supporting Several Fortune 500 companies on.
Segmap Solutions Mapping segments.
How Coremetrics is Priced
The Self-Service Business Intelligence Suite
DWE Software Offerings V9.1.2
What is the Value of an IBM Balanced Warehouse™
Delivering an End-to-End Business Intelligence Solution
Kovaion Consulting IT Services Portfolio Date : Apr-2015
Data Warehouse and OLAP Technology
Presentation transcript:

Workload Management BMO Financial Group Case Study IRMAC, January 2008 Sorina Faur, Database Development Manager

BMO Information Governance & Quality BMO Information Management 1  Corporate and presenter background  WLM case study  System profile  Business goals  WLM configuration  Other points Agenda

BMO Information Governance & QualityBMO Information Management 2 Founded in 1817 as Bank of Montreal, Canada’s first bank: BMO Financial Group is a highly diversified financial services provider. BMOFG offers clients a broad range of personal, commercial, corporate and institutional financial services across Canada and in the United States through BMO Bank of Montreal, BMO Nesbitt Burns, Harris Nesbitt and our Chicago-based subsidiary, Harris Bank. Total assets of $306 Billion at January 31, 2006 More than 33,000 employees Corporate Overview: BMO Financial Group

BMO Information Governance & QualityBMO Information Management 3  Award Winning Center of Competence for the Data Warehousing and Business Intelligence Solutions in BMO Financial Group  Develop & manage core data warehouse and data marts environment 10+ years of experience  Manage Business Intelligence competency across our various Bank businesses  Provide and ensure information governance and quality standards are in place across the enterprise  150+ staff, 100+ contractors Information Management Group at BMO Financial Group

BMO Information Governance & QualityBMO Information Management 4  Database Development Manager in Information Management Group. The team of 12 DBAs, provides support for Data Warehouse and Datamart environments varying from 100 GB to 10 TB of data for BMO Financial Group.  Area of expertise includes performance tuning and database design of large databases for BI applications.  IBM Certified Advanced Database Administrator  IBM Certified Solution Designer – DB2 Business Intelligence Presenter Background

BMO Information Governance & QualityBMO Information Management 5  1 Data Warehouse  20+ Data Marts  40+ source system feeds  Supporting multiple lines of businesses  Canada and US  Customer profitability, Marketing, Campaign management  Finance Profitability & Reporting  Risk Management & Basel  Fraud Detection & Anti-Money Laundering  Statutory Reporting BMO Information Management Environment

BMO Information Governance & QualityBMO Information Management 6 BMO IM Technical Production Environment   BCU – Balance Configuration Unit   8 data nodes (60 TB disk)   2 admin nodes   Servers   6 P690 (16CPU to 32CPU)   3 P595 (16CPU to 48CPU)   Disk Subsystems   IBM ( total 100 TB)   EMC   DBMSs   DB2 ESE PDF V8.2, 9.1   Oracle   SQL Server   Data Integration…   Ab Initio for ETL   Informatica for ETL   IBM Intelligent Miner Scoring   Peoplesoft   Promod for DB2   Trillium   Information Access   Microstrategy, SAS   MS Access, MS Excel, MS Reporting Services   Web Focus, Cognos   UNICA, Crystal Reports   Metadata   CA Metadata Repository

BMO Information Governance & QualityBMO Information Management 7  “NEWDB” database on new BCU platform  Next generation data warehouse platform  Consolidates legacy stand-alone data marts  Addresses emerging business needs  Business details  Customer Environment Insight include the following business units: Customer profitability analysts Customer segmentation and modeling analysts Marketing and campaign management staff  Technology details  DB2 LUW 9.5, including new WLM capability IBM BCU platform 64+8 CPU, 60 TB storage System Profile

BMO Information Governance & QualityBMO Information Management 8  1. Allocate limited resources among multiple business units  2. Change resource allocation on a schedule according to day of month  3. Protect against extremely high cost inefficient queries  4. Prevent excessive concurrency of large queries from monopolizing the system Business Goals

BMO Information Governance & QualityBMO Information Management 9  WLM in DB2 9.5  Part of the database engine  Define work categories by application, user group, user ID  Define execution environments and route work categories to its execution environments (DB2 service classes and AIX service classes)  Control and monitor execution environments via thresholds.  BMO WLM configuration  Work categories (with different WLM controls) One category per business unit (so can control each one separately)  Controls per work category: Set a target number of CPU shares per group (for Goal 1) Increase CPU share for a business unit on days when it has high priority reports (for Goal 2)  Database-wide controls: Set a threshold to stop requests that exceed a very high estimated cost (for Goal 3) Set a concurrency limit on large queries (for Goal 4) WLM Implementation

BMO Information Governance & QualityBMO Information Management 10  Strong relationship between WLM and Monitoring  Business not aware of resource consumption by different dimensions: Time hierarchy Application and application hierarchy including ad-hoc vs pre- defined work, data mining tools vs reporting User and user hierarchy including roll up by business unit Workload complexity  Need to understand resource usage patterns  Collect and analyze data for optimization opportunities  Collect and analyze data for capacity planning and forecasting Other Points