Download presentation
Presentation is loading. Please wait.
Published byEugenia Baldwin Modified over 9 years ago
1
2012 © Trivadis BASEL BERN LAUSANNE ZÜRICH DÜSSELDORF FRANKFURT A.M. FREIBURG I.BR. HAMBURG MÜNCHEN STUTTGART WIEN TechTalk Hochperformante und kostengünstige Data Warehouse Systeme Meinrad Weiss 09.05.2012 Hochperformante und Kostengünstige Data Warehouse Systeme 1
2
2012 © Trivadis AGENDA 1.Introduction Microsoft Appliances 2.Overview Microsoft Data Warehousing Solutions 3.FastTrack 4.“Case Study” 5.Concrete Offerings 09.05.2012 Hochperformante und Kostengünstige Data Warehouse Systeme 2
3
2012 © Trivadis Accelerate time to value, And optimized Systems Custom-built solution Integrated, optimized appliance 1 4 2 3 6 5 Weeks Design Build Deploy Use Acquire appliance Extract data from existing MS apps Choose appliance for workload Install appliance Stand-up in production Extract and manipulate data Generate reports Make decisions Manage and adapt Weeks Extract and manipulate data Define architecture Acquire SW, HW Evaluate options Install components Assess workload Load data Test with POC Balance SW, HW Integrate in environment Monitor and troubleshoot Generate reports Make decisions Design Build Deploy Use 1 12+ 4 8 12+ Months Months 09.05.2012 3 Hochperformante und Kostengünstige Data Warehouse Systeme
4
2012 © Trivadis Microsoft Data Warehousing Solutions Scalable and reliable platform for data warehousing on any hardware Reference Architectures offering best price performance for data warehousing Scalable and reliable platform for data warehousing on any hardware Appliance for high-end data warehousing requiring highest scalability, performance, or complexity Ideal for data marts or small to mid-sized EDWs Ideal for data marts or small to mid-sized DWs with scan- centric workloads Ideal for large data marts or mid-sized EDWs Offers flexibility in hardware and architecture Software only Reference Architectures (software and hardware) Software only DW appliance (fully integrated software and hardware) Scale-up DW Scale-out DW with MPP 10s of TB 2 – 80 TB 10s of TB 10s - 100s of TB 09.05.2012 4 Hochperformante und Kostengünstige Data Warehouse Systeme
5
2012 © Trivadis Data Warehouse – Products Positioning 1 1 2 2 3 3 Minimal HW tune- up/optimization; supports mixed workloads Balanced solution for mostly scan-centric workloads. Max HW tune-up for most DW scenarios. 4 4 Most flexible architecture for handling all DW scenarios. Scale Complexity HA by default SW-HW integration SQL Server 2008 R2 Fast Track SQL Server 2008 R2 Enterprise PDW SQL Server 2008 R2 Data Center 1 1 2 2 3 3 4 4 PDW with Distributed Data Architecture 09.05.2012 5 Hochperformante und Kostengünstige Data Warehouse Systeme
6
2012 © Trivadis Some (SQL) Data Warehouses today Big SAN Big 64-core Server Connected together What’s wrong with this picture? 09.05.2012 6 Hochperformante und Kostengünstige Data Warehouse Systeme
7
2012 © Trivadis Answer: system out of balance Such servers can consume 16 GB/Sec of IO, but the SAN can only deliver 2 GB/Sec Even when the SAN is dedicated to the SQL Data Warehouse, which it often isn’t Lots of disks for Random IOPS BUT Limited controllers Limited IO bandwidth System is typically IO bound Data Load and queries are slow Huge impact from and to other applications Result: significant investment, not delivering performance 09.05.2012 7 Hochperformante und Kostengünstige Data Warehouse Systeme
8
2012 © Trivadis The Alternative: FastTrack or A Balanced System Design a server + storage configuration that can deliver all the IO bandwidth that CPUs can consume when executing a SQL Relational DW workload Avoid sharing storage devices among servers Avoid overinvesting in disk drives Focus on scan performance, not IOPS Layout and manage data to maximize range scan performance and minimize fragmentation 09.05.2012 8 Hochperformante und Kostengünstige Data Warehouse Systeme
9
2012 © Trivadis SQL Server Fast Track Data Warehouse A method for designing a cost-effective, balanced system for Data Warehouse workloads Reference hardware configurations developed in conjunction with hardware partners using this method Best practices for data layout, loading and management Relational Database Only – Not SSAS, IS, RS - Well, may be also SSAS 09.05.2012 9 Hochperformante und Kostengünstige Data Warehouse Systeme
10
2012 © Trivadis Fast Track Data Warehouse Components 10 Software: SQL Server 2008 Enterprise Windows Server 2008 Hardware: Tight specifications for servers, storage and networking ‘Per core’ building block Configuration guidelines: Physical table structures Indexes Compression SQL Server settings Windows Server settings Loading 09.05.2012 Hochperformante und Kostengünstige Data Warehouse Systeme
11
2012 © Trivadis Case Study Swiss customer in energy trading business with: ca. 2 TB data ~ 4 GB new data/day Traditional server infrastructure with SAN storage Main pain points: High costs Bad data load performance Varying load and query performance 09.05.2012 Hochperformante und Kostengünstige Data Warehouse Systeme 11 Fast Track
12
2012 © Trivadis System Comparison 09.05.2012 Hochperformante und Kostengünstige Data Warehouse Systeme 12 ResourceType#Comment ServerHP BL685C G62Failover Cluster CPUAMD 6Core, 2.4Ghz424 Cores per Server Memory256GB256 GB per Server StorageShared Storage XP 12000 Including Replication to second Datacenter OSWindows Server 2008 SQL ServerSQL Server 2008SP1 ResourceType#Comment ServerHP DL380 G71 FastTrack DW Reference Architecture CPUIntel X5680 6 Core 3.33 Ghz212 cores per server Memory96GB StorageDirect Attached Storage 48 Data Discs Raid-10 Total 13 TB raw capacity OSWindows Server 2008 R2 SQL ServerSQL Server 2008 R2SP1 Old Infrastructure FastTrack System
13
2012 © Trivadis Balanced System Details System-Test with SQLIO Ø 3.25 GB/sec Scan Rate (3.34 GB/sec theoretical Scan Rate) 09.05.2012 Hochperformante und Kostengünstige Data Warehouse Systeme 13 12 * 4 * 300 GB (600 GB) 10K SAS 2.5 SFF DP HDD = Total 48 Data Discs 12 * 4 * 300 GB (600 GB) 10K SAS 2.5 SFF DP HDD = Total 48 Data Discs
14
2012 © Trivadis Migration, Final Comparison and Conclusion Easy application migration via Backup/Restore Existing data files distributed over the 12 mount points Partition process modified to allocate 12 files for each day (partition) 09.05.2012 Hochperformante und Kostengünstige Data Warehouse Systeme 14 Configuration Old Server Fast Track Memory GB25696 CPU Cores2412 DB Tests Perf. Factor (Tests B,C,F)100207 ROI in 12 Months
15
FAST TRACK REFERENCE ARCHITECTURE 3.0 Mark Wunderli Infra2Apps Technology Consultant Hewlett-Packard (Switzerland) GmbH mark.wunderli@hp.com
16
Fast Track Data Solution at a glance A range of proven configurations to accelerate deployment and optimize results 80% Faster report generation 95% Faster system queries than legacy DW $600K Savings on hardware annually 50% Faster deployment 2FTEs Redirected for innovation 10x Savings on storage consumption 1609.05.2012Hochperformante und Kostengünstige Data Warehouse Systeme
17
Fast Track Reference Architecture 3.0 1709.05.2012Hochperformante und Kostengünstige Data Warehouse Systeme
18
Configurations to scale from 1TB to 80 TBs Prescriptive guidance and optimized methodology for deployment – Targeted at query workloads patterned for large sequential data reads Balanced HW approach ideal for data marts – Fast Track Reference Architectures: 1– 80TB Leading price/performance metrics Configurations, tested performance guidance, and best practices – HP Sizer for Microsoft SQL Server Fast Track Data Warehouse Custom support The choice is yours! Broadest range of solutions to meet your data warehousing needs Entry Ref. Arch. ProLiant DL370 (2P) Internal disks (5.5 TB*) Expansion (14 TB*) Basic Ref. Arch. ProLiant DL38x (2P) MSA P2000 G3 (Rec. Capacity 20 TB*) Mainstream Ref. Arch. ProLiant DL58x (4P) MSA P2000 G3 (Rec. Capacity 40 TB*) Premium Ref. Arch. ProLiant DL980 (8P) MSA P2000 G3 (Rec. Capacity: 80 TB*) 18 * recommended data capacity with a 3.5X compression
19
Server: HP ProLiant DL 580 G7 with 4 x 8-core Intel Xeon Storage: HP P2000 G3 Recommended User Capacity: 40 TB 4P: 32 core, 192T GB – 1 TB RAM Server: HP ProLiant DL980 G7 with 8 x 8-core Intel Xeon Storage: HP P2000 G3 Recommended User Capacity: 80 TB Premium SMP: 8- Socket Processor Configuration Mainstream SMP: 4- Socket Processor Configuration HP SQL Server Fast Track 3.0 8p; 64 core, 512 GB - 2TB RAM 19 Server: HP ProLiant DL380 G7 with 2 x 12-core Intel Storage: HP P2000 G3 Recommended User Capacity: 20 TB Basic SMP: 2- Socket Processor Configuration 2P: 12 core, 96 – 384 GB RAM Data Warehousing Continuum – Intel options
20
Server: HP ProLiant DL385 G7 with 2 x 12-core AMD Opteron Storage: HP P2000 G3 Recommended User Capacity: 20 TB Server: HP ProLiant DL 585 G7 with 4 x 12-core AMD Opteron Storage : HP P2000 G3 Recommended User Capacity: 40 TB 2p; 24 core, 96 – 512 GB RAM HP SQL Server Fast Track 3.0 Data Warehousing Continuum – AMD options Mainstream SMP: 4- Socket Processor Configuration Basic SMP: 2- Socket Processor Configuration 4p; 48 core, 192 GB – 1 TB RAM 20
21
Greater scalability support and increased throughput for Fast Track queries HP StorageWorks P2000 G3 FC MSA 21 Allows dual reads Enables 450 MB/s throughput per storage volume Architecture optimized for sequential reads Achieves throughput equivalent to 2-3X drives in non-optimized High data capacity, supporting 149 SFF drives SFF
22
Freeing up IT, getting more value Without HP Factory Express: Complexity Confusion Slow time to solution With HP Factory Express: Faster time to solution More available IT resources Maximized IT investment 22
23
Choose the service level that best meets your business needs Care Pack Services −Support for HP hardware and software, as well as Microsoft software - 3 year 24x7 Proactive 24 Service −Integrated HW and SW support including proactive and reactive services to improve stability and availability across IT environment Critical Service −Comprehensive support to help minimize business impact of downtime for mission critical apps or Proactive Select −Flexible way to purchase proactive services and priority incident support + Priority Connect −Speeds resolution to interoperability issues, minimizes total business impact from downtime For HP for Fast Track 3.0 deployments Support options 23
24
2012 © Trivadis BASEL BERN LAUSANNE ZÜRICH DÜSSELDORF FRANKFURT A.M. FREIBURG I.BR. HAMBURG MÜNCHEN STUTTGART WIEN Merci! Thank you! Grazie mille! VIELEN DANK! Hewlett-Packard (Switzerland) GmbH mark.wunderli@hp.com Trivadis AG meinrad.weiss@trivadis.com 09.05.2012 Hochperformante und Kostengünstige Data Warehouse Systeme 24
Similar presentations
© 2024 SlidePlayer.com. Inc.
All rights reserved.