2012 © Trivadis BASEL BERN LAUSANNE ZÜRICH DÜSSELDORF FRANKFURT A.M. FREIBURG I.BR. HAMBURG MÜNCHEN STUTTGART WIEN TechTalk Hochperformante und kostengünstige.

Slides:



Advertisements
Similar presentations
2012 © Trivadis BASEL BERN LAUSANNE ZÜRICH DÜSSELDORF FRANKFURT A.M. FREIBURG I.BR. HAMBURG MÜNCHEN STUTTGART WIEN Welcome November 2012 Effiziente Data.
Advertisements

Module 13: Performance Tuning. Overview Performance tuning methodologies Instance level Database level Application level Overview of tools and techniques.
2012 © Trivadis BASEL BERN LAUSANNE ZÜRICH DÜSSELDORF FRANKFURT A.M. FREIBURG I.BR. HAMBURG MÜNCHEN STUTTGART WIEN TechTalk WrapUp, Q&A Mark Wunderli Meinrad.
2012 © Trivadis BASEL BERN LAUSANNE ZÜRICH DÜSSELDORF FRANKFURT A.M. FREIBURG I.BR. HAMBURG MÜNCHEN STUTTGART WIEN TechTalk Beste Skalierbarkeit dank massiv.
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 1.
Lenovo ® ThinkServer ® RD350 and RD450 Speaker Name, Date.
Doug Lanman Data Warehousing SSP North Central, Midwest and Heartland Districts SQL Server Data Warehousing.
High Performance Analytical Appliance MPP Database Server Platform for high performance Prebuilt appliance with HW & SW included and optimally configured.
1© Copyright 2011 EMC Corporation. All rights reserved. EMC SQL Server Data Warehouse Fast Track Solutions Nov 30, 2011 Ling Wu, EMC.
Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS PRIMERGY Servers and Windows Server® 2008 R2 Benefit from an efficient, high performance and flexible platform.
Scott Hulke Microsoft Technology Center - Dallas.
Microsoft Virtual Server 2005 Product Overview Mikael Nyström – TrueSec AB MVP Windows Server – Setup/Deployment Mikael Nyström – TrueSec AB MVP Windows.
SQL Server 2008 for Hosting Key Questions to Address How can SQL Server save your costs? How can SQL Server help you increase customer base? How can.
DBI308. What are SQL Server Fast Track Reference Configurations General Fast Track Recommendations Reference Configurations and Best Practices FT 3.0.
Fast Track, Microsoft SQL Server 2008 Parallel Data Warehouse and Traditional Data Warehouse Design BI Best Practices and Tuning for Scaling SQL Server.
© Hitachi Data Systems Corporation All rights reserved. 1 1 Det går pænt stærkt! Tony Franck Senior Solution Manager.
Capacity Planning in SharePoint Capacity Planning Process of evaluating a technology … Deciding … Hardware … Variety of Ways Different Services.
SAP on windows server 2012 hyper-v documentation
CERN IT Department CH-1211 Genève 23 Switzerland t Next generation of virtual infrastructure with Hyper-V Michal Kwiatek, Juraj Sucik, Rafal.
DBI301. Broad applicability Common workloads Pre-configured Pre-tuned Integrated management Surrounded by expert support Balanced architecture.
Acceleratio Ltd. is a software development company based in Zagreb, Croatia, founded in We create innovative software solutions for SharePoint,
SQL Server Warehousing (Fast Track 4.0 & PDW)
Scalable Data Warehouse & Data Marts ReportsAnalysis SQL Server DBMS SQL Server Integration Services Custom OLTP Increase usage & trust.
Bob Thome, Senior Director of Product Management, Oracle SIMPLIFYING YOUR HIGH AVAILABILITY DATABASE.
Exchange 2000 on Windows 2000 Data Center The Opportunity for Server Consolidation.
Key Perf considerations & bottlenecks Windows Azure VM characteristics Monitoring TroubleshootingBest practices.
VSolution Playbook VIRTUALIZED SAN SOLUTION FOR VMWARE SMB.
DBI332 ilikesql brianwmitchelll UNSTRUCTURED UNBALANCED UNPREDICTABLE.
CERN - IT Department CH-1211 Genève 23 Switzerland t Tier0 database extensions and multi-core/64 bit studies Maria Girone, CERN IT-PSS LCG.
Microsoft ® System Center Service Manager 2010 Infrastructure Planning and Design Published: December 2010.
4/23/2017 © 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks.
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Enterprise Data Warehouse.
FlashSystem family 2014 © 2014 IBM Corporation IBM® FlashSystem™ V840 Product Overview.
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. LogKV: Exploiting Key-Value.
SESSION CODE: BIE07-INT Eric Kraemer Senior Program Manager Microsoft Corporation.
Designing and Deploying a Scalable EPM Solution Ken Toole Platform Test Manager MS Project Microsoft.
Data Management Conference Data Warehousing John Plummer TSP Architect
Criteria for D/W Platform Selection Simple Architecture –Easy to deploy the solution with minimal efforts Scalable (Scale Out - Scale Up) –Ability to handle.
2012 © Trivadis BASEL BERN LAUSANNE ZÜRICH DÜSSELDORF FRANKFURT A.M. FREIBURG I.BR. HAMBURG MÜNCHEN STUTTGART WIEN SQL Server 2012 Parallel Data Warehouse.
Copyright/Privacy message 1 HP Solution Block: SAP ERP 6.0 & HP ProLiant ® SAP ERP 6.0 & HP ProLiant Multiprocessor Servers Turn up the volume on success.
2012 © Trivadis BASEL BERN LAUSANNE ZÜRICH DÜSSELDORF FRANKFURT A.M. FREIBURG I.BR. HAMBURG MÜNCHEN STUTTGART WIEN Welcome November 2012 Vorstellung Parallel.
Hosted SharePoint. Part 3/3: Office Live as a WSS solution Speaker Name Microsoft Corporation Hosted.
Solution to help customers and partners accelerate their data.
Dell Confidential Dell Database Solutions: SQL Server 2005 APR 2006.
CERN Database Services for the LHC Computing Grid Maria Girone, CERN.
CERN - IT Department CH-1211 Genève 23 Switzerland t High Availability Databases based on Oracle 10g RAC on Linux WLCG Tier2 Tutorials, CERN,
2012 © Trivadis BASEL BERN LAUSANNE ZÜRICH DÜSSELDORF FRANKFURT A.M. FREIBURG I.BR. HAMBURG MÜNCHEN STUTTGART WIEN Welcome November 2012 Columnstore Indexes.
WHAT EXACTLY IS ORACLE EXALYTICS?. 2 What Exactly Is Exalytics? AGENDA Exalytics At A Glance The Exa Family Do We Need Exalytics? Hardware & Software.
SQL Server 2008 R2 Parallel Data Warehouse: Under the Hood Brian Mitchell Senior Premier Field Engineer.
Configuring SQL Server for a successful SharePoint Server Deployment Haaron Gonzalez Solution Architect & Consultant Microsoft MVP SharePoint Server
© 2008 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice ProLiant G5 to G6 Processor Positioning.
DESIGNING HIGH PERFORMANCE ETL FOR DATA WAREHOUSE. Best Practices and approaches. Alexei Khalyako (SQLCAT) & Marcel Franke (pmOne)
Sql Server Architecture for World Domination Tristan Wilson.
IBM Systems and Technology Group © 2008 IBM Corporation Oracle Exadata Storage and the HP Oracle Database Machine Competitive Seller Podcast Mark Wulf.
YOUR LOGO Retail File 23 May 2016 Valid Until 31 May 2016 or Until Stock Last HP SERVER DL380 G9 2U,6C E GHZ/15MB,16GB(2X8GB)R,P440ar/2GB,2x300GB.
System Storage TM © 2007 IBM Corporation IBM System Storage™ DS3000 Series Jüri Joonsaar Tartu.
E2800 Marco Deveronico All Flash or Hybrid system
SUSE Linux Enterprise Server for SAP Applications
Data Platform and Analytics Foundational Training
2016 Citrix presentation.
Windows Server* 2016 & Intel® Technologies
Installation and database instance essentials
Build Better Microsoft SQL Server ® Solutions with Lenovo
SQL Server 2012 Licensing Overview.
Fast Track Data Warehouse for SQL SERVER 2012
12/26/2018 5:07 AM Leap forward with fast, agile & trusted solutions from Intel & Microsoft* Eman Yarlagadda (for Christine McMonigal) Hybrid Cloud – Product.
Dana Kaufman SQL Server Appliance Engineering
Dell EMC SQL Server Solutions Doug Bernhardt
How Dell, SAP and SUSE Deliver Value Quickly
Presentation transcript:

2012 © Trivadis BASEL BERN LAUSANNE ZÜRICH DÜSSELDORF FRANKFURT A.M. FREIBURG I.BR. HAMBURG MÜNCHEN STUTTGART WIEN TechTalk Hochperformante und kostengünstige Data Warehouse Systeme Meinrad Weiss Hochperformante und Kostengünstige Data Warehouse Systeme 1

2012 © Trivadis AGENDA 1.Introduction Microsoft Appliances 2.Overview Microsoft Data Warehousing Solutions 3.FastTrack 4.“Case Study” 5.Concrete Offerings Hochperformante und Kostengünstige Data Warehouse Systeme 2

2012 © Trivadis Accelerate time to value, And optimized Systems Custom-built solution Integrated, optimized appliance Weeks Design Build Deploy Use Acquire appliance Extract data from existing MS apps Choose appliance for workload Install appliance Stand-up in production Extract and manipulate data Generate reports Make decisions Manage and adapt Weeks Extract and manipulate data Define architecture Acquire SW, HW Evaluate options Install components Assess workload Load data Test with POC Balance SW, HW Integrate in environment Monitor and troubleshoot Generate reports Make decisions Design Build Deploy Use Months Months Hochperformante und Kostengünstige Data Warehouse Systeme

2012 © Trivadis Microsoft Data Warehousing Solutions Scalable and reliable platform for data warehousing on any hardware Reference Architectures offering best price performance for data warehousing Scalable and reliable platform for data warehousing on any hardware Appliance for high-end data warehousing requiring highest scalability, performance, or complexity Ideal for data marts or small to mid-sized EDWs Ideal for data marts or small to mid-sized DWs with scan- centric workloads Ideal for large data marts or mid-sized EDWs Offers flexibility in hardware and architecture Software only Reference Architectures (software and hardware) Software only DW appliance (fully integrated software and hardware) Scale-up DW Scale-out DW with MPP 10s of TB 2 – 80 TB 10s of TB 10s - 100s of TB Hochperformante und Kostengünstige Data Warehouse Systeme

2012 © Trivadis Data Warehouse – Products Positioning Minimal HW tune- up/optimization; supports mixed workloads Balanced solution for mostly scan-centric workloads. Max HW tune-up for most DW scenarios. 4 4 Most flexible architecture for handling all DW scenarios. Scale Complexity HA by default SW-HW integration SQL Server 2008 R2 Fast Track SQL Server 2008 R2 Enterprise PDW SQL Server 2008 R2 Data Center PDW with Distributed Data Architecture Hochperformante und Kostengünstige Data Warehouse Systeme

2012 © Trivadis Some (SQL) Data Warehouses today Big SAN Big 64-core Server Connected together What’s wrong with this picture? Hochperformante und Kostengünstige Data Warehouse Systeme

2012 © Trivadis Answer: system out of balance Such servers can consume 16 GB/Sec of IO, but the SAN can only deliver 2 GB/Sec  Even when the SAN is dedicated to the SQL Data Warehouse, which it often isn’t  Lots of disks for Random IOPS BUT  Limited controllers  Limited IO bandwidth System is typically IO bound Data Load and queries are slow  Huge impact from and to other applications Result: significant investment, not delivering performance Hochperformante und Kostengünstige Data Warehouse Systeme

2012 © Trivadis The Alternative: FastTrack or A Balanced System Design a server + storage configuration that can deliver all the IO bandwidth that CPUs can consume when executing a SQL Relational DW workload Avoid sharing storage devices among servers Avoid overinvesting in disk drives  Focus on scan performance, not IOPS Layout and manage data to maximize range scan performance and minimize fragmentation Hochperformante und Kostengünstige Data Warehouse Systeme

2012 © Trivadis SQL Server Fast Track Data Warehouse A method for designing a cost-effective, balanced system for Data Warehouse workloads Reference hardware configurations developed in conjunction with hardware partners using this method Best practices for data layout, loading and management Relational Database Only – Not SSAS, IS, RS - Well, may be also SSAS Hochperformante und Kostengünstige Data Warehouse Systeme

2012 © Trivadis Fast Track Data Warehouse Components 10 Software: SQL Server 2008 Enterprise Windows Server 2008 Hardware: Tight specifications for servers, storage and networking ‘Per core’ building block Configuration guidelines: Physical table structures Indexes Compression SQL Server settings Windows Server settings Loading Hochperformante und Kostengünstige Data Warehouse Systeme

2012 © Trivadis Case Study Swiss customer in energy trading business with: ca. 2 TB data ~ 4 GB new data/day Traditional server infrastructure with SAN storage Main pain points: High costs Bad data load performance Varying load and query performance Hochperformante und Kostengünstige Data Warehouse Systeme 11 Fast Track

2012 © Trivadis System Comparison Hochperformante und Kostengünstige Data Warehouse Systeme 12 ResourceType#Comment ServerHP BL685C G62Failover Cluster CPUAMD 6Core, 2.4Ghz424 Cores per Server Memory256GB256 GB per Server StorageShared Storage XP Including Replication to second Datacenter OSWindows Server 2008 SQL ServerSQL Server 2008SP1 ResourceType#Comment ServerHP DL380 G71 FastTrack DW Reference Architecture CPUIntel X Core 3.33 Ghz212 cores per server Memory96GB StorageDirect Attached Storage 48 Data Discs Raid-10 Total 13 TB raw capacity OSWindows Server 2008 R2 SQL ServerSQL Server 2008 R2SP1 Old Infrastructure FastTrack System

2012 © Trivadis Balanced System Details System-Test with SQLIO Ø 3.25 GB/sec Scan Rate (3.34 GB/sec theoretical Scan Rate) Hochperformante und Kostengünstige Data Warehouse Systeme * 4 * 300 GB (600 GB) 10K SAS 2.5 SFF DP HDD = Total 48 Data Discs 12 * 4 * 300 GB (600 GB) 10K SAS 2.5 SFF DP HDD = Total 48 Data Discs

2012 © Trivadis Migration, Final Comparison and Conclusion Easy application migration via Backup/Restore Existing data files distributed over the 12 mount points Partition process modified to allocate 12 files for each day (partition) Hochperformante und Kostengünstige Data Warehouse Systeme 14 Configuration Old Server Fast Track Memory GB25696 CPU Cores2412 DB Tests Perf. Factor (Tests B,C,F) ROI in 12 Months

FAST TRACK REFERENCE ARCHITECTURE 3.0 Mark Wunderli Infra2Apps Technology Consultant Hewlett-Packard (Switzerland) GmbH

Fast Track Data Solution at a glance A range of proven configurations to accelerate deployment and optimize results 80% Faster report generation 95% Faster system queries than legacy DW $600K Savings on hardware annually 50% Faster deployment 2FTEs Redirected for innovation 10x Savings on storage consumption Hochperformante und Kostengünstige Data Warehouse Systeme

Fast Track Reference Architecture Hochperformante und Kostengünstige Data Warehouse Systeme

Configurations to scale from 1TB to 80 TBs Prescriptive guidance and optimized methodology for deployment – Targeted at query workloads patterned for large sequential data reads Balanced HW approach ideal for data marts – Fast Track Reference Architectures: 1– 80TB Leading price/performance metrics Configurations, tested performance guidance, and best practices – HP Sizer for Microsoft SQL Server Fast Track Data Warehouse Custom support The choice is yours! Broadest range of solutions to meet your data warehousing needs Entry Ref. Arch. ProLiant DL370 (2P) Internal disks (5.5 TB*) Expansion (14 TB*) Basic Ref. Arch. ProLiant DL38x (2P) MSA P2000 G3 (Rec. Capacity 20 TB*) Mainstream Ref. Arch. ProLiant DL58x (4P) MSA P2000 G3 (Rec. Capacity 40 TB*) Premium Ref. Arch. ProLiant DL980 (8P) MSA P2000 G3 (Rec. Capacity: 80 TB*) 18 * recommended data capacity with a 3.5X compression

Server: HP ProLiant DL 580 G7 with 4 x 8-core Intel Xeon Storage: HP P2000 G3 Recommended User Capacity: 40 TB 4P: 32 core, 192T GB – 1 TB RAM Server: HP ProLiant DL980 G7 with 8 x 8-core Intel Xeon Storage: HP P2000 G3 Recommended User Capacity: 80 TB Premium SMP: 8- Socket Processor Configuration Mainstream SMP: 4- Socket Processor Configuration HP SQL Server Fast Track 3.0 8p; 64 core, 512 GB - 2TB RAM 19 Server: HP ProLiant DL380 G7 with 2 x 12-core Intel Storage: HP P2000 G3 Recommended User Capacity: 20 TB Basic SMP: 2- Socket Processor Configuration 2P: 12 core, 96 – 384 GB RAM Data Warehousing Continuum – Intel options

Server: HP ProLiant DL385 G7 with 2 x 12-core AMD Opteron Storage: HP P2000 G3 Recommended User Capacity: 20 TB Server: HP ProLiant DL 585 G7 with 4 x 12-core AMD Opteron Storage : HP P2000 G3 Recommended User Capacity: 40 TB 2p; 24 core, 96 – 512 GB RAM HP SQL Server Fast Track 3.0 Data Warehousing Continuum – AMD options Mainstream SMP: 4- Socket Processor Configuration Basic SMP: 2- Socket Processor Configuration 4p; 48 core, 192 GB – 1 TB RAM 20

Greater scalability support and increased throughput for Fast Track queries HP StorageWorks P2000 G3 FC MSA 21 Allows dual reads Enables 450 MB/s throughput per storage volume Architecture optimized for sequential reads Achieves throughput equivalent to 2-3X drives in non-optimized High data capacity, supporting 149 SFF drives SFF

Freeing up IT, getting more value Without HP Factory Express: Complexity Confusion Slow time to solution With HP Factory Express: Faster time to solution More available IT resources Maximized IT investment 22

Choose the service level that best meets your business needs Care Pack Services −Support for HP hardware and software, as well as Microsoft software - 3 year 24x7 Proactive 24 Service −Integrated HW and SW support including proactive and reactive services to improve stability and availability across IT environment Critical Service −Comprehensive support to help minimize business impact of downtime for mission critical apps or Proactive Select −Flexible way to purchase proactive services and priority incident support + Priority Connect −Speeds resolution to interoperability issues, minimizes total business impact from downtime For HP for Fast Track 3.0 deployments Support options 23

2012 © Trivadis BASEL BERN LAUSANNE ZÜRICH DÜSSELDORF FRANKFURT A.M. FREIBURG I.BR. HAMBURG MÜNCHEN STUTTGART WIEN Merci! Thank you! Grazie mille! VIELEN DANK! Hewlett-Packard (Switzerland) GmbH Trivadis AG Hochperformante und Kostengünstige Data Warehouse Systeme 24