Databases March 14, 2003. 3/14/2003Implementation Review2 Goals for Database Architecture Changes Simplify hardware architecture Improve performance Improve.

Slides:



Advertisements
Similar presentations
Archive Task Team (ATT) Disk Storage Stuart Doescher, USGS (Ken Gacke) WGISS-18 September 2004 Beijing, China.
Advertisements

Disk Arrays COEN 180. Large Storage Systems Collection of disks to store large amount of data. Performance advantage: Each drive can satisfy only so many.
RAID: Redundant Array of Inexpensive Disks Supplemental Material not in book.
The Power of Platform Solutions to Transform Higher Education
10 REASONS Why it makes a good option for your DB IN-MEMORY DATABASES Presenter #10: Robert Vitolo.
RAID- Redundant Array of Inexpensive Drives. Purpose Provide faster data access and larger storage Provide data redundancy.
1 Magnetic Disks 1956: IBM (RAMAC) first disk drive 5 Mb – Mb/in $/year 9 Kb/sec 1980: SEAGATE first 5.25’’ disk drive 5 Mb – 1.96 Mb/in2 625.
REDUNDANT ARRAY OF INEXPENSIVE DISCS RAID. What is RAID ? RAID is an acronym for Redundant Array of Independent Drives (or Disks), also known as Redundant.
NetBackup 6.0 What’s New. What’s New in NetBackup 6.0 Management and Reporting Core Product Enhancements Disk Management and Optimization Additional NetApp.
Oracle Data Guard Ensuring Disaster Recovery for Enterprise Data
Native Monitoring packsOps Mgr SP1Ops Mgr R2Ops Mgr 2012 Ops Mgr 2012 Feature PacksN/AOps Mgr 2012 Product Ship.
Business Continuity and DR, A Practical Implementation Mich Talebzadeh, Consultant, Deutsche Bank
Server Platforms Week 11- Lecture 1. Server Market $ 46,100,000,000 ($ 46.1 Billion) Gartner.
Agenda Introduction Running PeopleSoft on Exadata and Exalogic
OS and Hardware Tuning. Tuning Considerations Hardware  Storage subsystem Configuring the disk array Using the controller cache  Components upgrades.
Servers Redundant Array of Inexpensive Disks (RAID) –A group of hard disks is called a disk array FIGURE Server with redundant NICs.
Session 3 Windows Platform Dina Alkhoudari. Learning Objectives Understanding Server Storage Technologies Direct Attached Storage DAS Network-Attached.
Virtual Network Servers. What is a Server? 1. A software application that provides a specific one or more services to other computers  Example: Apache.
Presented by Jacob Wilson SharePoint Practice Lead Bross Group 1.
Simplify your Job – Automatic Storage Management Angelo Session id:
Server Types Different servers do different jobs. Proxy Servers Mail Servers Web Servers Applications Servers FTP Servers Telnet Servers List Servers Video/Image.
Selling the Database Edition for Oracle on HP-UX November 2000.
Oracle Recovery Manager (RMAN) 10g : Reloaded
PPOUG, 05-OCT-01 Agenda RMAN Architecture Why Use RMAN? Implementation Decisions RMAN Oracle9i New Features.
Chapter 10 : Designing a SQL Server 2005 Solution for High Availability MCITP Administrator: Microsoft SQL Server 2005 Database Server Infrastructure Design.
Redundant Array of Independent Disks
RAID: High-Performance, Reliable Secondary Storage Mei Qing & Chaoxia Liao Nov. 20, 2003.
Day 10 Hardware Fault Tolerance RAID. High availability All servers should be on UPSs –2 Types Smart UPS –Serial cable connects from UPS to computer.
2/10/2000 CHEP2000 Padova Italy The BaBar Online Databases George Zioulas SLAC For the BaBar Computing Group.
Managing Multi-User Databases AIMS 3710 R. Nakatsu.
Nexenta Proprietary Global Leader in Software Defined Storage Nexenta Technical Sales Professional (NTSP) COURSE CONTENT.
Data Storage CPTE 433 John Beckett. The Paradox “If I can go to a computer store and buy 1000 gigabytes for $50, why does it cost more in your server.
Top Performance Enhancers Top Performance Killers in Progress Dan Foreman Progress Expert
Virtualization. Virtualization  In computing, virtualization is a broad term that refers to the abstraction of computer resources  It is "a technique.
Chapter 8 Implementing Disaster Recovery and High Availability Hands-On Virtual Computing.
© Pearson Education Limited, Chapter 16 Physical Database Design – Step 7 (Monitor and Tune the Operational System) Transparencies.
Implementation Review1 Deriving Architecture Requirements March 14, 2003.
1 Wenguang WangRichard B. Bunt Department of Computer Science University of Saskatchewan November 14, 2000 Simulating DB2 Buffer Pool Management.
Selling the Storage Edition for Oracle November 2000.
Never Down? A strategy for Sakai high availability Rob Lowden Director, System Infrastructure 12 June 2007.
RAID SECTION (2.3.5) ASHLEY BAILEY SEYEDFARAZ YASROBI GOKUL SHANKAR.
11 DISASTER RECOVERY Chapter 13. Chapter 13: DISASTER RECOVERY2 OVERVIEW  Back up server data using the Backup utility and the Ntbackup command  Restore.
"1"1 Introduction to Managing Data " Describe problems associated with managing large numbers of disks " List requirements for easily managing large amounts.
Server Virtualization
CERN Physics Database Services and Plans Maria Girone, CERN-IT
INTRODUCTION TO DBS Database: a collection of data describing the activities of one or more related organizations DBMS: software designed to assist in.
The concept of RAID in Databases By Junaid Ali Siddiqui.
11 CLUSTERING AND AVAILABILITY Chapter 11. Chapter 11: CLUSTERING AND AVAILABILITY2 OVERVIEW  Describe the clustering capabilities of Microsoft Windows.
CERN Database Services for the LHC Computing Grid Maria Girone, CERN.
1 D0 Taking Stock By Anil Kumar CD/LSCS/DBI/DBA June 11, 2007.
CERN - IT Department CH-1211 Genève 23 Switzerland t High Availability Databases based on Oracle 10g RAC on Linux WLCG Tier2 Tutorials, CERN,
Greenlight Presentation Oracle 11g Upgrade February 16, 2012.
D0 Taking Stock1 By Anil Kumar CD/CSS/DSG June 06, 2005.
Install, configure and test ICT Networks
A Case Study Julie J. Smith Wachovia Corporation Superdome Implementation at a Glance.
Implementation Review1 Archive Ingest Redesign March 14, 2003.
DAQ Status & Plans GlueX Collaboration Meeting – Feb 21-23, 2013 Jefferson Lab Bryan Moffit/David Abbott.
Component 8/Unit 9aHealth IT Workforce Curriculum Version 1.0 Fall Installation and Maintenance of Health IT Systems Unit 9a Creating Fault Tolerant.
1 Future Directions in HST Data Processing 19 November 2004.
BNL dCache Status and Plan CHEP07: September 2-7, 2007 Zhenping (Jane) Liu for the BNL RACF Storage Group.
Chapter 11 System Performance Enhancement. Basic Operation of a Computer l Program is loaded into memory l Instruction is fetched from memory l Operands.
Network-Attached Storage. Network-attached storage devices Attached to a local area network, generally an Ethernet-based network environment.
Managing Multi-User Databases
Database Services at CERN Status Update
Cluster Active Archive
Storage Virtualization
Introduction of Week 3 Assignment Discussion
Real IBM C exam questions and answers
Managing Work in the New Computing Environment March 14, 2003
Seminar on Enterprise Software
Presentation transcript:

Databases March 14, 2003

3/14/2003Implementation Review2 Goals for Database Architecture Changes Simplify hardware architecture Improve performance Improve system reliability Provide better capabilities for full load testing in development environment Improve capacity planning ability

3/14/2003Implementation Review3 Current Database Architecture Independent Sun Servers 2 Operational Database Servers  Pipeline Processing/Archive Ingest/ Distribution  4 cpu server with MTI RAID Array  Archive Catalog Browsing  2 cpu server with MTI RAID Array

3/14/2003Implementation Review4 Current Database Architecture 2 Development/Test Database Servers  Original DADS dev/test server  2 cpu server with JBOD (Just a Bunch of Disks)  Original OPUS dev/test server  2 cpu server with JBOD

3/14/2003Implementation Review5 Current Database Architecture

3/14/2003Implementation Review6

3/14/2003Implementation Review7

3/14/2003Implementation Review8 Current Storage Issues MTI RAID Arrays – Operations  Starting to age – had planned to start replacing MTI with more current technology  Poor tools for performance monitoring JBOD (Just a Bunch of Disks) - Development  Much slower than RAID  No fault tolerance

3/14/2003Implementation Review9 Current Server Issues Sparc Servers  Highly reliable  Lack redundant hardware components  Unable to perform throughput tests on development systems since they are undersized compared to the operational servers.  No good performance monitoring tools

3/14/2003Implementation Review10 Data Processing/Ingest/Distribution DB Server Performance

3/14/2003Implementation Review11 Archive Catalog Browsing DB Server Performance

3/14/2003Implementation Review12 Archive Dev/Test DB Server Performance

3/14/2003Implementation Review13 Opus Dev/Test DB Server Performance

3/14/2003Implementation Review14 Current Database Backup Strategy Full database backups to local DLTs Tran Log dumps to local disks Operator Intensive

3/14/2003Implementation Review15 New Database Architecture Consolidate 4 servers to 3 domains on Sun Fire 15K  Domain 1 – Data Processing/ Archive Ingest/ Distribution  8 CPUs – EMC  Should provide significantly improved performance Doubles the number of CPUs Significantly more memory Faster RAID  Anticipate extra performance will be needed to handle: New Instruments Object catalogs New MAST catalogs

3/14/2003Implementation Review16 New Database Architecture Consolidate 4 servers to 3 domains on Sun Fire 15K  Domain 2 – Archive Catalog Browsing  4 CPUs – EMC  Should provide significantly improved performance Doubles the number of CPUs Significantly more memory Faster RAID  Anticipate extra performance will be needed to handle: New Instruments Object catalogs New MAST catalogs

3/14/2003Implementation Review17 New Database Architecture Consolidate 4 servers to 3 domains on Sun Fire 15K  Domain 3 – Development/Test  4 CPUs - EMC  Should provide improved performance Faster CPUs Significantly more memory RAID  Improved performance will be needed to allow more thorough throughput testing Domains can be reconfigured to provide 8 cpu test environment for full up test

3/14/2003Implementation Review18 New Database Architecture

3/14/2003Implementation Review19 New Database Architecture SUN FIRE 15K Domain Config Opus/Archive 7 Dynamically Re-Configurable Domains EMC OPUS/Archive OPS EMC Databases OPS Code Development System Test Database Test OS/Security Test

3/14/2003Implementation Review20

3/14/2003Implementation Review21 New Storage Benefits EMC RAID used for both Development, Test, Ops  Same Performance across domains  EMC storage easier to configure for both System Administrators and Database Administrators  Better performance monitoring tools  EMC switch will allow failover of disks to an alternate domain

3/14/2003Implementation Review22 New Storage Benefits EMC allows for new database backup strategies  Timefinder Snapshot  Backup to Centralized tape system  May facilitate snapshot refreshes of database to development/test server

3/14/2003Implementation Review23 New Server Benefits Consolidation of Database servers  Simplifies management for both SAs and DBAs Redundant hardware systems should reduce downtime Better performance monitoring tools Domains can be reconfigured to provide extra resources on demand

3/14/2003Implementation Review24 Database Transition Plans Storage  EMC Training Underway  Testing EMC with loaner Sun 4800  How to layout database partitions  Database backup strategies  Snapshot refreshes  Backup recovery from tape

3/14/2003Implementation Review25 Database Transition Plans Sun Fire 15K Server  System Administrator Training Underway  Testing with loaner Sun 4800  Need 64 bit Sybase to utilize >4GB Memory ST-ECF had experienced problems with initial release of 64 bit Sybase under v12.0 They report having no problems with Sybase v12.5 We will run full regression test with this version.

3/14/2003Implementation Review26 Database Transition Plans Sun Fire 15K Server  Testing with Sun Fire 15K  Will set up initial configuration of Dev/Test Server using database configuration parameters that are similar to existing servers. This will allow us to duplicate current performance requirements.  We then plan to test the benefit of large amounts of memory within the database server and to further tune configuration parameters. This tuning work will not impact the rollout of the other servers, since they can be brought on-line with the initial tuning configuration.

3/14/2003Implementation Review27 Database Transition Plans Order of Migration  Development Server (Opus Dev Server)  Merge in 2nd Development/Test Server (Archive Dev Server) onto same domain  Archive Catalog Browsing Server  Data Processing/ Archive Ingest/ Distribution Server

3/14/2003Implementation Review28 Database Contingency Plans Original hardware will be kept available should it be necessary to roll back  No trade in required for this equipment Roll back would consist of a simple database load onto the original server  Roll back will be tested.

3/14/2003Implementation Review29 Database Testing and Migration Schedule