SQL Migration Daniel Abbott Director of Admin Info Systems Contra Costa Comm College Dist 925-229-6920 Randy Wallace Senior Technical Architect.

Slides:



Advertisements
Similar presentations
Pamela Norris Project Manager Kraft Kennedy & Lesser, Inc.
Advertisements

An Outsourced Open Source LMS and a Pot of Gold? Clark Shah-Nelson, Coordinator of Online Education SUNY Delhi College of Technology Creative Commons Attribution.
Post-Implementation Organization & Support Loren Blinde Director, Administrative Systems Group.
A comparison of MySQL And Oracle Jeremy Haubrich.
19 May 2012 Plan, Build & Run a SharePoint Service. Not Server! Naz Parker – Sanlam #SPSJHB The first ever all green SharePoint event.
Common Mistakes Developers Make By Bryan Oliver SQL Server Mentor at SolidQ.
Technology Steering Group January 31, 2007 Academic Affairs Technology Steering Group February 13, 2008.
Enterprise Resource Planning (ERP) Systems
Business Intelligence (3 of 3): Technically Speaking, This is How We Did It PRESENTED BY.
Greg Pierce| Concerto Cloud Services Which Cloud is Right for Microsoft CRM?
Chapter 13 Organizing Information System Resources MIS Department Centralization and Decentralization Outsourcing Computer Facilities and Services.
Save Time and Reduce Costs with Microsoft SharePoint Patsy Bowers Director of Computer User and Media Support Services Northeast State Community College.
Information Technology Services Technical Support Services Summer 2009 Accomplishments Fall 2009 Current Projects.
Convergence /20/2017 © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks.
Keeping your Database Healthy and some other configuration suggestions April SigmonSr. Technical Analyst October 2008.
“Here’s why you need the new wheels, too…” Shawn and Steve Image from
10/26/00Splitting Access Databases...1 Preparing for Access 2000 Windows 2000/Office 2000 Roll-out.
Maintaining a Microsoft SQL Server 2008 Database SQLServer-Training.com.
Computers & Employment By Andrew Attard and Stephen Calleja.
1 Introduction to Database Systems. 2 Database and Database System / A database is a shared collection of logically related data designed to meet the.
Learningcomputer.com SQL Server 2008 – Administration, Maintenance and Job Automation.
File Systems and Databases Lecture 1. Files and Databases File: A collection of records or documents dealing with one organization, person, area or subject.
Chris Wright Senior Systems Engineer, Lucity MOVING TO ONE DATABASE FOR SQL SERVER.
NETWORK OPERATING SYSTEM INTEROPERABILITY Jason Looney EKU, Department of Technology, CEN.
Digital Imaging Project Digital Imaging Team Process, Recommendations & Status Patrick Thomas, Director Of Administrative Technology John Duff, Director.
By Shanna Epstein IS 257 September 16, Cnet.com Provides information, tools, and advice to help customers decide what to buy and how to get the.
SAS Grid Department of Finance Canada. Agenda SAS in the Department of Finance Before the implementation of SAS Grid Implementation of SAS Grid Effect.
Service Level Agreements Service Level Statements NO YES The process of negotiating and defining the levels of user service (service levels) required.
Week 7 : Chapter 7 Agenda SQL 710 Maintenance Plan:
1 Agenda 7 Hints from the field: how to make BI- Accelerator work for you  Sizing and Implementation  Management and Costs.
System Implementation. © 2011 Pearson Education, Inc. Publishing as Prentice Hall 2 Chapter 13 FIGURE 13-1 Systems development life cycle with the implementation.
University of Sunderland COM 220 Lecture Seven Slide 1 Database Users & Administration.
The value added by having a Uniface application solution when converting from one database solution to another. Dave Willford – Application Architect Mark.
Best Practices for a Successful SaaS Implementation Joseph H. Aston, Oracle Project Lead Velocity Technology Solutions September 18, 2015.
Holistic Approaches for New Releases: Training, Implementation and Support Presented by: Dave Fraedrich Manager of Course Management System Maricopa Community.
MAY 27, 2009 CCCCONFER SESSION DETS Executive Committee Meeting.
Student Centered ODS ETL Processing. Insert Search for rows not previously in the database within a snapshot type for a specific subject and year Search.
CERN IT Department CH-1211 Genève 23 Switzerland t Migration from ELFMs to Agile Infrastructure CERN, IT Department.
Software Development Cycle and Roles in a Project Team
MIS 451 Building Business Intelligence Systems Data Staging.
Planning for CCSAS: IT Infrastructure October 4, 2006.
CS 440 Database Management Systems Stored procedures & OR mapping 1.
1 BCS 4 th Semester. Step 1: Download SQL Server 2005 Express Edition Version Feature SQL Server 2005 Express Edition SP1 SQL Server 2005 Express Edition.
You Don't Need a PhD to Convert Your COA. Nephellie B. Dobie – Director, Business Analysis and Solutions Consulting Technology, Simmons College Kelly.
The Power of Excel for Ad Hoc Reporting FAB 5013 Brian Caviggiola Controller - Indiana Wesleyan University Mike Ionno Senior.
Introduction to System Administration. System Administration  System Administration  Duties of System Administrator  Types of Administrators/Users.
Albanian Government Financial Information System (AGFIS) AGFIS is the system, through which the Government of Albania performs the entire budget execution.
So you want to be a DBA….
11 Copyright © 2009, Oracle. All rights reserved. Enhancing ETL Performance.
ADMINISTRATIVE STRUCTURE OF A COMPUTER CENTRE. The administrative structure is being organized in such a way that a skilled professional personnel is.
Upgrade to Dynamics 365 Online From On Premise
Presenter: Igna Visser Date: Wednesday, 18 March 2015
Start-SPPowerShell – Introduction to PowerShell for SharePoint Admins and Developers Paul BAker.
Planning a Migration.
The Marshall University Experience with Implementing Project Server 2003 August 9, 2005 Presented by: Chuck Elliott, M.S. Associate Director, Customer.
NMMU Upgrade Integrator 3 Integrator UG 2014 Greg Saunders
Oracle Database Administration
Computerized and Manual Systems
SharePoint Saturday Omaha April 2016
ISYS366, Database Administration II
Lecture 1 File Systems and Databases.
IT and Development support services
Business Services Goals and Objectives for /20/2019.
What you will learn today
The Database Environment
Automated Testing Strategies and Dynamics 365 Performance Management
WPIC Department of Psychiatry Office of Academic Computing
Vendor Software Lessons From Consulting Vendor Software.
Presentation transcript:

SQL Migration Daniel Abbott Director of Admin Info Systems Contra Costa Comm College Dist Randy Wallace Senior Technical Architect Marygrove College

When did you begin the migration? How long did the project take? When was it completed? How did you prepare for it (data scanners, custom programming scanner, etc.?) The Migration Project

Purchased and installed new hardware in summer 2011 Configuration and installation of the SQL Clean environment was completed October 2011 Migration was completed April 2012 (during DUG) Started running data scanners in summer 2011 Began converting custom paragraphs into Envison reports fall 2011 Rewrote Query Builder reports into SQL Reporting Services throughout the migration Contra Costa Community College District

Began project October Did not buy servers, ended up renting since there was no budget New servers installed March 2011 Plan was to run 3 test migrations with final migration July 4 th 2011 break. Did not need to run DMIG. Completed July 4 th break – 4 days. Several challenges – printing, third-party products, custom integrations Marygrove College

What challenges did you experience with the DMIG process? How long did DMIG take to run for your environment? How big (gigs/records) would you estimate your environment to be? How many times did you run DMIG? DMIG

DMIG ran 3.5 days 1 additional day was needed to defrag indexes The size of our SQL database environment is: – SQL DB: 25 GB – SQL IDX: 135 GB – SQL LOG: 36 GB We ran 9 tests of DMIG before the final migration to production Contra Costa Community College District

The size of our environment pushed ALL of the limits of DMIG! We ran into MANY errors and DMIG constantly timed out Datatel programmers and team leads were involved with every execution Improvements were made to DMIG throughout the project Contra Costa Community College District

DMIG weird error example: Error encountered during Bulk Insert into PERSON table during processing of PERSON file. Fatal: 2627(14): Violation of PRIMARY KEY constraint 'PK_PERSON'. Cannot insert duplicate key in object 'dbo.PERSON ' Contra Costa Community College District

Did the migration result in improved overall performance of Colleague, reduced performance or no noticeable change? Has there been any noticeable impact or improvement to specific Colleague processes as a result of the migration? SQL Impact

Overall we have experienced improved performance – It’s not the great WOW we’ve had with other hardware replacements – We’re still tuning and adjusting parameters Some processes are faster, some are slower – Depends a great deal on computed columns Contra Costa Community College District

Experienced improved performance – Overall performance better more stable – Migrating existing SQL jobs was challenging with a new domain – We’re still running some scheduled process on SQL 2005 as well as Report Manager End user’s running jobs against SQL affects performance considerably – Looking to replicating to separate Enterprise SQL server for Report Manager and end user’s SQL access Marygrove College

What was your approach to reporting from the Unidata environment? What solution did you implement for SQL reporting? How has the transition to SQL reporting been for your I.T. Department and end-users? SQL Reporting

All of our prior to the migration reports were Query Builder, except a few custom Envision reports We took advantage of our Microsoft Campus License Agreement and implemented SQL Reporting Services – At no cost A lot of work for the I.T. Department, Users are VERY Happy Now implementing SQL Report Builder for ad-hoc reporting See Fred Tahan’s session at DUG! Contra Costa Community College District

Use SQL Reporting Services – At no cost – Currently in process of establishing project to migrate from SQL 2005 to SQL 2008 All report development in the I.T. Department – Limited resources to complete – Looking at implementing SQL 2008 differently – Users are frustrated they cannot build their own reports Also do reports from Envision and Studio – Sometimes it is just easier, better control in logic Marygrove College

What consulting services did you purchase from Datatel to assist with the migration? Did you purchase services from another company? How much of the migration did you perform yourself? Consulting and Services

Consulting Services from Datatel: Initial Colleague Installation – clean environment, LPR Minimal services – some programming Registration Health Check (after migration) Other Consulting: Brent Ozar PLF – SQL Server Health Check iData – QB to SQL Reports We did all of the migration ourselves, with a LOT of help from Solution Center Contra Costa Community College District

All in house – your looking at the main resource! Marygrove College

How has system administration (tuning, parameters, maintenance, etc.) changed from a Unidata perspective to SQL? Has there been an impact to staffing the System Administrator, Programmer/Analyst and other positions? Job Duties

No more WUFA Windows maintenance Occasional SQL Reindexing and Defrag No impact to Staffing – Training was conducted during the migration project Contra Costa Community College District

System administration close to the same – Patching is the same – More work since two servers compared to one – I still do a lot of my work at the : – On the rare occasion, I use SQL – System Administrator does a lot of work on SQL Staffing Impact – has skill set in SQL more so than Envision – Trying to get IT staff to adopt Envision more Marygrove College

What would you have done differently? Lessons Learned

Did anyone involved in the migration experience serious physical injuries, loss of mental capacity or were otherwise impaired as a result of the migration? Aftermath

“Daniel and I used to be friends…” Contra Costa Community College District Before During After

Questions from the audience? Questions

Thank You! Daniel Abbott Director of Admin Info Systems Contra Costa Comm College Dist Randy Wallace Senior Technical Architect Marygrove College