Solutions Summit 2014 High Volume Processing Workshop Kaki Wynn, Dave Tanner, Andre Curione, Kim Weber, Tammy Huff.

Slides:



Advertisements
Similar presentations
DIGIDOC A web based tool to Manage Documents. System Overview DigiDoc is a web-based customizable, integrated solution for Business Process Management.
Advertisements

Copyright © SoftTree Technologies, Inc. DB Tuning Expert.
Module 13: Performance Tuning. Overview Performance tuning methodologies Instance level Database level Application level Overview of tools and techniques.
ESafe Reporter V3.0 eSafe Learning and Certification Program February 2007.
 Management has become a multi-faceted complex task involving:  Storage Management  Content Management  Document Management  Quota Management.
SQL Server Accelerator for Business Intelligence (SSABI)
WSUS Presented by: Nada Abdullah Ahmed.
World Class Financial Reporting with FRx Report Writer Elisa R. Vick
Database Optimization & Maintenance Tim Richard ECM Training Conference#dbwestECM Agenda SQL Configuration OnBase DB Planning Backups Integrity.
Cacti Workshop Tony Roman Agenda What is Cacti? The Origins of Cacti Large Installation Considerations Automation The Current.
Database Systems: Design, Implementation, and Management Eighth Edition Chapter 11 Database Performance Tuning and Query Optimization.
Nu Project Management Office A web based tool to Manage Projects.
Module 2: Planning to Install SQL Server. Overview Hardware Installation Considerations SQL Server 2000 Editions Software Installation Considerations.
VMware vCenter Server Module 4.
Capacity Planning in SharePoint Capacity Planning Process of evaluating a technology … Deciding … Hardware … Variety of Ways Different Services.
Simplify your Job – Automatic Storage Management Angelo Session id:
Take An Internal Look at Hadoop Hairong Kuang Grid Team, Yahoo! Inc
Hands-On Microsoft Windows Server 2008 Chapter 1 Introduction to Windows Server 2008.
6/1/2001 Supplementing Aleph Reports Using The Crystal Reports Web Component Server Presented by Bob Gerrity Head.
Chapter-4 Windows 2000 Professional Win2K Professional provides a very usable interface and was designed for use in the desktop PC. Microsoft server system.
Introduction to HP LoadRunner Getting Familiar with LoadRunner >>>>>>>>>>>>>>>>>>>>>>
Module 1: Introduction to Microsoft SQL Server 7.0.
SSIS Over DTS Sagayaraj Putti (139460). 5 September What is DTS?  Data Transformation Services (DTS)  DTS is a set of objects and utilities that.
Overview of SQL Server Alka Arora.
Systems analysis and design, 6th edition Dennis, wixom, and roth
Database Systems: Design, Implementation, and Management Eighth Edition Chapter 10 Database Performance Tuning and Query Optimization.
DAY 14: ACCESS CHAPTER 1 Tazin Afrin October 03,
Codeigniter is an open source web application. It occupies a very small amount of space in the memory and is most useful for developers who aim to develop.
COLD FUSION Deepak Sethi. What is it…. Cold fusion is a complete web application server mainly used for developing e-business applications. It allows.
Module 1: Installing and Upgrading to Exchange Server 2003.
Goodbye rows and tables, hello documents and collections.
Bonrix SMPP Client. Index Introduction Software and Hardware Requirements Architecture Set Up Installation HTTP API Features Screen-shots.
PowerPoint Presentation for Dennis, Wixom, & Tegarden Systems Analysis and Design with UML, 4th Edition Copyright © 2009 John Wiley & Sons, Inc. All rights.
Block1 Wrapping Your Nugget Around Distributed Processing.
Learningcomputer.com SQL Server 2008 – Administration, Maintenance and Job Automation.
Solutions Summit 2014 Shanon Hust Reconciliation Workflow.
Introduction to the Adapter Server Rob Mace June, 2008.
Database Design and Management CPTG /23/2015Chapter 12 of 38 Functions of a Database Store data Store data School: student records, class schedules,
The Client/Server Database Environment Ployphan Sornsuwit KPRU Ref.
OSP310. What is a SharePoint® Farm? A collection of one or more SharePoint Servers and SQL Servers® providing a set of basic SharePoint.
DataMAPPER - Applied Database Tech. 이화여대 과학기술대학원 석사 3 학기 992COG08 김지혜.
INFORMATION MANAGEMENT Unit 2 SO 4 Explain the advantages of using a database approach compared to using traditional file processing; Advantages including.
6/1/2001 Supplementing Aleph Reports Using The Crystal Reports Web Component Server Presented by Bob Gerrity Head.
Master Data Management & Microsoft Master Data Services Presented By: Jeff Prom Data Architect MCTS - Business Intelligence (2008), Admin (2008), Developer.
The Million Point PI System – PI Server 3.4 The Million Point PI System PI Server 3.4 Jon Peterson Rulik Perla Denis Vacher.
SQL/Lesson 7/Slide 1 of 32 Implementing Indexes Objectives In this lesson, you will learn to: * Create a clustered index * Create a nonclustered index.
Physical Database Design Purpose- translate the logical description of data into the technical specifications for storing and retrieving data Goal - create.
Installation of Storage Foundation for Windows High Availability 5.1 SP2 1 Daniel Schnack Principle Technical Support Engineer.
Solutions Summit 2014 T-Recs Product Update and Feedback Kelly Darren, Jonathan Haynes, Shannon Parker, Gayla Steiner, Kaki Wynn.
1 Chapter The Impact of Database Customer centric approach - A highly personal approach Marketing databases are essential to the marketing process.
Database Systems, 8 th Edition SQL Performance Tuning Evaluated from client perspective –Most current relational DBMSs perform automatic query optimization.
1 BCS 4 th Semester. Step 1: Download SQL Server 2005 Express Edition Version Feature SQL Server 2005 Express Edition SP1 SQL Server 2005 Express Edition.
SQL Server 2014 AlwaysOn Step-by-Step SQL Server 2014 AlwaysOn Step-by-Step A hands on look at implementing AlwaysOn in SQL Server 2014.
CIS-NG CASREP Information System Next Generation Shawn Baugh Amy Ramirez Amy Lee Alex Sanin Sam Avanessians.
Configuring SQL Server for a successful SharePoint Server Deployment Haaron Gonzalez Solution Architect & Consultant Microsoft MVP SharePoint Server
9 Copyright © 2004, Oracle. All rights reserved. Getting Started with Oracle Migration Workbench.
 1- Definition  2- Helpdesk  3- Asset management  4- Analytics  5- Tools.
SQL Database Management
The Client/Server Database Environment
The Client/Server Database Environment
Installation and database instance essentials
Software Architecture in Practice
Database Performance Tuning and Query Optimization
Introduction of Week 3 Assignment Discussion
Migration Strategies – Business Desktop Deployment (BDD) Overview
Oracle Architecture Overview
Chapter 11 Database Performance Tuning and Query Optimization
Presentation transcript:

Solutions Summit 2014 High Volume Processing Workshop Kaki Wynn, Dave Tanner, Andre Curione, Kim Weber, Tammy Huff

Chesapeake System Solutions, Inc. Proprietary and Confidential Are you a High Volume Client? Transactional Volume Average – up to 400K Transactions per Day (80M per Year) High – up to 3-4 Million Transactions per Day (750M per Year) Account Volume Average - Lower number of accounts (500 or less), with a focus on cash reconciliation and/or other transactionally oriented recons. These are the customers that require matching. High - Higher number of accounts (in the thousands and above), which are focused on Balance Sheet reconciliation, and may not require matching. Number of Users Typically a higher number of accounts translates into a larger User base

Chesapeake System Solutions, Inc. Proprietary and Confidential Hardware Recommendations Application Server A VERAGE V OLUME 4 Processing Cores GB RAM GB available for Operating System and external processes 6 GB maximum allocation for T-Recs Application Server 30 GB of available disk space Windows 2008R2 Server x64 Standard Edition with SP1 H IGH V OLUME 4 Processing Cores 48 GB RAM 16 GB RAM available for Operating System and external processes 32 GB RAM maximum allocation for T-Recs Application Server Active/Standby T-Recs Application Server cluster

Chesapeake System Solutions, Inc. Proprietary and Confidential Hardware Recommendations Web Server A VERAGE V OLUME 4 Processing Cores GB RAM GB available for Operating System and external processes 4 GB maximum allocation for T-Recs Web Server 10 GB of available space 30 GB for Application Server and Data Files Windows 2008R2 Server x64 Standard Edition with SP1 H IGH V OLUME 4 Processing Cores 32 GB RAM 16 GB RAM available for Operating System and external processes 24 GB RAM maximum allocation for T-Recs Web Server Active/Standby T-Recs Web Server cluster

Chesapeake System Solutions, Inc. Proprietary and Confidential Hardware Recommendations Database Server A VERAGE V OLUME 4 Processing Cores 12 GB RAM 4 GB available for Operating System and external processes 8 GB memory limit for SQL Server 60 GB of available space Windows 2008R2 Server x64 Standard Edition with SP1 Microsoft SQL Server 2008R2 H IGH V OLUME ORACLE Dual Intel Xeon Processors (12 cores each) 96 GB RAM Windows 2008R2 Server x64 Enterprise Edition with SP1 11.2g running in Active/Active two(2) node RAC Orahome installed on local disk, all other drives are ISCSI mounted raw volumes (ASM managed) Recommended 1200 Open Cursors DB Block size 16K All other DB parameters are ORACLE DEFAULT

Chesapeake System Solutions, Inc. Proprietary and Confidential Database Configuration Recommendations Use of indexes for searches and high volume processes such as Importing, Matching, Reconciliation Generation, GL Export, etc. Indexes depends on data distribution particular to each customer business requirements and should be based on actual queries Speeding up searches reduces database locks Drawbacks of having too many indexes Space considerations, time it takes to update indexes during data manipulations, DB maintenance time, etc. Remove ineffective indexes Perform database maintenance regularly If the data changes rapidly do not rely on automatic stats collection Database partitioning

Chesapeake System Solutions, Inc. Proprietary and Confidential Code Optimization Current and on-going process to Improve application performance: Hot spots / Bottlenecks Execution Time Memory Usage Bandwidth / Network usage Java Upgrades 1.7.x and 64 bits platforms Re-design current code to improve performance and system response time Functionality migration from legacy desktop applications to T-Recs Enterprise Web Client Security standards and updates.

Chesapeake System Solutions, Inc. Proprietary and Confidential Code Optimization Long term plans: Updates to the latest technologies in the market Platform updates: java, utilities, libraries, database engines. Security standards Reporting engines (more appealing and flexible reports) Support for additional platforms (mobile) Automated System testing under stress / high volume scenarios

Chesapeake System Solutions, Inc. Proprietary and Confidential Code Optimization T-Recs is designed to be versatile and perform in a lot of different scenarios. It can be configured to satisfy the requirements of most businesses. Contact Development to Customize the process according to your specific needs: Custom Procedures to calculate and update complex data Scripts to re-format data Reports to pull customized data Personalized File Exports to interface with other systems All these custom processes will be integrated within your T-Recs installation and can be executed on demand or on a scheduled basis.

Chesapeake System Solutions, Inc. Proprietary and Confidential Code Optimization - Reference Fields Data in T-Recs can be stored in different Reference field types: Standard Transaction Fields (limited number of fields) Custom Fields (unlimited fields, performance can be impacted) Both types are alphanumeric and data validations are unsupported (prone to errors) What is alphanumeric ?…Why performance can be impacted? Sort by: ABC XYZ */$ 2014AB123-$100.5

Chesapeake System Solutions, Inc. Proprietary and Confidential Code Optimization – Supplemental Fields Starting with T-Recs 7.1 new Supplemental Fields have been introduced. Different Data Types Amount Fields (multi-currency) Date Fields Numeric (integer / decimals) Alphanumeric Customizable labels Data can be validated Faster Operations involving supplemental fields Fields can be secured individually. Supported in SmartMatch, SmartResolve, Reconciliation…

Chesapeake System Solutions, Inc. Proprietary and Confidential High Account Volume Configuration Considerations and Recommendations Structured Importing Load smaller groups of accounts. Operational Structures Group accounts together. (i.e. types of accounts, responsibility of the account, departments, or processes) Don’t put 1 account per node. Users As of 7.0 there is now an upload functionality to load users, as well as operational structure assignment.

Chesapeake System Solutions, Inc. Proprietary and Confidential High Account Volume Configuration Considerations and Recommendations Reconciliation Workflow Set Up Load smaller groups of accounts if using the structured importing format. Make sure that there is a different person for the adjacent role. Adjusted Balances Balances to be in rows is recommended if loading more than 1 month in the file. Workflow Process Auto-Certify where you are able to. Mass Verify Has to be the same workflow Grouping accounts into 1 T-Recs account vs many T-Recs accounts in 1 grouped recon.

Chesapeake System Solutions, Inc. Proprietary and Confidential High Transactional Volume Configuration Considerations and Recommendations Importing Data files should ALWAYS be sorted by Import Account Number If Import Account Number is determined by concatenating fields, the sort order of the file should be based on these fields Consider using the new Supplemental fields – there are less table joins than Custom Fields Match Rules The primary matching field should be placed in Reference 1 If additional Reference fields are required for matching, contact CSSI for indexing recommendations Match Rule Sets Order match rules with 1 to 1 matching first, then 1 to Many, then Many to Many Create an Operational Structure for matching purposes Only include Accounts that matching will actually occur in

Chesapeake System Solutions, Inc. Proprietary and Confidential High Transactional Volume Configuration Considerations and Recommendations SmartResolve Procedures Narrow down main Transaction Criteria Set as much as possible If Reference fields 2-10 are necessary, contact CSSI for indexing recommendations If Custom Fields (Reference 11 +) are required consider using the new Supplemental fields instead For Step Action “Send to Exception List”, consider the volume of data that will qualify to be sent to the Exception List. This tool is designed to assist users in research/resolution of exceptions – what is a manageable amount for users to research? If volume is unmanageable for the user, the tool is ineffective For high volume exceptions, consider the Custom Export feature Reporting Use Output Format of TXT, CSV or XLS and export file to a directory (filesystem) or use the export functionality

Thank you!