1 Applying SAS Parallel- Processing Feature Berwick Chan, Kaiser Permanente Vaccine Study Center NCAL Division of Research For BASAS.

Slides:



Advertisements
Similar presentations
Introduction to Database Management J.G. Zheng June 22 nd 2005 DB Chapter 1.
Advertisements

Introduction to Database J.G. Zheng May 14 th 2008.
NGS computation services: APIs and.
The SPIN System. What is SPIN? Model-checker. Based on automata theory. Allows LTL or automata specification Efficient (on-the-fly model checking, partial.
The SPIN System. What is SPIN? Model-checker. Based on automata theory. Allows LTL or automata specification Efficient (on-the-fly model checking, partial.
Introduction to Data Set Options Mark Tabladillo, Ph.D. Software Developer, MarkTab Consulting Associate Faculty, University of Phoenix January 30, 2007.
Find It Using SAS By David Steves. Would you like to be able to search SAS programs for certain expressions? Example: I have a list of SAS programs which.
Copyright © 2008 SAS Institute Inc. All rights reserved. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks.
Parallel Computing Glib Dmytriiev
XIr2 Recommended Performance Tuning Andy Erthal BI Practice Manager.
Debugging/Tuning Queries via iSeries Navigator Tom McKinley
Introduction to MS Access Steve Shapiro Computer Services Manager Office of Research Services and Administration University of Oregon Region VI/VII NCURA.
Oracle SQL Developer Data Modeler 3.0: Technical Overview March 2011.
PHANI VAMSI KRISHNA.MADDALI. BASIC CONCEPTS.. FILE SYSTEMS: It is a method for storing and organizing computer files and the data they contain to make.
Superscalar and VLIW Architectures Miodrag Bolic CEG3151.
I OWA S TATE U NIVERSITY Department of Animal Science PROC ROBUSTRET & Evaluating Regression analyses With The Help of PROC RSQUARE Animal Science 500.
Multiprocessing with SAS ® Software Now Bill Fehlner, Kathleen Wong, Kifah Mansour SAS Toronto.
1 Using SAS Parallel-Processing Features To Reduce Program Execution Time Presented by Berwick Chan Kaiser Permanente Vaccine Study Center NCAL Division.
Ceng Operating Systems Chapter 2.1 : Processes Process concept Process scheduling Interprocess communication Deadlocks Threads.
Copyright © 2006 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill Technology Education Copyright © 2006 by The McGraw-Hill Companies,
Client Server Model and Software Design TCP/IP allows a programmer to establish communication between two application and to pass data back and forth.
Slide 1 of 9 Presenting 24x7 Scheduler The art of computer automation Press PageDown key or click to advance.
Phil Brewster  One of the first steps – identify the proper data types  Decide how data (in columns) should be stored and used.
Basics of Web Databases With the advent of Web database technology, Web pages are no longer static, but dynamic with connection to a back-end database.
SednaSpace A software development platform for all delivers SOA and BPM.
Oracle Application Express (Oracle APEX), formerly called HTML DB, is a Free rapid web application development tool for the Oracle database.
KISTI’s Activities on the NA4 Biomed Cluster Soonwook Hwang, Sunil Ahn, Jincheol Kim, Namgyu Kim and Sehoon Lee KISTI e-Science Division.
Chapter 18: Database System Architectures
UNIT - 1Topic - 2 C OMPUTING E NVIRONMENTS. What is Computing Environment? Computing Environment explains how a collection of computers will process and.
Copyright © 2007, Oracle. All rights reserved. Managing Concurrent Requests.
Beate Danielsen, Health Information Solutions Soora Wi, Kaiser Permanente Eileen Walsh, Kaiser Permanente.
(Chapter 10 continued) Our examples feature MySQL as the database engine. It's open source and free. It's fully featured. And it's platform independent.
Copyright © 2006, SAS Institute Inc. All rights reserved. SAS Enterprise Guide Old Proc – New Tricks? Tim Trussell Academic Program, SAS Canada world diabetes.
Mainframe (Host) - Communications - User Interface - Business Logic - DBMS - Operating System - Storage (DB Files) Terminal (Display/Keyboard) Terminal.
1 Chapter 2.1 : Processes Process concept Process concept Process scheduling Process scheduling Interprocess communication Interprocess communication Threads.
Java Portals and Portlets Submitted By: Rashi Chopra CIS 764 Fall 2007 Rashi Chopra.
Intro to SQL Management Studio. Please Be Sure!! Make sure that your access is read only. If it isn’t, you have the potential to change data within your.
1. When things go wrong: how to find SQL error Sveta Smirnova Principle Technical Support Engineer, Oracle.
Distributed database system
Process Architecture Process Architecture - A portion of a program that can run independently of and concurrently with other portions of the program. Some.
File Server Architecture In File Server Architecture, file server can’t process the data but can only pass on the data to the client who can process it.
Oracle Warehouse Builder - Beta 1 New Features Jean-Pierre Dijcks.
Copyright 2007, Information Builders. Slide 1 Machine Sizing and Scalability Mark Nesson, Vashti Ragoonath June 2008.
9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs.
Data Structures and Algorithms in Parallel Computing
Data Communications and Networks Chapter 9 – Distributed Systems ICT-BVF8.1- Data Communications and Network Trainer: Dr. Abbes Sebihi.
23 Copyright © 2009, Oracle. All rights reserved. Oracle Business Intelligence Answers: Advanced Features.
RoOUG Iunie Bucuresti, 26 Iunie Agenda Inregistrarea participantilor ODI – Common Use Cases 2Iunie 2013.
Oracle Business Intelligence Foundation – Testing and Deploying OBI Repository.
Creating Simple and Parallel Data Loads With DTS.
The process of establishing a connection between a client and a server is called as Client – Server communication.
General Architecture of Retrieval Systems 1Adrienn Skrop.
AZ PASS User Group Azure Data Factory Overview Josh Sivey, Solution Partner October
COMPUTER NETWORKS Quizzes 5% First practical exam 5% Final practical exam 10% LANGUAGE.
ECE 297 Concurrent Servers Process, fork & threads ECE 297.
GCSE Computing - The CPU
Managing, Storing, and Executing DTS Packages
Presented By: Jessica M. Moss
Designing and Implementing an ETL Framework
Existing Perl/Oracle Pipeline
Handling Exceptions.
1Z0-148 Dumps Oracle Database 12c: Advanced PL/SQL Exam Just 1 day study required to pass exam 100% Passing Assurance.
Java Byte IPC: Part 6-Summary
Handling Exceptions.
نرم افزار گزارش ساز کارنیک
Module 10: Implementing Managed Code in the Database
Prof. Arfaoui. COM390 Chapter 6
Database System Architectures
GCSE Computing - The CPU
Presentation transcript:

1 Applying SAS Parallel- Processing Feature Berwick Chan, Kaiser Permanente Vaccine Study Center NCAL Division of Research For BASAS May 2014 meeting

2 SAS Step-by-Step Sequential Processing Flow SAS starts Task 1 Task 2 SAS ends Execution Time X seconds y seconds Total: (x+y) seconds Applying SAS Paralle Processing Feature - B. Chan

3 SAS Parallel Processing Flow SAS starts SAS ends SAS starts Task 1 SAS ends Execution Time Task 2 Task1Task 2 x sec y sec Total exec time: max(x,y) sec Applying SAS Paralle Processing Feature - B. Chan

4 Ideal Tasks For Parallel Processing Independent tasks that run on the same server. For example, sorting 2+ huge SAS tables Independent tasks that run on different servers. For example, reading Oracle/DB2/Teradata tables simultaneously Linking standalone SAS programs together with a set of user-defined condition. (Production job setting) Applying SAS Paralle Processing Feature - B. Chan

5 SAS Code Samples Basic MP-Connect program structure Sorting two tables concurrently Sending two passthru sql to different servers concurrently Applying SAS Paralle Processing Feature - B. Chan

6 More SAS Code Samples Linking/Running independent SAS programs with controls such as: Be able to communicate among independent programs Be able to check status of individual program Be able to define logic to determine program flow on the fly, for example, if anyone of the independent programs yields non zero return code then abort the entire program Applying SAS Paralle Processing Feature - B. Chan

7 More About MP-Connect Useful links: Applying SAS Paralle Processing Feature - B. Chan