San Francisco 2013

 Theme: Strength in Numbers  Big Data and Business Intelligence (BI) Applications

Paper : Cox Propotional Hazard Model Evaluation in one Shot. (Polina Kukhareva. Proceedings of the SAS® Global Forum 2013 Conference. Cary, NC: SAS Institute Inc. ) Martingale residual plots Tests linearity in the log scale assumption Schoenfeld residual plot to check PH

 %let predictors=age systolic_bp diastolic_bp ldl bmi diabetes smoking sex treatment activity;  %let class = diabetes(ref="0") smoking(ref="0") sex(ref="0") treatment(ref="0") activity(ref="average")  %check_Cox_assumptions_all (_NUMBER=1, _DATA=simCox, _PREDICTORS=&predictors, _class=&class, _OUTCOME=CV_event, _FU=CV_time, _STOP= activity,  _EXCLUDE= systolic_bp diastolic_bp ldl diabetes smoking sex)

 Quantlife Procedure for Survival Analysis ◦ Covariate analysis ◦ Summarize lifetime distribution by percentiles (25 th, 50 th, 75 th ) ◦ Separate regression models for each quartile proc quantlife data=pbc log method=na plot=(quantplot survival) seed=1268; model Time*Status(0)=logBilirubin logProtime logAlbumin Age Edema / quantile=( ); run;

IDDateTimeGender Score health Score mobility 122-Sep-091M Oct-092M Mar-101F Mar-102F Apr-101F Apr-102F May-101F May-102F2025

proc transpose data=have out=want (drop=_:) prefix=var1_; by idnum; var var1; id date; run;

 What would Art do?

Paper SAS Global Forum Beyond the Basics. Arthur S. Tabachneck, Ph.D., myQNA, Inc., Thornhill, Ontario Canada Xia Ke Shan, Chinese Financial Electrical Company, Beijing, China Robert Virgile, Robert Virgile Associates, Inc., Lexington, MA Joe Whitehurst, High Impact Technologies, Atlanta GA

 SAS Marco  Flips tall data sets to wide data sets or flips wide data sets to wider data sets  Macro creates and runs a program that creates a data step using arrays

 %macro transpose(libname_in=mydata, libname_out=, data=, out=, by=, prefix=, var=, autovars=, id=, var_first=, format=, delimiter=, copy=, drop=, sort=, sort_options, guessingrows=);

How the macro works if we have: dataset have idnumdatevar1var2 131MAR20131SD 130JUN20132EF 130SEP20133HK 131DEC20134HL 231MAR20135GH 230JUN20136MM 230SEP20137JH 231DEC20138MS Art Tabachneck. A Better Way to Flip(Transpose) a SAS® Dataset. Presented at MWSUG 24, 2013.

How the macro works and we need: dataset need idnumvar1 Qtr1 var2 Qtr1 var1 Qtr2 var2 Qtr2 var1 Qtr3 var2 Qtr3 var1 Qtr4 var2 Qtr4 11SD2EF3HK4HL 25GH6MM7JH8MS and we submit: %transpose(data=have, out=want, by=idnum, id=date, format=qtr1., delimiter=_Qtr, var=var1-var2, sort=yes) Art Tabachneck. A Better Way to Flip(Transpose) a SAS® Dataset. Presented at MWSUG 24, 2013.

How is it Different/Better than Proc Transpose? Does it Go Beyond Proc Transpose?

and you can use almost all the features that you can with PROC TRANSPOSE plus some additional ones %transpose(libname_in=,libname_out=, data=,out=, by=,prefix=, var=,autovars=, id=,var_first=, format=,delimiter=, copy=,drop=, sort=,sort_options=, use_varname=,preloadfmt=, guessingrows=) Art Tabachneck. A Better Way to Flip(Transpose) a SAS® Dataset. Presented at MWSUG 24, 2013

parameter: drop the variable(s) you want dropped from the transposed file ** only relevant if you want to drop any of the by variables ** the %transpose macro's features %transpose(libname_in=,libname_out=, data=,out=, by=,prefix=, var=,autovars=, id=,var_first=, format=,delimiter=, copy=,drop=, sort=,sort_options=, use_varname=,preloadfmt=, guessingrows=) Art Tabachneck. A Better Way to Flip(Transpose) a SAS® Dataset. Presented at MWSUG 24, 2013

%transpose(libname_in=,libname_out=, data=,out=, by=,prefix=, var=,autovars=, id=,var_first=, format=,delimiter=, copy=,drop=, sort=,sort_options=, use_varname=,preloadfmt=, guessingrows=) parameter: autovars determines whether char(acter), num(eric) or all variables should be transposed if the var parameter is null * * * * * * F E A T U R E * * * * * * Where PROC TRANSPOSE will only include all numeric variables if there is no var statement, this parameter lets you indicate if you want all numeric variables, all character variables or simply all variables the %transpose macro's features Art Tabachneck. A Better Way to Flip(Transpose) a SAS® Dataset. Presented at MWSUG 24, 2013

parameter: sort the %transpose macro's features %transpose(libname_in=,libname_out=, data=,out=, by=,prefix=, var=,autovars=, id=,var_first=, format=,delimiter=, copy=,drop=, sort=,sort_options=, use_varname=,preloadfmt=, guessingrows=) whether the input dataset should be sorted (YES or NO): for both, only &by, &id, &var and &copy variables will be used If Yes, the input data will be sorted using the noequals option Art Tabachneck. A Better Way to Flip(Transpose) a SAS® Dataset. Presented at MWSUG 24, 2013

What’s in it for me??

%transpose(data=have, out=want, by=idnum, var=var1, id=date, sort=yes, delimiter=_) Would you be interested in knowing how to obtain the same result with the following code? No system variables to drop No need for a prefix (var names automatically included) No need to differentiate between options and statements as they are all of the form: parameter=value, No need to presort your data Art Tabachneck. A Better Way to Flip(Transpose) a SAS® Dataset. Presented at MWSUG 24, 2013

%transpose(data=have, out=need, by=idnum, id=date, format=qtr1., delimiter=_Qtr, var=var1-var2, sort=yes) would you be interested in knowing how to obtain the right result with the following code? only requires one step only needs one pass through the data doesn't produce distorted results can run more than 50 times faster than PROC TRANSPOSE How about if you knew that the macro: Art Tabachneck. A Better Way to Flip(Transpose) a SAS® Dataset. Presented at MWSUG 24, 2013

Compare the performance of the following two sets of almost identical code run on a file with 40,000 records and 1,002 variables PROC SORT data=have out=need; by idnum date; run; took 2.41 seconds CPU time PROC TRANSPOSE data=need out=want (drop=_:) prefix=var1_Qtr; by idnum; var var1; id date; format date Qtr1.; run; took 0.74 seconds CPU time Art Tabachneck. A Better Way to Flip(Transpose) a SAS® Dataset. Presented at MWSUG 24, 2013

 Thanks to Art Tabachneck for providing access and sharing his slides Way_to_Flip_(Transpose)_a_SAS_Dataset