1. www.bea.gov An Evaluation of the Reliability of State Personal Income Matthew von Kerczek Association for University Business and Economic Research Indianapolis, IN October 9, 2011

2. www.bea.gov Overview of BEA estimates of State Personal Income ▪ BEA makes annual and quarterly estimates of state personal income. ▪ The annual estimates are published about 9 months after the end of the referenced year and are revised in each of the next two successive years. ▪ The annual estimates are more detailed than the quarterly estimates and are based on more complete source data. ▪ The quarterly estimates are published 3 months after the end of the referenced quarter and are revised three months later. ▪ The quarterly estimates are revised again when annual estimates are published. 2

3. www.bea.gov Three Vintages of Estimates of State Quarterly Personal Income ▪ Preliminary Estimates:  Current quarter wages based on change in Employment by NAICS sector from Current Employment Statistics (CES).  Farm Proprietors’ Income  NIPA controls ▪ Revised Estimates:  Wages and Salaries from Quarterly Census of Employment and Wages (QCEW).  Farm Proprietors’ Income  Revised NIPA controls ▪ Latest Available Estimates:  Revised NIPAs from Annual Comprehensive Revision  Revised Annual State Estimates  Revised Quarterly Source Data 3

4. www.bea.gov How Reliable are BEA’s Preliminary Estimates of State Quarterly Personal Income ? ▪ For policymakers and businesses to better understand the economy and to formulate appropriate policies, timely and accurate estimates of State Personal Income are essential. ▪ The revised (second) and latest (third) estimates incorporate progressively more complete and more accurate source data as they become available from the Bureau of Labor Statistics, the U.S. Department of Agriculture and other sources. ▪ Successive estimates provide a consistent measure of economic activity over time and across states ▪ While there is always a trade-off between timeliness and accuracy, BEA believes that the preliminary State Quarterly Personal Income estimates have struck an appropriate balance, as the magnitude of the revisions to the preliminary estimates tends to be small. 4

5. www.bea.gov Reliability Criteria ▪ Reliability refers to the ability of successive vintages of estimates to present a consistent picture of economic activity within a state. ▪ Mean Revision (MR) = sum of (L-E)/n, where:  L is the rate of change in the ‘Latest Available’ estimates  E is the rate of change in the earlier vintage  n is the number of observations in the sample period over which the mean is calculated. ▪ Mean Absolute Revision (MAR) = sum of |L-E|/n:  Also can be thought of as the mean revision without regard to sign. 5

6. www.bea.gov Periods / Scope of Study ▪ Last two complete business cycles (expansion to trough).  1991:II-2001:IV  2002:I-2009:II ▪ Scope of Study:  Total Personal Income  Nonfarm Personal Income  Total Wages and Salaries ▪ The analysis that follows is based on BEA estimates of state personal income as of June 21, 2011. 6

7. www.bea.gov Results (Revisions to rates of change) 7 Mean Absolute Revisions, Latest Estimates less Preliminary and Second Estimates 2002:I-2009:II (ranked by MAR to Preliminary Estimates of Personal Income) Personal IncomeNonfarm Personal IncomeTotal Wages and Salaries PreliminarySecondPreliminarySecondPreliminarySecond United States0.470.340.480.310.680.37 Mideast0.640.430.640.430.960.63 New England0.620.440.620.440.880.60 Southeast0.540.500.530.470.610.33 Great Lakes0.520.340.520.320.750.38 Plains0.510.520.410.340.530.44 Southwest0.510.390.520.390.590.40 Rocky Mountain0.480.370.450.390.660.39 Far West0.470.310.480.310.730.38 Mean Absolute Revisions, Latest Estimates less Preliminary and Second Estimates, 1991:II-2001:IV (Ranked by MAR to Preliminary Estimates of Personal Income) Personal IncomeNonfarm Personal IncomeTotal Wages and Salaries PreliminarySecondPreliminarySecondPreliminarySecond United States 0.410.420.430.420.560.51 Plains 0.911.000.460.470.610.62 Rocky Mountain 0.790.760.700.610.880.75 New England 0.630.570.630.570.860.84 Great Lakes 0.570.620.540.590.720.77 Southwest 0.560.500.600.470.700.54 Far West 0.520.470.530.470.780.55 Mideast 0.500.530.500.530.860.81 Southeast 0.410.470.410.450.480.49

8. www.bea.gov Results (Revisions to rates of change) Mean Absolute Revisions, Latest Estimates less Preliminary estimates (Ranked by MAR to Preliminary Estimates of Personal Income) 2002:I-2009:II Personal Income Nonfarm PIWages Largest revisions Louisiana4.624.640.73 North Dakota1.410.480.67 South Dakota1.230.550.77 Wyoming1.120.990.98 Iowa1.000.500.62 Nevada0.97 1.17 New York0.96 1.63 Nebraska0.890.510.67 Mississippi0.850.720.68 United States0.470.480.68 Smallest revisions Virginia0.49 0.75 Ohio0.480.500.79 West Virginia0.470.460.56 Oregon0.470.460.78 Maryland0.46 0.74 Pennsylvania0.46 0.72 Kentucky0.450.460.66 Alabama0.450.410.61 South Carolina0.440.400.65 Mean Absolute Revisions, Latest Estimates less Second estimates (Ranked by MAR to Second Estimates of Personal Income) 2002:I-2009:II Personal IncomeNonfarm PIWages Largest Revisions Louisiana5.515.520.40 North Dakota1.400.350.54 South Dakota1.190.410.35 Mississippi0.990.900.50 Nebraska0.890.370.40 Iowa0.890.400.51 Wyoming0.840.730.40 United States0.340.310.37 Smallest Revisions Illinois0.360.320.46 South Carolina0.350.320.42 Ohio0.34 0.41 Pennsylvania0.340.350.43 Maryland0.340.330.38 California0.340.330.44 Tennessee0.33 0.43 8

9. www.bea.gov Aggregate Average Revisions (to rates of change) by Quarter Mean Absolute Revisions, Latest Estimates less Preliminary and Second Estimates, 2002:I-2009:II [Percentage Points] Personal IncomeNonfarm Personal IncomeTotal Wages YRQTRPreliminarySecondPreliminarySecondPreliminarySecond 200210.911.000.730.740.930.86 200220.500.420.500.420.580.60 200230.620.410.630.390.710.32 200240.320.250.350.250.560.32 200310.580.660.500.550.610.64 200320.39 0.380.320.610.58 200330.460.320.390.290.590.31 200340.630.390.610.351.020.50 200410.890.680.790.590.770.42 200420.46 0.470.430.910.58 200430.630.480.660.490.770.48 200440.490.920.460.860.561.39 200511.030.901.000.771.020.55 200520.390.500.370.330.450.38 200531.341.721.311.650.710.39 200542.612.792.502.751.020.56 200611.400.761.310.611.540.59 200620.450.950.340.731.110.51 200630.510.390.460.340.670.45 200640.480.310.480.280.900.45 200710.760.750.580.660.540.59 200720.600.470.530.430.710.38 200730.530.46 0.350.640.39 200740.780.420.710.340.980.32 200811.091.040.770.650.710.47 200820.760.650.520.371.000.48 200830.390.320.330.350.790.87 200840.580.420.460.300.870.69 200911.310.681.310.562.190.34 200920.620.210.650.211.400.40 200930.550.230.590.150.590.58 200940.490.220.380.160.410.48 9

10. www.bea.gov Range of Revisions (to rates of change) 10

11. www.bea.gov Measuring Direction of Change & Acceleration / Deceleration Reliability of Quarterly Estimates of State Personal Income, 2002:I - 2009:II Percent with Correct Indication Direction of Change Acceleration or Deceleration From the Previous Quarter PreliminarySecondPreliminarySecond United States97% 63%77% New England90% 67%73% Connecticut83%80%63%57% Maine93% 70%83% Massachusetts87% 70%83% New Hampshire83% 70%80% Rhode Island83%93%73%87% Vermont93% 77%83% Mideast93%90%73%87% Delaware90%87%73%70% District of Columbia93% 87% Maryland93%97%87%93% New Jersey93% 63% New York83%80%70%77% Pennsylvania90% 70%80% Great Lakes93%90%77%83% Illinois93%97%70%73% Indiana93% 77% Michigan87%97%80%77% Ohio93% 73%90% Wisconsin93% 53%70% Plains 93% 57%70% Iowa87% 47%60% Kansas93%90%67%63% Minnesota97%90%77%87% Missouri93%97%67%73% Nebraska83% 60%57% North Dakota83% 63%70% South Dakota80%83%60% Reliability of Quarterly Estimates of State Personal Income, 2002:I - 2009:II Percent with Correct Indication Direction of Change Acceleration or Deceleration From the Previous Quarter PreliminarySecondPreliminarySecond Southeast97% 60%73% Alabama97%100%80%87% Arkansas93%90%53%43% Florida97%100%83%90% Georgia97%100%67%70% Kentucky97% 67%77% Louisiana90% 50%67% Mississippi87%90%67%73% North Carolina97% 63% South Carolina97%100%73%83% Tennessee97%100%60%63% Virginia93%100%70%73% West Virginia93%97%50%57% Southwest97%93%47%60% Arizona97%100%93%97% New Mexico90%93%63%70% Oklahoma87%93%53%63% Texas97%90%53%57% Rocky Mountain97% 70%83% Colorado93%87%83%80% Idaho93%90%70%83% Montana93%97%57%67% Utah93%100%73%77% Wyoming90%93%63%77% Far West97%100%70%90% Alaska97% 77% California97% 67%87% Hawaii93%100%70% Nevada87%93%77%90% Oregon100% 70%77% Washington St97% 67%77% 11

12. www.bea.gov Recent Developments ▪ In 2002 BEA began incorporating QCEW wages into the quarterly NIPA estimates of wages and salaries (private) on a concurrent basis. ▪ In 2004 BEA accelerated the release of State Quarterly Personal Income. ▪ In 2009 BEA substantially redefined the treatment of uninsured property losses in the NIPAs. ▪ Improvements in Farm Income 12

13. www.bea.gov Preliminary Observations ▪ Overall, the preliminary and second estimates of quarterly estimates of State Personal Income are reliable in predicting direction of change (97 percent of the time) and whether the change is accelerating or decelerating (about 70 percent of the time). ▪ Overall, the revisions to the preliminary estimates of personal income, nonfarm personal income, and total wages were slightly higher in the 2002-2009 period. ▪ However, the revisions to the second estimates of personal income, nonfarm personal income, and total wages were considerably lower in the 2002-2009 period. ▪ Revisions to Farm Income continue to cause outsized revisions to states where farming is important, but even among farm states revisions were lower in the second period. Revisions to farm income were significantly smaller in the later time period. ▪ Aside from the revisions in states where farming is important, most of the revisions to personal income were driven by revisions to wages and salaries. ▪ Unpredictability of lump-sum payments (bonus, stock etc.) affecting reliability of preliminary wage estimates. ▪ Conceptual definition changes to the treatment of uninsured losses from natural disasters affected the reliability measures in Louisiana and Mississippi. 13

14. www.bea.gov Contact information Matthew A. von Kerczek Economist Regional Income Division (202) 606-9250 Matthew.vonkerczek@bea.gov 14