© Deloitte Consulting, 2005 Predictive Modeling – Panacea or Placebo? Cheng-Sheng Peter Wu, FCAS, ASA, MAAA CAS 2005 Spring Meeting Scottsdale, AZ May.

Slides:



Advertisements
Similar presentations
Chapter 1 Business Driven Technology
Advertisements

1 General Iteration Algorithms by Luyang Fu, Ph. D., State Auto Insurance Company Cheng-sheng Peter Wu, FCAS, ASA, MAAA, Deloitte Consulting LLP 2007 CAS.
Brief introduction on Logistic Regression
Quantitative Research and Analytics, Proprietary and Confidential1 Ryan Michaluk
PERSONAL LINES RATEMAKING – WHAT’S DOWN THE ROAD? Midwest Actuarial Forum – September 21, 2007 Jeffrey L. Kucera, FCAS, MAAA – Sr. Consultant EMB America.
Predictive Data Modeling A CASE STUDY FOR DATA MODELING.
We’re Allstate Actuaries! Explore the possibilities. Proprietary of Allstate Insurance Company. Copyright © 2003.
Copyright © 2014 by the American Academy of Actuaries. All Rights Reserved. Michael E. Angelina, MAAA, ACAS Price Optimization Casualty Actuarial & Statistical.
Predictive Modeling for Disability Pricing May 13, 2009 Claim Analytics Inc. Barry Senensky FSA FCIA MAAA Jonathan Polon FSA
The Delphi Technique: A Tool For Long Range Travel and Tourism Planning Chapter 39 Research Methodologies.
Considerations in P&C Pricing Segmentation February 25, 2015 Bob Weishaar, Ph.D., FCAS, MAAA.
EFFECTIVE PREDICTIVE MODELING- DATA,ANALYTICS AND PRACTICE MANAGEMENT Richard A. Derrig Ph.D. OPAL Consulting LLC Karthik Balakrishnan Ph.D. ISO Innovative.
A Comparison of Property-Liability Insurance Financial Pricing Models Stephen P. D’Arcy, FCAS, MAAA, Ph.D. Richard W. Gorvett, FCAS, MAAA, Ph.D. Department.
Data Mining & Data Warehousing PresentedBy: Group 4 Kirk Bishop Joe Draskovich Amber Hottenroth Brandon Lee Stephen Pesavento.
2006 CAS RATEMAKING SEMINAR CONSIDERATIONS FOR SMALL BUSINESSOWNERS POLICIES (COM-3) Beth Fitzgerald, FCAS, MAAA.
Project Management For Class Plan Projects CAS Special Interest Seminar on Predictive Modeling October 11-12, 2007 Jonathan White.
Application of SAS®! Enterprise Miner™ in Credit Risk Analytics
Demand Modeling to Price Optimization
Data Mining. 2 Models Created by Data Mining Linear Equations Rules Clusters Graphs Tree Structures Recurrent Patterns.
Proprietary & Confidential 1 Product Development Workshop Part 7: Product Monitoring/Risk Management 2012 CAS Ratemaking and Product Management Seminar.
 Several years ago, a major P&C insurer established key business goal Significantly enhance approach to writing Small Commercial  Product / process.
A View Inside the “Black Box”: A Review and Analysis of Personal Lines Insurance Credit Scoring Models Filed in the State of Virginia By Cheng-sheng Peter.
Travelers Analytics: U of M Stats 8053 Insurance Modeling Problem
© Deloitte Consulting, 2004 Introduction to Data Mining James Guszcza, FCAS, MAAA CAS 2004 Ratemaking Seminar Philadelphia March 11-12, 2004.
Data Cleansing for Predictive Models: The Next Level Roosevelt C. Mosley, Jr., FCAS, MAAA CAS Ratemaking & Product Management Seminar Philadelphia, PA.
Practical GLM Modeling of Deductibles
Businessowners (BOP) Class Plans 2003 CAS Ratemaking Seminar March 27-28, 2003 Robert J. Walling, FCAS, MAAA.
@ Hanover Insurance Group: Catherine Eska 1 FROM CLASS TO INDIVIDUAL RATING CAS Predictive Modeling Seminar October 4 th, 5 th 2006 Data Challenges and.
Presented at: 1998 DFA Seminar July 13-14, 1998 Presented at: 1998 DFA Seminar July 13-14, 1998 lmn Dynamic Financial Analysis: Objectives & Design Gerald.
1 Does Credit Score Really Help Explain Insurance Losses? Cheng-Sheng Peter Wu, FCAS, ASA, MAAA, Jim Guszcza, ACAS, MAAA, Ph. D.
Greg Hansen, FCAS, MAAA Actuarial Research Leader Westfield Insurance Westfield Center, Ohio Lessons Learned(the Hard Way) from Predictive Modeling Projects.
© Deloitte Consulting, 2004 Alternatives to Credit Scoring in Insurance James Guszcza, FCAS, MAAA Cheng-Sheng Peter Wu, FCAS, ASA, MAAA CAS 2004 Ratemaking.
PRICE MONITOR Practical Considerations Casualty Actuarial Society 2005 Ratemaking Seminar John Ferraro FCAS, MAAA Philadelphia Insurance Companies.
Integrating the Broad Range Applications of Predictive Modeling in a Competitive Market Environment Jun Yan Mo Mosud Cheng-sheng Peter Wu 2008 CAS Spring.
Data Mining: Neural Network Applications by Louise Francis CAS Annual Meeting, Nov 11, 2002 Francis Analytics and Actuarial Data Mining, Inc.
SUVs and Automobile Insurance Costs SUV Drivers Have Different Underlying Liability Loss Costs Michael C. Dubin, FCAS, MAAA, MCA 1999 CAS Seminar on Ratemaking.
2007 CAS Predictive Modeling Seminar Estimating Loss Costs at the Address Level Glenn Meyers ISO Innovative Analytics.
© Deloitte Consulting, 2005 What To Do When You Cannot Use Credit? (Personal Lines) Cheng-Sheng Peter Wu, FCAS, ASA, MAAA CAS 2005 Special Interest Seminar.
May 18, 2004CAS Spring Meeting1 Demand Based Pricing: A Company Perspective CAS Spring Meeting May 18, 2004 Floyd M. Yager, FCAS, MAAA Allstate Insurance.
Jennifer Lewis Priestley Presentation of “Assessment of Evaluation Methods for Prediction and Classification of Consumer Risk in the Credit Industry” co-authored.
© 2011 Towers Watson. All rights reserved. Intelligent Use of Competitive Analysis 2012 Ratemaking and Product Management Seminar Kelleen Arquette March.
Institute for Mathematics and Its Applications
Reserve Variability – Session II: Who Is Doing What? Mark R. Shapland, FCAS, ASA, MAAA Casualty Actuarial Society Spring Meeting San Juan, Puerto Rico.
Predictive Modeling for Small Commercial Risks CAS PREDICTIVE MODELING SEMINAR Beth Fitzgerald ISO October 2006.
©2015 : OneBeacon Insurance Group LLC | 1 SUSAN WITCRAFT Building an Economic Capital Model
Credit History Impact on Personal Lines Loss Experience Session CPP-49 James E. Monaghan Thurs. March 9, 2000 CAS Ratemaking Seminar.
Legislative Reform: Reform or Be Reformed 2003 CAS ANNUAL MEETING Presented by Steven G. Lehmann, FCAS, FSA, FCIA, MAAA Pinnacle Actuarial Resources, Inc.
Society of Actuaries Education Update March 12, 2013 Spring 2013 Actuarial Education Event Drake University March 12, 2013 Spring 2013 Actuarial Education.
Challenges with Incorporating Predictive Models within the Underwriting Process.
Predictive Modeling Spring 2005 CAMAR meeting Louise Francis, FCAS, MAAA Francis Analytics and Actuarial Data Mining, Inc
Glenn Meyers ISO Innovative Analytics 2007 CAS Annual Meeting Estimating Loss Cost at the Address Level.
Businessowners (BOP) Class Plans 2004 CAS Ratemaking Seminar March 11, 2004 Robert J. Walling, FCAS, MAAA.
Neural Networks Demystified by Louise Francis Francis Analytics and Actuarial Data Mining, Inc.
INNOVATION AND THE REGULATOR JANET SILVERMAN NEW YORK INSURANCE DEPARTMENT CASUALTY ACTUARIAL SOCIETY SPRING MEETING MAY , 2000.
Practical GLM Analysis of Homeowners David Cummings State Farm Insurance Companies.
1 Casualty Actuarial Society 2008 Seminar on Ratemaking Use of GLMs in Ratemaking David Dahl, FCAS, MAAA Casualty Actuary Oregon Insurance Division.
Accounting Implications of Finite Reinsurance Contracts 2003 Casualty Loss Reserve Seminar Chicago, IL Session 4 – Recent Developments in Finite Reinsurance.
1 Deloitte Consulting LLP Predictive Modeling for Commercial Risks Cheng-Sheng Peter Wu, FCAS, ASA, MAAA CAS 2005 Special Interest Seminar Chicago September.
Special Challenges With Large Data Mining Projects CAS PREDICTIVE MODELING SEMINAR Beth Fitzgerald ISO October 2006.
COM-2 PRODUCT DEVELOPMENT CAS Ratemaking Seminar, New Orleans March 11, 2005 Dave McLaughry, FCAS, MAAA Senior Actuary and Product Manager Farmers Insurance.
Customer Relationship Management (CRM) Chapter 4 Customer Portfolio Analysis Learning Objectives Why customer portfolio analysis is necessary for CRM implementation.
2005 CAS Ratemaking Seminar Pricing and Market Conditions: Financial Lines Measuring Risk for D&O Liability Ben Fidlow, FCAS, MAAA.
Predictive Modeling – Potentials and Pitfalls CAS Annual Meeting November, 2006 John R. Pedrick, FCAS, MAAA Ohio Department Of Insurance
Ryan Purdy, FCAS, MAAA Merlinos & Associates
Makes Insurance Smarter.
Data Mining CAS 2004 Ratemaking Seminar Philadelphia, Pa.
MIGRATING TO NEW TECHNOLOGY
John R. Pedrick, FCAS, MAAA Ohio Department Of Insurance
No, Really, You Can Use DFA for Ratemaking, Too!
Dr. Morgan C. Wang Department of Statistics
Presentation transcript:

© Deloitte Consulting, 2005 Predictive Modeling – Panacea or Placebo? Cheng-Sheng Peter Wu, FCAS, ASA, MAAA CAS 2005 Spring Meeting Scottsdale, AZ May 16-19, 2005

© Deloitte Consulting, Agenda What is Predictive Modeling A Case Study of Successful Predictive Modeling - Credit Scoring Revolution From Credit Scoring to Predictive Modeling What Does Predictive Modeling Mean for Actuaries?

© Deloitte Consulting, What is Predictive Modeling What is predictive modeling? –Predictive modeling is an application of mathematical and statistical techniques and algorithms to produce a mathematical model that can effectively predict and segment future events

© Deloitte Consulting, Why is PM a Hot Topic? Is it just a new actuarial fashion? Is it just the “flavor of the month” that we all like to talk about at conferences but nobody really does? No to both! –It is a new addition to the actuary’s toolkit. –It is here to stay.

© Deloitte Consulting, Why is PM a Hot Topic? PM is a natural extension of what actuaries have done all along. –Use data to make predictions and forecasts. It allows us to add statistical rigor and additional info to traditional areas of actuarial practice. –Large scale data mining and multivariate analysis –GLM-based ratemaking –Stochastic Loss reserving

© Deloitte Consulting, Why is PM a Hot Topic? PM also allows us to broaden actuarial practice. –Underwriting models –Credit scoring –Retention and cross-sell modeling –Target marketing models –Agency monitoring tools –Other industries

© Deloitte Consulting, What is New About “Today’s” Predictive Modeling? Rapid advancement of cheap computing power Moore’s Law Year Storage Cost per Megabyte $190 $ 70 $ 10 $0.90 $0.05 $0.001 Microprocessor Speed, MHz

© Deloitte Consulting, What is New About “Today’s” Predictive Modeling? Availability of wide range of data from internal and external sources. “Data Mining”: “Data mining is a process that utilizes predictive modeling techniques to analyze large quantities of internal and external data, in order to unlock previously unknown and meaningful business relationships”

© Deloitte Consulting, What is New About “Today’s” Predictive Modeling? Development of new and powerful modeling and data exploration techniques –Examples: regression, GLM, neural networks, decision trees, clustering analysis, MARS,... –Explore complicated patterns in data such as non- normality, non-linearity, interactions, etc. Statistical analysis is no longer restricted to what you can do with pencil and paper... …or spreadsheets.

© Deloitte Consulting, What is New About “Today’s” Predictive Modeling? Multivariate analysis with large amount of data and many variables –Analyze multiple variables “simultaneously” instead of one or two at a time. –Use large amounts of data No need to use summarized data for actuarial analyses. –Create and analyze novel predictive variables.

© Deloitte Consulting, A Case Study of Successful PM

© Deloitte Consulting, Credit Score Revolution

© Deloitte Consulting, Why? Multiple Choice Progressive provided foosball tables and free snacks to their trendy, 20-something workforce Progressive built a compound Gamma- Poisson GLM model to design their class plan Progressive pioneered the use of credit in pricing/underwriting

© Deloitte Consulting, Credit Score Revolution Personal line rating history: –Few rating factors before World War II –Explosion of class plan factors after the War –Auto class plans: Territory, driver, vehicle, coverage, loss and violation, others, tiers/company… –Homeowners class plans: Territory, construction class, protection class, coverage, prior loss, others, tiers/company... –Credit scoring introduced in late 80s and early 90s

© Deloitte Consulting, Credit Score Revolution About credit score: –First important factor identified over the past 2 decades –Composite multivariate score vs. raw credit information –Introduced in late 80s and early 90s –Viewed at first as a “secret weapon” –Quiet, confidential, controversial, black box, …etc “Early believers and users have gained significant competitive advantage!”

© Deloitte Consulting, Credit Score Revolution Current environment of credit score: –Now everyone is using it: Marketing and direct solicitation New business and renewal business pricing and underwriting –Regulatory constraints: Many states have conducted studies on the true correlation with loss ratio and potential discrimination issues - WA study, TX study, MO study Many states have/are considering restricting the use of credit scores or certain type of information, MI. More states want the “black box” filed and opened

© Deloitte Consulting, Credit Score Revolutions What is “credit score”? –A composite score that usually contains 10 to 40 pieces of credit information Payment pattern information, account history, bankruptcies/liens, collections, inquiries, bad debt/defaults… Formula scoring or rule-based scoring Industry scores and proprietary scores

© Deloitte Consulting, Credit Score Revolutions Why “credit score” is so successful? –“Large scale” “multivariate” scoring using “external data source” –Loss ratio lift is significant, a powerful class plan factor or rate tiering factor –“Brilliant” marketing approach for credit score: Benefits/ROI are measurable and lift curve can be translated into bottom-line benefit Blind test and independent validation can be done to verify the benefit

© Deloitte Consulting, Loss Ratio Lift Curve Credit Score Decile Loss Ratio

© Deloitte Consulting, Credit Score Revolution

© Deloitte Consulting, From Credit Scores to Predictive Modeling A credit score is just “one example” of an insurance predictive model The same methods used to build credit scores are used in data mining to build insurance predictive models: –Fully utilize all sources of internal and external data sources –Fully utilize all available data Not just credit –Other lines of business?

© Deloitte Consulting, 2005 What Does PM Mean for Actuaries?

© Deloitte Consulting, What Does PM Mean for Actuaries? New ways of analyzing data –New data sources –New technologies –New analytical tools –True Multivariate analysis No longer one or two variables at a time No longer one or two variables at a time –Analysis of risk-, policy-, or HH-level data, rather than aggregated data.

© Deloitte Consulting, What Does PM Mean for Actuaries? New emphasis on the “business” side of the analytical work and out-of-box thinking Who thought of credit a decade ago? How to stay competitive if everyone is using credit and GLM? What is the “next” big thing out there? Are you using the same “lift curve” and ROI concept in your analytical work? How do you tie in your model/analytical work to business benefit? Can you demonstrate the business benefits of your analytical work through a blind test? …etc

© Deloitte Consulting, What Does PM Mean for Actuaries? New challenges to “actuarial” methodologies and principles –Actuarial Ratemaking Principle #1: “A rate is an estimate of the expected value of future costs” –Actuarial Ratemaking Principle #4: ” A rate is reasonable, not excessive, not inadequate, and not unfairly discriminatory –But is that really the way profit-seeking companies price their products? Are rates ultimately based on costs or on what the market will bear?

© Deloitte Consulting, What Does PM Mean for Actuaries? New challenges to actuarial principles and methodology: –“Unfairly discriminatory”: If we develop a powerful new segmentation model, is it discriminatory to certain risks? If we don’t introduce it, is it discriminatory to other risks? How do we know if we don’t do the analysis? Actuaries’ “Static/Equalibrium” Principles vs. Business’ “Ever Changing/Dynamic” Principles

© Deloitte Consulting, Placebo or Panacea? So which is it? Not a placebo –PM is here to stay –A permanent addition to the actuary’s toolkit –Has the power to both deepen and expand actuarial practice. Not a panacea –PM complements, doesn’t replace fundamental actuarial principles –PM does nothing without sound business strategy and implementation.