1. Disclosure: Dr. Kues and Mr. Kelly are both members of the Board of Directors for NCCME Jack Kues, Ph.D, CCMEP University of Cincinnati Laird Kelly, BS, CCMEP RSi/FocalSearch

4. Competencies Expert Opinion Professional Literature Worker Input Examination of the work environment

5. S K K K K K S S S S S A A A A K K K S S S A A A A AK K A A Scope of Competence

6. S K K K K K S S S S S A A A A K K K S S S A A A A AK K A A

7. K1 K1 K1 K1 K2 K2 K2 K2 K3 K3 K3 K3 S1 S1 S1 S1 S2 S2 S2 S2 S3 S3 S3 S3 A1 A1 A1 A1 A2 A2 A2 A2 A3 A3 A3 A3

8. K1 K1 K1 K1 K2 K2 K2 K2 K3 K3 K3 K3 S1 S1 S1 S1 S2 S2 S2 S2 S3 S3 S3 S3 A1 A1 A1 A1 A2 A2 A2 A2 A3 A3 A3 A3

9. Having the ability to apply knowledge, skills, or judgment in practice if called upon to do so.

12. Domain # of Questions Adult Learning Principles9 Educational Interventions17 Relationships with Stakeholders12 Mission and Vision26 Knowledge of Environment11 Survey75

15. Current Field of Employment Percentage of Respondents (%) Number of Respondents Academic Health Center [Medical school] 12.937 Accrediting organization [e.g. ACCME,, ACPE] 1.44 Federal Government 1.03 Healthcare Delivery System [direct patient care] 19.957 Insurance/Managed Care Company 0.72 Medical Device or Biologics Company 0.00 Medical Education & Communications Company, ACCME- accredited 22.063 Medical Education & Communications Company, non-accredited 9.126 Medical Specialty Society 11.533 Pharmaceutical Company 5.215 Publisher 2.88 State Medical Society 1.03 Other 9.828

16. Job Title Percentage of Respondents (%) Number of Respondents Associate Dean / Assistant Dean 2.16 President / CEO10.530 Vice-President / / CFO11.132 Director30.387 Associate / Assistant Director 4.212 Coordinator12.235 Associate / Assistant Coordinator 0.31 Manager14.341 Associate / Assistant Manager1.03 Specialist4.212 Administrative Assistant / Secretary0.31 Other6.619

18. Competency Element Mean Score ACCME Standards for commercial support (SCS)4.66 ACCME Policies4.61 Accreditation standards4.60 ACCME Essential elements4.56 Learning objectives/desired outcomes4.55 Leadership – Operate within code of ethics4.55 Needs assessment4.51 Legal – Compliance4.50 Leadership – Continuous assessment4.43 Instructional design4.43

19. Competency Element Mean Score Stakeholder Assessment - Payers3.00 Resource management - Facilities3.25 Resource management - Contractors3.28 Professional literature – seminal papers3.31 Research on physician informal learning3.33 Research on physician psychosocial stages3.38 Stakeholder assessment - patients3.43 Informal learning facilitation3.44 New forms of CME – Point of care learning3.63 ACGME/ABMS competencies3.63

20. Competency ElementAHCHDS Accred MECC Non- Accred MECCMSpecPharmOther ACCME (SCS)4.954.604.754.544.614.674.50 ACCME Policies4.844.564.694.504.704.334.53 Accreditation standards4.894.654.764.154.483.934.67 ACCME Essential elements4.864.60 4.384.604.004.50 Learning objectives4.644.584.484.624.484.534.60 Operate within code of ethics 4.784.634.564.464.244.734.62 Needs assessment4.684.474.444.504.454.644.54 Legal – Compliance4.704.554.624.244.344.734.48 Continuous assessment4.434.474.544.154.644.214.43 Instructional design4.574.234.48 4.444.534.45

21. Competency Element AHCHDS Accred MECC Non- Accred MECCMSpecPharmOther Stakeholder Assessment - Payers 3.093.102.933.292.573.213.09 Facilities management 3.283.782.953.353.002.503.34 Resource management - Contractors 3.143.003.263.923.33 3.35 Seminal Literature 3.463.143.433.753.333.403.07 Informal learning 3.503.223.323.273.383.363.33 Physician psychosocial stages 3.413.133.443.38 3.713.54 Stakeholder assessment - patients 3.663.593.613.583.643.313.47 Informal learning facilitation 3.673.253.693.613.174.003.29 Point of care learning 3.583.693.663.963.564.203.34 ACGME competencies 4.253.843.653.363.563.003.33