1. Board Member Training 2006 Session 1: Continuing Competence Session 2: Impact of Technology Steven K. Bryant, PhD and William D. Hogan, ME Applied Measurement Professionals, Inc. 2006 Annual ConferenceAlexandria, Virginia Council on Licensure, Enforcement and Regulation Expect the Unexpected: Are We Clearly Prepared?

2. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia About Us……. Steven K. Bryant, PhD Founder and President, AMP (1982-2002) CEO, Nat’l Board for Respiratory Care (1974-2002) William D. Hogan, ME Vice President, Marketing and Business Products AMP, 1993-Present

3. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia NBRC and State Regulation Use of Entry Level Exam by States State Licensure Liaison Group National RC Disciplinary Database Mandatory Continuing Competency Program, 2002

4. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia AMP and Technology Examination Development/Research Real Estate Program National Network of AMP Assessment Centers

5. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Consistent with……. CLEAR Guidelines, Modules 4 & 6 NOCA/NCCA Standards

6. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Continuing Competence “Luck is where preparation meets opportunity.”

7. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Continuing Competence Complete Situational Exercises

8. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia CLEAR Definition….. Success on licensure exams = Minimally competent at the time of testing

9. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Continuing Competence….. What about the future after licensure? What are our responsibilities?

10. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Continuing competency programs… Attempt to address future Various options: Re-examination (same/different) Self-assessment Portfolio review Continuing education Others

11. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Re-Examination Not professionally/politically OK May not be valid for current job “Makes money” for agencies Extra development expense

12. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Self-Assessment Difficult to supervise Not secure Who really did it? May not be job-related

13. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Portfolio Reviews Similar problems to self-assessment References are all good May not be job-related

14. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Continuing Education Readily available Acceptable Lesser of other evils Professional associations love it

15. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Continuing Competence Continuing education has become the face of continued competence— are they really the same?

16. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Continuing Competence Probably not!! Validity evidence lacking Exams can measure job performance CE most preferred anyway

17. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia NOCA/NCCA Standards ….a process that documents or “contributes to” the continued competence of the certified occupation…..

18. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Respiratory care……. 48 states regulate the profession---all provide for completion of CE to satisfy continuing competency requirements

19. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia NBRC Mandatory CCP Re-examination Pass higher level exam Complete CE compatible with states

20. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Difficulties with imposing CCP Post-voluntary credentialing Post-licensure Two different worlds!

21. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Continuing Competence What Board Members really need to know: CC is difficult to document Most often method used is CE CE Programs offered by many Administrative pitfalls to avoid

22. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Administrative Pitfalls…… Approval of CE Programs Using what exists Lead time required Verification of completion

23. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Continuing Competence The controversy continues!!

24. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Continuing Competence Review Situational Exercises

25. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Speaker Contact Information Thank You! Steven K. Bryant, PhD and William D. Hogan, ME Applied Measurement Professionals, Inc. 8310 Nieman Rd. Lenexa, KS 66214 913-541-0400 www.goAMP.com sbryant or whogan@goAMP.com

26. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia CLEAR Board Training --Session Two The Impact of Technology on Board Meetings, Examination Development and Administration

27. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Impact of Technology “Technology is a wonderful thing---- when it works!!”

28. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Impact of Technology Technology Assisted Meetings Focused Displays Agendas/Background Info Virtual Meetings

29. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Sample of NBRC Board Book AGENDA Board of Trustees National Board for Respiratory Care, Inc. Saturday, May 6, 2006 9:00 am – 3:00 pm Merrick I & II The Colonnade Hotel Coral Gables, FL 1.Call to Order/Secretary’s Roll Call 2.Introduction/Welcome of New Board Members and Guests Minutes 3.Approval of Minutes of November 12, 2005 Meeting 4.Officer Reports (optional – except President) a.President b.Vice President c.Secretary d.Treasurer 5.Public Advisor’s Report 6.Executive Committee Report 7.Examination Committee Reports (A single resolution to accept all Examination Committee Reports is requested after all have been presented.) aExamination Committee Chairmen b.Entry Level CRT Examination Committee c.Therapist Written Examination Committee d.Clinical Simulation Examination Committee e.Pulmonary Function Technology Examination Committee f.Neonatal/Pediatric Respiratory Care Examination Committee

30. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Use of Technology During Meetings Laptops for note taking Power Point and other aids Internet Connections Demonstrations Video Contacts

31. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Virtual Meetings Phone and computer may be needed Individual review of materials Committee meetings Board meetings

32. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Sample item

33. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Technology and Examinations Steps in Examination Development Job analysis/test specs Item development/test assembly Minimum passing level Validation/pre-testing

34. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Technology and Examinations Job Analysis/Role Delineation Survey-based Committee-based Content set by law Transportability

35. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Technology and Examinations Test Specifications More Important Job Duties Tasks/KSAs

36. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Technology and Examinations Test Development Items linked to tasks/KSAs Series of structured reviews Cueing

37. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Technology and Examinations Setting the MPL Angoff, Nedelsky, Others Panel of Experts State vs. National

38. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Technology and Examinations Validation/Pre-testing Content Predictive Pre-test Item Stats Not Mentioned in CLEAR Guidelines

39. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Technology and Examinations Costs of Testing Test for 1 vs. 10,000 Administration Using CBT

40. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Technology and Examinations Job analysis research Test development/items reviews Final test reviews Post-test statistics

41. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Technology and Examinations Computer-based testing simply replaces a test booklet and answer sheet with a computer--- Real Impact of Technology Instant Results/Quick Re-tests Enhanced Security

42. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Technology and Examinations High-Stakes Testing vs. Web-tests/self assessments

43. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Some CBT Pitfalls Need Integrated System Reliance on ATG’s False Sense of “Security” Human Intervention Important Proctor Training Examination Storage

44. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Impact of Technology “Technology is a wonderful thing---- when it works!!”

45. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Impact of Technology Review Technology-Related Situational Exercises

46. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia Speaker Contact Information Thank You! Steven K. Bryant, PhD and William D. Hogan, ME Applied Measurement Professionals, Inc. 8310 Nieman Rd. Lenexa, KS 66214 913-541-0400 www.goAMP.com sbryant or whogan@goAMP.com