This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies1 Competency Rules and Competencies Rule! Robby Robson Chair, IEEE Learning Technology Standards Committee President, Eduworks Corporation ©2006, Eduworks Corporation. Each slide in this presentation is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. You are free to redistribute and use any slides provided you give proper attribution and do not change them (other than changing the styles).Attribution-NoDerivs 2.5 License
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies2 Why I am Passionate about competencies!
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies3 Wait a Minute – I need TO GET a Calculator
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies4 HOW DO YOU SPELL “PRIVACY?”
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies5 THE CURRENT STATE OF AFFAIRS
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies6 Learning Objects are Everywhere
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies7 But Sometimes HARD TO FIND
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies8 And EVEN Harder to Get Credit FOR Photo by Ari Brown (whatnot on flickr) Some Rights Reserved
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies9 WE HAVE SOME STANDARDS … “Competency Definitions” (b. 1999)
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies10 And More Standards
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies11 And More Standards
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies12 (But some standards are missing)
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies13 And Lots of Taxonomies …
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies14 AND EVEN SOME SOFTWARE
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies15 SO LET’S ENVISION THE FUTURE A distributed learning world in which learning experiences are selected, personalized, sequenced and evaluated on the basis of how well they address a learner’s desire to improve or demonstrate knowledge, skills and abilities
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies16 BUT … quadratic formula A student is ready to learn the quadratic formula She searches and finds appropriate content in a digital library She learns about the quadratic formula online She takes a test online Her teacher is notified Her teacher gives her a new challenge (and doesn’t waste re-teaching what she already knows.) Is that a standardized term? What is the educational level of the student? Was she learning a skill (e.g. solving quadratic equations) or about the quadratic formula? Notified of What? The results? A conclusion drawn from the results? Does the teacher know the student? Does the learning system? Are results reported? Are they tied to a skill or ability?
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies17 it SEEMS SIMPLE … BUT
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies18 TERMINOLOGY DIFFERS FROM PLACE TO PLACE AND DOMAIN TO DOMAIN SHORT BLACK? HUH…???
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies19 Brews Coffee Grinds Beans Steams Milk Properly Handles Food Makes Espresso Operates Machine Washes Hands Sanitizes Utensils Taxonomies are TOUGH! Mapping taxonomies is hard Just representing taxonomies (in an interoperable way) is an open problem Directed Acyclic Graphs seem to work Barista Licensed Food Handler Bartender, grade 1 Makes Short Black ?
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies20 The Concepts are COMPLEX: Status of a competency: Can X do Y? Measure of a competency: X can do Y with probability p? Roll-up: status and measure determined from status and measure of subordinate competencies Evidence: Data used to determine status and measure Assessment: The process of deriving status and measures from evidence Conditions: The conditions under which evidence has been gathered or a competency applies Confidence: The confidence in evidence (validity) or an assessment (reliability)
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies21 Personalization is Tough Need to know existing competencies Need to know learning goal Need to know performance requirements Need to find matching content Need to consider groups as well as individuals
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies22 AND LEARNING TECHNOLOGY HAS EVOLVED IN STRANGE WAYS Photo by dmvscan on flickr Some Rights Reserved
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies23 At first … CONTENT & SYSTEMS WERE ONE AND THE SAME DELIVERY SYSTEM LEARNING CONTENT
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies24 Separated from HR / SIS DELIVERY SYSTEM LEARNING CONTENT STUDENT RECORDS / CURRICULUM / LEARNING PLANS
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies25 DOING THEIR OWN TRACKING DELIVERY SYSTEM LEARNING CONTENT STUDENT RECORDS / CURRICULUM / LEARNING PLANS SCORES FROM TESTS SKILLS & SKILL GAPS
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies26 LEADING TO THE TURN-OF-THE-CENTURY “LEARNING MANAGEMENT SYSTEM” DELIVERY SYSTEM LEARNING CONTENT STUDENT RECORDS / CURRICULUM / LEARNING PLANS SCORES FROM TESTS SKILLS & SKILL GAPS LMS
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies27 AT WHICH POINT IT BECAME APPARENT THAT CONTENT SHOULD BE SEPATED FROM DELIVERY STUDENT RECORDS / CURRICULUM / LEARNING PLANS DELIVERY SYSTEM SCORES FROM TESTS SKILLS & SKILL GAPS LEARNING CONTENT SCORES FROM TESTS LEARNING CONTENT RUNTIME COMMUNICATION
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies28 AND INTEGRATED WITH HR / SIS SYSTEMS DELIVERY SYSTEM SCORES FROM TESTS SKILLS & SKILL GAPS SCORES FROM TESTS LEARNING CONTENT RUNTIME COMMUNICATION STUDENT RECORDS / CURRICULUM / LEARNING PLANS
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies29 BUT COMPETENCIES ARE STILL TIED TO THE LEARNING SYSTEMS
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies30 Summing up: Not enough (or too many) standards No uniform underlying framework Open technical and conceptual problems Competencies are tied to LMS
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies31 WHICH IS The WAY THINGS WERE FOR CONTENT A FEW SHORT YEARS AGO (AND WE HAVE A VERY CONTENT-CENTRIC PERSPECTIVE)
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies32 SO WHAT DOES THE WORLD LOOK LIKE FROM A COMPETENCY PERSPECTIVE?
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies33 HERE’S ONE PERSON’S VIEW (MINE)* *WHICH COULD CHANGE TOMORROW: THE BIG CHALLENGE IS TO FIND GLOBAL CONSENSUS
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies34 THE BASIC PICTURE COMPETENCY MANAGEMENT Competency Database Maps taxonomies Rolls up status Externally Defined Competencies Rules for Rolling up status
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies35 HR / SIS / TALENT MANAGEMENT SYSTEM THE BASIC PICTURE Plus Tracking COMPETENCY & LEARNER MANAGEMENT Competency Database Maps taxonomies Rolls up status Keeps records Externally Defined Competencies Rules for Rolling up status Competency status reports Identity Management Raw Data (Evidence)
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies36 Tracking depends on assessment HR / SIS / TALENT MANAGEMENT SYSTEM COMPETENCY & LEARNER MANAGEMENT Competency Database Maps taxonomies Rolls up status Keeps records Externally Defined Competencies Rules for Rolling up status Competency status reports Identity Management Raw Data (Evidence) ASSESSMENT PROCESS
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies37 Currently this is done by an lms HR / SIS / TALENT MANAGEMENT SYSTEM COMPETENCY & LEARNER MANAGEMENT Competency Database Maps taxonomies Rolls up status Keeps records Externally Defined Competencies Rules for Rolling up status Competency status reports Identity Management Raw Data (Evidence) ASSESSMENT PROCESS LMS CONTENT
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies38 (But why not enable content to report results directly?) HR / SIS / TALENT MANAGEMENT SYSTEM COMPETENCY & LEARNER MANAGEMENT Competency Database Maps taxonomies Rolls up status Keeps records Externally Defined Competencies Rules for Rolling up status Competency status reports Identity Management Raw Data (Evidence) ASSESSMENT PROCESS LMS CONTENT
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies39 Any Content! Games PowerPoint Web Sites Documents Simulations
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies40 And Manage Competencies External to an LMS HR / SIS / TALENT MANAGEMENT SYSTEM COMPETENCY & LEARNER MANAGEMENT Competency Database Maps taxonomies Rolls up status Keeps records Externally Defined Competencies Rules for Rolling up status Competency status reports Identity Management Raw Data (Evidence) ASSESSMENT PROCESS LMS CONTENT
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies41 AND WhAt abouT context? HR / SIS / TALENT MANAGEMENT SYSTEM COMPETENCY & LEARNER MANAGEMENT Competency Database Maps taxonomies Rolls up status Keeps records Externally Defined Competencies Rules for Rolling up status Competency status reports Identity Management Raw Data (Evidence) ASSESSMENT PROCESS LMS CONTENT REPOSITORY / CONTENT SERVER SEARCH / DISCOVERY
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies42 AND THE LEARNER AS THE LEARNING ARCHITECT? HR / SIS / TALENT MANAGEMENT SYSTEM COMPETENCY & LEARNER MANAGEMENT Competency Database Maps taxonomies Rolls up status Keeps records Externally Defined Competencies Rules for Rolling up status Competency status reports Identity Management Raw Data (Evidence) ASSESSMENT PROCESS LMS CONTENT REPOSITORY / CONTENT SERVER SEARCH / DISCOVERY
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies43 OR A BRAVE NEW WORLD? Broadcast Listen ASSESSMENT PROCESS LMS Calls Assessment HR / SIS / TALENT MANAGEMENT SYSTEM Content correlated with competencies COMPETENCY & LEARNER MANAGEMENT Push Pull CONTENT REPOSITORY / CONTENT SERVER SEARCH / DISCOVERY LMS Privacy? Business Rules?
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies44 AND WHAT STANDARDS ARE NEEDED?
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies45 Environmental SCAN of STANDARDS Taxonomy mapping Semantic Web standards Competency Definitions / Competency Evidence IMS / IEEE LTSC / HR-XML Models like “OCM” (Objective, Condition, Measure) Need localized industry standards Competency Models Directed Acyclic Graphs with roll up rules DITA? Ostyn? Other? Learner information IMS and other
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies46 AND FINALLY What the IEEE Learning Technology Standards Committee is starting
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies47 A CONVERSATION – AND STUDY GROUPS STUDY GROUPS – INVESTIGATE THE NEED, RESOURCES AND IMPACT OF POTENTIAL NEW PROJECTS A. Candidate A: Competency Framework A standard for a structured Competency framework or architecture would be used to identify and classify the data, metadata, data models, data mappings, applications, and services that are needed to manage and apply competencies in learning and learning technology. B. Candidate B: Objective Statements A standard for objective statements would provide a common data model to capture, store, maintain, share, and reuse objectives. Objective statements enable objectives to be stored in repositories and can be used to determine how content assets are assembled to form learning objects. They can also be used as part of the process of initiating learning to meet a particular objective. C. Candidate C: Standardized Competency Definitions A competency definition is a description of a competency and an indication of how it can be measured. Such definitions can potentially be represented using the IEEE RCD structure. The candidate standard would standardize a specific set of such definitions, i.e. standardize some basic taxonomies (e.g. for leadership skills) that would promote interoperability across application domains.
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies48 HOW to participate in ltsc activities Join the online discussion site Competencies Competencies Contribute supporting documents Submit these to the same online site at Competencies Competencies Post your questions and comments to Competencies Competencies Watch for upcoming announcements Announcements will be distributed through the site listed above as well as through mailing lists on other related groups who become involved.
This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Attribution-NoDerivs 2.5 License. 10 October, 2006IDEA 2006: Competencies49 QUESTIONS? Comments?