2. Active Case-Based Reasoning for Lessons Delivery Systems Rosina Weber David W. Aha L. Karl Branting J. Robert Lucas Irma-Becerra Fernandez

3. Knowledge Management motivation State-of-the-art KM applicationsState-of-the-art KM applications Active Case-Based Reasoning for Active Case-Based Reasoning for Lessons Delivery Systems Lessons Delivery Systems better reuse of their knowledgebetter reuse of their knowledge organization's learning abilityorganization's learning ability elicitelicit

4. Knowledge Management context organizational knowledgeorganizational knowledge learning organizationlearning organization technologicaltechnological finding solutions to new and recurrent problemsfinding solutions to new and recurrent problems reusing and adapting previous solutionsreusing and adapting previous solutions past project experiencespast project experiences

5. Lessons learned Working experiencesWorking experiences Successes and failuresSuccesses and failures ValidValid ApplicableApplicable Generate impact on organization’s resultsGenerate impact on organization’s results

6. Lessons learned systems Exist to support an organizational process.Exist to support an organizational process. Are intended to promote knowledge sharing & leveraging.Are intended to promote knowledge sharing & leveraging. Which organizations?

7. http://www.aic.nrl.navy.mil:80/~aha/lessons/ Air Force Air Combat Command Center for Lessons Learned Center for Knowledge Sharing Lessons Learned Automated Lessons Learned Capture and Retrieval System (ALLCARS) Army Center for Army Lessons Learned (CALL) Center for Engineers Lessons Learned (CELL) Medical Lessons Learned (AMEDD) US Army Europe - Lessons Learned Operating System Coast Guard Lessons Learned and Best Practices Joint Forces Joint Center for Lessons Learned (JULLS) Marine Corps Marine Corps Lessons Learned System (MCLLS) Navy Doctrine Command Lessons Learned System Combined Automated Lessons Learned (CALL @ NAWCAD) Naval Facilities Engineering Command Lessons Learned System Non-Military Construction Industry Institute (Lessons Learned Wizard) Decision Systems, Inc. (REASON) DOE: Lessons Learned Services, SELLS, Project Hanford LL, etc. NASA Lessons Learned Information System International Safety Lessons Learned Information System NASA-Goddard: RECALL: Reusable Experience with CBR for Automating Lessons Learned) Canadian Army Lessons Learned Centre United Nations: UN Lessons Learned in Peacekeeping Operations Air Force Air Combat Command Center for Lessons Learned Center for Knowledge Sharing Lessons Learned Automated Lessons Learned Capture and Retrieval System (ALLCARS) Army Center for Army Lessons Learned (CALL) Center for Engineers Lessons Learned (CELL) Medical Lessons Learned (AMEDD) US Army Europe - Lessons Learned Operating System Coast Guard Lessons Learned and Best Practices Joint Forces Joint Center for Lessons Learned (JULLS) Marine Corps Marine Corps Lessons Learned System (MCLLS) Navy Doctrine Command Lessons Learned System Combined Automated Lessons Learned (CALL @ NAWCAD) Naval Facilities Engineering Command Lessons Learned System Non-Military Construction Industry Institute (Lessons Learned Wizard) Decision Systems, Inc. (REASON) DOE: Lessons Learned Services, SELLS, Project Hanford LL, etc. NASA Lessons Learned Information System International Safety Lessons Learned Information System NASA-Goddard: RECALL: Reusable Experience with CBR for Automating Lessons Learned) Canadian Army Lessons Learned Centre United Nations: UN Lessons Learned in Peacekeeping Operations All passive stand-alone systems Do LL systems promote knowledge sharing?? Have they been incorporated to the learning organization’s culture?? Do LL systems promote knowledge sharing?? Have they been incorporated to the learning organization’s culture??

8. Lessons Learned Repository Lessons Learned Repository Passive standalone systems users Lessons Learned Coordination Lessons Learned Coordination

9. LL systems do not promote knowledge sharing System Issue: they are standalone; Information Issue: Textual representations are not oriented for reuse; Unrealistic Assumptions Users: users know about LL systems, and where to find them; users have the time and the skills to search (i.e., learn to use) them; users can correctly interpret the lessons and reuse them successfully; users are reminded of their possible utility when needed; System Issue: they are standalone; Information Issue: Textual representations are not oriented for reuse; Unrealistic Assumptions Users: users know about LL systems, and where to find them; users have the time and the skills to search (i.e., learn to use) them; users can correctly interpret the lessons and reuse them successfully; users are reminded of their possible utility when needed; Reasons :

10. Knowledge Management context

11. Most KM tasks are performed in the context of a well-defined (e.g., business) process, and any techniques designed to support KM must be embedded in it. Knowledge is useful during decision- making. Embed lessons learned in decision-support systems. Embed lessons learned in decision-support systems. + =

12. An Active Lessons Delivery SystemAn Active Lessons Delivery System not standalone; a lessons delivery agent is embedded in a decision support system; user is within the decision-making environment (i.e., managing tasks); not standalone; a lessons delivery agent is embedded in a decision support system; user is within the decision-making environment (i.e., managing tasks); when the user changes world state conditions, the agent checks if there are lessons that apply and does one of: a) a lesson applies to the current decision then that lesson is shown to the user immediately; b) a lesson applies to a decision other than the current decision then that lesson is highlighted without interrupting the user. when the user changes world state conditions, the agent checks if there are lessons that apply and does one of: a) a lesson applies to the current decision then that lesson is shown to the user immediately; b) a lesson applies to a decision other than the current decision then that lesson is highlighted without interrupting the user.

13. Implications of Active Lessons Delivery user doesn’t need to know the agent exists; user doesn’t need to learn to use it, it is active; no additional time is required for its use; lessons and suggestions are stated clearly; suggestions are related to the current decision; user is told about the lesson only if it is useful. user doesn’t need to know the agent exists; user doesn’t need to learn to use it, it is active; no additional time is required for its use; lessons and suggestions are stated clearly; suggestions are related to the current decision; user is told about the lesson only if it is useful.

14. Our Solution: Active Lessons Delivery in HICAP

15. The lessons learned process starts when a decision/task is about to be made; world state conditions match an applicable lesson; the applicable lesson contributes knowledge to perform the task/make a decision; the process is only completed when the lesson is learned, i.e., knowledge is reused and a process has been changed. starts when a decision/task is about to be made; world state conditions match an applicable lesson; the applicable lesson contributes knowledge to perform the task/make a decision; the process is only completed when the lesson is learned, i.e., knowledge is reused and a process has been changed. The system that captures this process promotes knowledge sharing. The system that captures this process promotes knowledge sharing.

16. 1. Review: lessons learned systems 2. Active Lessons Delivery: Design, implementation 3. Example in HICAP 4. Lesson representation 5. Evaluation: effect in plans 6. Lesson elicitation 7. Evaluation of overall project 1. Review: lessons learned systems 2. Active Lessons Delivery: Design, implementation 3. Example in HICAP 4. Lesson representation 5. Evaluation: effect in plans 6. Lesson elicitation 7. Evaluation of overall project Directions

17. Knowledge Management context