A Web Mining Platform for Enhancing Knowledge Management on the Web KOK-LEONG ONG WEE-KEONG NG EE-PENG LIM Center for Advanced Information Systems, Nanyang Technological University 012ITI12 Song Mi-Kyoung

0. Contents Introduction Current Mining Scenario Existing Architecture Whoweda, Wiccap Platform for Web Mining Data Mining Kernel, Components, Application Interface Application Example A Web Mining Platform for Enhancing Knowledge Management on the Web 2002 Spring Semester Data Mining 012ITI12 Song Mi-Kyoung

1. Introduction MS MSDN KM & DataMining Recorded w/o knowledge analyst Time invariant and global reach KM & DataMining A Web Mining Platform for Enhancing Knowledge Management on the Web 2002 Spring Semester Data Mining 012ITI12 Song Mi-Kyoung

1. Introduction Web data Issues Loosening KDD Process Web data is semi-structures at best Web data is distributed Web data is owned by everyone Web data has privacy concerns Web data is online and interactive Loosening KDD Process XML connecting components A Web Mining Platform for Enhancing Knowledge Management on the Web 2002 Spring Semester Data Mining 012ITI12 Song Mi-Kyoung

2. Current Mining Scenario PMML Interchange format for DM Supports DM seven models Independent on the application, system and architecture A Web Mining Platform for Enhancing Knowledge Management on the Web 2002 Spring Semester Data Mining 012ITI12 Song Mi-Kyoung

2. Current Mining Scenario JSR 073 The JAVA Data Mining application programming interface OLE DB Microsoft SQL with Data Mining CWM The OMG’s Common Warehouse Meta-data A Web Mining Platform for Enhancing Knowledge Management on the Web 2002 Spring Semester Data Mining 012ITI12 Song Mi-Kyoung

3. Existing Architecture Inter-API calls, data transfer b/w components by XML Web logs, multimedia data, transaction records A Web Mining Platform for Enhancing Knowledge Management on the Web 2002 Spring Semester Data Mining 012ITI12 Song Mi-Kyoung

3. Existing Architecture Whoweda Web warehouse : brings, preprocessing and storing data & information WICS : data manipulation module WIMS : data mining Module A Web Mining Platform for Enhancing Knowledge Management on the Web 2002 Spring Semester Data Mining 012ITI12 Song Mi-Kyoung

3. Existing Architecture Wiccap generate mapping rules extraction of information with mapping rule Whoewda + Wiccap Web protocol & interface in data mining kernel & platform can access all Web data in a structured and location independent manner A Web Mining Platform for Enhancing Knowledge Management on the Web 2002 Spring Semester Data Mining 012ITI12 Song Mi-Kyoung

4. Platform for Web Mining Data mining Kernel Provide a consistent set of interface to the Data Mining components Provide Security features to the incoming data : algorithm’s no direct access, sharing data Monitor the change on a Web site A Web Mining Platform for Enhancing Knowledge Management on the Web 2002 Spring Semester Data Mining 012ITI12 Song Mi-Kyoung

4. Platform for Web Mining Data mining Components Interpreters : bridge b/w application interfaces and the rest, translate, language framework Algorithms : data mining algorithms PMML : model exchange, component communication Visualization : visualization of PMML A Web Mining Platform for Enhancing Knowledge Management on the Web 2002 Spring Semester Data Mining 012ITI12 Song Mi-Kyoung

4. Platform for Web Mining Application Interface Web services API : application programming interface ASP interface : application service providers KQML/FIPA : standard for agent communication, software agent A Web Mining Platform for Enhancing Knowledge Management on the Web 2002 Spring Semester Data Mining 012ITI12 Song Mi-Kyoung

5. Application Example User 1. User’s keyword 2. Filtering, removal of unrelated doc. 9. Click documents 10. track the documents 3. Negotiate services 4. Initiate protocol Translate the request 5. Retrieve documents 6. Data mining task 7. Translate to PMML 8. Return to search agent A Web Mining Platform for Enhancing Knowledge Management on the Web 2002 Spring Semester Data Mining 012ITI12 Song Mi-Kyoung

6. Summary With Whoewda, Web data can be harvested into structured records that can be queried using Whoewda’s Web query language while Wiccap materializes information on the Web into XML documents that can be structurally proceed Standardization Web warehousing, Web technologies, software agent, database A Web Mining Platform for Enhancing Knowledge Management on the Web 2002 Spring Semester Data Mining 012ITI12 Song Mi-Kyoung

7. Q & A Thank you. A Web Mining Platform for Enhancing Knowledge Management on the Web 2002 Spring Semester Data Mining 012ITI12 Song Mi-Kyoung