Knowledge Science & Engineering Institute, Beijing Normal University, Analyzing Transcripts of Online Asynchronous Discussion Groups with VINCA Yanyan Li Knowledge Science & Engineering Institute, School of Education Technology, Beijing Normal University

Knowledge Science & Engineering Institute, Beijing Normal University, Outline Existing tools VINCA introduction Further development

Knowledge Science & Engineering Institute, Beijing Normal University, Existing Tools Annotation aids Nvivo ( Atlas-ti ( Dictionary-based content analysis CATPAC LIWC ( Development environments Profiler Plus DIMAP (

Knowledge Science & Engineering Institute, Beijing Normal University, Shortcomings of the tools Not integrated Coding process is largely manual Not learnable Display coding results in text or tables Lack of freestanding content analysis packages incorporating text mining.

Knowledge Science & Engineering Institute, Beijing Normal University, Our goal Can we design and implement an integrated tool to assist identifying features of interaction and provide feedbacks to facilitate the collaboration in CSCL?

Knowledge Science & Engineering Institute, Beijing Normal University, Implementing a Tool to Support Discussion Transcripts Analysis

Knowledge Science & Engineering Institute, Beijing Normal University, Multidimensional Analysis How do the students talking with others? What are the students talking about? Who are talking to whom? Process Pattern Speech Topics Member Relationship Interaction Discourse Keywords in context Semi-auto Coding Statistics for Social Network Analysis

Knowledge Science & Engineering Institute, Beijing Normal University, Tool Design Framework

Knowledge Science & Engineering Institute, Beijing Normal University, Vinca ‘ s Features Learnable semi-automatic coding support Analyze text in Chinese (traditional and simplified) Utilize computational language & text mining technologies Support assessing for CKB Underlying technologies Syntax analysis Domain ontology Association rules mining

Knowledge Science & Engineering Institute, Beijing Normal University, 1) Data preparation Data preparation to convert Knowledge Forum (KF platform) discourse in html to database format  From Version 3.4  From Version 4.5

Knowledge Science & Engineering Institute, Beijing Normal University, 2) Annotation Aids Edit Coding Scheme  New, Modify, Delete Associate feature keywords to specific codes Annotation  Support segment & merge  *Automatic discover the code hint, highlight it and attach possible codes with confidence probability.  During the process of coding, users are allowed to select the hint to mark the final coding. View Coding Result Suggested codes

Knowledge Science & Engineering Institute, Beijing Normal University, 3) Text Analysis Keywords retrieval & frequency counting Concordance *Discourse pattern discovery *Category analysis  Similarity Computation *Text clustering Ontology-based assessing for CKB

Knowledge Science & Engineering Institute, Beijing Normal University, Word Frequency (Keywords Retrieval) Select Data  From KF  From Speech File  From Single Text File Exclusive List  Special  Common Tag Filter Picked List Find Keywords in Word List Export Keywords & User Keywords Distribution Import user ’ s lexicon Select exclusive list Select the words with specified tags

Knowledge Science & Engineering Institute, Beijing Normal University, 14 Concordance List of extracted keywords Concordance

Knowledge Science & Engineering Institute, Beijing Normal University, Check the original text

Knowledge Science & Engineering Institute, Beijing Normal University, Discourse Pattern Discovery Pattern configuration interface Frequent pattern mining results

Knowledge Science & Engineering Institute, Beijing Normal University, Category Analysis Open Category File Search Para Synonyms in Interaction Text Based on Similarity Computation Category List Lexicon specified by tutors and auto-found synonyms

Knowledge Science & Engineering Institute, Beijing Normal University, Text Clustering Select Data.. Get Keywords.. Set Option Export Result of Text Clustering

Knowledge Science & Engineering Institute, Beijing Normal University, 19 Assessing for CKB Group Performance Member Contribution Topic similarity between members Domain ontology

Knowledge Science & Engineering Institute, Beijing Normal University, 4) Data Export for SNA Export KF Data Export Relation Matrix Export Coding Result Export Coding Matrix Export Coding Frequency

Knowledge Science & Engineering Institute, Beijing Normal University, Annotation aids  Semi-automatic coding with enhanced precision Text analysis  Category analysis for topic recognition  Discourse Pattern discovery Visualization  Topic space  Social network Further Development

Knowledge Science & Engineering Institute, Beijing Normal University, Thanks! Welcome Questions and Comments