Introduction.  “a technique that enables the computer to encode complex grammatical knowledge such as humans use to assemble sentences, recognize errors.

Slides:



Advertisements
Similar presentations
Software & Services Group, Developer Products Division Copyright© 2010, Intel Corporation. All rights reserved. *Other brands and names are the property.
Advertisements

Natural Language Understanding Difficulties: Large amount of human knowledge assumed – Context is key. Language is pattern-based. Patterns can restrict.
Proceedings of the Conference on Intelligent Text Processing and Computational Linguistics (CICLing-2007) Learning for Semantic Parsing Advisor: Hsin-His.
Compilers and Language Translation
Statistical NLP: Lecture 3
1 Developing Statistic-based and Rule-based Grammar Checkers for Chinese ESL Learners Howard Chen Department of English National Taiwan Normal University.
1 Words and the Lexicon September 10th 2009 Lecture #3.
Yu-Chen Kuo1 Chapter 1 Introduction to Compiling.
NaLIX: A Generic Natural Language Search Environment for XML Data Presented by: Erik Mathisen 02/12/2008.
An interactive environment for creating and validating syntactic rules Panagiotis Bouros*, Aggeliki Fotopoulou, Nicholas Glaros Institute for Language.
CALL: Computer-Assisted Language Learning. 2/14 Computer-Assisted (Language) Learning “Little” programs Purpose-built learning programs (courseware) Using.
Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Oracle Enterprise Data Quality CDEP: Tailoring Parser Configuration.
Models of Generative Grammar Smriti Singh. Generative Grammar  A Generative Grammar is a set of formal rules that can generate an infinite set of sentences.
Communication Difficulties Oral Expression & Listening Comprehension.
1.3 Executing Programs. How is Computer Code Transformed into an Executable? Interpreters Compilers Hybrid systems.
March 1, 2009 Dr. Muhammed Al-Mulhem 1 ICS 482 Natural Language Processing INTRODUCTION Muhammed Al-Mulhem March 1, 2009.
Statistical Natural Language Processing. What is NLP?  Natural Language Processing (NLP), or Computational Linguistics, is concerned with theoretical.
Introduction.  Classification based on function role in classroom instruction  Placement assessment: administered at the beginning of instruction 
Lecture 1, 7/21/2005Natural Language Processing1 CS60057 Speech &Natural Language Processing Autumn 2005 Lecture 1 21 July 2005.
GRAMMAR APPROACH By: Katherine Marzán Concepción EDUC 413 Prof. Evelyn Lugo.
Invitation to Computer Science 5th Edition
Lecture 12: 22/6/1435 Natural language processing Lecturer/ Kawther Abas 363CS – Artificial Intelligence.
INTRODUCTION TO COMPUTING CHAPTER NO. 06. Compilers and Language Translation Introduction The Compilation Process Phase 1 – Lexical Analysis Phase 2 –
COP4020 Programming Languages
Parser-Driven Games Tool programming © Allan C. Milne Abertay University v
Chapter 10: Compilers and Language Translation Invitation to Computer Science, Java Version, Third Edition.
Learner corpus analysis and error annotation Xiaofei Lu CALPER 2010 Summer Workshop July 13, 2010.
PETRA – the Personal Embedded Translation and Reading Assistant Werner Winiwarter University of Vienna InSTIL/ICALL Symposium 2004 June 17-19, 2004.
1 COMP 3438 – Part II-Lecture 1: Overview of Compiler Design Dr. Zili Shao Department of Computing The Hong Kong Polytechnic Univ.
1 Natural Language Processing Lecture Notes 11 Chapter 15 (part 1)
Unit-1 Introduction Prepared by: Prof. Harish I Rathod
An ICALL writing support system tunable to varying levels of learner initiative Karin Harbusch 1 & Gerard Kempen 2,3 1 University of Koblenz-Landau, Koblenz,
Deeper Sentiment Analysis Using Machine Translation Technology Kanauama Hiroshi, Nasukawa Tetsuya Tokyo Research Laboratory, IBM Japan Coling 2004.
1.  10% Assignments/ class participation  10% Pop Quizzes  05% Attendance  25% Mid Term  50% Final Term 2.
LANGUAGE TRANSFER SRI SURYANTI WORD ORDER STUDIES OF TRANSFER ODLIN (1989;1990) UNIVERSAL POSITION WHAT EXTENT WORD ORDER IN INTERLANGUAGE IS.
Error Correction: For Dummies? Ellen Pratt, PhD. UPR Mayaguez.
Linguistic Essentials
What you have learned and how you can use it : Grammars and Lexicons Parts I-III.
Computational linguistics A brief overview. Computational Linguistics might be considered as a synonym of automatic processing of natural language, since.
Chapter 1 Introduction. Chapter 1 - Introduction 2 The Goal of Chapter 1 Introduce different forms of language translators Give a high level overview.
Grammars Grammars can get quite complex, but are essential. Syntax: the form of the text that is valid Semantics: the meaning of the form – Sometimes semantics.
Introduction to Compilers. Related Area Programming languages Machine architecture Language theory Algorithms Data structures Operating systems Software.
Topic #1: Introduction EE 456 – Compiling Techniques Prof. Carl Sable Fall 2003.
1 Compiler Design (40-414)  Main Text Book: Compilers: Principles, Techniques & Tools, 2 nd ed., Aho, Lam, Sethi, and Ullman, 2007  Evaluation:  Midterm.
Chapter 1 Introduction Study Goals: Master: the phases of a compiler Understand: what is a compiler Know: interpreter,compiler structure.
Artificial Intelligence: Natural Language
Introduction to Compiling
Compiler Design Introduction 1. 2 Course Outline Introduction to Compiling Lexical Analysis Syntax Analysis –Context Free Grammars –Top-Down Parsing –Bottom-Up.
Compiler Construction By: Muhammad Nadeem Edited By: M. Bilal Qureshi.
1 Compiler & its Phases Krishan Kumar Asstt. Prof. (CSE) BPRCE, Gohana.
 Fall Chart 2  Translators and Compilers  Textbook o Programming Language Processors in Java, Authors: David A. Watts & Deryck F. Brown, 2000,
Concepts and Realization of a Diagram Editor Generator Based on Hypergraph Transformation Author: Mark Minas Presenter: Song Gu.
Compiler Construction CPCS302 Dr. Manal Abdulaziz.
CSC 4181 Compiler Construction
NATURAL LANGUAGE PROCESSING
Overview of Compilation Prepared by Manuel E. Bermúdez, Ph.D. Associate Professor University of Florida Programming Language Principles Lecture 2.
1 Instructing the English Language Learner (ELL) in the Regular Classroom.
The University of Illinois System in the CoNLL-2013 Shared Task Alla RozovskayaKai-Wei ChangMark SammonsDan Roth Cognitive Computation Group University.
Advanced Computer Systems
Compiler Design (40-414) Main Text Book:
Introduction to Compiler Construction
Statistical NLP: Lecture 3
ELT 213 APPROACHES TO ELT I GRAMMAR-TRANSLATION METHOD WEEK 3
Kenneth Baclawski et. al. PSB /11/7 Sa-Im Shin
Improving a Pipeline Architecture for Shallow Discourse Parsing
An ICALL writing support system tunable to varying levels
Linguistic Essentials
Compilers Principles, Techniques, & Tools Taught by Jing Zhang
Chapter 10: Compilers and Language Translation
Artificial Intelligence 2004 Speech & Natural Language Processing
Presentation transcript:

Introduction

 “a technique that enables the computer to encode complex grammatical knowledge such as humans use to assemble sentences, recognize errors and make corrections”

 CALL  Hardcoded instructions  Pre-configured assessment items  Pre-specified mapping between learner response and error category  ICALL  Adaptive instructions  Dynamic assessment item generation  Automated mapping using NLP techniques

 CALL  Teacher centric rather than learner centric  Explosion in learner responses  Explicit learner response to error mapping not feasible  Highly constrained learner responses  Not sufficient for self-learning  ICALL  Abstract away from specific string entered by learner to more general classes of properties  Generation of feedback, learner modeling, instructional sequencing can be based on small number of abstract properties  NLP systems are not robust

Student NLP Feedback Designer LM Learner Modeling Instructional Sequencing Feedback Response Instruction Tutoring System

 In form-focused ICALL, the interaction workflow proceeds as follows:  In response to some prompt or question by the tutor, the student enters a sentence  The sentence is forwarded to the parser for analysis of syntax validity  The sentence passes the syntax validity check or  The parser will fail in case the learner response is ill- formed  The error is classified into generic error classes  The error handler generate appropriate feedback to be presented to the learner.

 Tutoring subsystem  moderation of parser output  withholding information  alerting the student that something is wrong  highlighting the location of errors  classifying the errors  correction or hint on errors  showing the structural analysis of the sentence  assign score against the learner response  revisiting instruction sequence dynamically  update student model

 Vocabulary learning  Diagnosis of learner error  Correcting learner errors  Language learning exercise generation

 Lexical Hypothesis: Speaking is essentially lexicon driven (Levelt, 1989)  Grammatical form can only be activated once a lexical item has been chosen  Lexical items need to have a rich internal structure ▪ Meaning, syntactic, morphological and phonological properties  Learning types  Intentional  Incidental

“An intelligent word-based language learning assistant” – Nerbonne and Dokter University of Groningen

 The task  Given a learner provided response, mark the errors  Need to parse learner response  Erroneous sentences are ill-formed  Parsers expects the input sentence to be well- formed.  Parsers should show tolerance to error

 Overgenerate and rank  Imposing ranking constraints on grammatical rule violation  Mal-rules to allow parsing with specific errors  Parse fitting  Generate fragmented parse trees and try to fit them together  Do not allow analysis of completely arbitrary ungrammatical input

 Issues with English Language Learners (ELL)  Concentration of errors are much higher than native learners.  Using proofreading tools (e.g. MS Word)? ▪ Designed for native users ▪ Not very robust against foreign learner errors ▪ Targeted errors are small subset of learner errors

 Error correction in machine translation output  Data driven approach  Classification approach ▪ Whether an article will be followed by a noun? ▪ Whether an article appearing before noun is correct? ▪ What would be the correct article?  Language modelling approach ▪ Errors will most likely be located in the area with low LM score  A hybrid system?

 Influence of L1  No equivalent for a feature. ▪ Japanese and Russians face difficulty in learning articles  Languages sharing features ▪ German and French learners find it easy to learn English article systems  Transfer problem ▪ Positive transfer ▪ Negative transfer

 Spelling errors  Article usage  Preposition usage  Collocation errors

 Negative transfer  Correspondence between prepositions of any two languages is many-to-many  घर पर  at home, सड़क पर  on the road  Prepositions imposes semantic variation  in the summer vs. during the summer  Argument of predicates  Nomilalization (removal of hazard vs remove the hazard)  Type of argument (book in the box vs book on the table)  Verb alteration (They loaded hay on the wagon vs They loaded the wagon with hay)

 Phrasal Verbs (verb+particle)  Non-compositional  give vs give up  Particles can move (put the switch off)  Phrasal verbs often used with prepositions (give in to their demands)  Idioms (in the house vs on the house) This is Kalyani in the house with all your favourite tunes “in the house”  venue All the drinks were on the house “On the house”  free

 Indefinite article depends on countability of nouns  Countable vs uncountable ▪ The price of a Spring Fest hoody is Rs ▪ The price of freedom is constant vigilance.  Syntactic  Some uncountable nouns can take indefinite article when attached with a preposition phrase (a knowledge of English)  Discourse  World knowledge

 Learner Error Corpora  Grammatical Error Detection  Grammatical Error Correction  Evaluation of Error Detection/Correction System