Presentation is loading. Please wait.

Presentation is loading. Please wait.

Lemma: canonical (citation) form of a lexeme, which conventionally represents the set of related words Lexeme: the set of related words But….

Published byKurt Pedersen Modified over 6 years ago

Similar presentations

Presentation on theme: "Lemma: canonical (citation) form of a lexeme, which conventionally represents the set of related words Lexeme: the set of related words But…."— Presentation transcript:

1 Lemma: canonical (citation) form of a lexeme, which conventionally represents the set of related words Lexeme: the set of related words But….

2 Text Corpora: Speech Corpora: British National Corpus: 100M words
Brown Corpus: 1M words Hansards: 750K words Wall Street Journal: 914K words AP newswire: 620+M words Penn Treebank: +1M words, bracketed syntactically, WSJ+ Speech Corpora: London-Lund Corpus: 1M words Call Home: lots ATIS (7812 words) Switchboard: 240h (+3M words) Broadcast News: lots TDT: h (Eng,Ara,Mand) Communicator: 62h (317k words)

Download ppt "Lemma: canonical (citation) form of a lexeme, which conventionally represents the set of related words Lexeme: the set of related words But…."

Similar presentations

School of something FACULTY OF OTHER School of Computing FACULTY OF ENGINEERING Chunking: Shallow Parsing Eric Atwell, Language Research Group.

School of something FACULTY OF OTHER School of Computing FACULTY OF ENGINEERING Chunking: Shallow Parsing Eric Atwell, Language Research Group.
What’s in a Corpus? School of Computing

What’s in a Corpus? School of Computing
Language Modeling: Ngrams

Language Modeling: Ngrams
N-Grams and Corpus Linguistics 6 July 2012. Linguistics vs. Engineering “But it must be recognized that the notion of “probability of a sentence” is an.

N-Grams and Corpus Linguistics 6 July Linguistics vs. Engineering “But it must be recognized that the notion of “probability of a sentence” is an.
Lund Online: SAGE Publications Los Angeles | London | New Delhi Singapore | Washington DC.

Lund Online: SAGE Publications Los Angeles | London | New Delhi Singapore | Washington DC.
1990s DARPA Programmes WSJ and BN Dapo Durosinmi-Etti Bo Xu Xiaoxiao Zheng.

1990s DARPA Programmes WSJ and BN Dapo Durosinmi-Etti Bo Xu Xiaoxiao Zheng.
Week 7 Churchill and the Taxi Driver

Week 7 Churchill and the Taxi Driver
What's Happened Since the First SIGDAT Meeting? Kenneth Ward Church AT&T Labs-Research

What's Happened Since the First SIGDAT Meeting? Kenneth Ward Church AT&T Labs-Research
CS 4705 N-Grams and Corpus Linguistics Julia Hirschberg CS 4705.

CS 4705 N-Grams and Corpus Linguistics Julia Hirschberg CS 4705.
N-Grams and Corpus Linguistics.  Regular expressions for asking questions about the stock market from stock reports  Due midnight, Sept. 29 th  Use.

N-Grams and Corpus Linguistics.  Regular expressions for asking questions about the stock market from stock reports  Due midnight, Sept. 29 th  Use.
Searching for Wall Street Journal Articles in ABI Inform 12.2009 NLU Library.

Searching for Wall Street Journal Articles in ABI Inform NLU Library.
LING 581: Advanced Computational Linguistics Lecture Notes February 2nd.

LING 581: Advanced Computational Linguistics Lecture Notes February 2nd.
Albert Gatt LIN3022 Natural Language Processing Lecture 8.

Albert Gatt LIN3022 Natural Language Processing Lecture 8.
N-Grams and Corpus Linguistics

N-Grams and Corpus Linguistics
LELA English Corpus Linguistics

LELA English Corpus Linguistics
Resources Primary resources – Lexicons, structured vocabularies – Grammars (in widest sense) – Corpora – Treebanks Secondary resources – Designed for a.

Resources Primary resources – Lexicons, structured vocabularies – Grammars (in widest sense) – Corpora – Treebanks Secondary resources – Designed for a.
CS 4705 N-Grams and Corpus Linguistics. Homework Use Perl or Java reg-ex package HW focus is on writing the “grammar” or FSA for dates and times The date.

CS 4705 N-Grams and Corpus Linguistics. Homework Use Perl or Java reg-ex package HW focus is on writing the “grammar” or FSA for dates and times The date.
CS 4705 N-Grams and Corpus Linguistics. Spelling Correction, revisited M$ suggests: –ngram: NorAm –unigrams: anagrams, enigmas –bigrams: begrimes –trigrams:

CS 4705 N-Grams and Corpus Linguistics. Spelling Correction, revisited M$ suggests: –ngram: NorAm –unigrams: anagrams, enigmas –bigrams: begrimes –trigrams:
CS 4705 Lecture 14 Corpus Linguistics II. Relating Conditionals and Priors P(A | B) = P(A ^ B) / P(B) –Or, P(A ^ B) = P(A | B) P(B) Bayes Theorem lets.

CS 4705 Lecture 14 Corpus Linguistics II. Relating Conditionals and Priors P(A | B) = P(A ^ B) / P(B) –Or, P(A ^ B) = P(A | B) P(B) Bayes Theorem lets.
1 Statistical NLP: Lecture 6 Corpus-Based Work. 2 4 Text Corpora are usually big. They also need to be representative samples of the population of interest.

1 Statistical NLP: Lecture 6 Corpus-Based Work. 2 4 Text Corpora are usually big. They also need to be representative samples of the population of interest.

Similar presentations

Ads by Google