1. ©2003 Paula Matuszek Taken primarily from a presentation by Lin Lin. http://webster.cs.uga.edu/~lin/GlobalInfoSys/GATE.ppt CSC 9010: Text Mining Applications Fall, 2003 Introduction to GATE Dr. Paula Matuszek Paula_A_Matuszek@glaxosmithkline.com Taken primarily from a presentation by Lin Lin http://webster.cs.uga.edu/~lin/GlobalInfoSys/GATE.ppt

2. ©2003 Paula Matuszek Taken primarily from a presentation by Lin Lin. http://webster.cs.uga.edu/~lin/GlobalInfoSys/GATE.ppt What is GATE? l Stands for General Architecture for Text Engineering. l The theory behind GATE is SALE (Software Architecture for Language Engineering): –computer processing of human language –computer infrastructure for software development

3. ©2003 Paula Matuszek Taken primarily from a presentation by Lin Lin. http://webster.cs.uga.edu/~lin/GlobalInfoSys/GATE.ppt Who Use GATE? l Scientists performing experiments that involve processing human language l Developers developing applications with language processing components l Teachers and students of courses about language and language computation

4. ©2003 Paula Matuszek Taken primarily from a presentation by Lin Lin. http://webster.cs.uga.edu/~lin/GlobalInfoSys/GATE.ppt How GATE can Help? l Specify an architecture, or organizational structure, for language processing software l Provide a framework, or class library, that implements the architecture and can be used to embed language processing capabilities in diverse applications l Provide a development environment built on top of the framework made up of convenient graphical tools for developing components

5. ©2003 Paula Matuszek Taken primarily from a presentation by Lin Lin. http://webster.cs.uga.edu/~lin/GlobalInfoSys/GATE.ppt What are GATE Components? l Reusable software chunks with well defined interfaces l Used in Java beans and Microsoft’s.Net

6. ©2003 Paula Matuszek Taken primarily from a presentation by Lin Lin. http://webster.cs.uga.edu/~lin/GlobalInfoSys/GATE.ppt GATE as an architecture l Breaks down to three types of components: –LanguageResources (LRs) –represent entities such as lexicons, documents, corpora, annotation schemas, or ontologies; –ProcessingResources (PRs) –represent entities that are primarily algorithmic, such as parsers, generators or ngram modelers; –VisualResources (VRs) –represent visualization and editing components that participate in GUIs.

7. ©2003 Paula Matuszek Taken primarily from a presentation by Lin Lin. http://webster.cs.uga.edu/~lin/GlobalInfoSys/GATE.ppt LRs: Corpora, Documents, and Annotations l A Corpus in Gate is a Java Set whose members are Documents. l Documents are modeled as content plus annotations plus features. l Annotations are organized in graphs, which are modeled as Java sets of Annotation.

8. ©2003 Paula Matuszek Taken primarily from a presentation by Lin Lin. http://webster.cs.uga.edu/~lin/GlobalInfoSys/GATE.ppt Documents Processing in GATE l Document: –Formats including XML, RTF, email, HTML, SGML, and plain text. –Identified and converted into GATE annotation format. –Processed by PRs. –Results stored in a serial data store (based on Java serialization) or as XML.

9. ©2003 Paula Matuszek Taken primarily from a presentation by Lin Lin. http://webster.cs.uga.edu/~lin/GlobalInfoSys/GATE.ppt Built-in GATE Components l Resources for common LE data structures and algorithms, including documents, corpora and various annotation types l A set of language analysis components for Information Extraction (e.g. ANNIE) l A range of data visualization and editing components

10. ©2003 Paula Matuszek Taken primarily from a presentation by Lin Lin. http://webster.cs.uga.edu/~lin/GlobalInfoSys/GATE.ppt Develop Language Processing Functionality using GATE l Programming, or the development of Language Resources such as grammars that are used by existing Processing Resources, or a mixture of both. l The development environment is used for: –visualization of the data structures produced and consumed during processing –debugging –performance measurement

11. ©2003 Paula Matuszek Taken primarily from a presentation by Lin Lin. http://webster.cs.uga.edu/~lin/GlobalInfoSys/GATE.ppt CREOLE l A Collection of REusable Objects for Language Engineering l The set of resources integrated with GATE l All the resources are packaged as Java Archive (or ‘JAR’) files, plus some XML configuration data.

12. ©2003 Paula Matuszek Taken primarily from a presentation by Lin Lin. http://webster.cs.uga.edu/~lin/GlobalInfoSys/GATE.ppt PRs: ANNIE l A family of Processing Resources for language analysis included with GATE l Stands for A Nearly-New Information Extraction system. l Using finite state techniques to implement various tasks: tokenization, semantic tagging, verb phrase chunking, and so on.

13. ©2003 Paula Matuszek Taken primarily from a presentation by Lin Lin. http://webster.cs.uga.edu/~lin/GlobalInfoSys/GATE.ppt ANNIE IE Modules

14. ©2003 Paula Matuszek Taken primarily from a presentation by Lin Lin. http://webster.cs.uga.edu/~lin/GlobalInfoSys/GATE.ppt ANNIE Components l Tokenizer l Gazetteer l Sentence Splitter l Part of Speech Tagger –produces a part-of-speech tag as an annotation on each word or symbol. l Semantic Tagger l OrthoMatcher Coreference Module

15. ©2003 Paula Matuszek Taken primarily from a presentation by Lin Lin. http://webster.cs.uga.edu/~lin/GlobalInfoSys/GATE.ppt ANNIE Component: Tokenizer l Token Types –word, number, symbol, punctuation, and spaceToken. l A tokenizer rule has a left hand side and a right hand side.

16. ©2003 Paula Matuszek Taken primarily from a presentation by Lin Lin. http://webster.cs.uga.edu/~lin/GlobalInfoSys/GATE.ppt Tokenizer Rule l Operations used on the LHS: – | (or) – * (0 or more occurrences) – ? (0 or 1 occurrences) – + (1 or more occurrences) l The RHS uses ’;’ as a separator, and has the following format: {LHS} > {Annotation type};{attribute1}={valu e1};...;{attribute n}={value n}

17. ©2003 Paula Matuszek Taken primarily from a presentation by Lin Lin. http://webster.cs.uga.edu/~lin/GlobalInfoSys/GATE.ppt Example Tokenizer Rule "UPPERCASE_LETTER" "LOWERCASE_LETTER"* > Token;orth=upperInitial;kind=word; –The sequence must begin with an uppercase letter, followed by zero or more lowercase letters. This sequence will then be annotated as type “Token”. The attribute “orth” (orthography) has the value “upperInitial”; the attribute “kind” has the value “word”.

18. ©2003 Paula Matuszek Taken primarily from a presentation by Lin Lin. http://webster.cs.uga.edu/~lin/GlobalInfoSys/GATE.ppt ANNIE Component: Gazetteer l The gazetteer lists used are plain text files, with one entry per line. l Each list represents a set of names, such as names of cities, organizations, days of the week, etc. l src\gate\resources\Creole\gazeteer\Default\*.lst

19. ©2003 Paula Matuszek Taken primarily from a presentation by Lin Lin. http://webster.cs.uga.edu/~lin/GlobalInfoSys/GATE.ppt Example Gazetteer List l A small section of the list for units of currency: l …… Ecu European Currency Units FFr Fr German mark German marks New Taiwan dollar New Taiwan dollars NT dollar NT dollars ……

20. ©2003 Paula Matuszek Taken primarily from a presentation by Lin Lin. http://webster.cs.uga.edu/~lin/GlobalInfoSys/GATE.ppt ANNIE Component: Semantic Tagger l Based on JAPE language, which contains rules that act on annotations assigned in earlier phases. l Produce outputs of annotated entities.

21. ©2003 Paula Matuszek Taken primarily from a presentation by Lin Lin. http://webster.cs.uga.edu/~lin/GlobalInfoSys/GATE.ppt ANNIE Component: Sentence Splitter l Segments the text into sentences. l This module is required for the tagger. l The splitter uses a gazetteer list of abbreviations to help distinguish sentence-marking full stops from other kinds.

22. ©2003 Paula Matuszek Taken primarily from a presentation by Lin Lin. http://webster.cs.uga.edu/~lin/GlobalInfoSys/GATE.ppt ANNIE Component: OrthoMatcher l Adds identity relations between named entities found by the semantic tagger, in order to perform coreference. l Does not find new named entities, but it may assign a type to an unclassified proper name.

23. ©2003 Paula Matuszek Taken primarily from a presentation by Lin Lin. http://webster.cs.uga.edu/~lin/GlobalInfoSys/GATE.ppt Create a New Resource l Write a Java class that implements GATE’s beans model. l Compile the class, and any others that it uses, into a Java Archive (JAR) file. l Write some XML configuration data for the new resource. l Tell GATE the URL of the new JAR and XML files.

24. ©2003 Paula Matuszek Taken primarily from a presentation by Lin Lin. http://webster.cs.uga.edu/~lin/GlobalInfoSys/GATE.ppt Example: Create a New Component Called GoldFish l GoldFish: –Is a processing resource –Look for all instances of the word “fish” in the document –Add an annotation of type “GoldFish”

25. ©2003 Paula Matuszek Taken primarily from a presentation by Lin Lin. http://webster.cs.uga.edu/~lin/GlobalInfoSys/GATE.ppt Example: Create GoldFish Using BootStrap Wizard

26. ©2003 Paula Matuszek Taken primarily from a presentation by Lin Lin. http://webster.cs.uga.edu/~lin/GlobalInfoSys/GATE.ppt GoldFish: default files created l Creates Java code in Goldfish.java. l Creates XML configuration for GoldFish in resource.xml.

27. ©2003 Paula Matuszek Taken primarily from a presentation by Lin Lin. http://webster.cs.uga.edu/~lin/GlobalInfoSys/GATE.ppt Create an Application with PRs l Applications model a control strategy for the execution of PRs. l Currently only pipeline execution is supported. – Simple pipelines: group a set of PRs together in order and execute them in turn. –Corpus pipelines: open each document in the corpus in turn, set that document as a runtime parameter on each PR, run all the PRs on the corpus, then close the document

28. ©2003 Paula Matuszek Taken primarily from a presentation by Lin Lin. http://webster.cs.uga.edu/~lin/GlobalInfoSys/GATE.ppt Additional Facilities l JAPE –a Java Annotation Patterns Engine, provides regular-expression based pattern/action rules over annotations. –The file “Main.jape” contains a list of the grammars to be used for for Named Entity Recognition, in the correct processing order. –Used in ANNIE.

29. ©2003 Paula Matuszek Taken primarily from a presentation by Lin Lin. http://webster.cs.uga.edu/~lin/GlobalInfoSys/GATE.ppt Embedding ANNIE l Create a stand alone ANNIE extraction system. l Example code that will embed ANNIE in an application that takes URLs as inputs and produces named entities as outputs. Example code