1. TimeML Annotation Tool Suite Tutorial Using Callisto and Tango for TimeML Annotation 10/26/04

2. The TimeML Tool Suite There are two tools useful for TimeML annotation Callisto and Tango Callisto A general annotation tool that includes a task for annotating time expressions, events and event instances, and signals Tango Specifically designed for graphical annotation of TimeML links

3. Installing Callisto & Tango Callisto Download the file: Callisto.zip Use java -jar to run Callisto.jar “java -jar Callisto.jar” You may need to do some searching to discover the correct path for java on the machine you are using Tango Download the file: tango.zip Use java -jar to run tango-20040912.jar “java -jar tango-20040912.jar”

4. “Opening” a Document in Callisto To do a TimeML annotation in Callisto, we have to import the document File --> Import Tango TimeML must be selected under Available Importers Once you have chosen the document you want to annotate, click Import Note: Simply “opening” a document in Callisto doesn’t allow you to do a TimeML annotation

5. Callisto’s Workspace Main Window Text to be annotated Tables for each TimeML Tag Switch tag tables by clicking on the name of the tag Create a new window for a tag table by clicking on the window icon next to the tag’s name Available Actions Panel (AAP) Edit -> Show Available Actions Displays a new window for adding tags and modifying existing tags

6. Adding TimeML Tags 1)Select the tag’s button from the AAP Select the button next to the name of the tag, not the name itself 2)Switch to the correct tag table in the main window 3)Select the text you want to annotate 4)Click the name of tag in the AAP to add the tag 5)Add any necessary information in the tag table

7. Creating Instances When you add an event, an instance of that event is automatically added to the MAKEINSTANCE table It is a good idea to add the necessary information to the MAKEINSTANCE table immediately after adding an EVENT Hint: Open the MAKEINSTANCE table in a new window so you have access to it and the EVENT table at the same time

8. Additional Callisto Information Adding info to the table If you make a mistake when typing into a table, click in the box where you are typing before pressing delete (if you don’t see the blinking cursor, you might accidentally erase the tag) Some attributes in the tag tables have drop down menus for their value; if there is no menu, you must type in the correct value Non-tag Available Actions Modify Extent Select this button if you want to change the extent of a tag you’ve already added Create Instance Use this button to add an additional instance of an event

9. Leaving Callisto Once you are ready to add links to your annotation, you must export the file from Callisto to save your work Again, simply “saving” will not save the TimeML annotation An exported Callisto file can be opened in Tango to complete the TimeML annotation

10. Working in Tango Tango is used only to add TLINKs, SLINKs, and ALINKs to a document The values for the LINK (ex. TIMEX3, event instance) must be added first in Callisto Opening and Saving work normally in Tango Get started by opening your exported Callisto document

11. Tango’s Workspace This is the annotation from Callisto Unused event instances and signals appear here in the Pending List Draw LINKs here in the Graph Area TIMEX3s are already added and ordered for you This toolbar shows what you can do

12. Adding Links Begin your annotation by moving event instances and/or signals to the graph area Use the button marked => Once the tags are in the graph area, you can move them around the area with the Select Button Select the type of link from the toolbar and draw it in the graph area

13. Details on Adding Links When you draw a link, a box pops up asking for the specification of the link You only need to worry about the signalID and relType in this box If a link requires a SIGNAL, it must already be in the graph area to be added Any signals that are in this area will appear as choices in the signalID drop down Once a signal is added, it goes back to the pending list so it can be used again

14. Using SmartLink Sometimes, one event instance or TIMEX3 has a lot of TLINKs associated with it SmartLink is used to draw these TLINKs with more ease Start by moving all the tags including the focus tag to the graph area Select the SmartLink button in the toolbar and ctrl-click on the focus tag Now, simply drag other tags to the left or right of the focus Left -- BEFORE relType, Right -- AFTER relType If you drop a tag under the focus, the specification box will pop up to ask you for the relType you want

15. Additional Tango Features Many annotators arrange their graph in their own way while they’re working The arrange feature also temporally orders the graph based on the links you add It is helpful to use this feature to check on your annotation -- if it looks funny, you might have added an incorrect link You can hide links using the Hide/Show buttons on the top of the toolbar This helps clean up the screen while you work You can also use this to examine just those links that include particular tags by hiding all links and then selecting the tags you care about in the graph area

16. Tango Final Thoughts Extra Buttons Score -- used for inter-annotator agreement studies You should have no need of this feature in this assignment Closure -- Marc’s closure algorithm integrated in Tango Again, this feature isn’t required, but is pretty cool to look at when you’re done GrappaView -- additional way of viewing the graph Requires additional software and is not needed for this assignment Save often! Tango can be a bit temperamental; it’s a good idea to save your work often If you start to notice weird happenings, close Tango and reopen the document

17. Back to Callisto If you import a document that contains links from Tango into Callisto, the LINK tables show these links This is another way to check your work You can’t make any changes to the links in Callisto, but you might notice if you made a mistake Remember: import/export in Callisto, open/save in Tango