Language Technology Evaluation & Application LTEA Goran Markovic - goran.markovic@dliflc.edu RealLanguage: https://ltea.dliflc.edu/reallanguage … and more: https://ltea.dliflc.edu/fep

https://ltea.dliflc.edu/reallanguage/ RealLanguage: The App https://ltea.dliflc.edu/reallanguage/ 2-hour lessons at ILR levels 1+ - 3/3+, in 23 languages Unscripted, real-life language Transcription, translation, EEI collection, prediction, gisting, summarizing, interpretation*, pronunciation*, and, as appropriate, SAATS and SKATS. *audio recording not available on iOS due to Apple limitations.

RealLanguage: Lesson Structure 3-5 minute vocabulary brainstorming (students) 3-5 minute structures brainstorming (students) 40-45 minutes: listening to the cut and completing the tasks (students) transcription, editing for misinformation, "splicing" long strings into discrete words, collecting EEIs, and translation. Depending on the activity, content questions, and interpretation and/or shadowing -- break -- 20-25 minutes: students teamwork and go over the tasks. Instructor’s focus is on the colloquialisms and/or rare and complex items only. 20 minutes: students process the "big picture”, come up with a summary in English and TL, as well as implications, speculation, prediction, etc. They also add all the EEIs they can discern. 5 minutes: students return to the Pre-Post vocabulary & structures rubric and fill out the “new vocab” column next to the “old vocab” one

RealLanguage: The Results Statistically significant increase in DLPT scores since the start of consistent RealLanguage implementation 94.37% overall satisfaction rate (sample: 251 students) The most appreciated aspect: in-depth analysis (12+%) https://ltea.dliflc.edu/fep/reporter.html

… and more: - RealLanguage - Graphic https://ltea.dliflc.edu/reallanguage_g/ 1-to-2-hour lessons at ILR 1+ through 3 or 3+ in 23 languages, using "non-traditional" text - photos or scans of graffiti, damaged documents, TV stills, etc., with distorted text difficult or partially impossible to read. Trains transcription, EEI collection, prediction, gisting, and summarizing. - Simple Transcript Trainer https://ltea.dliflc.edu/stt/ Follows the basic course structure, using the context sentences from NetProf to train transcription in a simple and quick manner. It can be warm-up or wind-down for 5 minutes, or homework, or as longer self- study activity, depending on the number of tasks in a given language. Generally for ILR 1-2, 2+. Currently available for Korean, Chinese, Russian, Spanish, MSA, Egyptian, Sudanese and Farsi.