Modelling the evolution of language for modellers and non-modellers EvoLang 2004 1 Vowel Systems Practical Example.

Slides:



Advertisements
Similar presentations
A. Hatzis, P.D. Green, S. Howard (1) Optical Logo-Therapy (OLT) : Visual displays in practical auditory phonetics teaching. Introduction What.
Advertisements

Vowel Formants in a Spectogram Nural Akbayir, Kim Brodziak, Sabuha Erdogan.
The cultural origins of colour categories Tony Belpaeme Artificial Intelligence Lab Vrije Universiteit Brussel.
Is Recursion Uniquely Human? Hauser, Chomsky and Fitch (2002) Fitch and Hauser (2004)
An Introduction to Artificial Intelligence. Introduction Getting machines to “think”. Imitation game and the Turing test. Chinese room test. Key processes.
CENTER FOR SPOKEN LANGUAGE UNDERSTANDING 1 PREDICTION AND SYNTHESIS OF PROSODIC EFFECTS ON SPECTRAL BALANCE OF VOWELS Jan P.H. van Santen and Xiaochuan.
Speaking Style Conversion Dr. Elizabeth Godoy Speech Processing Guest Lecture December 11, 2012.
Effectiveness of spatial cues, prosody, and talker characteristics in selective attention C.J. Darwin & R.W. Hukin.
Speech Group INRIA Lorraine
Speech Translation on a PDA By: Santan Challa Instructor Dr. Christel Kemke.
Psych 56L/ Ling 51: Acquisition of Language Lecture 8 Phonological Development III.
Artificial Intelligence and Lisp Lecture 13 Additional Topics in Artificial Intelligence LiU Course TDDC65 Autumn Semester, 2010
Pattern Recognition using Hebbian Learning and Floating-Gates Certain pattern recognition problems have been shown to be easily solved by Artificial neural.
SPEECH PERCEPTION The Speech Stimulus Perceiving Phonemes Top-Down Processing Is Speech Special?
Trading optimality for speed…
1 Phonetics Study of the sounds of Speech Articulatory Acoustic Experimental.
What is language? It’s easy to identify language… … but not so easy to define it What is special about human language? How does it differ from forms of.
Prerequisites for a Theory of Intelligence - G. Ananthakrishnan -Simon Benjaminsson.
ARE PHONOLOGICAL ENTITIES FICTITIOUS OR REAL? Prepared by: Agnieszka Sowińska and Beata Szymczak Based on: ‘Self-organizing processes and the explanation.
Attack-Resistant Networks Allen G. Taylor Communication networks have four primary objectives: Minimize.
Modeling Cross-linguistic Relationships Across Consonant Inventories: A Complex Network Approach.
SPEECH ARTICULATION: Vowels David Brett David Brett.
English Phonetics arifsuryopriyatmojo.com. Questions to consider? what is a language? how many languages are there? why do people need a language? how.
Phonology, phonotactics, and suprasegmentals
Phonetics HSSP Week 5.
CHAPTER 12 ADVANCED INTELLIGENT SYSTEMS © 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang.
By Paul Cottrell, BSc, MBA, ABD. Author Complexity Science, Behavioral Finance, Dynamic Hedging, Financial Statistics, Chaos Theory Proprietary Trader.
Psych 56L/ Ling 51: Acquisition of Language Lecture 8 Phonological Development III.
Speech Perception. Phoneme - a basic unit of a speech sound that distinguishes one word from another Phonemes do not have meaning on their own but they.
„Bandwidth Extension of Speech Signals“ 2nd Workshop on Wideband Speech Quality in Terminals and Networks: Assessment and Prediction 22nd and 23rd June.
Artificial Intelligence 2004 Speech & Natural Language Processing Natural Language Processing written text as input sentences (well-formed) Speech.
Engineering Design Process
Engineering Design Process
Embodied Machines Artificial vs. Embodied Intelligence –Artificial Intelligence (AI) –Natural Language Processing (NLP) Goal: write programs that understand.
MARCH 11, 2011 The Continuum of ASL The Continuum of ASL.
Statistical learning, cross- constraints, and the acquisition of speech categories: a computational approach. Joseph Toscano & Bob McMurray Psychology.
Language. Language Communication – transmitting information Many animals communicate Call systems – system of communication limited to a set number of.

Adaptive Design of Speech Sound Systems Randy Diehl In collaboration with Bjőrn Lindblom, Carl Creeger, Lori Holt, and Andrew Lotto.
Applied Speech Sciences 4/11/00. Speech Science Application Speech production via computers Forensics- criminal investigations; voice prints Assessing.
Linking multi-agent simulation to experiments in economy Re-implementing John Duffy’s model of speculative learning agents.
Key Centre of Design Computing and Cognition – University of Sydney Concept Formation in a Design Optimization Tool Wei Peng and John S. Gero 7, July,
Modelling Language Evolution Lecture 1: Introduction to Learning Simon Kirby University of Edinburgh Language Evolution & Computation Research Unit.
3308 First Language acquisition Acquisition of sounds Perception Sook Whan Cho Fall, 2012.
Adrian Treuille, Seth Cooper, Zoran Popović 2006 Walter Kerrebijn
Sounds and speech perception Productivity of language Speech sounds Speech perception Integration of information.
Artificial Intelligence 2004 Speech & Natural Language Processing Speech Recognition acoustic signal as input conversion into written words Natural.
Hello, Everyone! Part I Review Review questions 1.In what ways can English consonants be classified? 2. In what ways can English vowels be classified?
LING 580: Today Goals: 1. What constitute possible changes for the vowel systems of natural languages? 2. Schools of thought (McMahon 2) Neogrammarian.
LODManager A framework for rendering multiresolution models in real-time applications J. Gumbau O. Ripollés M. Chover.
Näätänen et al. (1997) Language-specific phoneme representations revealed by electric and magnetic brain responses. Presented by Viktor Kharlamov September.
Speech Perception.
Language Perception.
Language Evolution and Change Presented by Brianna Conrey Complex Adaptive Systems Seminar February 27, 2003.
Investigating the basis for conversation between human and robot Experiments using natural, spontaneous speech, speaking to the robot as if it were a small.
1 CO Games Development 1 Week 3 Game Agents 2 Gareth Bellaby.
CSC321: Introduction to Neural Networks and Machine Learning Lecture 15: Mixtures of Experts Geoffrey Hinton.
Text Information Management ChengXiang Zhai, Tao Tao, Xuehua Shen, Hui Fang, Azadeh Shakery, Jing Jiang.
Bridging the gap between L2 speech perception research and phonological theory Paola Escudero & Paul Boersma (March 2002) Presented by Paola Escudero.
Against formal phonology (Port and Leary).  Generative phonology assumes:  Units (phones) are discrete (not continuous, not variable)  Phonetic space.
Chapter 1 Introduction PHONOLOGY (Lane 335). Phonetics & Phonology Phonetics: deals with speech sounds, how they are made (articulatory phonetics), how.
Intelligent Agents Chapter 2. How do you design an intelligent agent? Definition: An intelligent agent perceives its environment via sensors and acts.
Message Source Linguistic Channel Articulatory Channel Acoustic Channel Observable: MessageWordsSounds Features Bayesian formulation for speech recognition:
Objectives Chapter 1, Part 1 Illustrate and describe the perceptual cycle Explain the difference between top-down and bottom-up processing Compare and.
DYNAMICS OF CITY BIKE SHARING NETWORKS Kasia Samson & Claudio Durastanti.
PHONETICS AND PHONOLOGY
Implementing Boosting and Convolutional Neural Networks For Particle Identification (PID) Khalid Teli .
Intelligent Agents Chapter 2.
Abstraction versus exemplars
Self-organisation in vowel systems
Presentation transcript:

Modelling the evolution of language for modellers and non-modellers EvoLang Vowel Systems Practical Example

Modelling the evolution of language for modellers and non-modellers EvoLang Why speech? Cross-linguistic data available –On universals –On acquisition –On language change This data is relatively uncontroversial –As opposed to e.g. syntax

Modelling the evolution of language for modellers and non-modellers EvoLang Speech is easy to model It is a physical signal We can use existing techniques –Speech synthesis techniques –Speech processing techniques –Even neural processing models Results are directly comparable to the real thing

Modelling the evolution of language for modellers and non-modellers EvoLang The aim of the study Explain universals of vowel systems –Why are do certain (combinations of) vowels occur more often than others (acoustic distinctiveness) –How does the optimisation take place? Hypothesis –Self-organisation in a population under constraints of production, perception, learning causes optimal systems to emerge Model –Agent-based model –Imitation games

Modelling the evolution of language for modellers and non-modellers EvoLang Computational considerations Simplification 1 –Agents communicate formants, not complete signals –Greatly reduces the number of computations –Perception, production already in terms of formants Simplification 2 –No meaning (problem: phonemes are defined in terms of meaning) –Imitation is used instead of distinguishing meaning

Modelling the evolution of language for modellers and non-modellers EvoLang Architecture For vowels: Realistic production articulatory synthesiser (Maeda, Valleé) Realistic perception Formant weighting (Mantakas, Schwarz, Boë) Learning model Prototype based associative memory Sounds ProductionPerception Associative Memory

Modelling the evolution of language for modellers and non-modellers EvoLang The interactions Imitation with categorical perception –Humans hear speech signals as the nearest phoneme in their language (?) Correctness of imitation depends not only on the signals used, but also on the agents’ repertoires Initiator Imitator

Modelling the evolution of language for modellers and non-modellers EvoLang Imitation failure Initiator Imitator

Modelling the evolution of language for modellers and non-modellers EvoLang Distributed probabilistic optimization Distributed probabilistic optimization Pick an agent from the population Pick a signal from this agent Modify the signal randomly Play imitation games with all other agents in the population If success of modification is higher than success of original vowel, keep the change, otherwise revert. Disadvantage: –Number of signals per agent is fixed beforehand

Modelling the evolution of language for modellers and non-modellers EvoLang Reactions to imitation game Merge Shift Closer F2F2 F1F1 Add Vowel Throw away Vowel

Modelling the evolution of language for modellers and non-modellers EvoLang Measures Imitative success Energy of vowel systems (Liljencrants & Lindblom) Size Preservation –Success of imitation between agents from populations a number of generations apart –Only in systems with changing populations Realism