PSY 369: Psycholinguistics

PSY 369: Psycholinguistics
Language Production: Theories & Models

Nitty-gritty details of the model
Message level Central questions: How many levels are there? Are the stages discrete or cascading? Discrete: must complete before moving on Cascade: can get started as soon as some information is available Is there feedback? Top-down only (serial processing) Garrett, Levelt Bottom up too (interactive processing) Dell, Stemberger, McKay Syntactic level Morphemic level Phonemic level Articulation

Doing it in time Strongest constraint may be fluency: Incrementality:
Have to get form right under time pressure. Incrementality: ‘Work with what you’ve got’ Flexibility: allows speaker to say something quickly, also respond to changing environment. Modularity: ‘Work only with what you’ve got’ Regulate flow of information.

Two different models Levelt (1989) Dell (1986) TACTIC FRAMES
LEXICAL NETWORK

Levelt’s model Four broad stages: Conceptualization Formulation
Deciding on the message (= meaning to express) Formulation Turning the message into linguistic representations Grammatical encoding (finding words and putting them together) Phonological encoding (finding sounds and putting them together) Articulation Speaking (or writing or signing) Monitoring (via the comprehension system)

Levelt’s model Formalization on the Syntax side of the model
Works in parallel with the lexicon side Functional processing: Assignment of roles Direct object Grammatical subject

Levelt’s model Formalization on the Syntax side of the model
Works in parallel with the lexicon side Positional processing: Build syntactic tree NP VP S V

Levelt’s model Formalization on the Lexicon side of the model
Involves lexical retrieval: Semantic/syntactic content (lemmas) Phonological content (lexemes or word-forms) Tip of tongue state when lemma is retrieved without word-form being retrieved

Levelt’s model Lexical concepts tigre Lemmas /tigre/ Lexemes /t/ /I/
has stripes is dangerous TIGER (X) Lexical concepts Noun tigre Lemmas Fem. countable /tigre/ Lexemes /t/ /I/ /g/ Phonemes

Levelt’s model: conceptual level
has stripes is dangerous Conceptual level is not decomposed one lexical concept node for “tiger” instead, conceptual links from “tiger” to “stripes”, etc. TIGER (X) Noun tigre Fem. countable /tigre/ /t/ /I/ /g/

Levelt’s model: meaning & syntax
has stripes is dangerous First, lemma activation occurs This involves activating a lemma or lemmas corresponding to the concept thus, concept TIGER activates lemma “tiger” TIGER (X) Noun tigre Fem. countable /tigre/ /t/ /I/ /g/

has stripes is dangerous First, lemma activation occurs This involves activating a lemma or lemmas corresponding to the concept thus, concept TIGER activates lemma “tiger” TIGER (X) LION (X) Noun But also involves activating other lemmas TIGER also activates LION (etc.) to some extent and LION activates lemma “lion” tigre lion Fem. /tigre/ /t/ /I/ /g/

has stripes is dangerous First, lemma activation occurs Second, lemma selection occurs Selection is different from activation Only one lemma is selected Probability of selecting the target lemma (“tiger”) ratio of that lemma’s activation to the total activation of all lemmas (“tiger”, “lion”, etc.) Hence competition between semantically related lemmas TIGER (X) LION (X) Noun tigre lion Fem. /tigre/ /t/ /I/ /g/

Morpho-phonological encoding (and beyond)
has stripes is dangerous The lemma is now converted into a phonological representation called “word-form” (or “lexeme”) If “tiger” lemma plus plural (and noun) are activated Leads to activation of morphemes tigre and s Other processes too Stress, phonological segments, phonetics, and finally articulation TIGER (X) Noun countable tigre Fem. /tigre/ /t/ /I/ /g/

Model’s assumptions Modularity
Later processes cannot affect earlier processes No feedback between the word-form (lexemes) layer and the grammatical (lemmas) layer Also, only one lemma activates a word form If “tiger” and “lion” lemmas are activated, they compete to produce a winner at the lemma stratum Only the “winner” activates a word form (selection) The word-forms for the “losers” aren’t accessed

Dell’s interactive account
Dell (1986) presented the one of the best-known interactive accounts other similar accounts exist (e.g., Stemberger, McKay) Network organization 3 levels of representation Semantics (decomposed into features) Words and morphemes phonemes (sounds) These get selected and inserted into frames

A moment in the production of: “Some swimmers sink” TACTIC FRAMES LEXICAL NETWORK

TACTIC FRAMES LEXICAL NETWORK information Interactive because information flows “upwards” information as well as “downwards” Cascading because processing at lower levels can start early

FURRY BARKS MAMMAL e.g., the semantic features mammal, barks, four-legs activate the word “dog” this activates the sounds /d/, /o/, /g/ dot dog log these send activation back to the word level, activating words containing these sounds (e.g., “log”, “dot”) to some extent /t/ /d/ /g/ /a/ /l/ this activation is upwards (phonology to syntax) and wouldn’t occur in Levelt’s account

Model comparisons Similarities Levelt’s Dell’s Differences
Similar representations Frames and slots Insertion of representations into the frames Similarities Levelt’s Dell’s Serial Modular External monitor (comprehension) Interactive Cascaded Differences

Testing Models of language production
Experimental investigations of some of these issues Time course - cascading vs serial Picture word interference Separation of syntax and semantics Subject verb agreement Abstract syntax vs surface form Syntactic priming

Experimental tests Picture-word interference task tiger Task:
Participants name basic objects as quickly as possible Distractor words are embedded in the object (or presented aloud) Participants are instructed to ignore these words tiger

Experimental tests Picture-word interference task tiger
Semantic interference Meaning related words can slow down naming the picture e.g., the word TIGER in a picture of a LION tiger

Experimental tests Picture-word interference task liar
Semantic interference Form-related words can speed up processing e.g., the word liar in a picture of a LION liar

Experimental tests liar liar liar time Experiments manipulate timing:
picture and word can be presented simultaneously or one can slightly precede the other We draw inferences about time-course of processing

Evidence against interactivity
Schriefers, Meyer, and Levelt (1990) DOT phonologically related CAT semantically related SHIP unrelated word SOA (Stimulus onset asynchrony) manipulation -150 ms (word …150 ms … picture) 0 ms (i.e., synchronous presentation) +150 ms (picture …150ms …word)

Schriefers, Meyer, and Levelt (1990) DOT phonologically related CAT semantically related SHIP unrelated word Early Only Semantic effects Late Only Phonological effects

Schriefers, Meyer, and Levelt (1990) Also looked for any evidence of a mediated priming effect DOG (X) CAT (X) dog cat hat /cat/ /hat/ Found no evidence for it /k/ /a/ /t/ /h/

Interpretation Early semantic inhibition
Late phonological facilitation Fits with the assumption that semantic processing precedes phonological processing No overlap suggests two discrete stages in production an interactive account might find semantic and phonological effects at the same time

Evidence for interactivity
Mixed errors Both semantic and phonological relationship to target word Target = “cat” semantic error = “dog” phonological error = “hat” mixed error = “rat” Occur more often than predicted by modular models if you can go wrong at either stage, it would only be by chance that an error would be mixed

Dell’s explanation The process of making an error The semantic features of dog activate “cat” Some features (e.g., animate, mammalian) activate “rat” as well “cat” then activates the sounds /k/, /ae/, /t/ /ae/ and /t/ activate “rat” by feedback This confluence of activation leads to increased tendency for “rat” to be uttered Also explains the tendency for phonological errors to be real words (lexical bias effect) Sounds can only feed back to words (non-words not represented) so only words can feedback to sound level

A number of recent experimental findings appear to support interaction under some circumstances (or at least cascading models) Damian & Martin (1999) Cutting & Ferreira (1999) Peterson & Savoy (1998)

Damian and Martin (1999) Picture-Word interference The critical difference: the addition of a “semantic and phonological” condition Picture of Apple peach (semantically related) apathy (phonologically related) apricot (sem & phono related) couch (unrelated) peach

Damian & Martin (1999) couch (unrelated) peach (semantically related) apathy (phonologically related) apricot (sem & phono related) early semantic inhibition

Damian & Martin (1999) couch (unrelated) peach (semantically related) apathy (phonologically related) apricot (sem & phono related) early semantic inhibition late phonological facilitation (0 and ms)

Damian & Martin (1999) couch (unrelated) peach (semantically related) apathy (phonologically related) apricot (sem & phono related) early semantic inhibition late phonological facilitation (0 and ms) Shows overlap, unlike Schriefers et al.

Cutting and Ferreira (1999) Picture-Word interference The critical difference: Used homophone pictures Related distractors could be to the depicted meaning or alternative meaning “game” “dance” “hammer” (unrelated) Only tested -150 SOA dance

Cutting and Ferreira (1999) GAME (X) BALL (X) BALL (X) DANCE (X) game ball ball dance /ball/ Cascading Prediction: dance ball /ball/

Cutting and Ferreira (1999) Early semantic inhibition

Cutting and Ferreira (1999) Early semantic inhibition Early Facilitation from a phonologically mediated distractor Evidence of cascading information flow (both semantic and phonological information at early SOA)

Peterson & Savoy (1998) Slightly different task Prepare to name the picture If “?” comes up name it ?

Peterson & Savoy (1998) Slightly different task Prepare to name the picture If “?” comes up name it If a word comes up instead, name the word liar Manipulate Word/picture relationship SOA

Peterson & Savoy (1998) Used pictures with two synonymous names soda Subordinate Dominant Used words that were phonologically related to the non dominant name of the picture sofa couch

Peterson & Savoy Found evidence for phonological activation of near synonyms: Participants slower to say distractor soda than unrelated distractor when naming couch Soda is related to non-selected sofa Remember that Levelt et al. assume that only one lemma can be selected and hence activate a phonological form Levelt et al’s explanation: Could be erroneous selection of two lemmas?

Can the two-stage account be saved?
Evidence for interaction is hard to reconcile with the Levelt account However, most attempts are likely to revolve around the monitor Basically, people sometimes notice a problem and screen it out Levelt argues that evidence for interaction really involves “special cases”, not directly related to normal processing

Overall summary Levelt et al.’s theory of word production:
Strictly modular lexical access Syntactic processing precedes phonological processing Dell’s interactive account: Interaction between syntactic and phonological processing Experimental evidence is equivocal, but increasing evidence that more than one lemma may activate associated word-form

Conversational interaction
ABBOTT: Super Duper computer store. Can I help you? COSTELLO: Thanks. I'm setting up an office in my den, and I'm thinking about buying a computer. ABBOTT: Mac? COSTELLO: No, the name is Lou. ABBOTT: Your computer? COSTELLO: I don't own a computer. I want to buy one. COSTELLO: I told you, my name is Lou. ABBOTT: What about Windows? COSTELLO: Why? Will it get stuffy in here? ABBOTT: Do you want a computer with windows? COSTELLO: I don't know. What will I see when I look in the windows? ABBOTT: Wallpaper. COSTELLO: Never mind the windows. I need a computer and software. ABBOTT: Software for windows? COSTELLO: No. On the computer! I need something I can use to write proposals, track expenses and run my business. What have you got? ABBOTT: Office.

COSTELLO: Yeah, for my office. Can you recommend anything? ABBOTT: I just did. COSTELLO: You just did what? ABBOTT: Recommend something. COSTELLO: You recommended something? ABBOTT: Yes. COSTELLO: For my office? COSTELLO: OK, what did you recommend for my office? ABBOTT: Office. COSTELLO: Yes, for my office! ABBOTT: I recommend office with windows. COSTELLO: I already have an office and it has windows!OK, lets just say, I'm sitting at my computer and I want to type a proposal. What do I need? ABBOTT: Word. COSTELLO: What word? ABBOTT: Word in Office. COSTELLO: The only word in office is office. ABBOTT: The Word in Office for Windows.

COSTELLO: Which word in office for windows? ABBOTT: The Word you get when you click the blue "W.” COSTELLO: I'm going to click your blue "w" if you don't start with some straight answers. OK, forget that. Can I watch movies on the Internet? ABBOTT: Yes, you want Real One. COSTELLO: Maybe a real one, maybe a cartoon. What I watch is none of your business. Just tell me what I need! ABBOTT: Real One. COSTELLO: If it’s a long movie I also want to see reel 2, 3 and 4. Can I watch them? ABBOTT: Of course. COSTELLO: Great, with what? COSTELLO; OK, I'm at my computer and I want to watch a movie. What do I do? ABBOTT: You click the blue "1.” COSTELLO: I click the blue one what? ABBOTT: The blue "1.” COSTELLO: Is that different from the blue "W"? ABBOTT: The blue 1 is Real One and the blue W is Word. COSTELLO: What word?

ABBOTT: The Word in Office for Windows. COSTELLO: But there are three words in "office for windows"! ABBOTT: No, just one. But it’s the most popular Word in the world. COSTELLO: It is? ABBOTT: Yes, but to be fair, there aren't many other Words left. It pretty much wiped out all the other Words. COSTELLO: And that word is real one? ABBOTT: Real One has nothing to do with Word. Real One isn't even Part of Office. COSTELLO: Stop! Don't start that again. What about financial bookkeeping you have anything I can track my money with? ABBOTT: Money. COSTELLO: That's right. What do you have? COSTELLO: I need money to track my money? ABBOTT: It comes bundled with your computer. COSTELLO: What's bundled to my computer?

COSTELLO: Money comes with my computer? ABBOTT: Yes. No extra charge. COSTELLO: I get a bundle of money with my computer? How much? ABBOTT: One copy. COSTELLO: Isn't it illegal to copy money? ABBOTT: Microsoft gave us a license to copy money. COSTELLO: They can give you a license to copy money? ABBOTT: Why not? THEY OWN IT! (LATER) COSTELLO: How do I turn my computer off?? ABBOTT: Click on "START".

“the horse raced past the barn” “the kids swam across the river” Conversation is more than just two side-by-side monologues.

“The horse raced past the barn” “Really? Why would it do that?” Conversation is a specialized form of social interaction, with rules and organization.

Conversation Fillmore (1981)
“The language of face-to-face conversation is the basic and primary use of language” (pg. 152) Co-presence: the participants share the same physical environment Visibility: the participants can see each other Audibility: the participants can hear each other Instantaneity: the participants perceive each other’s actions at no perceptible delay Evanescence: the medium fades quickly Recordlessness: the participants’ leave no record or artifact Simultaneity: the participants can produce and receive at once and simultaneously Extemporaneity: the participants formulate and execute their actions extemporaneously, in real time Self-determination: the participants determine for themselves what actions to take when Self-expression: the participants take actions as themselves So all instances of language usage can (should) be compared to conversation What is the impact of the presence or absence of different features of face-to-face conversation?

Conversation Herb Clark (1996)
Face-to-face conversation - the basic setting Features Immediacy Medium Control Co-presence Visibility Audibility Instantaneity Evanescence Recordlessness Simultaneity Extemporaneity Self-determination Self-expression Co-presence: the participants share the same physical environment Visibility: the participants can see each other Audibility: the participants can hear each other Instantaneity: the participants perceive each other’s actions at no perceptible delay Evanescence: the medium fades quickly Recordlessness: the participants’ leave no record or artifact Simultaneity: the participants can produce and receive at once and simultaneously Extemporaneity: the participants formulate and execute their actions extemporaneously, in real time Self-determination: the participants determine for themselves what actions to take when Self-expression: the participants take actions as themselves Other settings may lack some of these features e.g., telephone conversations take away co-presence and visibility, which may change language use

Conversation Herb Clark (1996) Joint action Autonomous actions
Things that you do by yourself Participatory actions Individual acts only done as parts of joint actions People acting in coordination with one another Doing the tango Driving a car with a pedestrian crossing the street The participants don’t always do similar things

Conversation Herb Clark (1996) Speaking and listening
Traditionally treated as autonomous actions Contributing to the tradition of studying language comprehension and production separately Clark proposed that they should be treated as participatory actions

Conversation Herb Clark (1996) Speaking and listening Speaking
Component actions in production and comprehension come in pairs Speaking Listening A vocalizes sounds for B B attends to A’s vocalizations A formalizes utterances for B B identifies A’s utterances A means something for B B understands A’s meaning The actions of one participant depend on the actions of the other

Conversation Herb Clark (1996)
Arena’s of language use - places where people do things with language Meaning and understanding Establishing Common Ground Identifying participants Layers Conversation is structured

Meaning and understanding
Common ground Common ground is necessary to coordinate speaker’s meaning with listener’s understanding Knowledge, beliefs and suppositions that the participants believe that they share Members of cultural communities Shared experiences What has taken place already in the conversation Lack of successful communication was due to lack of common ground Starting around 1:20

Identifying participants
Conversation often takes place in situations that involve various types of participants and non-participants Eavesdropper All listeners Bystander Side participants All participants Speaker Addressee

Identifying participants
Humor come in part because we (eavesdroppers) share common ground that Lou and Bud didn’t) Eavesdropper All listeners Bystander Side participants All participants Speaker Addressee

Layers Layer 2: Conversations may have several layers
The primary conversation Layer 2 A commentary about Layer 1 Each layer needs to be coherent (within the layer) as well as be connected to other layers in a relevant way Layer 2: “I'm going to click your blue "w" if you don't start with some straight answers. OK, forget that.”

Structure of a conversation
Conversations are purposive and unplanned Typically you can’t plan exactly what you’re going to say because it depends on another participant Conversations look planned only in retrospect Conversations have a fairly stable structure Opening the conversation Identifying participants Taking turns Negotiating topics Closing conversations

Joe: (places a phone call) Kevin: Miss Pink’s office - hello Joe: hello, is Miss Pink in Kevin: well, she’s in, but she’s engaged at the moment, who is it? Joe: Oh it’s Professors Worth’s secretary, from Pan-American college Kevin: m, Joe: Could you give her a message “for me” Kevin: “certainly” Joe: u’m Professor Worth said that, if Miss Pink runs into difficulties, .. On Monday afternoon, .. With the standing subcommittee, .. Over the item on Miss Panoff, … Kevin: Miss Panoff? Joe: Yes, that Professor Worth would be with Mr Miles all afternoon, .. So she only had to go round and collect him if she needed him, … Kevin: ah, … thank you very much indeed, Joe: right Kevin: Panoff, right “you” are Kevin: I’ll tell her, Joe: thank you Kevin: bye bye Joe: bye

Joe: (places a phone call) Kevin: Miss Pink’s office - hello Joe: hello, is Miss Pink in Kevin: well, she’s in, but she’s engaged at the moment, who is it? Joe: Oh it’s Professors Worth’s secretary, from Pan-American college Kevin: m, Joe: Could you give her a message “for me” Kevin: “certainly” Joe: u’m Professor Worth said that, if Miss Pink runs into difficulties, .. On Monday afternoon, .. With the standing subcommittee, .. Over the item on Miss Panoff, … Kevin: Miss Panoff? Joe: Yes, that Professor Worth would be with Mr Miles all afternoon, .. So she only had to go round and collect him if she needed him, … Kevin: ah, … thank you very much indeed, Joe: right Kevin: Panoff, right “you” are Kevin: I’ll tell her, Joe: thank you Kevin: bye bye Joe: bye Opening the conversation

Joe: (places a phone call) Kevin: Miss Pink’s office - hello Joe: hello, is Miss Pink in Kevin: well, she’s in, but she’s engaged at the moment, who is it? Joe: Oh it’s Professors Worth’s secretary, from Pan-American college Kevin: m, Joe: Could you give her a message “for me” Kevin: “certainly” Joe: u’m Professor Worth said that, if Miss Pink runs into difficulties, .. On Monday afternoon, .. With the standing subcommittee, .. Over the item on Miss Panoff, … Kevin: Miss Panoff? Joe: Yes, that Professor Worth would be with Mr Miles all afternoon, .. So she only had to go round and collect him if she needed him, … Kevin: ah, … thank you very much indeed, Joe: right Kevin: Panoff, right “you” are Kevin: I’ll tell her, Joe: thank you Kevin: bye bye Joe: bye Exchanging information

Joe: (places a phone call) Kevin: Miss Pink’s office - hello Joe: hello, is Miss Pink in Kevin: well, she’s in, but she’s engaged at the moment, who is it? Joe: Oh it’s Professors Worth’s secretary, from Pan-American college Kevin: m, Joe: Could you give her a message “for me” Kevin: “certainly” Joe: u’m Professor Worth said that, if Miss Pink runs into difficulties, .. On Monday afternoon, .. With the standing subcommittee, .. Over the item on Miss Panoff, … Kevin: Miss Panoff? Joe: Yes, that Professor Worth would be with Mr Miles all afternoon, .. So she only had to go round and collect him if she needed him, … Kevin: ah, … thank you very much indeed, Joe: right Kevin: Panoff, right “you” are Kevin: I’ll tell her, Joe: thank you Kevin: bye bye Joe: bye Exchanging a message

Joe: (places a phone call) Kevin: Miss Pink’s office - hello Joe: hello, is Miss Pink in Kevin: well, she’s in, but she’s engaged at the moment, who is it? Joe: Oh it’s Professors Worth’s secretary, from Pan-American college Kevin: m, Joe: Could you give her a message “for me” Kevin: “certainly” Joe: u’m Professor Worth said that, if Miss Pink runs into difficulties, .. On Monday afternoon, .. With the standing subcommittee, .. Over the item on Miss Panoff, … Kevin: Miss Panoff? Joe: Yes, that Professor Worth would be with Mr Miles all afternoon, .. So she only had to go round and collect him if she needed him, … Kevin: ah, … thank you very much indeed, Joe: right Kevin: Panoff, right “you” are Kevin: I’ll tell her, Joe: thank you Kevin: bye bye Joe: bye Closing the conversation

Opening conversations
Need to pick who starts Turn taking is typically not decided upon in advance Potentially a lot of ways to open, but we typically restrict our openings to a few ways Address another Request information Offer information Use a stereotyped expression or topic

Opening conversations
Need to pick who starts Turn taking is typically not decided upon in advance Potentially a lot of ways to open Has to resolve: The entry time Is now the time to converse? The participants Who is talking to whom? Their roles What is level of participation in the conversation? The official business What is the conversation about?

Taking turns Typically conversations don’t involve two (or more) people talking at the same time Individual styles of turn-taking vary widely Length of a turn is a fairly stable characteristic within a given individual’s conversational interactions Standard signals indicate a change in turn: a head nod, a glance, a questioning tone

Taking turns Typically conversations don’t involve two (or more) people talking at the same time Three implicit rules (Sacks et al, 1974) Rule 1: Current speakers selects next speaker Rule 2: Self-selection: if rule 1 isn’t used, then next speaker can select themselves Rule 3: current speaker may continue (or not) These principles are ordered in terms of priority The first is the most important, and the last is the least important Just try violating them in an actual conversation (but debrief later!)

Taking turns Typically conversations don’t involve two (or more) people talking at the same time Use of non-verbal cues Drop of pitch Drawl on final syllable Termination of hand signals Drop in loudness Completion of a grammatical clause Use of stereotyped phrase “you know”

Negotiating topics Keep the discourse relevant to the topic (remember Grice’s maxims) Coherence again Earlier we looked at coherence within a speaker, now we consider it across multiple speakers Must use statements to signal topic shifts

Closing conversations
Closing statements Must exit from the last topic, mutually agree to close the conversation, and coordinate the disengagement Signal the end of conversation (or topic) “Okay” Justifying why conversation should end “I gotta go” Reference to potential future conversation “Later dude”

Dialog is the key Why so little research on dialog?
Most linguistic theories were developed to account for sentences in de-contextualized isolation Dialog doesn’t fit the competence/performance distinction well Hard to do experimentally Conversations are interactive and largely unplanned Pickering and Garrod (2004) Proposed that processing theories of language comprehension and production may be flawed because of a focus on monologues

Processing models of dialog
Pickering and Garrod (2004) Interactive alignment model Alignment of situation models is central to successful dialogue Alignment at other levels is achieved via priming Alignment at one level can lead to alignment at another Model assumes parity of representations for production and comprehension

Summary “People use language for doing things with each other, and their use of language is itself a joint action.” Clark (1996, pg387) Conversation is structured But, that structure depends on more than one individual Models of language use (production and comprehension) need to be developed within this perspective

PSY 369: Psycholinguistics

Similar presentations

Presentation on theme: "PSY 369: Psycholinguistics"— Presentation transcript:

Similar presentations

About project

Feedback

Log in

Auth with social network:

PSY 369: Psycholinguistics

Similar presentations

Presentation on theme: "PSY 369: Psycholinguistics"— Presentation transcript:

Similar presentations

About project

Feedback