1. Self-correction and Fluency in ESL Speaking Development Nel de Jong, Dawn E. McCormick, M. Christine O’Neill, Claire Bradin Siskin University of Pittsburgh Pittsburgh Science of Learning Center April 24, 2007

2. Overview 1. 1.Speaking classes: background 2. 2.Self-Correction: Recorded Speaking Activity (RSA) Software Study 3. 3.Fluency: 4/3/2 task Software Study 4. 4.Conclusions: CALL and L2 speaking development

3. 1. Speaking Classes English Language Institute University of Pittsburgh

4. Levels of the ELI Level 2 High- beginning MTELP: 33-44 (0-100) ELI Listening Test: 6-9 (0-30) ELI Writing Sample: 1 (1-5) Level 3 Low- intermediate MTELP: 45-59 ELI Listening Test:10-17 ELI Writing Sample: 2 Level 4 High- intermediate MTELP: 60-79 ELI Listening Test: 18-23 ELI Writing Sample: 3 Level 5 Advanced MTELP: 80-100 ELI Listening Test: 24-30 ELI Writing Sample: 4-5

5. Student Information L1s include: Gender Age Range English Language Learning ArabicKoreanChinese Japanese Turkish Russian Spanish F: 49.4% M: 50.6% 16-66 <1yr: 11% 1-2 yrs: 13% 3-5 yrs: 19% >5 yrs: 56%

6. General Speaking Goals Use English to engage in discussions in personal, professional, and academic contexts Use English to conduct transactions in personal, professional, and academic contexts Use English to make presentations in professional and academic contexts Develop self-correction skills and language learning strategies

7. 2. Self-Correction: Recorded Speaking Activity (RSA)

8. RSA Software: Procedures Students record Students transcribe Students take notes on errors Students speak corrections (RSA #1 and #2), or rerecord sample (RSA #3) Teacher provides feedback Students take notes on teacher feedback

9. Demo of the student version

10. RSA: Role in Speaking Curriculum Increase students’ in the learning process Increase students’ involvement in the learning process Increase students’ of individual errors Increase students’ awareness of individual errors Increase students’ ability to spoken language Increase students’ ability to monitor and self- correct spoken language Provide a starting point from which students could devise language learning strategies to increase language and appropriateness of language use Provide a starting point from which students could devise language learning strategies to increase language accuracy and appropriateness of language use Provide additional for the teacher Provide additional assessment data for the teacher

11. RSA Study: Research Questions What errors are students able to identify within given proficiency levels (high-beginning, low- intermediate, high-intermediate, advanced)? across levels? Of the errors identified by students, what errors are they able to self-correct within given proficiency levels (high-beginning, low-intermediate, high- intermediate, advanced)? across levels? Can students use a self-correction learning event to immediately improve spoken production accuracy?

12. Data Example Level 4 on halloween, i hung out with my friend i gave candy for children. so i saw lots of weird charecter like which and ghost. i think people dressed on costume. i think people only dressde up as a weird chareter but some people dressed up on cute charecter like bunny girls and i saw a couple wearing a nurse and a doctor. like which and ghost>like a which and a ghost i think people dressed on costum>people drssed on a costum on halloween dressed up on cute> dressed up on a cute charecter. wearing a nurse> dressed up as a nurse

13. Preliminary Observations 1. 1.All levels able to identify and self- correct to some degree 2. 2.Students able to identify and correct errors in the areas of grammar, pronunciation, and vocabulary

14. RSA and SLA Connections The RSA acts as a tool to promote the metalinguistic (reflective) function of output as described by Swain (2005) through ‘collaboration with self’ The transcription component of the RSA is a tool to facilitate noticing in output (Lynch, 2001; 2005) RSAs provide learners with the “time and opportunity for self-initiated, self-completed repair of their messages” (Shehadeh, 2001, p. 451)

15. 3. Fluency development: The 4/3/2 task

16. What is oral fluency? The rapid, smooth, accurate, lucid, and efficient translation of thought or communicative intention into language under the temporal constraints of on-line processing (Lennon, 2000) Fluency in broad vs. narrow sense Related to accuracy and complexity

17. Many studies on immersion and study abroad but what can we do in the classroom?

18. 4/3/2 Software: Procedures Talk about a topic for 4 minutes Retell in 3 minutes Retell in 2 minutes Increases fluency, accuracy and complexity. Students cannot repeat verbatim, but can benefit from recently having generated semantic content, and having selected vocabulary and syntactic constructions (Maurice, 1983; Nation, 1989) Computerized version: individual, no pair work

19. Preparation: Take notes

20. Speaking: 4, 3 or 2 minutes

21. 4/3/2 Study: Research Questions 1. 1.Does repetition of a short speech increase fluency?   Repetition (1 topic) vs. No Repetition (3 topics) 2. 2.If so:   Which components of fluency are affected?   Proceduralization   Speed (articulation rate)   Is it a long-term effect?

22. Fluency and Proceduralization Proceduralization leads to higher fluency, because students can more easily construct longer and more complex sentences (Towell, Hawkins & Bazergui, 1996) :   Mean Length of Fluent Run: increase   Mean Length of Pause: stable or decrease   Phonation/Time Ratio: stable or increase Articulation rate: number of syllables per minute

23. Procedure Repetition vs. No Repetition condition Three training sessions of 4/3/2 technique Tests: RSAs about different topics  Pretest: 3-4 days before training  Immediate posttest: week after training  Delayed posttest: 3.5 weeks after training RSA#14/3/24/3/24/3/2RSA#2RSA#3 Section 4M Sep 25 Sep 28 Oct 5 Oct 12 Oct 19 Nov 6 Section 4P Sep 22 Sep 26 Oct 3 Oct 10 Oct 17 Nov 3

24. Participants 4/3/2 study Level 4: advanced intermediate Randomly assigned 19 students 19-37 yrs (mean 25 yrs) L1s: Arabic, Chinese, Korean, other

25. Preliminary Results Pause = filled or unfilled; uh and um counted as pause Proceduralization No Repetition (n=10) Repetition(n=9) PrePost1Post2PrePost1Post2 Fluent runs (syll.) 4.264.054.724.97 Pause length* 1.121.111.19.95 Phon/time ratio*.57.55.56.62 Syllables per minute 197194192191

26. Preliminary Results Pause = filled or unfilled; uh and um counted as pause Proceduralization No Repetition (n=10) Repetition(n=9) PrePost1Post2PrePost1Post2 Fluent runs (syll.) 4.264.054.264.724.974.75 Pause length* 1.121.11.991.19.951.01 Phon/time ratio*.57.55.56.56.62.60 Syllables per minute 197194204192191199

27. Summary Some evidence for proceduralization Markers of fluency in Repetition condition: shorter pauses more speech (verbosity) with stable length of fluent runs No Repetition condition catches up on delayed posttest

28. Open questions How does 4/3/2 affect accuracy and complexity? What is being proceduralized? What is the role of specific types of language knowledge and processing mechanisms in fluency?

29. 4. Conclusions: CALL and L2 speaking development

30. CALL contribution to L2 speaking development For students: individual feedback time to reflect on performance more speaking time per student improvement in self-correction and fluency For teachers: streamlining the process of collecting speech samples and giving feedback

31. CALL contribution to L2 speaking research In vivo experimentation: Controlled data collection in real classrooms External validity External validity Long-term retention Long-term retention Diverse participants Diverse participants Data loss Data loss Need for fit with speaking curricula of language institute, e.g., course objectives, language lab availability Need for fit with speaking curricula of language institute, e.g., course objectives, language lab availability Streamlined data collection

32. Many thanks to: Prof. A. Juffs Prof. C.A. Perfetti The students and teachers at the ELI Pittsburgh Science of Learning Center Please direct questions to Nel de Jong (ndjong@pitt.edu) or Dawn E. McCormick (mccormic@pitt.edu) This work was supported in part by the Pittsburgh Science of Learning Center, which is funded by the National Science Foundation award number SBE-0354420.

33. References Lynch, T. (2001), Seeing what they meant: Transcribing as a route to noticing. ELT Journal, 55 (2), 124-132. Lynch, T. (2005). Self-transcribing and noticing in EAP speaking classes. Edinburgh Working Papers in Applied Linguistics, 14, 54-67. Lennon, P. (2000). Investigating Fluency in EFL: A Quantitative Approach. Language Learning, 40 (3), 387-417. Maurice, K. (1983). The fluency workshop. TESOL Newsletter, 17, 429. Nation, P. (1989). Improving speaking fluency. System, 17(3), 377-384. Shehadeh, A. (2001). Self- and other-initiated modified output during task-based interaction. TESOL Quarterly, 35 (3), 433-457. Swain, M. (2005). The output hypothesis: Theory and research. In E. Hinkel (Ed.), Handbook on research in second language teaching and learning (pp. 471-484). Mahwah, NJ: Lawrence Erlbaum. Towell, R., Hawkins, R., & Bazergui, N. (1996). The development of fluency in advanced learners of French. Applied Linguistics, 17(1), 84-119.

34. Extra slides …

35. RSA: Accuracy and Self-correction Accuracy Grammar - target structures from speaking class as well as level-appropriate structures Grammar - target structures from speaking class as well as level-appropriate structures Pronunciation - target segmentals and suprasegmentals as well as errors that interfere with interlocutor comprehension Pronunciation - target segmentals and suprasegmentals as well as errors that interfere with interlocutor comprehension Vocabulary - target words and level-appropriate words; word choice and word form Vocabulary - target words and level-appropriate words; word choice and word form Self-correction - identification and correction of incorrect forms

36. RSA Topics Fall 2006 Pretest: How do you feel about pets? Posttest: Talk about a person who was very important to you in the past. Delayed posttest: What is the biggest problem your country is facing today?

37. Current and Future Research Do higher-proficiency students benefit more or less from the 4/3/2 training than lower-proficiency students? Does a pretraining of formulaic sequences help students produce more fluent speech during and after the 4/3/2 training? (Nattinger & DeCarrico, 1992)

38. Formulaic Sequences The point is that … The first thing is that … Take something like … That’s not all. … It seems to me that … Nattinger & DeCarrico (1992)