Introduction Chomsky (1984) theorized that language is an innate ability ingrained in all humans as expressed by universal grammar. Later, Mitchell and.

Slides:



Advertisements
Similar presentations
YOU CANT RECYCLE WASTED TIME Victoria Hinkson. EXPERIMENT #1 :
Advertisements

Copyright © 2014 by Educational Testing Service. ETS, the ETS logo, LISTENING. LEARNING. LEADING. and GRE are registered trademarks of Educational Testing.
L1 TRANSFER ON L2 by Hacer Kökcür & Duygu Işık. RESEARCH QUESTION Does first language (L1) influence the acquisition of the second language (L2)in terms.
How to Solve Test Problems Test Taking Strategy
Paid Staff and Volunteers: Do Their Attitudes Differ? Riikka Teikari and Christeen George Abstract The aim of the present study was to explore whether.
Age Differences in Emotion Recognition of Briefly Presented Faces Lisa Emery, Kory Morgan, Kaitlyn Pechanek & Caitlin Williams Reprints may be obtained.
Using Rubrics for Evaluating Student Learning. Purpose To review the development of rubrics for the purpose of assessment To share an example of how a.
Questions:  Are behavioral measures less valid and less reliable due to the amount of error that can occur during the tests compared to the other measures?
1 Name Giannaki KonstantinaWhich of the four face-to-face institute or Elluminate session topics did you select to report on and why? I select the first.
Item Response Theory. Shortcomings of Classical True Score Model Sample dependence Limitation to the specific test situation. Dependence on the parallel.
Maria Cristina Matteucci, Dina Guglielmi
Preparing for the Verbal Reasoning Measure. Overview Introduction to the Verbal Reasoning Measure Question Types and Strategies for Answering General.
Stages of testing + Common test techniques
Stages of Second Language Acquisition
Speaking Sample Items for Scoring Practice Speaking Components Speaking Scoring Guide Test Administration Manual Student Speaking Prompts- on CD Input.
Pilot: Customizing a Commercially Available Digital Game to Assess Cognitive Function William C. M. Grenhart, John F. Sprufera, Jason C. Allaire, & Anne.
1 Item Analysis - Outline 1. Types of test items A. Selected response items B. Constructed response items 2. Parts of test items 3. Guidelines for writing.
 The ACT Writing Test is an optional, 30-minute test which measures your writing skills. The test consists of one writing prompt, following by two opposing.
Is it Necessary to Develop Grammar Learning Materials?
SAT: CRITICAL READING English 11. Warm Up When you are faced with a multiple choice question (like on the SAT) what do you do? List all the apply. Re-read.
Near East University Department of English Language Teaching Advanced Research Techniques Correlational Studies Abdalmonam H. Elkorbow.
 Increasing the amount of hours spent studying and doing homework on a daily basis  Increasing the amount of work completed while studying on a daily.
Technical Adequacy Session One Part Three.
10 Mistakes to Avoid While Learning Spanish
SLOW DOWN!!!  Remember… the easiest way to make your score go up is to slow down and miss fewer questions  You’re scored on total points, not the percentage.
Constructing Objective Test Items: Simple Forms
Understanding Statistics
1 CSI5388: Functional Elements of Statistics for Machine Learning Part I.
Assessing assessment: the role of student effort in comparative studies Ray Adams Jayne Butler.
1 Item Analysis - Outline 1. Types of test items A. Selected response items B. Constructed response items 2. Parts of test items 3. Guidelines for writing.
What are the stages of test construction??? Take a minute and try to think of these stages???
LSP 120: Quantitative Reasoning and Technological Literacy Topic 1: Introduction to Quantitative Reasoning and Linear Models Lecture Notes 1.2 Prepared.
Reliability a measure is reliable if it gives the same information every time it is used. reliability is assessed by a number – typically a correlation.
Lesson 4 Grammar - Chapter 13.
PREPARATION OF QUESTIONNAIRES PREPARATION OF QUESTIONNAIRES Chapter - 4 Dr. BALAMURUGAN MUTHURAMAN
Regression Analysis: A statistical procedure used to find relations among a set of variables B. Klinkenberg G
2013 Fall Semester- Week 3. Step One  Make a brief introduction of Grammar Translation with a PPT (10 minutes)  Tell the classmates (5 minutes) 1. your.
Baron-Cohen Cognitive Psychology The Core Studies.
Poster presented at APS 2014 Abstract This study was conducted to determine if explaining criminal behavior influences later identification. Schooler and.
 Good for:  Knowledge level content  Evaluating student understanding of popular misconceptions  Concepts with two logical responses.
IRT Equating Kolen & Brennan, 2004 & 2014 EPSY
Effects of Word Concreteness and Spacing on EFL Vocabulary Acquisition 吴翼飞 (南京工业大学,外国语言文学学院,江苏 南京211816) Introduction Vocabulary acquisition is of great.
Participants & Procedure
Learning a Foreign Language: Can Features Influence Learning?
Test Based on Response There are two kinds of tests based on response. They are subjective test and objective test. 1. Subjective Test Subjective test.
Learning a Foreign Language: Can Features Influence Learning?
Do We Learn English Differently
Data Analysis and Standard Setting
Which of these is “a boy”?
Differences in comprehension strategies for discourse understanding by native Chinese and Korean speakers learning Japanese Katsuo Tamaoka Graduate.
Preparing for the Verbal Reasoning Measure
Partial Credit Scoring for Technology Enhanced Items
Y6 Parents’ Information Thursday 8th March 2018
Understanding Your PSAT/NMSQT® Results
Understanding Your PSAT/NMSQT Results
Understanding Your PSAT/NMSQT Results
Understanding Your PSAT/NMSQT® Results
Understanding Your PSAT/NMSQT Results
Understanding Your PSAT/NMSQT Results
Understanding Your PSAT/NMSQT Results
Understanding Your PSAT/NMSQT Results
Understanding Your PSAT/NMSQT Results
Understanding Your PSAT/NMSQT Results
Understanding Your PSAT/NMSQT Results
Understanding Your PSAT/NMSQT Results
Understanding Your PSAT/NMSQT Results
Understanding Your PSAT/NMSQT Results
Understanding Your PSAT/NMSQT Results
AP U.S. History Exam Details
Presentation transcript:

Introduction Chomsky (1984) theorized that language is an innate ability ingrained in all humans as expressed by universal grammar. Later, Mitchell and Myles (1998) explained that when faced with learning a second language, we learn the features of this new language in the same order as our first and subsequent languages. When trying to learn a second language, we theorize that that learning will come with more ease when the languages are similar – which would match a positive transfer of expertise in the first language mapping onto the second. For this experiment, we asked English natives to learn simple phrases and words in Swedish and Italian. Swedish and English are both Indo-European languages (Germanic) while Italian is a Romance language similar to French and Spanish (Italic). Therefore, Swedish learning questions should be easier while Italian learning questions may be more difficult and discriminable due to negative transfer from English. This positive and negative transfer may only be present for this initial learning process, and may fade over time. Participants 93 participants were included in this study. All participants were recruited through introductory Psychology courses for course credit. 37% of the sample identified themselves as male; 62% as female. Ages ranged from years old with the average age of the sample being years old, SD = 4.00 years. Procedure All participants were directed to Qualtrics and asked some brief demographic questions, such as expertise with the target languages. Participants then received a 20-minute lesson either on basic Swedish or basic Italian (randomly assigned). Although the language order was randomly assigned, the order of the questions remained constant and were matched verbatim for both languages. Questions began as multiple choice for learning purposes, but increased in difficulty to include multiple choice for testing purposes, matching, and sentence translation. Once participants concluded the lesson, they received the lesson for the second language. Multiple Choice- Learning and Screening Purposes The first four questions provided a basis for learning the language. Pictures in each answer option gave participants time to connect the target word to the picture and possibly to the English equivalent word. For example, see Figure 1. Since these questions had pictures, it was assumed that participants should get these correct. Instead, these were used to screen out participants that could not understand the directions or were not making a true effort in this study; defined as anyone correctly answering three or less of the four questions correctly. Multiple Choice- Test Questions Once participants had learned a few basic words, they were presented with multiple choice questions that lacked the pictures. Participants had to begin to rely on their recognition memory to correctly answer questions. For example, “How do you say ‘apple’ in Swedish?” Matching Questions As participants began to learn abstract words (such as “a”), they were presented with drag-and-drop matching questions. Participants had to use their recognition memory and correctly identify multiple matching words simultaneously. For example, see Figure 2. Sentence Translations Finally, participants were asked to translate short phrases and sentences. Most sentences included a word or two that had not been presented to the participant, but should be translatable within the context of the other words. This concluding section required participants to rely on their memory and contextual skills to correctly translate the phrase. For example, “Translate this sentence: ‘Jag är en pojke.’” Results Item Response Theory was used to determine differences in difficulty and discrimination between the Italian and Swedish lesson. Both a 2PL and a 3PL model were programmed, but a 2PL analysis is used since these two models were not significantly different. Items with ceiling effects (SD < 0.15) were removed from the analysis. When comparing the difficulty coefficients on remaining items, it appears that Swedish is easier on multiple choice, but Italian is easier for matching and translation in general (see Figure 3). When comparing discriminability coefficients on remaining items, it appears that Swedish is more discriminable for translation while Italian is more discriminable for multiple choice and matching in general (see Figure 4). However, this is heavily biased by the omission of items with ceiling effects and should be taken into consideration. Discussion Traditional IRT requires a dichotomized outcome, which loses valuable information about complex question scoring. When comparing the average score by item using the dichotomized scores (see Figure 5), differences between languages seem more distinct than when comparing average score allowing for partial credit (see Figure 6). Further, time constraints led to the sole use of basic knowledge questions for testing. 20 minutes is not enough time to solidify any testable language skills. The lack of answering variability forced us to omit most items since most participants were scoring extremely well. Although it seems that a trend may be present (see Figure 7), future research will require much more time with participants to gain enough skills in multiple languages to test a larger variety of questions ranging in difficulty level.. Abstract Participants were given a short lesson on Italian and Swedish, similar to DuoLingo. Although both were relatively easy, differences in the variance, discriminability, and difficulty were found between the two languages. Figure 3. Difficulty coefficients for items remaining in the IRT for both languages. Figure 7. Average score of all questions by each type of question, allowing for partial credit. Figure 6. Average score by each item, allowing for partial credit. Figure 5. Average score by each item, dichotomizing (no partial credit). Figure 4. Discriminability coefficients for items remaining in the IRT for both languages. Which of these is “a boy”? La donna La mela Un ragazzo Una ragazza Figure 1. Example item for screening multiple choice questions. Drag the Italian word to the correct English word. Italian Items donna Boy ragazzo Is sono I io Girl ragazza English Items Figure 2. Example item for matching questions. Contact Us: For more information, us at