Inter-Rater Reliability

Slides:



Advertisements
Similar presentations
Figure Three-dimensional reconstruction of the left hemisphere of the human brain showing increased activity in ventrolateral area 45 during verbal.
Advertisements

Cognitive Neuroscience of Language 1. Premise 1: Constituent Cognitive Processes Phonological analysis Syntactic analysis Semantic analysis Premise 2:
Diffusion Tensor Imaging Johansen-Berg and Rushworth 2008 Glasser and Rilling April 2010.
APHASIA. What is it?  “Acquired language dysfunction due to neurological injury or disease”  Most common cause is stroke (about 25-40% of stroke patients.
Communication after a Stroke
Reversion to a Previously Learned Foreign Accent After Stroke Presented by: Vineet Sidhu.
Spatial Neglect and Attention Networks
BACKGROUND Lesion Characteristics Related to Naming Improvement in Aphasic Stroke Patients: The Role of Anterior Cortex and the Basal Ganglia R.B. Parkinson.
Marshall, R. C. , Gandour, J. , & Windsor, J. (1988)
The Neuroscience of Music. Main points Music is like language –Characterized by rhythmic sequential sounds –Has syntax: “rules” by which a sequence of.
1 Chapter 19: Higher mental functions Chris Rorden University of South Carolina Norman J. Arnold School of Public Health Department of Communication Sciences.
1 Language disorders We can learn a lot by looking at system failure –Which parts are connected to which Examine the relation between listening/speaking.
Coarticulation in apraxia of speech: an acoustic study of non-words Authors : Sandra P Whiteside and Rosemary A. Varley.
Plasticity of Language-Related Brain Function During Recovery from Stroke K.R. Thulborn, P.A. Carpenter, & M.A. Just By Sydney Schnell.
1 Visual word recognition rules vs. pattern recognition and memory retrieval Erika Nyhus.
Where is the semantic network?. What is the semantic network?  Knowledge of objects, people, concepts and word meanings  Spreading-activation theory.
Bookheimer 2003 Annual Rev. Neurosci.. Phonology in IFG Gelfand and Bookheimer, Neuron 2002.
CSD 2230 HUMAN COMMUNICATION DISORDERS Topic 6 Language Disorders Adult Disorders Aphasia and Right Hemisphere Injury.
Camille Blochet Language Brain areas implied in language analysis Oscillations related to language and cognitive skills.
ADULT LANGUAGE DISORDERS Week 1 Jan 13, Text Book LaPointe, L. L. (2005). Aphasia and Related Neurogenic Language Disorders. 3rd edition, Thieme,
Drummon, S. P. A., Brown, G. G., Gillin, J. C., Stricker, J. L., Wong, E. C., Buxton, R. B. Lecturer: Katie Yan.
Psychological Testing
Welcome Back Pick up a Packet! UAA, Cody Augdahl, 2005.
1 Cerebrum November 6, 2013 Chapter 13: Dr. Diane M. Jaworski Frontal Temporal Occipita l Parietal.
By: Angela D. Friederici Presented By: Karol Krzywon.
Insights into Verbal Planning Total score of core propositions
31 Speaker: Hanna Lu (PhD Candidate of Medical Sciences, CUHK)
Continuing Medical Education (CME)
Copyright © 2013 American Medical Association. All rights reserved.
Higher Cortical Functions
Dr. Deborah Larsen, PT, PhD Alexandra Borstad, PT, PhD
Neurological Basis for Speech and Language
Paul Broca’s Case Study
Cognitive and Discriminative Somatosensory Cortical Networks Overlap
Language: An Overview Language is a brain function
“I am going to the other movies”
Brief Computerized Measures of Information Processing Speed are Sensitive to Multiple Sclerosis across the Lifespan M. Shaw1, C. Schwarz1, L.B. Krupp1,
Lesion Volumes in Agrammatic Aphasia: The Role of the Posterior Perisylvian Region for Syntactic Processing Borna Bonakdarpour*†, Sladjana Lukic, Kyla.
Function of Brain in Communication (Language)
Association of Cortical Thickness to Cognitive Functioning in Late Life Depression Melissa Hirt, MA, David Bickford, BA, Alana Kivowitz, BA, Joseph Brewer,
ABILITY READING COMPREHENSION IN PATIENTS WITH SPEECH AND LANGUAGE IMPAIRMENTS AFTER STROKE Goran Savić, Institute of Physical Medicine and Rehabilitation.
Language Part 2 Saygin, AP.
RESULTS AND DISCUSSION Fall Level High-rising Fall Level High-rising
Exploring Online Eye Movement Indices of Attention Allocation in Aphasia Sabine Heuer, Brooke Hallowell Procedure Single-task conditions. During the comprehension.
The Human Default Mode Network: A revelation of modern neuroimaging
Duration of presentat ion
Temporal associational cortex
Cerebral responses to vocal attractiveness and auditory
Disrupted Neural Synchronization in Toddlers with Autism
Volume 20, Issue 5, Pages (May 1998)
Dorothee Saur, MD, Gesa Hartwigsen, PhD 
Neural Changes following Remediation in Adult Developmental Dyslexia
فرآيند نوشتن در انسان.
Volume 87, Issue 4, Pages (August 2015)
A Network Diffusion Model of Disease Progression in Dementia
Volume 19, Issue 6, Pages (March 2009)
Neural Changes following Remediation in Adult Developmental Dyslexia
The Neural Basis of Body Form and Body Action Agnosia
Towards a neural basis of auditory sentence processing
Liping Wang, Lynn Uhrig, Bechir Jarraya, Stanislas Dehaene 
Volume 79, Issue 4, Pages (August 2013)
Elizabeth J. Coulthard, Parashkev Nachev, Masud Husain  Neuron 
Neural Correlates of Visual Working Memory
Study of the neural bases of language development and use
Mnemonic Training Reshapes Brain Networks to Support Superior Memory
Resting State Functional Connectivity Analysis in Children with Childhood Apraxia of Speech Following the Treatment for Establishing Motor Program Organization.
Cognition Brain and Language Team
Christian J. Fiebach, Jesse Rissman, Mark D'Esposito  Neuron 
John D.E. Gabrieli, Satrajit S. Ghosh, Susan Whitfield-Gabrieli  Neuron 
Presentation transcript:

Inter-Rater Reliability Resting-state fMRI of the Phonologic Network in Repetition Mara E. Callahan1, M.S. Candidate Advisor: Amy E. Ramage1, Ph.D.; Committee: Donald A. Robin1, Ph.D., Kirrie J. Ballard2, Ph.D. Communication Sciences and Disorders at 1UNH and 2University of Sydney Background Participants Methods Results Aphasia is an acquired language disorder resulting from a stroke in the left hemisphere of the brain. Verbal expression in aphasia may include speech sound errors that are due to either phonological or motor system impairments. [1,2] Speech-Language Pathologists struggle with differential diagnoses between phonological [language] and motor programing [speech] deficits in word production. [1,2] Phonological and motoric deficits are thought to arise from differing neural systems and to manifest from different levels of word processing. [3,4] AOS Non-AOS n 9 11 Age 63.5 ± 12.1 61.9 ± 9.5 Gender (M:F) 9:0 9:2 Phonological Severity 3.11 ± 1.83 3.3 ± 1.35 AOS Severity * 4.56 ± 1.59 1.18 ± .405 Months Post Onset Stroke* 57.7 ± 83.0 24 ± 16.53 Western Aphasia Battery-Revised (WAB-R) – Aphasia Quotient* 57.7 ± 24.2 75.02 ± 19 Raven’s Progressive Matrices 26.9 ± 6.5 31.45 ± 3.4 PALPA Auditory Discrimination 71.4% ± 26.5% 91.7% ± 10.6% Regression Equation AOS Severity Y = 13.5(Distortions) + .426; F1,18 = 21.597, p<.001 Dysarthria Y = 6.3(Distortions) + 2.5(Moderate Segmentation) – 3.3(Inappropriate Stress) + .136 ; F3,16 = 9.745, p<.001 Nonverbal-Oral Apraxia Y = 9.7(Distortions) + 1.67; F1,18 = 7.504, p<.001 WAB AQ Y = -85.1(Severe Segmentation) – 94.4 (Substitutions) + 88.4; F2,17 = 12.18, p<.001 Table 3. Error types predict the severity of AOS, Dysarthria, Nonverbal-Oral AOS, and WAB AQ. Figure 2. Significant correlations between errors types and functional connectivity between the regions of interest. Blue is associated with phonological errors and green is associated with motoric errors AOS Non-AOS Table 1. * Indicates significant group differences, p < .05. Lesion Overlap by Group Specific Aims Reliably identify error types in verbal repetition data and their relation to diagnostic group. Identify differences in functional connectivity between brain regions of a phonological processing network in individuals with aphasia from that of healthy, age-matched controls. Examine differences in phonological network functional connectivity individuals with aphasia who demonstrate more phonological than AOS-type errors differs (Non-AOS) relative to those with AOS-type errors (AOS). Figure 1. Lesion Overlap Map. Blue = least overlap, White = most overlap Region x y z Frontal Lobe Premotor Cortex -58 1 23 Posterior Inferior Frontal Gyrus -56 17 15 Temporal Lobe Angular Gyrus -48 -68 28 Supramarginal Gyrus -50 14 Planum Polare -16 Posterior Middle Temporal Gyrus -62 -18 -14 Figure 1. Regions of Interest This Photo by Unknown Author is licensed under CC BY-SA IFG PM AG PP pMTG SMG Conclusion Experience and clearly defined criteria for differential diagnoses of AOS and phonological impairments are crucial for the identification and treatment of underlying deficits. Errors predict symptom severity: An increased number of distortions is predictive of AOS, dysarthria, and nonverbal-oral apraxia severity. Moderate segmentation is predictive of dysarthria, but individuals who do not use inappropriate stress are less likely to be dysarthric. Lastly, patient’s who have fewer substitutions, even with severe segmentation, have higher WAB AQ scores. Patterns observed in correlations between error production-FC include: All correlations between phonological errors and FC involved the pIFG-ROIs, where FC was weaker in the Non-AOS group. The significant correlations between motoric errors and FC were in connections that were stronger in the AOS than Non-AOS group. Methods Error Detection and Types Twenty left hemisphere stroke patients (11 Non-AOS, 9 AOS) and 18 healthy controls underwent a battery of assessments to diagnose and determine the severity of aphasia and AOS. Six graduate student clinicians were trained in identification of phonologically versus motorically-based speech sound errors and rated the presence and severity of each in auditory repetition data. Clinicians rated the stimuli of the Repetition Task from the Western Aphasia Battery – Revised (WAB-R). Motoric Features: distortions, stress, and segmentation. Phonological Features: transpositions and substitutions. Structural and functional MRI data was acquired and functional connectivity (FC) assessed amongst regions of a phonological brain network (Table 4). [5] Error types were correlated with FC to determine the components of the network relating to phonological relative to motoric errors. [5] Error Type Inter-Rater Reliability Error Frequency AOS Non-AOS Motoric Distortions* κ = 0.857 .24 ± .1 .11 ± .1 Stress κ = 0.775 1 2 3 .62 ± .3 .29 ± .2 .09 ± .1 .78 ± .2 .05 ± .1 Segmentation κ = 0.730 .52 ± .1 .31 ± .1 .18 ± .1 .64 ± .2 .25 ± .2 Phonologic Transpositions κ = 0.994 .02 ± .04 Substitutions κ = 0.902 .73 ± .2 .10 ± .1 .04 ± .1 .13 ± .1 .81 ± .2 .03 ± .0 .06 ± .1 References [1] Duffy, J. R. (2013). Motor Speech Disorders: Substrates, Differential Diagnosis, and Management(3rd ed.). St. Louis, MO: Elsevier. [2] Hope, T. M., Prejawa, S., Jones, A P., Oberhuber, M., Seghier, M. L., Green, D. W., & Price, C. J. (2014). Dissecting the functional anatomy of auditory word repetition. Frontiers in Human Neuroscience, 8. doi:10.3389/fnhum.2014.00246 [3] Bock, K., and Levelt, W.J.M. (1994). Language production. Grammatical encoding. IN M.A. Gernsbacher (Ed.). Handbook of psycholinguistics (pp.741-779). New York: Academic Press [4] Dell, G.S., Change, F., and Griffin, Z.M. (1999). Connectionist models of language production: lexical access and grammatical encoding. Cognitive Review. 23: 517- 542 [5] New, A. B., Robin, D. A., Parkinson, A. L., Duffy, J. R., McNeil, M. R., Piguet, O., & Ballard, K. J. (2015). Altered resting-state network connectivity in stroke patients with and without apraxia of speech. Neuroimage. Clinical, 8429-439. doi:10.1016/j.nicl.2015.03.013 Table 2. Inter-rater reliability was established using Cohen’s Kappa. Inter-rater agreement at/above K = .6 was difficult to achieve until the three of the clinicians were retrained using an agreed-upon rating system and reached agreement. The groups differed for frequency of distortions (F1,18 = 11, p = .004). Stress: 1=normal, 2=equal, 3=inappropriate; Segmentation: 1=smooth, 2=moderate 3=severe; Substitutions: 0=none, 1=voicing, 2=group switching, 3=true.