JJ Orban de Xivry jj.orban@kuleuven.be Hands on session JJ Orban de Xivry jj.orban@kuleuven.be.

Slides:



Advertisements
Similar presentations
Internal models, adaptation, and uncertainty
Advertisements

Visual feedback in the control of reaching movements David Knill and Jeff Saunders.
Lecture 18: Temporal-Difference Learning
Decomposition Method.
Part II – TIME SERIES ANALYSIS C3 Exponential Smoothing Methods © Angel A. Juan & Carles Serrat - UPC 2007/2008.
3-Dimensional Gait Measurement Really expensive and fancy measurement system with lots of cameras and computers Produces graphs of kinematics (joint.
Sampling: Final and Initial Sample Size Determination
G. Alonso, D. Kossmann Systems Group
Computational Analysis of Motor Learning. Three paradigms Force field adaptation Visuomotor transformations Sequence learning Does one term (motor learning)
Quantifying Generalization from Trial-by-Trial Behavior in Reaching Movement Dan Liu Natural Computation Group Cognitive Science Department, UCSD March,
Probability & Statistical Inference Lecture 7 MSc in Computing (Data Analytics)
Journal club Marian Tsanov Reinforcement Learning.
Econ Prof. Buckles1 Multiple Regression Analysis y =  0 +  1 x 1 +  2 x  k x k + u 4. Further Issues.
Module 7A Presentation of ideas Estimated time: 5 minutes per idea.
Evolutionary Computational Intelligence Lecture 9: Noisy Fitness Ferrante Neri University of Jyväskylä.
Is it an error to be ‘too different’!? Neurobiology of social conformity Ale Smidts a Co-authors: Vasily Klucharev ab Kaisa Hytönen ab, Mark Rijpkema b.
Mathematical Statistics Lecture Notes Chapter 8 – Sections
Constant process Separate signal & noise Smooth the data: Backward smoother: At any give T, replace the observation yt by a combination of observations.
Review of normal distribution. Exercise Solution.
Forecasting and Statistical Process Control MBA Statistics COURSE #5.
An Example Using PET for Statistical Parametric Mapping An Example Using PET for Statistical Parametric Mapping Jack L. Lancaster, Ph.D. Presented to SPM.
Correlation and Prediction Error The amount of prediction error is associated with the strength of the correlation between X and Y.
Participants Interference in Motor Learning MEASUREMENTSExperimental ResultsIntroduction  The history of prior action in the human motor system is known.
The effect of varying the visual context on trajectory planning and perceptual awareness of one’s own performance 1 Psychology and Neurocognition Laboratory.
Operant Conditioning of Cortical Activity E Fetz, 1969.
Variation and Prediction Intervals
Statistical learning and optimal control: A framework for biological learning and motor control Lecture 2: Models of biological learning and sensory- motor.
Visuo-Motor Relationships: Plasticity and Development Read: Rosenbaum Chapters 2, 6 + may.doc.
The final exam solutions. Part I, #1, Central limit theorem Let X1,X2, …, Xn be a sequence of i.i.d. random variables each having mean μ and variance.
Linear Prediction Correlation can be used to make predictions – Values on X can be used to predict values on Y – Stronger relationships between X and Y.
Human and Optimal Exploration and Exploitation in Bandit Problems Department of Cognitive Sciences, University of California. A Bayesian analysis of human.
9-1 ESTIMATION Session Factors Affecting Confidence Interval Estimates The factors that determine the width of a confidence interval are: 1.The.
MURI High- Level Control Biomimetic Robots - ONR Site Visit - August 9, 2000 Human Computational Modeling PurposePurpose: to understand arm impedance.
Maxlab proprietary information – 5/4/09 – Maximilian Riesenhuber CT2WS at Georgetown: Letting your brain be all that.
R&R Homework Statgraphics “Range Method”. DATA OperatorPartTrialMeasure B B B B B B326.5 B B B C
Statistics 350 Lecture 2. Today Last Day: Section Today: Section 1.6 Homework #1: Chapter 1 Problems (page 33-38): 2, 5, 6, 7, 22, 26, 33, 34,
Does the brain compute confidence estimates about decisions?
Separate Contributions of Kinematic and Kinetic Errors to Trajectory and Grip Force Adaptation When Transporting Novel Hand-Held Loads Frederic Danion,1*
Multiple Regression.
STAT 312 Chapter 7 - Statistical Intervals Based on a Single Sample
Chapter 6: Temporal Difference Learning
The Measurement of Motor Performance
FIGURE 1. Estimated instantaneous fault detection rate
Regression Computer Print Out
Multiple Regression.
Motor Task Variation Induces Structural Learning
Sampling Distribution
Sampling Distribution
Context-Dependent Decay of Motor Memories during Skill Acquisition
Combining Geometric- and View-Based Approaches for Articulated Pose Estimation David Demirdjian MIT Computer Science and Artificial Intelligence Laboratory.
Why Psychology Matters To College Students
Enhanced Muscle Afferent Signals during Motor Learning in Humans
Caspar M. Schwiedrzik, Winrich A. Freiwald  Neuron 
Volume 87, Issue 1, Pages (July 2015)
Context-Dependent Decay of Motor Memories during Skill Acquisition
Chapter 6: Temporal Difference Learning
Hannah M. Bayer, Paul W. Glimcher  Neuron 
Caspar M. Schwiedrzik, Winrich A. Freiwald  Neuron 
Chapter 13 - Confidence Intervals - The Basics
Motor Learning with Unstable Neural Representations
Finding Periodic Discrete Events in Noisy Streams
Rethinking Motor Learning and Savings in Adaptation Paradigms: Model-Free Memory for Successful Actions Combines with Internal Models  Vincent S. Huang,
The Organization and Planning of Movement Ch
Implicit adaptation generalizes around the aiming location (30° CCW)
Masaya Hirashima, Daichi Nozaki  Current Biology 
Chapter 14 - Confidence Intervals: The Basics
Effect of inter-movement interval on movement duration under various temporal discounting regimes. Effect of inter-movement interval on movement duration.
Relationship between saccade duration, endpoint accuracy, and expected value of reward. Relationship between saccade duration, endpoint accuracy, and expected.
Behavioral task and performance.
Richard A. Andersen, He Cui  Neuron 
Presentation transcript:

JJ Orban de Xivry jj.orban@kuleuven.be Hands on session JJ Orban de Xivry jj.orban@kuleuven.be

Visuomotor rotation Changing the direction of cursor motion with respect to actual hand motion

Saving in visuomotor rotation

Interference Error (deg) Cycles (8 trials each) Krakauer et al. Journal of Neuroscience 2005

Model-free memory Huang, V. S., Haith, A. M., Mazzoni, P., & Krakauer, J. W. (2011). Rethinking motor learning and savings in adaptation paradigms: model-free memory for successful actions combines with internal models. Neuron, 70(4), 787–801.

Model-free memory Huang, V. S., Haith, A. M., Mazzoni, P., & Krakauer, J. W. (2011). Rethinking motor learning and savings in adaptation paradigms: model-free memory for successful actions combines with internal models. Neuron, 70(4), 787–801.

Effect of reinforcement learning Shmuelof, L., Huang, V. S., Haith, A. M., Delnicki, R. J., Mazzoni, P., & Krakauer, J. W. (2012). Overcoming motor “forgetting” through reinforcement of learned actions. Journal of Neuroscience, 32(42), 14617–21.

Effect of reinforcement learning Shmuelof, L., Huang, V. S., Haith, A. M., Delnicki, R. J., Mazzoni, P., & Krakauer, J. W. (2012). Overcoming motor “forgetting” through reinforcement of learned actions. Journal of Neuroscience, 32(42), 14617–21.

Shmuelof: to do list Fit exponential to first learning phase Compute average during the last 20 trials of reinforcement Compare the two groups Look at error at the end of “error-clamp” measure. Did you reproduce the results from original paper? Fit a state-space model on the average data (from initial learning to end of error-clamp period). Any differences between the two groups?

Huang: to do list Fit exponential to first learning phase Fit exponential to second learning phase Compute average error at the end of washout Compare the two groups Fit a state-space model on the average data. Any differences between the two groups? What is the variability of the learning rate? How many subjects are needed to detect a change of learning rate of 50% (effect size = 0.5)? s= estimated standard deviation (from sample) d = effect size 2 is parameter for 95% confidence interval

Design of an experiment You are nothing without a good control group Inter-subject variability: need of a power analysis to compute require sample size Choosing the right variable (mid-movement, end of movement)

Richness of behavior Reaction time Feedforward (planning) vs feedback (online control of movement) Different measures of motor memory (faster relearning, interference, error-clamp measure, ) Many factors can influence motor memories (errors, binary reinforcement, reward, etc)

Further ideas How to obtain a motor memory (following learning, sequence learning, motor adaptation, bimanual coordination learning, etc.) How can you measure it, improve it, disrupt it, etc. Which patients are likely to be impaired at this memory? Motor behavior is really rich if it is adequately measured. Models can make predictions that are testable