Loading...
Neural activity in the primary motor cortex is reminiscent of temporal difference reinforcement learning.
Journal Title
Keywords
Readers/Advisors
Francis, Joe
Journal Title
Term and Year
Fall 2017
Publication Date
2017-11-21
Book Title
Publication Volume
Publication Issue
Publication Begin
Publication End
Number of pages
Files
Loading...
Doctoral Dissertation
Adobe PDF, 11.45 MB
Research Projects
Organizational Units
Journal Issue
Abstract
A key component of Reinforcement Learning (RL) is the value function, which captures the expected, temporally discounted reward, from a given state. The value function can also be modified by the animal’s knowledge and certainty of its environment. Here we show that motor cortex (M1) encodes a value function in line with temporal difference RL. M1 responds to the delivery of unpredictable reward, and shifts its value related response earlier in atrial, becoming predictive of expected reward, when reward is predictable. M1also encodes multiple levels of reward. This is observed in tasks performed manually or observed passively. The Microstimulus Temporal Difference (MSTD)model, known to accurately capture RL related dopaminergic activity, extends to account for M1 reward related neural activity.
Citation
Tarigoppula, V. (2017). Neural activity in the primary motor cortex is reminiscent of temporal difference reinforcement learning. [Doctoral dissertation, SUNY Downstate Health Sciences University]. SUNY Open Access Repository. https://soar.suny.edu/handle/20.500.12648/15862
DOI
Description
Doctoral Dissertation