Cortical and Hippocampal Correlates of Deliberation during Model-Based Decisions for Rewards in Humans

Bornstein, Aaron M.; Daw, Nathaniel D.
December 2013
PLoS Computational Biology;Dec2013, Vol. 9 Issue 12, p1
Academic Journal
How do we use our memories of the past to guide decisions we've never had to make before? Although extensive work describes how the brain learns to repeat rewarded actions, decisions can also be influenced by associations between stimuli or events not directly involving reward — such as when planning routes using a cognitive map or chess moves using predicted countermoves — and these sorts of associations are critical when deciding among novel options. This process is known as model-based decision making. While the learning of environmental relations that might support model-based decisions is well studied, and separately this sort of information has been inferred to impact decisions, there is little evidence concerning the full cycle by which such associations are acquired and drive choices. Of particular interest is whether decisions are directly supported by the same mnemonic systems characterized for relational learning more generally, or instead rely on other, specialized representations. Here, building on our previous work, which isolated dual representations underlying sequential predictive learning, we directly demonstrate that one such representation, encoded by the hippocampal memory system and adjacent cortical structures, supports goal-directed decisions. Using interleaved learning and decision tasks, we monitor predictive learning directly and also trace its influence on decisions for reward. We quantitatively compare the learning processes underlying multiple behavioral and fMRI observables using computational model fits. Across both tasks, a quantitatively consistent learning process explains reaction times, choices, and both expectation- and surprise-related neural activity. The same hippocampal and ventral stream regions engaged in anticipating stimuli during learning are also engaged in proportion to the difficulty of decisions. These results support a role for predictive associations learned by the hippocampal memory system to be recalled during choice formation.


Related Articles

  • Altered Hippocampal-Parahippocampal Function During Stimulus Encoding. Rasetti, Roberta; Mattay, Venkata S.; White, Michael G.; Sambataro, Fabio; Podell, Jamie E.; Zoltick, Brad; Qiang Chen; Berman, Karen F.; Callicott, Joseph H.; Weinberger, Daniel R. // JAMA Psychiatry;Mar2014, Vol. 71 Issue 3, p236 

    IMPORTANCE Declarative memory--the ability to learn, store, and retrieve information--has been consistently reported to be altered in schizophrenia, and hippocampalparahippocampal dysfunction has been implicated in this deficit. To elucidate the possible role of genetic risk factors in such...

  • Online evaluation of novel choices by simultaneous representation of multiple memories. Barron, Helen C; Dolan, Raymond J; Behrens, Timothy E J // Nature Neuroscience;Oct2013, Vol. 16 Issue 10, p1492 

    Prior experience is critical for decision-making. It enables explicit representation of potential outcomes and provides training to valuation mechanisms. However, we can also make choices in the absence of prior experience by merely imagining the consequences of a new experience. Using...

  • Age-Related Changes in the Functional Network Underlying Specific and General Autobiographical Memory Retrieval: A Pivotal Role for the Anterior Cingulate Cortex. Martinelli, Pénélope; Sperduti, Marco; Devauchelle, Anne-Dominique; Kalenzaga, Sandrine; Gallarda, Thierry; Lion, Stéphanie; Delhommeau, Marion; Anssens, Adèle; Amado, Isabelle; Meder, Jean François; Krebs, Marie-Odile; Oppenheim, Catherine; Piolino, Pascale // PLoS ONE;Dec2013, Vol. 8 Issue 12, p1 

    Age-related changes in autobiographical memory (AM) recall are characterized by a decline in episodic details, while semantic aspects are spared. This deleterious effect is supposed to be mediated by an inefficient recruitment of executive processes during AM retrieval. To date, contrasting...

  • Deciding Not to Decide: Computational and Neural Evidence for Hidden Behavior in Sequential Choice. Gluth, Sebastian; Rieskamp, Jörg; Büchel, Christian // PLoS Computational Biology;Oct2013, Vol. 9 Issue 10, p1 

    Understanding the cognitive and neural processes that underlie human decision making requires the successful prediction of how, but also of when, people choose. Sequential sampling models (SSMs) have greatly advanced the decision sciences by assuming decisions to emerge from a bounded evidence...

  • The Positional-Specificity Effect Reveals a Passive-Trace Contribution to Visual Short-Term Memory. Postle, Bradley R.; Awh, Edward; Serences, John T.; Sutterer, David W.; D’Esposito, Mark // PLoS ONE;Dec2013, Vol. 8 Issue 12, p1 

    The positional-specificity effect refers to enhanced performance in visual short-term memory (VSTM) when the recognition probe is presented at the same location as had been the sample, even though location is irrelevant to the match/nonmatch decision. We investigated the mechanisms underlying...

  • Optimization and reliability of multiple postlabeling delay pseudo-continuous arterial spin labeling during rest and stimulus-induced functional task activation. Mezue, Melvin; Segerdahl, Andrew R; Okell, Thomas W; Chappell, Michael A; Kelly, Michael E; Tracey, Irene // Journal of Cerebral Blood Flow & Metabolism;Dec2014, Vol. 34 Issue 12, p1919 

    Arterial spin labeling (ASL) sequences that incorporate multiple postlabeling delay (PLD) times allow estimation of when arterial blood signal arrives within a region of interest. Sequences that account for such variability may improve the reliability of ASL and therefore make the technique well...

  • Stimulus-Response Mappings Shape Inhibition Processes: A Combined EEG-fMRI Study of Contextual Stopping. Lavallee, Christina F.; Herrmann, Christoph S.; Weerda, Riklef; Huster, René J. // PLoS ONE;Apr2014, Vol. 9 Issue 4, p1 

    Humans are rarely faced with one simple task, but are typically confronted with complex stimulus constellations and varying stimulus-relevance in a given situation. Through modifying the prototypical stop-signal task and by combined recording and analysis of electroencephalography (EEG) and...

  • Reward Sensitivity Is Associated with Brain Activity during Erotic Stimulus Processing. Costumero, Victor; Barrós-Loscertales, Alfonso; Bustamante, Juan Carlos; Ventura-Campos, Noelia; Fuentes, Paola; Rosell-Negre, Patricia; Ávila, César // PLoS ONE;Jun2013, Vol. 8 Issue 6, p1 

    The behavioral approach system (BAS) from Gray’s reinforcement sensitivity theory is a neurobehavioral system involved in the processing of rewarding stimuli that has been related to dopaminergic brain areas. Gray’s theory hypothesizes that the functioning of reward brain areas is...

  • Elaboration versus Suppression of Cued Memories: Influence of Memory Recall Instruction and Success on Parietal Lobe, Default Network, and Hippocampal Activity. Gimbel, Sarah I.; Brewer, James B. // PLoS ONE;Feb2014, Vol. 9 Issue 2, p1 

    Functional imaging studies of episodic memory retrieval consistently report task-evoked and memory-related activity in the medial temporal lobe, default network and parietal lobe subregions. Associated components of memory retrieval, such as attention-shifts, search, retrieval success, and...


Read the Article


Sorry, but this item is not currently available from your library.

Try another library?
Sign out of this library

Other Topics