Home LiteratureArticle Details
PMID: 16949252 Published · ppublish English Comparative Study Journal Article Research Support, Non-U.S. Gov't

Weighing up the benefits of work: behavioral and neural analyses of effort-related decision making.

Walton ME, Kennerley SW, Bannerman DM, Phillips PE, Rushworth MF

Abstract

How we decide whether a course of action is worth undertaking is largely unknown. Recently, neuroscientists have been turning to ecological approaches to address this issue, examining how animals evaluate the costs and benefits of different options. We present here evidence from rodents and monkeys that demonstrate the degree to which they take into account work and energetic requirements when deciding what responses to make. These calculations appear to be critically mediated by the anterior cingulate cortex (ACC) and mesolimbic dopamine (DA) pathways, with damage to either causing a bias towards options that are easily obtained but yield relatively smaller reward rather than alternatives that require more work but result in greater reward. The evaluation of such decisions appears to be carried out in systems independent of those involved in delay-discounting. We suggest that top-down signals from ACC to nucleus accumbens (NAc) and/or midbrain DA cells may be vital for overcoming effort-related response costs.

MeSH Terms
Animals Behavior, Animal/physiology Decision Making Dopamine/physiology Limbic System/physiology Macaca mulatta Male Maze Learning/physiology Neural Pathways/physiology Prefrontal Cortex/physiology Rats Reaction Time Reinforcement Schedule Reinforcement, Psychology Time Factors Work/psychology
Chemicals
Dopamine
Authors & Affiliations
5 authors, click to expand affiliations / ORCID
Walton M E
Department of Experimental Psychology, South Parks Road, Oxford, UK. mark.walton@psy.ox.ac.uk
Kennerley S W
Bannerman D M
Phillips P E M
Rushworth M F S
References (83)
83 references, click to expand
  1. Differential involvement of serotonin and dopamine systems in cost-benefit decisions about delay or effort.
    Psychopharmacology (Berl). 2005 May;179(3):587-96 PMID: 15864561
  2. Acquired personality disturbances associated with bilateral damage to the ventromedial prefrontal region.
    Dev Neuropsychol. 2000;18(3):355-81 PMID: 11385830
  3. Brain dopamine and reward.
    Annu Rev Psychol. 1989;40:191-225 PMID: 2648975
  4. Nucleus accumbens dopamine depletions alter relative response allocation in a T-maze cost/benefit task.
    Behav Brain Res. 1996 Jan;74(1-2):189-97 PMID: 8851929
  5. Neural correlates of decisions.
    Curr Opin Neurobiol. 2002 Apr;12(2):141-8 PMID: 12015229
  6. Effects of methamphetamine on the adjusting amount procedure, a model of impulsive behavior in rats.
    Psychopharmacology (Berl). 1999 Oct;146(4):432-9 PMID: 10550493
  7. Effects of unilateral 6-hydroxydopamine lesions of the caudate-putamen on skilled forepaw use in the rat.
    Behav Brain Res. 1984 Oct;14(1):61-8 PMID: 6097287
  8. Interactions between decision making and performance monitoring within prefrontal cortex.
    Nat Neurosci. 2004 Nov;7(11):1259-65 PMID: 15494729
  9. The mesocortical dopamine projection to anterior cingulate cortex plays no role in guiding effort-related decisions.
    Behav Neurosci. 2005 Feb;119(1):323-8 PMID: 15727537
  10. Haloperidol and nucleus accumbens dopamine depletion suppress lever pressing for food but increase free food consumption in a novel food choice procedure.
    Psychopharmacology (Berl). 1991;104(4):515-21 PMID: 1780422
  11. Interactions between serotonin and dopamine in the control of impulsive choice in rats: therapeutic implications for impulse control disorders.
    Neuropsychopharmacology. 2005 Apr;30(4):669-82 PMID: 15688093
  12. To walk or to fly? How birds choose among foraging modes.
    Proc Natl Acad Sci U S A. 2001 Jan 30;98(3):1089-94 PMID: 11158599
  13. Nucleus accumbens dopamine depletions in rats affect relative response allocation in a novel cost/benefit procedure.
    Pharmacol Biochem Behav. 1994 Sep;49(1):85-91 PMID: 7816895
  14. Form and distribution of neurons in rat cingulate cortex: areas 32, 24, and 29.
    J Comp Neurol. 1981 Feb 1;195(4):603-25 PMID: 7462444
  15. Accumbens dopamine and the regulation of effort in food-seeking behavior: modulation of work output by different ratio or force requirements.
    Behav Brain Res. 2004 May 5;151(1-2):83-91 PMID: 15084424
  16. Conflict monitoring and anterior cingulate cortex: an update.
    Trends Cogn Sci. 2004 Dec;8(12):539-46 PMID: 15556023
  17. Functional specialization within medial frontal cortex of the anterior cingulate for evaluating effort-related decisions.
    J Neurosci. 2003 Jul 23;23(16):6475-9 PMID: 12878688
  18. Orbitomedial prefrontal cortical projections to distinct longitudinal columns of the periaqueductal gray in the rat.
    J Comp Neurol. 2000 Jul 10;422(4):556-78 PMID: 10861526
  19. Will travel for food: spatial discounting in two new world monkeys.
    Curr Biol. 2005 Oct 25;15(20):1855-60 PMID: 16243033
  20. Organization of catecholamine neurons projecting to the frontal cortex in the rat.
    Brain Res. 1978 Feb 17;142(1):1-24 PMID: 626911
  21. Burst firing induced in midbrain dopamine neurons by stimulation of the medial prefrontal and anterior cingulate cortices.
    Brain Res. 1988 Oct 11;462(1):194-8 PMID: 3179734
  22. The role of the medial frontal cortex in cognitive control.
    Science. 2004 Oct 15;306(5695):443-7 PMID: 15486290
  23. Adipsia and aphagia after 6-hydroxydopamine induced degeneration of the nigro-striatal dopamine system.
    Acta Physiol Scand Suppl. 1971;367:95-122 PMID: 4332694
  24. Do rats have prefrontal cortex? The rose-woolsey-akert program reconsidered.
    J Cogn Neurosci. 1995 Winter;7(1):1-24 PMID: 23961750
  25. Comparison of the effects of neonatal and adult medial prefrontal cortex lesions on food hoarding and spatial delayed alternation.
    Behav Brain Res. 1991 Jan 31;42(1):67-75 PMID: 2029346
  26. Subsecond dopamine release promotes cocaine seeking.
    Nature. 2003 Apr 10;422(6932):614-8 PMID: 12687000
  27. The pharmacology of impulsive behaviour in rats: the effects of drugs on response choice with varying delays of reinforcement.
    Psychopharmacology (Berl). 1996 Nov;128(2):161-70 PMID: 8956377
  28. Effects of dopaminergic drugs on delayed reward as a measure of impulsive behavior in rats.
    Psychopharmacology (Berl). 2000 May;150(1):90-101 PMID: 10867981
  29. Human cingulate cortex and autonomic control: converging neuroimaging and clinical evidence.
    Brain. 2003 Oct;126(Pt 10):2139-52 PMID: 12821513
  30. Neurons in rat medial prefrontal cortex show anticipatory rate changes to predictable differential rewards in a spatial memory task.
    Behav Brain Res. 2001 Sep 14;123(2):165-83 PMID: 11399329
  31. Prefrontal cortical projections to the hypothalamus in macaque monkeys.
    J Comp Neurol. 1998 Nov 30;401(4):480-505 PMID: 9826274
  32. Prefrontal cortex regulates burst firing and transmitter release in rat mesolimbic dopamine neurons studied in vivo.
    Neurosci Lett. 1993 Jul 9;157(1):53-6 PMID: 7901810
  33. Anterior cingulate: single neuronal signals related to degree of reward expectancy.
    Science. 2002 May 31;296(5573):1709-11 PMID: 12040201
  34. Normative and descriptive models of decision making: time discounting and risk sensitivity.
    Ciba Found Symp. 1997;208:51-67; discussion 67-70 PMID: 9386907
  35. Getting formal with dopamine and reward.
    Neuron. 2002 Oct 10;36(2):241-63 PMID: 12383780
  36. An integrative theory of prefrontal cortex function.
    Annu Rev Neurosci. 2001;24:167-202 PMID: 11283309
  37. Nucleus accumbens dopamine depletions make rats more sensitive to high ratio requirements but do not impair primary food reinforcement.
    Neuroscience. 1999;92(2):545-52 PMID: 10408603
  38. "Work ethic" in pigeons: reward value is directly related to the effort or time required to obtain the reward.
    Psychon Bull Rev. 2000 Mar;7(1):100-6 PMID: 10780022
  39. The effects of d-amphetamine, chlordiazepoxide, alpha-flupenthixol and behavioural manipulations on choice of signalled and unsignalled delayed reinforcement in rats.
    Psychopharmacology (Berl). 2000 Nov;152(4):362-75 PMID: 11140328
  40. Persistence and brain circuitry.
    Proc Natl Acad Sci U S A. 2003 Mar 18;100(6):3479-84 PMID: 12626765
  41. Beyond discounting: possible experimental models of impulse control.
    Psychopharmacology (Berl). 1999 Oct;146(4):339-47 PMID: 10550485
  42. A computational substrate for incentive salience.
    Trends Neurosci. 2003 Aug;26(8):423-8 PMID: 12900173
  43. Catecholamine innervation of the human cerebral cortex as revealed by comparative immunohistochemistry of tyrosine hydroxylase and dopamine-beta-hydroxylase.
    J Comp Neurol. 1989 Jan 8;279(2):249-71 PMID: 2563268
  44. Anhedonia or anergia? Effects of haloperidol and nucleus accumbens dopamine depletion on instrumental response selection in a T-maze cost/benefit procedure.
    Behav Brain Res. 1994 Dec 15;65(2):221-9 PMID: 7718155
  45. Electrical stimulation of the prefrontal cortex increases dopamine release in the nucleus accumbens of the rat: modulation by metabotropic glutamate receptors.
    J Neurosci. 1995 May;15(5 Pt 2):3896-904 PMID: 7751954
  46. Metalearning and neuromodulation.
    Neural Netw. 2002 Jun-Jul;15(4-6):495-506 PMID: 12371507
  47. Impulsive choice induced in rats by lesions of the nucleus accumbens core.
    Science. 2001 Jun 29;292(5526):2499-501 PMID: 11375482
  48. Choice between delayed reinforcers in a discrete-trials schedule: the effect of deprivation level.
    Q J Exp Psychol B. 1992 Jan;44(1):1-6 PMID: 1546183
  49. Effects of cingulate cortical lesions on avoidance learning and training-induced unit activity in rabbits.
    Exp Brain Res. 1991;86(3):585-600 PMID: 1761092
  50. Effects of mesolimbic dopamine depletion on responding maintained by cocaine and food.
    J Exp Anal Behav. 1994 Mar;61(2):213-21 PMID: 8169570
  51. Orbitomedial prefrontal cortical projections to hypothalamus in the rat.
    J Comp Neurol. 2001 Apr 9;432(3):307-28 PMID: 11246210
  52. Involvement of the rat anterior cingulate cortex in control of instrumental responses guided by reward expectancy.
    Learn Mem. 2005 May-Jun;12(3):334-42 PMID: 15930509
  53. Qualitative and quantitative comparison of the prefrontal cortex in rat and in primates, including humans.
    Prog Brain Res. 1990;85:31-62 PMID: 2094901
  54. Experimental evidence for spatial memory in foraging wild capuchin monkeys, Cebus apella.
    Anim Behav. 1998 May;55(5):1229-43 PMID: 9632507
  55. The effects of delaying reward on choice preference in rats with hippocampal or selective septal lesions.
    Behav Brain Res. 1985 May;15(3):191-203 PMID: 4005029
  56. Neural selection and control of visually guided eye movements.
    Annu Rev Neurosci. 1999;22:241-59 PMID: 10202539
  57. How visual stimuli activate dopaminergic neurons at short latency.
    Science. 2005 Mar 4;307(5714):1476-9 PMID: 15746431
  58. The role of rat medial frontal cortex in effort-based decision making.
    J Neurosci. 2002 Dec 15;22(24):10996-1003 PMID: 12486195
  59. Dissociations between appetitive and consummatory responses by pharmacological manipulations of reward-relevant brain regions.
    Behav Neurosci. 1996 Apr;110(2):331-45 PMID: 8731060
  60. Comparison of the effects of clozapine, haloperidol, chlorpromazine and d-amphetamine on performance on a time-constrained progressive ratio schedule and on locomotor behaviour in the rat.
    Psychopharmacology (Berl). 2000 Sep;152(1):47-54 PMID: 11041315
  61. Anterior cingulate activity during routine and non-routine sequential behaviors in macaques.
    Nat Neurosci. 2000 May;3(5):502-8 PMID: 10769392
  62. Efferent projections of infralimbic and prelimbic areas of the medial prefrontal cortex in the Japanese monkey, Macaca fuscata.
    Brain Res. 2001 Jan 5;888(1):83-101 PMID: 11146055
  63. Distributed neural representation of expected value.
    J Neurosci. 2005 May 11;25(19):4806-12 PMID: 15888656
  64. The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans.
    Cereb Cortex. 2000 Mar;10(3):206-19 PMID: 10731217
  65. Theory and method in the quantitative analysis of "impulsive choice" behaviour: implications for psychopharmacology.
    Psychopharmacology (Berl). 1999 Oct;146(4):362-72 PMID: 10550487
  66. Functional differences between the prelimbic and anterior cingulate regions of the rat prefrontal cortex.
    Behav Neurosci. 1995 Dec;109(6):1063-73 PMID: 8748957
  67. Effects of selective excitotoxic prefrontal lesions on acquisition of nonmatching- and matching-to-place in the T-maze in the rat: differential involvement of the prelimbic-infralimbic and anterior cingulate cortices in providing behavioural flexibility.
    Eur J Neurosci. 2000 Dec;12(12):4457-66 PMID: 11122356
  68. Prefrontal cortical projections to longitudinal columns in the midbrain periaqueductal gray in macaque monkeys.
    J Comp Neurol. 1998 Nov 30;401(4):455-79 PMID: 9826273
  69. Stimulation of the prefrontal cortex in the rat induces patterns of activity in midbrain dopaminergic neurons which resemble natural burst events.
    Synapse. 1996 Mar;22(3):195-208 PMID: 9132987
  70. Neuronal correlates of goal-based motor selection in the prefrontal cortex.
    Science. 2003 Jul 11;301(5630):229-32 PMID: 12855813
  71. Dopaminergic innervation of the frontal cerebral cortex. Evolutionary trends and functional implications.
    Adv Neurol. 1992;57:525-44 PMID: 1543078
  72. Determination of discount functions in rats with an adjusting-amount procedure.
    J Exp Anal Behav. 1997 May;67(3):353-66 PMID: 9163939
  73. What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
    Brain Res Brain Res Rev. 1998 Dec;28(3):309-69 PMID: 9858756
  74. Decisions, decisions, decisions: choosing a biological science of choice.
    Neuron. 2002 Oct 10;36(2):323-32 PMID: 12383785
  75. Topographical organization of the efferent projections of the medial prefrontal cortex in the rat: an anterograde tract-tracing study with Phaseolus vulgaris leucoagglutinin.
    J Comp Neurol. 1989 Dec 8;290(2):213-42 PMID: 2592611
  76. Haloperidol blocks the response-reinstating effects of food reward: a methodology for separating neuroleptic effects on reinforcement and motor processes.
    Pharmacol Biochem Behav. 1988 Dec;31(4):861-5 PMID: 3252277
  77. Neural economics and the biological substrates of valuation.
    Neuron. 2002 Oct 10;36(2):265-84 PMID: 12383781
  78. Motivational views of reinforcement: implications for understanding the behavioral functions of nucleus accumbens dopamine.
    Behav Brain Res. 2002 Dec 2;137(1-2):3-25 PMID: 12445713
  79. The effects of excitotoxic lesion of the medial prefrontal cortex on latent inhibition, prepulse inhibition, food hoarding, elevated plus maze, active avoidance and locomotor activity in the rat.
    Neuroscience. 1998 May;84(2):431-42 PMID: 9539214
  80. The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking.
    Brain Res Brain Res Rev. 1999 Dec;31(1):6-41 PMID: 10611493
  81. Action sets and decisions in the medial frontal cortex.
    Trends Cogn Sci. 2004 Sep;8(9):410-7 PMID: 15350242
  82. Effects of orbital prefrontal cortex dopamine depletion on inter-temporal choice: a quantitative analysis.
    Psychopharmacology (Berl). 2004 Sep;175(2):206-14 PMID: 14991223
  83. Haloperidol produces within-session increments in operant response duration in rats.
    Pharmacol Biochem Behav. 1990 May;36(1):191-201 PMID: 2349260
Article Info
Journal
Neural networks : the official journal of the International Neural Network Society
Abbr.
Neural Netw
ISSN
0893-6080
Published
2006-10-00
Epub
2006-00-01
Pages
1302-14
Language
English
Region
United States
NLM ID
8805018
PMCID
PMC2519033
Subset
IM
Grants
Wellcome Trust · 072427 · United Kingdom
Wellcome Trust · 087736 · United Kingdom
Medical Research Council · G0300665 · United Kingdom
Analysis Services
Analysis Services

Contact

No. 2 Wenbo Road, Zhangqiu District, Jinan, Shandong

Qilu Normal University · Genelibs Bioinformatics Lab

750 Shunhua Rd, Jinan

2F, Bldg F, University Science Park

Tel: 0531-88819269

WeChat Official Account

Follow our WeChat subscription account for real-time updates and the latest in medical and biological research.


Business Email

E-mail: product@genelibs.com