Home LiteratureArticle Details
PMID: 15731896 Published · ppublish English Journal Article Research Support, N.I.H., Extramural Research Support, Non-U.S. Gov't Research Support, U.S. Gov't, P.H.S.

Transition to drug addiction: a negative reinforcement model based on an allostatic decrease in reward function.

Psychopharmacology ·Vol. 180 ·No. 3 ·2005-07-00 ·Pages 473-90

Ahmed SH, Koob GF

Abstract

The transition from initial drug use to drug addiction has been proposed to result from an allostatic decrease in reward function driven by an overactivation of brain antireward processes. How decreased reward function explains compulsive drug use is not entirely clear at present, and is still a subject for debate. We present a quantitative model of cocaine self-administration that integrates pharmacokinetic, pharmacodynamic, and motivational factors to address this question. The model assumes that reward system responsivity is a homeostatically regulated process where the desired level of responsivity (called the reward set point) is initially different from the baseline level. The reduction or correction of this difference or error in reward function would drive cocaine self-administration. Theoretical data obtained by computer simulation fit the experimental data obtained in animals self-administering cocaine (i.e., the within-session pattern of self-injections, the shape and curvature of the dose-injection function, the nonlinear relationship between drug intake and regulated drug effects). Importantly, simulation of an allostatic decrease in reward system responsivity exacerbates the initial error that drives self-administration, thereby increasing both the intake of, and the motivation for, the drug. This allostatic change manifests as a vertical shift in the dose-injection function similar to that seen in animals with escalating cocaine self-administration. The present model provides a satisfactory explanation of escalated drug intake and suggests a novel negative reinforcement view of addiction based on an allostatic decrease in reward function.

MeSH Terms
Adaptation, Physiological Algorithms Animals Cocaine/administration & dosage,pharmacokinetics Computer Simulation Neural Networks, Computer Reinforcement, Psychology Reward Self Administration Substance-Related Disorders/etiology,metabolism,physiopathology
Chemicals
Cocaine
Authors & Affiliations
2 authors, click to expand affiliations / ORCID
Ahmed Serge H
Laboratoire de Neuropsychobiologie des Désadaptations, University Victor-Segalen Bordeaux2, CNRS-UMR 5541, 33076, Bordeaux, France. sahmed@lnpb.u-bordeaux2.fr
Koob George F
References (117)
117 references, click to expand
  1. Self-administration of psychomotor stimulant drugs: the effects of unlimited access.
    Pharmacol Biochem Behav. 1976 Jan;4(1):45-51 PMID: 4818
  2. Postcocaine anhedonia. An animal model of cocaine withdrawal.
    Neuropsychopharmacology. 1991 Jan;4(1):17-26 PMID: 2003866
  3. Behavior postulates and corollaries--1949.
    Psychol Rev. 1950 May;57(3):173-80 PMID: 15417685
  4. Cocaine self-administration in rats influenced by environmental conditions: implications for the etiology of drug abuse.
    Neurosci Lett. 1987 Oct 16;81(1-2):227-31 PMID: 3696469
  5. Pipradrol enhances reinforcing properties of stimuli paired with brain stimulation.
    Pharmacol Biochem Behav. 1978 Mar;8(3):219-22 PMID: 26063
  6. Parameters of self-administration of cocaine in rats under a progressive-ratio schedule.
    Pharmacol Biochem Behav. 1993 Jul;45(3):539-48 PMID: 8332614
  7. Behavioral effects of self-administered cocaine: responding maintained alternately by cocaine and electric shock in squirrel monkeys.
    J Pharmacol Exp Ther. 1979 Aug;210(2):206-14 PMID: 110922
  8. Cocaine-reinforced behavior in rats: effects of reinforcement magnitude and fixed-ratio size.
    J Pharmacol Exp Ther. 1968 May;161(1):122-9 PMID: 5648489
  9. Addiction as a computational process gone awry.
    Science. 2004 Dec 10;306(5703):1944-7 PMID: 15591205
  10. Satiety threshold: a quantitative model of maintained cocaine self-administration.
    Brain Res. 1999 Aug 21;839(1):85-93 PMID: 10482802
  11. Dramatic decreases in brain reward function during nicotine withdrawal.
    Nature. 1998 May 7;393(6680):76-9 PMID: 9590692
  12. Longitudinal patterns of cocaine use among adolescents.
    Am J Drug Alcohol Abuse. 1988;14(1):1-15 PMID: 3265025
  13. Drug addiction: the yin and yang of hedonic homeostasis.
    Neuron. 1996 May;16(5):893-6 PMID: 8630244
  14. Relative sensitivity to naloxone of multiple indices of opiate withdrawal: a quantitative dose-response analysis.
    J Pharmacol Exp Ther. 1994 Dec;271(3):1391-8 PMID: 7996451
  15. Basic concepts of pharmacokinetic/pharmacodynamic (PK/PD) modelling.
    Int J Clin Pharmacol Ther. 1997 Oct;35(10):401-13 PMID: 9352388
  16. Comparison of fixed-ratio and progressive-ratio schedules of maintenance of stimulant drug-reinforced responding.
    Drug Alcohol Depend. 1985 May;15(1-2):123-30 PMID: 4017869
  17. Neuroscience. Addiction as compulsive reward prediction.
    Science. 2004 Dec 10;306(5703):1901-2 PMID: 15591193
  18. Low dose cocaine self-administration transiently increases but high dose cocaine persistently decreases brain reward function in rats.
    Eur J Neurosci. 2003 Jan;17(1):191-5 PMID: 12534985
  19. Fluctuations in nucleus accumbens dopamine concentration during intravenous cocaine self-administration in rats.
    Psychopharmacology (Berl). 1995 Jul;120(1):10-20 PMID: 7480530
  20. Synchronization and rhythmic processes in physiology.
    Nature. 2001 Mar 8;410(6825):277-84 PMID: 11258383
  21. The pharmacokinetic determinants of the frequency and pattern of intravenous cocaine self-administration in rats by pharmacokinetic modeling.
    Drug Metab Dispos. 2002 Mar;30(3):254-61 PMID: 11854142
  22. Predictable individual differences in the initiation of cocaine self-administration by rats under extended-access conditions are dose-dependent.
    Psychopharmacology (Berl). 2001 Aug;157(1):31-9 PMID: 11512040
  23. Cocaine-seeking by rats: regulation, reinforcement and activation.
    Psychopharmacology (Berl). 2000 Oct;152(2):123-31 PMID: 11057515
  24. Pretreatment with the dopamine agonist 7-OH-DPAT shifts the cocaine self-administration dose-effect function to the left under different schedules in the rat.
    Behav Pharmacol. 1995 Jun;6(4):333-347 PMID: 11224342
  25. Psychomotor stimulant self administration as a function of dosage per injection in the rhesus monkey.
    Psychopharmacologia. 1971;22(3):271-81 PMID: 4399836
  26. Increased motivation for self-administered cocaine after escalated cocaine intake.
    Neuroreport. 2003 Dec 2;14(17):2229-32 PMID: 14625453
  27. A psychomotor stimulant theory of addiction.
    Psychol Rev. 1987 Oct;94(4):469-92 PMID: 3317472
  28. An opponent-process theory of motivation. I. Temporal dynamics of affect.
    Psychol Rev. 1974 Mar;81(2):119-45 PMID: 4817611
  29. Drug addiction, dysregulation of reward, and allostasis.
    Neuropsychopharmacology. 2001 Feb;24(2):97-129 PMID: 11120394
  30. Effects of increasing the magnitude of an alternative reinforcer on drug choice in a discrete-trials choice procedure.
    Psychopharmacology (Berl). 1991;105(2):169-74 PMID: 1796123
  31. A concurrently available nondrug reinforcer prevents the acquisition or decreases the maintenance of cocaine-reinforced behavior.
    Psychopharmacology (Berl). 1989;97(1):23-9 PMID: 2496421
  32. Progressive ratio and fixed ratio schedules of cocaine-maintained responding in baboons.
    Psychopharmacology (Berl). 1979 Oct;65(2):125-36 PMID: 117480
  33. The neuropsychological basis of addictive behaviour.
    Brain Res Brain Res Rev. 2001 Oct;36(2-3):129-38 PMID: 11690609
  34. Ideal homes? Housing effects on rodent brain and behaviour.
    Trends Neurosci. 2001 Apr;24(4):207-11 PMID: 11250003
  35. The role of the dopaminergic projections in MFB self-stimulation.
    Behav Brain Res. 1986 Jun;20(3):313-21 PMID: 3488749
  36. Dissociation of Pavlovian and instrumental incentive learning under dopamine antagonists.
    Behav Neurosci. 2000 Jun;114(3):468-83 PMID: 10883798
  37. Persistent increase in the motivation to take heroin in rats with a history of drug escalation.
    Neuropsychopharmacology. 2000 Apr;22(4):413-21 PMID: 10700660
  38. A comparison of the reinforcing efficacy of PCP, the PCP derivatives TCP and BTCP, and cocaine using a progressive ratio schedule in the rat.
    Behav Pharmacol. 1995 Apr;6(3):223-228 PMID: 11224330
  39. Environmental enrichment decreases intravenous self-administration of amphetamine in female and male rats.
    Psychopharmacology (Berl). 2001 May;155(3):278-84 PMID: 11432690
  40. Comparison of mesocorticolimbic neuronal responses during cocaine and heroin self-administration in freely moving rats.
    J Neurosci. 1998 Apr 15;18(8):3098-115 PMID: 9526026
  41. Do vertical shifts in dose-response rate-relationships in operant conditioning procedures indicate "sensitization" to "drug wanting"?
    Psychopharmacology (Berl). 2004 Jan;171(3):349-51; author reply 352-63 PMID: 14530895
  42. Neurobiology of addiction.
    Curr Opin Neurobiol. 1996 Apr;6(2):243-51 PMID: 8725967
  43. Reward and detection thresholds for brain stimulation: dissociative effects of cocaine.
    Brain Res. 1981 Mar 30;209(2):496-500 PMID: 6971689
  44. Withdrawal from chronic amphetamine elevates baseline intracranial self-stimulation thresholds.
    Psychopharmacology (Berl). 1995 Jan;117(2):130-6 PMID: 7753958
  45. Rapid assessment of choice between cocaine and food in rhesus monkeys: effects of environmental manipulations and treatment with d-amphetamine and flupenthixol.
    Neuropsychopharmacology. 2003 May;28(5):919-31 PMID: 12637948
  46. Effects of increment size and reinforcer volume on progressive ratio performance.
    J Exp Anal Behav. 1963 Jul;6:387-92 PMID: 13963807
  47. Cue-induced cocaine craving: neuroanatomical specificity for drug users and drug stimuli.
    Am J Psychiatry. 2000 Nov;157(11):1789-98 PMID: 11058476
  48. Control strategies in physiological systems.
    FASEB J. 1988 Feb;2(2):97-107 PMID: 3277888
  49. Self-administration of optical isomers of amphetamine and methylamphetamine by rats.
    J Pharmacol Exp Ther. 1973 Oct;187(1):27-33 PMID: 4795731
  50. Cocaine.
    Sci Am. 1982 Mar;246(3):128-41 PMID: 7043731
  51. The need to feed: homeostatic and hedonic control of eating.
    Neuron. 2002 Oct 10;36(2):199-211 PMID: 12383777
  52. Dopamine in drug abuse and addiction: results from imaging studies and treatment implications.
    Mol Psychiatry. 2004 Jun;9(6):557-69 PMID: 15098002
  53. Codeine- and cocaine-reinforced responding in rhesus monkeys: effects of dose on response rates under a fixed-ratio schedule.
    J Pharmacol Exp Ther. 1974 Oct;191(1):179-88 PMID: 4421302
  54. Heroin self-administration in rats under a progressive ratio schedule of reinforcement.
    Psychopharmacology (Berl). 1993;111(2):215-8 PMID: 7870955
  55. The psychology and neurobiology of addiction: an incentive-sensitization view.
    Addiction. 2000 Aug;95 Suppl 2:S91-117 PMID: 11002906
  56. The reward value of light increment under supranormal and subnormal arousal.
    Can J Psychol. 1969 Feb;23(1):11-23 PMID: 5776912
  57. Drug dependence: myth or motive?
    Pharmacol Biochem Behav. 1983 Sep;19(3):385-91 PMID: 6634887
  58. Escalation of cocaine self-administration does not depend on altered cocaine-induced nucleus accumbens dopamine levels.
    J Neurochem. 2003 Jul;86(1):102-13 PMID: 12807430
  59. The self-medication hypothesis of substance use disorders: a reconsideration and recent applications.
    Harv Rev Psychiatry. 1997 Jan-Feb;4(5):231-44 PMID: 9385000
  60. A self-awareness model of the causes and effects of alcohol consumption.
    J Abnorm Psychol. 1981 Dec;90(6):586-600 PMID: 7320328
  61. Drug level of d- and l-amphetamine during intravenous self-administration.
    Psychopharmacologia. 1974 Jan 14;34(3):255-64 PMID: 4819978
  62. Amphetamine and the reward system: evidence for tolerance and post-drug depression.
    Psychopharmacologia. 1976;46(1):19-25 PMID: 1257363
  63. Regulation of drug intake.
    Exp Clin Psychopharmacol. 2001 May;9(2):131-43 PMID: 11518086
  64. Intravenous drug injection habits: drug users' self-reports versus researchers' perception.
    Pharmacology. 2003 May;68(1):49-56 PMID: 12660479
  65. High dose cocaine use in São Paulo: a comparison of treatment and community samples.
    Subst Use Misuse. 2001 Feb;36(3):237-55 PMID: 11325165
  66. Fractal dynamics in physiology: alterations with disease and aging.
    Proc Natl Acad Sci U S A. 2002 Feb 19;99 Suppl 1:2466-72 PMID: 11875196
  67. Opiate addiction: the case for an adaptive orientation.
    Psychol Bull. 1982 Sep;92(2):367-81 PMID: 7146233
  68. Relationship between reward-enhancing and stereotypical effects of psychomotor stimulant drugs.
    Nature. 1976 Nov 4;264(5581):57-9 PMID: 12471
  69. Decreased striatal dopaminergic responsiveness in detoxified cocaine-dependent subjects.
    Nature. 1997 Apr 24;386(6627):830-3 PMID: 9126741
  70. Long-lasting increase in the set point for cocaine self-administration after escalation in rats.
    Psychopharmacology (Berl). 1999 Oct;146(3):303-12 PMID: 10541731
  71. The biological, social and clinical bases of drug addiction: commentary and debate.
    Psychopharmacology (Berl). 1996 Jun;125(4):285-345 PMID: 8826538
  72. Self-administration of heroin, acetylmethadol, morphine, and methadone in rhesus monkeys.
    Life Sci. 1978 Feb;22(7):619-23 PMID: 415198
  73. Drug abuse: hedonic homeostatic dysregulation.
    Science. 1997 Oct 3;278(5335):52-8 PMID: 9311926
  74. Modulation of cocaine self-administration in the rat through D-3 dopamine receptors.
    Science. 1993 Jun 18;260(5115):1814-6 PMID: 8099761
  75. A psychodynamic study of a patient during experimental self-regulated re-addiction to morphine.
    Psychiatr Q. 1952 Apr;26(2):270-93 PMID: 14920640
  76. Preclinical evaluation of pharmacotherapies for treatment of cocaine and opioid abuse using drug self-administration procedures.
    Neuropsychopharmacology. 1996 Jun;14(6):375-424 PMID: 8726752
  77. Sensitization of midbrain dopamine neuron reactivity and the self-administration of psychomotor stimulant drugs.
    Neurosci Biobehav Rev. 2004 Jan;27(8):827-39 PMID: 15019432
  78. Differences in the pharmacokinetics of cocaine in naive and cocaine-experienced rats.
    J Neurochem. 1991 Apr;56(4):1299-306 PMID: 2002342
  79. Environmental enrichment decreases intravenous amphetamine self-administration in rats: dose-response functions for fixed- and progressive-ratio schedules.
    Psychopharmacology (Berl). 2002 Aug;162(4):373-8 PMID: 12172690
  80. Effects of cocaine and related drugs in nonhuman primates. III. Self-administration by squirrel monkeys.
    J Pharmacol Exp Ther. 1989 Oct;251(1):150-5 PMID: 2529365
  81. Comparison of the reinforcing efficacy of cocaine and procaine in rhesus monkeys responding under a progressive-ratio schedule.
    Psychopharmacology (Berl). 1995 Aug;120(3):296-302 PMID: 8524977
  82. Mesocorticolimbic dopaminergic network: functional and regulatory roles.
    Physiol Rev. 1991 Jan;71(1):155-234 PMID: 1986388
  83. Physiological role of pleasure.
    Science. 1971 Sep 17;173(4002):1103-7 PMID: 5098954
  84. Choice between cocaine and food by rhesus monkeys: effects of conditions of food availability.
    Behav Pharmacol. 1992 Dec;3(6):635-638 PMID: 11224164
  85. Changing patterns of cocaine use: longitudinal observations, consequences, and treatment.
    NIDA Res Monogr. 1984;50:92-110 PMID: 6440028
  86. Drug seeking becomes compulsive after prolonged cocaine self-administration.
    Science. 2004 Aug 13;305(5686):1017-9 PMID: 15310907
  87. Cocaine: acute effects on reinforcement thresholds for self-stimulation behavior to the medial forebrain bundle.
    Pharmacol Biochem Behav. 1978 Apr;8(4):437-9 PMID: 307772
  88. Dopamine in the nucleus accumbens during cocaine self-administration as studied by in vivo microdialysis.
    Pharmacol Biochem Behav. 1989 Dec;34(4):899-904 PMID: 2623043
  89. A new anatomical framework for neuropsychiatric disorders and drug abuse.
    Am J Psychiatry. 2003 Oct;160(10):1726-39 PMID: 14514480
  90. Toxicity associated with long-term intravenous heroin and cocaine self-administration in the rat.
    JAMA. 1985 Jul 5;254(1):81-3 PMID: 4039767
  91. Synergistic effects of cocaine with lateral hypothalamic brain stimulation reward: lack of tolerance or sensitization.
    J Pharmacol Exp Ther. 1997 Dec;283(3):1160-7 PMID: 9399989
  92. Euphorigenic drugs: effects on the reward pathways of the brain.
    Fed Proc. 1979 Oct;38(11):2473-6 PMID: 488370
  93. Progressive ratio as a measure of reward strength.
    Science. 1961 Sep 29;134(3483):943-4 PMID: 13714876
  94. Reinforcement value of gustatory stimuli determined by progressive ratio performance.
    Pharmacol Biochem Behav. 1999 Jun;63(2):301-11 PMID: 10371660
  95. Decreased brain reward produced by ethanol withdrawal.
    Proc Natl Acad Sci U S A. 1995 Jun 20;92(13):5880-4 PMID: 7597046
  96. Neurobiological evidence for hedonic allostasis associated with escalating cocaine use.
    Nat Neurosci. 2002 Jul;5(7):625-6 PMID: 12055635
  97. Phasic firing time locked to cocaine self-infusion and locomotion: dissociable firing patterns of single nucleus accumbens neurons in the rat.
    J Neurosci. 1998 Sep 15;18(18):7588-98 PMID: 9736676
  98. Clinical implications of reinforcement as a determinant of substance use disorders.
    Annu Rev Psychol. 2004;55:431-61 PMID: 14744222
  99. Leftward shift in the acquisition of cocaine self-administration in isolation-reared rats: relationship to extracellular levels of dopamine, serotonin and glutamate in the nucleus accumbens and amygdala-striatal FOS expression.
    Psychopharmacology (Berl). 2000 Jul;151(1):55-63 PMID: 10958117
  100. Dose-dependent selective facilitation of response-contingent light-onset behavior by d-amphetamine.
    Psychopharmacologia. 1974 Jan 14;34(3):199-208 PMID: 4856517
  101. Behavioral economics of drug self-administration. I. Functional equivalence of response requirement and drug dose.
    Life Sci. 1990;47(17):1501-10 PMID: 2250566
  102. What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
    Brain Res Brain Res Rev. 1998 Dec;28(3):309-69 PMID: 9858756
  103. Parametric analysis of cocaine self-administration under a progressive-ratio schedule in rhesus monkeys.
    Psychopharmacology (Berl). 1996 Jun;125(4):361-70 PMID: 8826541
  104. Effects of extended access to high versus low cocaine doses on self-administration, cocaine-induced reinstatement and brain mRNA levels in rats.
    Psychopharmacology (Berl). 2004 Aug;175(1):26-36 PMID: 15042275
  105. Construct validity of a self-stimulation threshold paradigm: effects of reward and performance manipulations.
    Physiol Behav. 1992 Jan;51(1):111-9 PMID: 1741436
  106. Cellular and molecular mechanisms of drug dependence.
    Science. 1988 Nov 4;242(4879):715-23 PMID: 2903550
  107. Transition from moderate to excessive drug intake: change in hedonic set point.
    Science. 1998 Oct 9;282(5387):298-300 PMID: 9765157
  108. The neural basis of drug craving: an incentive-sensitization theory of addiction.
    Brain Res Brain Res Rev. 1993 Sep-Dec;18(3):247-91 PMID: 8401595
  109. Self-administration of psychoactive substances by the monkey.
    Psychopharmacologia. 1969;16(1):30-48 PMID: 4982648
  110. Progressive enhancement of delayed hyperalgesia induced by repeated heroin administration: a sensitization process.
    J Neurosci. 2001 Jun 1;21(11):4074-80 PMID: 11356895
  111. Variability of drug self-administration in rats.
    Psychopharmacology (Berl). 2003 Apr;167(1):9-19 PMID: 12644888
  112. Frustrations of fur-farmed mink.
    Nature. 2001 Mar 1;410(6824):35-6 PMID: 11242031
  113. Cocaine dependence.
    Annu Rev Med. 1989;40:149-61 PMID: 2658744
  114. Evidence for bidirectional cues as a function of time following treatment with amphetamine: implications for understanding tolerance and withdrawal.
    Pharmacol Biochem Behav. 2004 Dec;79(4):761-71 PMID: 15582685
  115. Autoshaping i.v. cocaine self-administration in rats: effects of nondrug alternative reinforcers on acquisition.
    Psychopharmacology (Berl). 1993;110(1-2):5-12 PMID: 7870898
  116. The transition from controlled to compulsive drug use is associated with a loss of sensitization.
    Brain Res. 2004 Jan 2;995(1):46-54 PMID: 14644470
  117. Evidence for opponent-process actions of intravenous cocaine.
    Pharmacol Biochem Behav. 1999 Nov;64(3):507-12 PMID: 10548263
Article Info
Journal
Psychopharmacology
Abbr.
Psychopharmacology (Berl)
ISSN
0033-3158
Published
2005-07-00
Epub
2005-00-25
Pages
473-90
Language
English
Region
Germany
NLM ID
7608025
Subset
IM
Grants
NIDA NIH HHS · DA04398 · United States
Corrections
ErratumIn
-
Analysis Services
Analysis Services

Contact

No. 2 Wenbo Road, Zhangqiu District, Jinan, Shandong

Qilu Normal University · Genelibs Bioinformatics Lab

750 Shunhua Rd, Jinan

2F, Bldg F, University Science Park

Tel: 0531-88819269

WeChat Official Account

Follow our WeChat subscription account for real-time updates and the latest in medical and biological research.


Business Email

E-mail: product@genelibs.com