Increased Impulsivity Retards the Transition to Dorsolateral Striatal Dopamine Control of Cocaine Seeking (2014)

Biological Psychiatry Volume 76, Issue 1, Pages 15–22, July 1, 2014

Received: May 21, 2013; Received in revised form: September 18, 2013; Accepted: September 18, 2013; Published Online: October 23, 2013
 
 

Background

Development of maladaptive drug-seeking habits occurs in conjunction with a ventral-to-dorsal striatal shift in dopaminergic control over behavior. Although these habits readily develop as drug use continues, high impulsivity predicts loss of control over drug seeking and taking. However, whether impulsivity facilitates the transition to dorsolateral striatum (DLS) dopamine-dependent cocaine-seeking habits or whether impulsivity and cocaine-induced intrastriatal shifts are additive processes is unknown.

Methods

High- and low-impulsive rats identified in the five-choice serial reaction-time task were trained to self-administer cocaine (.25 mg/infusion) with infusions occurring in the presence of a cue-light conditioned stimulus. Dopamine transmission was blocked in the DLS after three stages of training: early, transition, and late-stage, by bilateral intracranial infusions of α-flupenthixol (0, 5, 10, or 15 μg/side) during 15-min cocaine-seeking test sessions in which each response was reinforced by a cocaine-associated conditioned stimulus presentation.

Results

In early-stage tests, neither group was affected by DLS dopamine receptor blockade. In transition-stage tests, low-impulsive rats showed a significant dose-dependent reduction in cocaine seeking, whereas high-impulsive rats were still unaffected by α-flupenthixol infusions. In the final, late-stage seeking test, both groups showed dose-dependent sensitivity to dopamine receptor blockade.

Conclusions

The results demonstrate that high impulsivity is associated with a delayed transition to DLS-dopamine-dependent control over cocaine seeking. This suggests that, if impulsivity confers an increased propensity to addiction, it is not simply through a more rapid development of habits but instead through interacting corticostriatal and striato-striatal processes that result ultimately in maladaptive drug-seeking habits.

Increasing evidence suggests that addiction results from the convergence of various neurobiological adaptations in vulnerable subjects, eventually resulting in the loss of control over maladaptive drug seeking (1, 2, 3). Exposure to addictive drugs, such as cocaine, not only impairs executive processes, resulting in impulse control deficits and behavioral inflexibility (4), but it also facilitates the development of drug-seeking habits (3, 5, 6), thereby rendering instrumental actions that are resistant to their immediate consequences and motivational significance (6, 7). Addictive drugs trigger adaptations within corticostriatal circuitry, including reductions in metabolic activity and D2 dopamine receptors, that are initially restricted to the ventral limbic areas of the striatum and prefrontal cortex but eventually encompass the more dorsolateral, associative and cognitive, territories of these structures (8, 9, 10). This progressive shift from limbic to cognitive corticostriatal networks that occurs over the course of addiction (11) takes place alongside a transition from the nucleus accumbens to the dorsolateral striatum (DLS) in the locus of control over drug seeking and taking (12) and the associated imbalance in fronto-striatal and striato-striatal functional coupling (13) displayed by former and current addicted individuals.

Studies in animals have further demonstrated that this ventral to DLS shift in the control over drug seeking (14, 15) is not only associated with the development of habitual responding for the drug as assessed by devaluation procedures (3, 6) but also reflects the emergence of compulsive cocaine seeking (16). The latter, a hallmark feature of addiction (17), is predicted by the behavioral trait of high impulsivity (18), which is associated with low D2/3 dopamine receptor availability in the ventral striatum (19). This has led to hypotheses suggesting that impulsivity and habits, with their striatal dopaminergic substrates, interact during the development of cocaine addiction, but the neurobiological basis of this interaction is unknown. Neurocomputational learning theory-based, actor-critic models of basal ganglia function (20) suggest that high impulsivity and its associated low D2 dopamine receptor availability in the ventral striatum facilitate the transition to DLS control over drug self-administration. However, we and others have suggested that compulsive drug seeking in addiction might instead result from weak inhibitory control over a rather independently established, drug-influenced, maladaptive incentive habit (4, 21).

We therefore directly investigated whether high impulsivity interacts with the recruitment of dopamine-dependent DLS control over cocaine-seeking behavior over an extended period of cocaine self-administration. To do this, we investigated the effects of bilateral infusions of the dopamine receptor antagonist α-flupenthixol into the DLS of rats identified as high (HI) and low impulsive (LI) in the 5-choice serial reaction-time task (5-CSRTT), on cue-controlled cocaine-seeking behavior at early, transitional, and late stages of training under a second-order schedule of reinforcement for cocaine (22). Under these conditions we have previously shown that cocaine seeking becomes dependent upon dopamine transmission in the DLS (14, 18, 23), and the functional recruitment of this dopaminergic mechanism is a neurobiological marker of the emergence of drug-seeking habits (3, 6).

Methods and Materials

Subjects

Forty male Lister Hooded rats (Charles River Laboratories, Kent, United Kingdom) weighing approximately 300 g on arrival were housed as described previously (23). Experiments were conducted in accordance with the United Kingdom 1986 Animals (Scientific Procedures) Act.

5-CSRTT

Apparatus and Procedure. The 5-CSRTT apparatus has been described in detail elsewhere (24, 25) (Supplement 1). The training procedure was identical to that previously described (18). Each training session began with illumination of the operant chamber by a house light and the delivery of a food pellet in the magazine. Pushing open the magazine panel and collecting this pellet initiated the first trial. After a fixed intertrial interval (ITI), a light at the rear of one of the response apertures was briefly illuminated. Responses in this aperture within a limited-hold period (5 sec) were reinforced by the delivery of a food pellet in the magazine (correct responses). Responses in a nonilluminated aperture were recorded as incorrect responses and were punished by a 5-sec time-out period. Failure to respond within the limited-hold period counted as an omission and was likewise punished. Additional responses in any aperture before food collection (perseverative responses) were recorded but not punished. Responses made in any aperture before the onset of the target stimulus, or premature responses, were punished by a 5-sec time-out period. Across training sessions, the ITI was gradually increased, and the stimulus duration was gradually decreased (25). Subjects were considered to have acquired the task when accuracy was > 75% and omissions were fewer than 20% while the stimulus duration was .5 sec with a 5-sec ITI.

After 2 weeks of stable responding, rats underwent three 60-min challenge 7-sec ITI (long intertrial interval [LITI]) sessions, separated by baseline 5-sec ITI sessions (18, 26). The LITIs markedly increase premature responding, thereby facilitating the identification of interindividual differences in impulsivity. The number of premature responses during LITI sessions provides an index of impulse control (18, 19, 24, 25, 26), which is used to identify HI or LI rats. Subjects were ranked according to the mean number of premature responses during the last two LITI sessions (10, 18). Those with <20 or >50 premature responses were selected as LI and HI rats, respectively (n = 8/group) (Figure S1 in Supplement 1).

In addition, premature responses, magazine panel pushes, correct and incorrect responses, omitted trials, and collection latency (milliseconds to collect the food pellet) were averaged across the baseline sessions preceding each of the last two LITI sessions to compare baseline behavioral performance in LI and HI rats

Surgery

Rats then underwent standard intravenous and intrastriatal surgeries under general anesthesia (Supplement 1). Cannulae were implanted bilaterally 2 mm above the dorsolateral striatum (anterior/posterior+1.2, medial/lateral±3, dorsal/ventral-3 [15]; AP and ML coordinates measured from bregma, DV coordinates from the skull surface, incisor bar at −3.3 mm [27]).

Drugs

Cocaine hydrochloride (Macfarlan-Smith, Edinburgh, United Kingdom) was dissolved in sterile .9% saline. α-Flupenthixol (Sigma Aldrich, Poole, United Kingdom) was dissolved in double-distilled water. Drug doses are reported in the salt form.

Cocaine Self-Administration

Apparatus. Twelve standard operant conditioning chambers described in detail elsewhere (15) were used (Methods in Supplement 1).

Procedure. The timeline of self-administration procedures is shown in Figure 1. Briefly, cocaine self-administration training sessions began 7 days after surgery. Cocaine (.25 mg/infusion; .1 mL/5 sec) was available under a fixed-ratio 1 (FR1) (continuous reinforcement) schedule of reinforcement in which one active lever press resulted in an infusion and initiated a 20-sec timeout. During that 20 sec, the cue-light (conditioned stimulus [CS]) above the active lever was illuminated, the house light was extinguished, and both levers were retracted. Pressing on the inactive lever was recorded to provide an index of general activity but had no programmed consequence. A maximum of 30 cocaine infusions was available at this stage. Active and inactive lever assignment was counterbalanced.

Thumbnail image of Figure 1. Opens large image

Figure 1

The timeline of self-administration experimentation. Subjects underwent intravenous catheter and central cannulae surgery a week before beginning behavioral training. There were five sessions of fixed-ratio 1 (FR1) training followed by early-acquisition testing. From Days 13 to 17, the response requirement was increased across sessions to the mid-stage training schedule of FR10(FR4:S). Rats remained on that schedule for five sessions before entering mid-stage testing. The response requirement was again increased on Days 30 and 31 to the final second-order training schedule, FI15(FR10:S). Rats were again tested after 15 training sessions from Days 32 to 46 on the final schedule of reinforcement. Late-stage testing began on Day 37. d, day; FI, fixed-interval.

After five training sessions under the FR1 schedule of reinforcement, the dose-dependent effects of striatal dopamine receptor blockade on early-stage cocaine seeking were tested. Bilateral infusions of α-flupenthixol were made into the DLS. These 15-min test sessions [FI15(FR10:S)] instituted a change in contingency in that every active lever press resulted in a 1-sec light CS presentation, and cocaine was only delivered on the first lever press after the 15-min interval (23). Thus, the early performance tests were conducted before and were thus unaffected by self-administered cocaine on these sessions, because they were explicitly assessed for cocaine seeking within the fixed interval rather than a fixed ratio. Each test session was immediately followed by a FR1 cocaine self-administration training session (30 reinforcers over 2 hours), and rats were given a training session between test days so as to confirm and maintain a stable cocaine-taking baseline.

After the tests evaluating the early performance of cocaine seeking, the response requirement was increased across the daily training sessions through the following schedules of reinforcement: FR1; FR3; FR5(FR2:S); FR10(FR2:S); then to FR10(FR4:S). Under each intermediate second-order schedule, completion of the unit schedule (given within parentheses) resulted in a 1-sec CS light presentation; cocaine infusions and the 20-sec timeout were given only upon completion of the overall schedule. Therefore, for the transition-stage assessments, rats had been trained under conditions that promote the association between instrumental responding and conditioned reinforcers: contingent presentations of the cocaine-associated CS occurred after 4 responses (FR4:S); and cocaine was delivered on completion of the 10th set of four lever presses. Rats remained on this schedule for five training sessions before beginning the transition-stage cocaine-seeking tests. During each 15-min test session with α-flupenthixol infusions in the DLS, every four active lever presses continued to result in a 1-sec light CS presentation, and cocaine was only delivered on the fourth lever press after the 15-min interval [i.e., FI15(FR4:S)]. Thus, the transition-stage performance tests were again conducted before and were unaffected by daily self-administered cocaine. Each test session was immediately followed by an FR10(FR4:S) cocaine self-administration training session (30 reinforcers over 2 hours), and rats were given a training session between test days so as to confirm and maintain a stable cocaine-taking baseline.

After completing the tests evaluating cocaine seeking at the transition stage, the response requirements were again increased through daily training sessions across the following schedules of reinforcement: FR10(FR6:S); FR10(FR10:S); and finally to an overall fixed interval (fixed ratio) schedule of FI15(FR10:S) used in previous studies (23, 28). During the final FI15(FR10:S) schedule, responding was maintained by contingent presentation of the cocaine-associated CS after 10 responses (FR10:S); cocaine was delivered on completion of the first 10 lever presses after the expiration of each 15-min fixed interval. At this final stage, there was a limit of five available cocaine infusions. Rats were trained under this FI15(FR10:S) schedule of reinforcement for 15 sessions before the well-established, or late-stage, tests were conducted, in which the effects of α-flupenthixol infusions in the DLS were again assessed. The first interval (FI15) of the second-order schedule provides a time period in which no cocaine has been administered, yet rats are actively seeking the drug. Two rats were removed before the final tests, due to faulty catheters. Rats were given at least one session of training under FI15(FR10:S) conditions between each α-flupenthixol infusion test to ensure baseline stable baseline levels of responding.

Intrastriatal Infusions

For all three testing stages, intrastriatal infusions (.5 μL/side) of α-flupenthixol (0, 5, 10, and 15 μg/infusion in a counterbalanced, Latin-square order of treatment) were made with 28-gauge steel hypodermic injectors (Plastics One, Roanoke, Virginia) lowered to the injection sites 2 mm ventral to the end of the guide cannulae (i.e., DV-5 mm). Bilateral infusions were made over 90 sec with a syringe pump (Harvard Apparatus, Holliston, Massachusetts) and were followed by a 60-sec diffusion period before injectors were removed and obturators were replaced. Test sessions began 5 min later.

Histology

At the end of the experiment, histology was conducted as described previously (23) (Supplement 1).

Statistical Analyses

Premature responses in the 5-CSRTT were analyzed with 2-way analyses of variance (ANOVAs) with Session as the within-subject factor, and Group (HI or LI) as the between-subjects factor. Premature responses were then correlated with selected training measures from the 5-CSRTT, and significant correlations were confirmed with between-subject t tests.

Recruitment of DLS dopaminergic involvement in cocaine seeking was confirmed with a three-way ANOVA with Stage (early, transition, and well-established), Dose (0, 5, 10, and 15 μg), and Lever (active and inactive) as within-subject factors. The differential recruitment of DLS dopaminergic involvement in cocaine seeking between HI and LI rats was investigated with a three-way ANOVA with planned contrasts (29) with Session (weights on session 2 vs. session 1) and Dose (weights on doses of 10 and 15 µg/side vs. vehicle) as the within-subject factors and Group (HI or LI) as the between-subjects factor. Differences between HI and LI rats for each stage were then investigated with ANOVA with Dose and Lever as within-subject factors. Significant interactions were analyzed further with Tukey’s honestly significant difference (HSD) tests. Significance was set at α = .05.

Results

5-CSRTT

Rats selected as HI (n = 8) in the 5-CSRTT displayed greater sensitivity to increased ITI duration than the LI (n = 8) rats as supported by increases in premature responses for the three LITI trials for the HI compared with the LI rats (Figure 2) (main effects of Group: F1,14 = 65.20, p < .001, Session: F14,196 = 59.34, p < .001, and Group × Session interaction: F14,196 = 25.44, p < .001). Post hoc analysis revealed that group differences emerged as a result of lengthening the ITI (HSD = 14.477).

Thumbnail image of Figure 2. Opens large image 

Figure 2

High-impulsive rats are characterized by a high number of premature responses made before the onset of the target stimulus during the long inter-trial intervals (LITIs) but not during baseline (BL) sessions. *Significant difference from low-impulsive rats during the same LITI.

Higher impulsivity (measured as the level of premature responses during the last two LITI sessions) was related to greater amounts of goal tracking (measured as panel pushes into the magazine) and latency to collect earned pellets as revealed by a positive relationship between premature responses and panel pushing during training (τ = .481, p = .010) (Figure 3A); this was further confirmed by a follow-up t test comparing the number of panel pushes in HI and LI rats (t14 = 2.36, p = .033). Impulsivity was not, however, related to motivation for the reinforce, as revealed by both the lack of relationship between the number of premature responses and the latency to collect pellets after a correct trial (τ = −.211, p = .259) (Figure 3B) and the absence of a difference in this latter measure between HI and LI rats (t14 = 1.14, p = .273). Baseline behavioral measures recorded during the training sessions immediately preceding LITI 2 and 3 are shown in Table S1 in Supplement 1.

Thumbnail image of Figure 3. Opens large image 

Figure 3

Premature responses during the long inter-trial interval (LITI) sessions were correlated with magazine panel pushes (goal-tracking) (A) and latency to collect reinforcers (motivation) (B) during training sessions. High-impulsive rats showed higher levels of interaction with the magazine, but not more motivated to obtain the reward, than low-impulsive rats.

Histological Assessments

All rats had cannulae located bilaterally within the DLS (Figure 4) (27).

Thumbnail image of Figure 4. Opens large image 

Figure 4

Schematic representations of the localization of injection sites in high-impulsive (A) and low-impulsive (B) rats with guide cannulae placed in the anterior dorsolateral striatum. Reprinted from Paxinos and Watson (27) with permission from Elsevier, copyright 1998.

Recruitment of DLS Dopamine Control over Cocaine Seeking

Progressive recruitment of dopamine-dependent DLS processes in the control over well-established, habitual, cue-controlled cocaine-seeking behavior was observed from early to late stage tests as illustrated by the progressive increase in the effect of bilateral intra-DLS α-flupenthixol infusions on active lever presses during the 15-min drug-free cocaine-seeking interval (Stage × Dose × Lever interaction: F6,78 = 3.50, p = .004), confirming our earlier results (15, 23). Thus, although dopamine receptor blockade in the DLS was ineffective during the early stage of cocaine seeking (Figure 5A) (effect of Dose: F3,45 = 1.03, p = .389 and Lever × Dose interaction: F3,45 = 1.06, p = .375), it dose-dependently reduced cocaine seeking when performed at the transition stage (Figure 5B) (main effect of Dose, F3,45 = 3.41, p = .025; and a Lever × Dose interaction, F3,45 = 3.45, p = .024). Post hoc analyses revealed that this effect was attributable to the 10- and 15-μg/side doses of α-flupenthixol (HSD = 26.59). When cue-controlled cocaine seeking was well-established, bilateral DLS α-flupenthixol infusions resulted in an even more pronounced decrease in cocaine-seeking responses measured during the 15-min drug-free interval (Figure 5C) (main effect of Dose: F3,39 = 9.69, p < .001 and Lever × Dose interaction: F3,39 = 9.01, p < .001). At this stage, all doses of α-flupenthixol significantly reduced cocaine seeking relative to vehicle (HSD = 40.30).

Thumbnail image of Figure 5. Opens large image 

Figure 5

Progressive recruitment of dopamine-dependent dorsolateral striatum control over cue-controlled cocaine seeking. Active and inactive lever presses (±1 SEM) during (cocaine-free) tests of drug seeking with α-flupenthixol injections into the dorsolateral striatum of high- and low-impulsive rats combined at the early (A), transition (B), and well-established (C) stages of training. *Significant difference in active lever responding from the 0 μg test. +Significant difference between active and inactive lever responses for each dose tested. FI, fixed-interval; FR, fixed-ratio.

Impulsivity Is Associated with a Delayed Transition to DLS Dopamine Control over Cocaine Seeking

The progressive recruitment of DLS dopamine control over cocaine seeking observed in the entire population was modulated by impulsivity status. Thus, HI and LI rats displayed different time-courses in their sensitivity to DLS dopamine receptor blockade over the transition from early to well-established, habitual, cue-controlled cocaine seeking (Session × Dose × Group contrasts: F1,12 = 8.07, p < .05). Thus, whereas DLS α-flupenthixol infusions had no significant effect on active lever presses in HI (Figure 6A) and LI rats (Figure 6B) during the early seeking tests (main effects of Dose or Dose × Lever interaction: Fs ≤ 2.83, p ≥ .063), they dose-dependently decreased cocaine seeking in LI rats (Figure 6C) (main effect of Dose: F3,21 = 3.89, p = .023, and a Dose × Lever interaction: F3,21 = 3.86, p = .024) but not in HI rats (Figure 6D) (Fs < 1) during the transition seeking tests. Post hoc analyses revealed that cocaine seeking in LI rats behavior was decreased after infusions of 10- and 15-μg/side doses of α-flupenthixol relative to vehicle and inactive lever presses (HSD = 40.62).

Thumbnail image of Figure 6. Opens large image 

Figure 6

Delayed transition to dorsolateral striatum control over cocaine-seeking behavior in high impulsive rats. Active and inactive lever presses (±1 SEM) during (cocaine-free) tests of drug seeking with α-flupenthixol injections into the dorsolateral striatum of low- and high-impulsive rats at the early (A, B, respectively), transition (C, D, respectively), and well-established (E, F, respectively) stages of training. *Significant difference in active lever responding from the 0 μg test. +Significant difference between active and inactive lever responses for each dose tested. FI, fixed-interval; FR, fixed-ratio.

In the well-established seeking tests, after rats had been trained to seek cocaine under the control of contingent presentations of the drug associated CSs, during the FI15(FR10:S) stage of the second-order schedule, responding was dose-dependently decreased by bilateral infusions of α-flupenthixol into the DLS in both HI and LI rats. LI rats continued to display dose-dependent effects of α-flupenthixol infusions into the DLS (Figure 6E), while this sensitivity to DLS dopamine receptor blockade now emerged in HI rats (Figure 6F) (main effect of Dose: F3,15 = 5.23, p = .011 and F3,21 = 4.11, p = .019, respectively, Dose × Lever interaction: F3,15 = 5.20, p = .012 and F3,21 = 3.59, p = .031, respectively). Thus, the 10 and 15 μg/side doses of α-flupenthixol markedly reduced active-lever presses relative to vehicle such that significant differences between active and inactive lever pressing were no longer observed (HSD = 69.58 and HSD = 55.62 for LI and HI rats, respectively).

Although a shift in the time course of the recruitment of dopamine-dependent DLS control over cue-controlled cocaine seeking was observed between HI and LI rats, the two groups differed neither in the propensity to initiate cocaine self-administration over the five FR1 acquisition sessions (main effect of Session: F4,56 = 3.124, p = .022 but no effect of Group: F1,14 = 1.606, p = .226, or Group × Session interaction: F < 1) nor in their performance to the increasing behavioral demands associated with each stage of the establishment of a second-order schedule of reinforcement for the drug. Indeed, no differences were observed in cocaine-seeking responses between HI and LI rats either during the five FR10(FR4:S) sessions that preceded the intermediate stage assessment (all Fs < 1) or during the FI15(FR10:S) sessions that preceded the late stage assessment (main effect of Group: F1,12 = 1.367, p = .265, and Group × Session interaction: F14,168 = 1.167, p = .305), despite an overall increase in active lever presses over the sessions, indicative of the progressive increase in the influence of contingent presentations on CS on instrumental cocaine-seeking responses over time (main effect of Session: F14,168 = 1.872, p = .033).

Discussion

Cocaine-induced intrastriatal processes eventually resulting in DLS dopamine-dependent drug-seeking habits (3, 14, 15, 23, 30, 31) are increasingly considered to be a pivotal mechanism during the development of addiction (16). Although impulsivity characterized by low ventral striatal D2/3 dopamine receptor availability (19) has been identified as a key marker of the individual propensity to switch from controlled to compulsive drug use (18), the ways in which impulsivity and its underlying neural substrates interact with drug-induced intrastriatal adaptations are unknown. According to our earlier speculation (28) and a computational model of addiction based on striatal function (20), the trait of high impulsivity and associated low dopamine D2/3 ventral striatal dopamine receptors (19) has been suggested to facilitate drug-induced recruitment of DLS-dependent habitual control over cocaine-seeking behavior. By contrast, integrative hypotheses suggest that addiction develops when the neurobiological underpinnings of impaired executive, corticostriatal-dependent, inhibitory control, lying at the core of impulsivity, add to and converge with those associated with drug-induced intrastriatal shifts subserving the development of cue-controlled drug–seeking habits (6, 7, 21, 32, 33).

The findings in the present study support the latter view by providing evidence that increased impulsivity does not facilitate or accelerate the progressive recruitment of dopamine-dependent DLS control over behavior that has been shown to underlie both drug-seeking habits and compulsive cocaine seeking (3, 6, 15, 16, 23). Instead, high impulsivity was associated with a delay in striato-striatal neuroadaptations leading to the progressive devolution of control over cocaine seeking to DLS dopamine-dependent processes. This thereby indicates that the interaction between impulsivity and cocaine-induced recruitment of dopamine-dependent dorsolateral striatal control over behavior underlying the eventual transition to compulsive drug seeking (16) might depend upon interactive, co-occurring corticostriatal and striato-striatal processes. It might therefore be speculated that compulsive drug seeking arises from the development of qualitatively aberrant, rigid, maladaptive habits in vulnerable individuals that are characterized by premorbid alterations in corticostriatal-dependent inhibitory control processes.

Thus, in HI rats, there was a shift in the time-course of the effects of bilateral intra-DLS infusions of the dopamine receptor antagonist α-flupenthixol to reduce active lever presses during the 15-min drug-seeking challenge tests. Although DLS dopamine receptor blockade had no effect on cue-controlled cocaine-seeking responses at the early performance test stage, it significantly decreased active lever presses at the later, habitual test stage, the two test stages when there were no significant differences between HI and LI rats. These data, in agreement with our previous work (23), thereby demonstrate that—regardless of differences in impulse control—all subjects eventually develop DLS dopamine-dependent cocaine-seeking habits after protracted drug-seeking performance (3, 8, 15, 23). However, at the intermediate stage of training, cocaine-seeking responses were decreased by DLS dopamine receptor blockade specifically in LI but not HI rats.

This delayed recruitment of the DLS in the control over cocaine seeking suggests that low availability of ventral striatum dopamine D2 receptors might influence drug-induced adaptations underlying the progressive ventral to dorsal striatal shift that occurs in the course of addiction in humans (12, 34) and during extended periods of cocaine self-administration in nonhuman primates (8, 9, 11, 35) and rats (10). We and others have suggested that this ventral to dorsal striatal shift depends upon the dopamine-dependent ascending spiraling circuitry (36, 37) functionally linking the ventral with the dorsolateral striatum (13, 15, 31, 38), even though the mechanisms whereby this circuitry is recruited remain to be established. Added to the recent demonstration that the progressive cocaine-induced ventral to the dorsal striatum decrease in dopamine D2 receptors and messenger RNA (mRNA) levels demonstrated in primates (39, 40, 41) and rats (10) is also delayed in HI as compared with LI rats (10), despite lower baseline levels of D2 mRNA in the nucleus accumbens shell and dopaminergic neurons of the former (10), the present results suggest that low D2 receptor availability in the ventral striatum retards intra-striatal cocaine-induced plasticity processes. This is consistent with the demonstration that individual vulnerability to develop addiction-like behavior for cocaine, that we have demonstrated to be highly predicted by high impulsivity (18), is associated with impaired cocaine-induced plasticity in the ventral striatum (42).

Although protracted cocaine exposure results in marked decreases in striatal D2 dopamine receptor and mRNA levels, an adaptation suggested to contribute to the development of addiction (39, 43, 44, 45), cocaine self-administration in HI rats that display spontaneous low D2 mRNA and receptor levels in the ventral striatum results in a normalization of D2 receptor levels (46) that parallels a reduction in impulsivity. This observation therefore suggests that the potential delay in dorsal striatal recruitment after cocaine exposure observed in HI rats might be attributed to cocaine-induced remediation of low D2 dopamine receptors in the ventral striatum and the associated impulsivity that occurs early on after cocaine self-administration. Indeed, this hypothesis is supported by a recent micro positron emission topography study in LI and HI rats (46). This has important implications at the psychological level in that it suggests that, for HI rats, instrumental actions for cocaine might remain goal-directed for longer than in LI rats, a consequence partly determined by a dopamine deficiency state in the ventral striatum. This is consistent with the observation that HI rats are more focused on a food goal than LI rats, spending more time at the food delivery magazine when trained in the 5-CSRTT. Moreover goal-trackers in a Pavlovian conditioned approach task motivated by food were more impulsive in a delay discounting task than sign-trackers (47), a dimension of impulsivity that is also expressed by HI rats selected in the 5-CSRTT (48). These observations indicate that impulsivity is associated with a dominance of goal-directed behavior during early experience in instrumental and Pavlovian tasks.

The present results show that the psychological mechanisms whereby impulsivity and habits contribute to addiction do not depend upon a facilitation of the development of the latter by the former. However, it is pivotal to dissociate the propensity to develop habits, which in itself is not an aberrant process, from the inability to regain control over maladaptive habits that have become inflexible, such as those that are seen in addicted individuals who compulsively seek and take drugs. This further suggests that vulnerability to addiction does not lie in the propensity of an individual to develop habits but instead in the rigid nature of drug-seeking habits and the inability of an individual to regain control over these maladaptive habits. This inflexibility of drug-seeking habits might stem from either cortical (49) or striatal components of weak inhibitory control or in the persistence of aberrant neurobiological adaptations that have accumulated during the recruitment of dorsolateral striatal control over behavior to overcome the apparent lack of striatal neuroplasticity that characterizes HI rats (10).

This work was supported by Medical Research Council (MRC) grants to BJE and JWD (G1002231, G0701500) and by a joint core award from the MRC and Wellcome Trust (MRC G1000183; WT 093875/Z/10/Z) in support of the Behavioral and Clinical Neuroscience Institute at Cambridge University.

We acknowledge funding support within the MRC Imperial College-Cambridge University-Manchester University (ICCAM) strategic addiction cluster (G1000018). DB is a member of the Groupe de Recheche (GDR) 3557 and is supported by an INSERM AVENIR grant, the ANR “heraddictstress,” the IREB and the University of Poitiers. We thank Emily Jordan, David Theobald, and Alan Lyon for their technical assistance.

The authors reported no biomedical financial interests or potential conflicts of interest.

Appendix A. Supporting Information

References

  1. Chen, B.T., Yau, H.J., Hatch, C., Kusumoto-Yoshida, I., Cho, S.L., Hopf, F.W., and Bonci, A. Rescuing cocaine-induced prefrontal cortex hypoactivity prevents compulsive cocaine seeking. Nature. 2013; 496: 359–362
  2. Pelloux, Y., Dilleen, R., Economidou, D., Theobald, D., and Everitt, B.J. Reduced forebrain serotonin transmission is causally involved in the development of compulsive cocaine seeking in rats. Neuropsychopharmacology. 2012; 37: 2505–2514
  3. View in Article
  4. View in Article
  5. View in Article
  6. View in Article
  7. View in Article
  8. View in Article
  9. View in Article
  10. View in Article
  11. View in Article
  12. View in Article
  13. View in Article
  14. View in Article
  15. View in Article
  16. View in Article
  17. View in Article
  18. View in Article
  19. View in Article
  20. View in Article
  21. View in Article
  22. View in Article
  23. View in Article
  24. View in Article
  25. View in Article
  26. View in Article
  27. View in Article
  28. View in Article
  29. View in Article
  30. View in Article
  31. View in Article
  32. View in Article
  33. View in Article
  34. View in Article
  35. View in Article
  36. View in Article
  37. View in Article
  38. View in Article
  39. View in Article
  40. View in Article
  41. View in Article
  42. View in Article
  43. View in Article
  44. View in Article
  45. View in Article
  46. View in Article
  47. View in Article
  48. View in Article
  49. View in Article
  50. View in Article
  51. Zapata, A., Minney, V.L., and Shippenberg, T.S. Shift from goal-directed to habitual cocaine seeking after prolonged experience in rats. J Neurosci. 2010; 30: 15457–15463
  52. Jentsch, J.D. and Taylor, J.R. Impulsivity resulting from frontostriatal dysfunction in drug abuse: implications for the control of behavior by reward-related stimuli. Psychopharmacology. 1999; 146: 373–390
  53. Dickinson, A., Wood, N., and Smith, J. Alcohol seeking by rats: Action or habit?. Q J Exp Psychol B. 2002; 55: 331–348
  54. Corbit, L.H., Nie, H., and Janak, P.H. Habitual alcohol seeking: time course and the contribution of subregions of the dorsal striatum. Biol Psychiatry. 2012; 72: 389–395
  55. Everitt, B. and Robbins, T. Neural systems of reinforcement for drug addiction: From actions to habits to compulsion. Nat Neurosci. 2005; 8: 1481–1489
  56. Porrino, L.J., Daunais, J.B., Smith, H.R., and Nader, M.A. The expanding effects of cocaine: Studies in a nonhuman primate model of cocaine self-administration. Neurosci Biobehav Rev. 2004; 27: 813–820
  57. Porrino, L. Cocaine self-administration produces a progressive involvement of limbic, association, and sensorimotor striatal domains. J Neurosci. 2004; 24: 3554–3562
  58. Besson, M., Pelloux, Y., Dilleen, R., Theobald, D., Belin-Rauscent, A., Robbins, T.W. et al. Cocaine modulation of fronto-striatal expression of zif268, D2 and 5-HT2c receptors in high and low impulsive rats. Neuropschopharmacology. 2013; 38: 1963–1973
  59. Porrino, L., Smith, H.R., Nader, M.A., and Beveridge, T.J. The effects of cocaine: A shifting target over the course of addiction. Prog Neuropsychopharmacol Biol Psychiatry. 2007; 31: 1593–1600
  60. Vollstadt-Klein, S., Wichert, S., Rabinstein, J., Buhler, M., Klein, O., Ende, G. et al. Initial, habitual and compulsive alcohol use is characterized by a shift of cue processing from ventral to dorsal striatum. Addiction. 2010; 105: 1741–1749
  61. Xie, C., Shao, Y., Ma, L., Zhai, T., Ye, E., Fu, L. et al. Imbalanced functional link between valuation networks in abstinent heroin-dependent subjects [published online ahead of print December 4]. Mol Psychiatry. 2012;
  62. Vanderschuren, L.J., Di Ciano, P., and Everitt, B.J. Involvement of the dorsal striatum in cue-controlled cocaine seeking. J Neurosci. 2005; 25: 8665–8670
  63. Belin, D. and Everitt, B.J. Cocaine-seeking habits depend upon dopamine-dependent serial connectivity linking the ventral with the dorsal striatum. Neuron. 2008; 57: 432–441
  64. Jonkman, S., Pelloux, Y., and Everitt, B.J. Differential roles of the dorsolateral and midlateral striatum in punished cocaine seeking. J Neurosci. 2012; 32: 4645–4650
  65. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, 4th ed. American Psychiatric Press, Washington, DC; 1994
  66. Belin, D., Mar, A., Dalley, J., Robbins, T., and Everitt, B. High impulsivity predicts the switch to compulsive cocaine-taking. Science. 2008; 320: 1352–1355
  67. Dalley, J.W., Fryer, T., Brichard, L., Robinson, E., Theobald, D., Laane, K. et al. Nucleus accumbens D2/3 receptors predict trait impulsivity and cocaine reinforcement. Science. 2007; 315: 1267–1270
  68. Piray, P., Keramati, M.M., Dezfouli, A., Lucas, C., and Mokri, A. Individual differences in nucleus accumbens dopamine receptors predict development of addiction-like behavior: A computational approach. Neural Comput. 2010; 22: 2334–2368
  69. Belin, D., Belin-Rauscent, A., Murray, J.E., and Everitt, B.J. Addiction: Failure of control over maladaptive incentive habits. Curr Opin Neurobiol. 2013; 23: 564–572
  70. Everitt, B. and Robbins, T. Second-order schedules of drug reinforcement in rats and monkeys: Measurement of reinforcing efficacy and drug-seeking behaviour. Psychopharmacology. 2000; 153: 17–30
  71. Murray, J.E., Belin, D., and Everitt, B.J. Double dissociation of the dorsomedial and dorsolateral striatal control over the acquisition and performance of cocaine seeking. Neuropsychopharmacology. 2012; 37: 2456–2466
  72. Robbins, T. The 5-choice serial reaction time task: Behavioural pharmacology and functional neurochemistry. Psychopharmacology. 2002; 163: 362–380
  73. Bari, A., Dalley, J., and Robbins, T. The application of the 5-choice serial reaction time task for the assessment of visual attentional processes and impulse control in rats. Nature Protocol. 2008; 3: 759–767
  74. McNamara, R., Dalley, J.D., Robbins, T.W., Everitt, B.J., and Belin, D. Trait-like impulsivity does not predict escalation of heroin self-administration in the rat. Psychopharmacology. 2010; 212: 453–464
  75. Paxinos, G. and Watson, C. The Rat Brain in Stereotaxic Coordinates, 4th ed. Academic Press, San Diego; 1998
  76. Everitt, B.J., Belin, D., Economidou, D., Pelloux, Y., Dalley, J., and Robbins, T.W. Neural mechanisms underlying the vulnerability to develop compulsive drug-seeking habits and addiction. Philos Trans R Soc Lond B Biol Sci. 2008; 363: 3125–3135
  77. Hedges, L.V. Fixed effect models. in: H. Cooper, L.V. Hedges (Eds.) Handbook of Research Synthesis. Russell Sage Foundation, New York; 1994: 301–321
  78. Ito, R., Dalley, J., Robbins, T., and Everitt, B.J. Dopamine release in the dorsal striatum during cocaine-seeking behavior under the control of a drug-associated cue. J Neurosci. 2002; 22: 6247–6253
  79. Willuhn, I., Burgeno, L.M., Everitt, B.J., and Phillips, P.E. Hierarchical recruitment of phasic dopamine signaling in the striatum during the progression of cocaine use. Proc Natl Acad Sci U S A. 2012; 109: 20703–20708
  80. Belin-Rauscent, A., Everitt, B.J., and Belin, D. Intrastriatal shifts mediate the transition from drug-seeking actions to habits. Biol Psychiatry. 2012; 72: 343–345
  81. Everitt, B.J. and Robbins, T.W. From the ventral to the dorsal striatum: Devolving views of their roles in drug addiction [published online ahead of print February 21]. 2013; Neurosci Biobehav Rev. 2013;
  82. Volkow, N., Wang, G.J., Telang, F., Fowler, J.S., Logan, J., Childress, A.R. et al. Cocaine cues and dopamine in dorsal striatum: Mechanism of craving in cocaine addiction. J Neurosci. 2006; 26: 6583–6588
  83. Letchworth, S.R., Nader, M.A., Smith, H.R., Friedman, D.P., and Porrino, L. Progression of changes in dopamine transporter binding site density as a result of cocaine self-administration in rhesus monkeys. J Neurosci. 2001; 21: 2799–2807
  84. Haber, S., Fudge, J.L., and McFarland, N.R. Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum. J Neurosci. 2000; 20: 2369–2382
  85. Ikemoto, S. Dopamine reward circuitry: Two projection systems from the ventral midbrain to the nucleus accumbens–olfactory tubercle complex. Brain Res Rev. 2007; 56: 27–78
  86. Keramati, M. and Gutkin, B. Imbalanced decision hierarchy in addicts emerging from drug-hijacked dopamine spiraling circuit. PLoS One. 2013; 8: e61489
  87. Volkow, N., Fowler, J., Wang, G., and Hitzemann, R. Decreased dopamine D2 receptor availability is associated with reduced frontal metabolism in cocaine abusers. Synapse. 1993; 14: 169–177
  88. Moore, R.J., Vinsant, S.L., Nader, M.A., Porrino, L., and Friedman, D.P. Effect of cocaine self-administration on dopamine D2 receptors in rhesus monkeys. Synapse. 1998; 30: 88–96
  89. Nader, M., Morgan, D., Gage, H., Nader, S., Calhoun, T., Buchheimer, N. et al. PET imaging of dopamine D2 receptors during chronic cocaine self-administration in monkeys. Nat Neurosci. 2006; 9: 1050–1056
  90. Kasanetz, F., Deroche-Gamonet, V., Berson, N., Balado, E., Lafourcade, M., Manzoni, O., and Piazza, P.V. Transition to addiction is associated with a persistent impairment in synaptic plasticity. Science. 2010; 328: 1709–1712
  91. Volkow, N.D., Fowler, J.S., Wang, G.J., and Goldstein, R.Z. Role of dopamine, the frontal cortex and memory circuits in drug addiction: insight from imaging studies. Neurobiol Learn Mem. 2002; 78: 610–624
  92. Volkow, N.D., Fowler, J.S., Wang, G.J., Baler, R., and Telang, F. Imaging dopamine’s role in drug abuse and addiction. Neuropharmacology. 2009; 56: 3–8
  93. Asensio, S., Romero, M.J., Romero, F.J., Wong, C., Alia-Klein, N., Tomasi, D. et al. Striatal dopamine D2 receptor availability predicts the thalamic and medial prefrontal responses to reward in cocaine abusers three years later. Synapse. 2010; 64: 397–402
  94. Caprioli, D., Hong, Y.T., Sawiak, S.J., Ferrari, V., Williamson, D.J., Jupp, B. et al. Baseline-dependent effects of cocaine pre-exposure on impulsivity and D2/3 receptor availability in the rat striatum: Possible relevance to the attention-deficit hyperactivity syndrome. Neuropsychopharmacology. 2013; 38: 1460–1471
  95. Flagel, S.B., Robinson, T.E., Clark, J.J., Clinton, S.M., Watson, S.J., Seeman, P. et al. An animal model of genetic vulnerability to behavioral disinhibition and responsiveness to reward-related cues: Implications for addiction. Neuropsychopharmacology. 2010; 35: 388–400
  96. Robinson, E.S., Eagle, D.M., Economidou, D., Theobald, D.E., Mar, A.C., Murphy, E.R. et al. Behavioural characterisation of high impulsivity on the 5-choice serial reaction time task: Specific deficits in ‘waiting’ versus ‘stopping’. Behav Brain Res. 2009; 196: 310–316
  97. Jupp, B., Caprioli, D., Saigal, N., Reverte, I., Shrestha, S., Cumming, P. et al. Dopaminergic and GABA-ergic markers of impulsivity in rats: Evidence for anatomical localisation in ventral striatum and prefrontal cortex. Eur J Neurosci. 2013; 37: 1519–1528