Dev Cogn Neurosci. 2014 Nov 22. pii: S1878-9293(14)00082-6. doi: 10.1016/j.dcn.2014.11.001.
Simon NW1, Moghaddam B2.
Abstract
Immaturities in adolescent reward processing are thought to contribute to poor decision making and increased susceptibility to develop addictive and psychiatric disorders. Very little is known; however, about how the adolescent brain processes reward. The current mechanistic theories of reward processing are derived from adult models. Here we review recent research focused on understanding of how the adolescent brain responds to rewards and reward-associated events. A critical aspect of this work is that age-related differences are evident in neuronal processing of reward-related events across multiple brain regions even when adolescent rats demonstrate behavior similar to adults. These include differences in reward processing between adolescent and adult rats in orbitofrontal cortex and dorsal striatum. Surprisingly, minimal age related differences are observed in ventral striatum, which has been a focal point of developmental studies. We go on to discuss the implications of these differences for behavioral traits affected in adolescence, such as impulsivity, risk-taking, and behavioral flexibility. Collectively, this work suggests that reward-evoked neural activity differs as a function of age and that regions such as the dorsal striatum that are not traditionally associated with affective processing in adults may be critical for reward processing and psychiatric vulnerability in adolescents.
KEYWORDS:
Adolescent; Dopamine; Electrophysiology; Rat; Reward; Striatum
Highlights
The adolescent brain processes rewards differently than in adults.
These differences occur even when behavior is similar between age groups.
DS was the locus of substantial developmental differences in reward activity.
Surprisingly, differences were not as pronounced in VS
These differences may have implications for adolescent psychiatric vulnerability.
1. Introduction
Current research on psychiatric disorders has placed a strong emphasis on early detection and treatment. Many symptoms of schizophrenia, mood disorders and addiction first manifest during the adolescent period (Adriani and Laviola, 2004, Casey et al., 2008, Schramm-Sapyta et al., 2009 and Mitchell and Potenza, 2014). Accordingly, it is critical to elucidate the biological and environmental risk factors that render adolescents highly vulnerable to these disorders. Such mechanistic knowledge is necessary for the development of interventions to prevent or attenuate the emergence of disease.
Previous preclinical research on brain development and disease has primarily assessed morphological changes or alterations at the receptor level. These studies have yielded critical information about adolescent biology and behavior. There is little known, however, about real-time dynamics of neuronal activity during behavior. This information is particularly relevant in light of recent theories positing that dysfunctional neuronal network activity is a critical contributor to the etiology of disease (Uhlhaas and Singer, 2012 and Moghaddam and Wood, 2014). To fully understand how behaviorally relevant neuronal network activity is altered in vulnerable individuals, we must first understand how individual neurons and neural ensembles encode salient events in healthy adolescents and adults.
Changes in affect, motivation, and motivational processing during adolescence are among the first observed behaviors predictive of schizophrenia and other psychiatric illnesses in high risk individuals (Ernst et al., 2006, Gladwin et al., 2011 and Juckel et al., 2012). To understand the development of symptoms during this vulnerable developmental period, it is essential to quantify the basic neural mechanisms underlying adolescent reward processing. Recent data accumulated in our lab using adolescence rats suggest substantial age-related differences in reward-induced neuronal activity. These differences are manifested even when (1) measurable behavior is equivalent between adolescent and adult subjects, and (2) baseline levels of neuronal activity are equivalent between age groups. Thus, reward-evoked neuronal activity may, in some instances, be more effective than behavioral measures of motivation or baseline activity as a marker of early vulnerability to disease. In this review, we summarize adolescent reward-processing data acquired from a rat model across multiple brain regions, and discuss the implications of these differences for adolescent behavior and disease vulnerability.
2. Adolescent reward processing differs from adults across multiple regions
The technique focused in this review is single-unit extracellular recording where neuronal activity of multiple neurons can be measured in real-time in behaving animals (Sturman and Moghaddam, 2011b). For this method, multiwire electrode arrays are implanted in specific brain regions and electrical signals are amplified and high pass filtered to isolate high frequency neuronal activity, such as action potentials or local field potential oscillations (Buzsaki, 2004, Sturman and Moghaddam, 2011b and Wood et al., 2012). Measuring neural activity in awake-behaving adolescent rats is a challenging endeavor, as the adolescent window only spans approximately between postnatal days 28–55 (Spear, 2000). After accounting for the required time for electrode implantation surgery, recovery and habituation, the brief remaining time window precludes the use of complex behavioral paradigms with electrophysiology. Therefore, behavioral tasks that do not require long training times must be used to measure reward processing in adolescent rats. Our lab utilizes a rewarded instrumental task in which rats learn to nose poke into a lit port to receive a single sugar pellet, while neural activity is recorded from electrode arrays implanted into specific brain regions (Fig. 1). Importantly, the task is simple enough that learning and performance of the primary components of the task are comparable between adults and adolescents (Sturman et al., 2010), thus any differences in neuronal activity are indicative of reward processing differences, rather than a product of behavioral asymmetry between groups. Each of these behavioral events can be synchronized with measures of neural activity with sub-second long temporal resolution, allowing assessment of neural activity associated with reward-related cues, goal-directed actions, and reward anticipation and delivery. Using variants of this task, we recorded from orbitofrontal cortex, dorsal and ventral striatum, and ventral tegmental area in adult and adolescent rats. We then discuss how these differences in reward-processing may be related to reward-related cognitive traits observed during adolescence, including impulsivity, risk taking and behavioral flexibility.
Fig. 1.
(A) Single unit electrophysiology was performed with awake-behaving adolescent and adult rats during reward-related behavior. Rats were implanted with microwire arrays and placed into an operant chamber equipped with a nose poke port, food trough that delivered sugar pellet rewards, and a cue light used to signal reward availability. It should be noted that the identity of the cue was a light, a tone, or a compound cue consisting of both. (B) The instrumental tasks utilized began with illumination of the light cue, during which performance of a nose-poke (action) caused delivery of a pellet reward. After the rat collected the reward, a variable inter-trial interval was initiated, then the next trial began. (C) This heat plot shows sample data demonstrating the typical response of individual neurons to a reward-associated event. A subset of neurons demonstrate increased firing rate surrounding the event (bottom), others demonstrate suppressed firing rate during the event (top), and others are unresponsive (middle).
2.1. Prefrontal cortex
Prefrontal cortex (PFC) undergoes substantial development throughout adolescence, and this development has been implicated in adolescent behavioral tendencies, particularly the ability to regulate and inhibit motivated behaviors (Brenhouse et al., 2010, Geier et al., 2010, Sturman and Moghaddam, 2011a and Ernst, 2014). PFC is divided into multiple functionally distinct subregions with different implications for adolescent behavior and disease vulnerability. Orbitofrontal cortex (OFC) is a lateral prefrontal-cortical region that receives input from sensory regions and is extensively connected with limbic areas (Price, 2007 and Rolls and Grabenhorst, 2008). Accordingly, OFC is ideally suited to integrate physical aspects of rewarding and aversive outcomes with emotional information, and then utilize this affective information to guide behavior. Neuronal activity in OFC has been associated with the representation of rewarding outcomes (van Duuren et al., 2007, Balleine et al., 2011 and Schoenbaum et al., 2011), and has been implicated in multiple facets of impulsive behavior (Berlin et al., 2004, Winstanley et al., 2010 and Zeeb et al., 2010), which is elevated in humans and rats during adolescence (Green et al., 1994, Adriani and Laviola, 2003, Burton and Fletcher, 2012, Doremus-Fitzwater et al., 2012 and Mitchell and Potenza, 2014). Because OFC (along with other prefrontal regions) has been shown to be underdeveloped in human adolescents (Sowell et al., 1999 and Galvan et al., 2006), OFC is a logical target for probing for age-related differences in reward processing.
Single unit extracellular recording was used to measure task-evoked activity in individual neurons. In adults, OFC population neuronal activity decreased during reward retrieval (Fig. 1B). In contrast, the adolescent OFC population activity was increased during retrieval (Sturman and Moghaddam, 2011b). This profound difference in activity occurred despite similar baseline firing rate between groups, and comparable neuronal inhibition during the performance phase of the instrumental action that lead to reward delivery. These data suggest that reward processing in OFC can be an effective biomarker of age-related differences, even when baseline neuronal activity and behavior are equivalent between groups.
Although baseline firing rate was similar between age groups, an alternate analysis of firing patterns revealed further distinctions. Adolescent OFC showed increased variability compared to adults in firing rate across multiple trials, as assessed by fano factor, which provides a measure of normalized variability and can be calculated by ross-trial variance by cross-trial mean (Churchland et al., 2010). This variability may be indicative of inefficient neural coding of reward-related events, as spike variability undermines effective inter-regional communication through spike-field coherence (Fries, 2005 and Churchland et al., 2010). Importantly, this finding suggests that measures beyond simple firing rate may be necessary to detect functional differences in neural processing between age groups, and possibly between healthy controls and diseased or at-risk patients.
OFC plays a modulatory role in impulsive choice, defined as a preference for immediate rewards/gratification (Winstanley, 2007). Adolescent humans and rats have increased preference for immediate gratification compared to adult humans and rats, and this has been implicated in adolescent drug abuse and maladaptive behavior (Adriani and Laviola, 2003, Doremus-Fitzwater et al., 2012, Mitchell and Potenza, 2014 and Stanis and Andersen, 2014). Impulsive decision-making is associated with several psychiatric disorders (Bechara et al., 2001, Ahn et al., 2011 and Nolan et al., 2011), and is both a predictor of drug abuse and a consequence of long-term exposure to drugs of abuse (Simon et al., 2007, Perry et al., 2008, Anker et al., 2009, de Wit, 2009 and Mendez et al., 2010). Thus, a feed forward condition may develop in which individuals with psychiatric vulnerabilities involving aberrant impulsive regulation are highly likely to abuse drugs, which then exacerbates trait impulsivity (Garavan and Stout, 2005 and Setlow et al., 2009). Our data suggest that age differences in impulsivity may be, in part, due to neuronal processing differences in the OFC, as OFC encodes information about reward-associated delays (Roesch and Olson, 2005 and Roesch et al., 2006). The highly variable neural processing throughout task performance (as assessed by fano factor) and hyperactive reward-evoked response observed in adolescent OFC may, therefore, be related to unstable representations of reward-related events. Our observation may also be related to a suboptimal ability to bridge long delays between actions and outcomes, a function associated with OFC neurons (Roesch et al., 2006). This in turn would facilitate persistent choice of immediate over delayed gratification.
Age-related differences also are observed in infralimbic and prelimbic regions of the medial PFC, which are implicated in behavioral planning and feedback, attention, and response inhibition (Goldman-Rakic, 1995, Fuster, 2001, Killcross and Coutureau, 2003, Magno et al., 2006, Peters et al., 2008, Burgos-Robles et al., 2013 and Pezze et al., 2014). While neuronal activity has not yet been recorded in these regions in behaving adolescent animals, developmental correlates of reward processing have been revealed by quantifying immediate early genes. After heroin self-administration, adolescents showed an attenuated increase in Fos positive neurons in prelimbic and infralimbic cortices compared to adults, indicative of reduced activation of adolescent medial PFC by drug reward seeking (Doherty et al., 2013). Reports of nicotine-evoked activity are conflicting, demonstrating either enhanced increase in Arc or similar changes in cfos in adolescent compared to adult medial PFC (Leslie et al., 2004 and Schochet et al., 2005). Finally, cocaine exposure caused increase c-fos expression in adolescent PFC (Cao et al., 2007). While these studies provide useful data, direct measurements of neural processing of both drug and natural rewards in adolescent medial PFC will yield temporally specific information about adolescent medial PFC function.
Dopamine receptor expression in prelimbic cortex peaks during adolescence (Andersen et al., 2000). D1 dopamine receptors, in particular, have been linked to adolescent motivated behavior. Adolescent rats demonstrate increased vulnerability to drug-associated cues compared to adult rats (Leslie et al., 2004, Brenhouse and Andersen, 2008, Brenhouse et al., 2008 and Kota et al., 2011); blocking D1 receptors in adolescent prelimbic cortex decreases sensitivity to these cues (Brenhouse et al., 2008). In addition, overexpressing D1 receptors in adult prelimbic cortex recapitulated adolescent behavioral tendencies, including impulsivity and increased sensitivity to drug-associated cues (Sonntag et al., 2014). D1 receptor manipulation also modulates behavioral sensitivity to amphetamine to a greater degree in adolescents than adults (Mathews and McCormick, 2012).
2.2. Striatum
Neural development during adolescence is ongoing in the striatum (Sowell et al., 1999, Ernst et al., 2006, Casey et al., 2008, Geier et al., 2010 and Somerville et al., 2011). Striatum is involved with learning, reward processing and movement, and has been strongly implicated in psychiatric disorders including schizophrenia and addiction (Kalivas and Volkow, 2005, Everitt et al., 2008 and Horga and Abi-Dargham, 2014). Both ventral and dorsal striatum receive dense dopaminergic projections from the midbrain, and dopamine transmission has repeatedly been shown to differ between adulthood and adolescence (Adriani and Laviola, 2004, Volz et al., 2009 and McCutcheon et al., 2012). While there is a wealth of data from animal models describing neuroanatomical and pharmacological differences in striatum between adolescent and adult rodents (Andersen et al., 1997, Bolanos et al., 1998 and Tarazi et al., 1998), there are considerably less data describing age-related differences in neural activity. The majority of the neural imaging studies performed in human adolescent subjects have focused on ventral striatum (VS) in particular the nucleus accumbens (NAc), which is implicated in motivation, learning and cue processing (Robbins and Everitt, 1996, Kelley, 2004, Ernst et al., 2006, Galvan et al., 2006, Geier et al., 2010 and Hart et al., 2014). However, dorsal striatum (DS), which is implicated in learning, action-selection and habit formation (Packard and White, 1990, Balleine et al., 2007 and Kimchi et al., 2009), has been largely overlooked as a locus of developmental differences. To quantify and compare neural correlates of reward processing in both striatal regions, our lab recorded single-unit extracellular activity in both DS and NAc of adult and adolescent rats during goal-directed behavior.
Somewhat surprisingly, task-evoked activity in NAc did not differ substantially between adult and adolescent rats (Sturman and Moghaddam, 2012). Robust age-related differences, however, were observed in DS. Adolescent neurons were activated just prior to a reward-seeking action, whereas adult neurons did not respond until after action completion (Fig. 1B). Adolescent neurons in DS also were activated prior to reward retrieval, while adult neurons were inhibited by reward (Fig. 1B). This demonstrated that the adolescent brain recruits DS circuitry both earlier and to a greater degree than adults during reward-retrieval.
While adolescent DS neurons are hyper-responsive to rewards, amphetamine-evoked dopamine release is attenuated compared to adults in this region. Lower levels of amphetamine-evoked dopamine efflux in the DS, but, again, not the NAc of adolescent rats compared to adults (Matthews et al., 2013). Interestingly, the opposite effect has been observed with dopaminergic drugs that act as uptake inhibitors, such as cocaine and methylphenidate, which cause enhanced dopamine efflux in adolescent compared to adult DS (Walker and Kuhn, 2008 and Walker et al., 2010). As with amphetamine, this age-related cocaine effect was more pronounced in DS than NAc (Frantz et al., 2007 and Walker and Kuhn, 2008). This difference between DS dopamine release may be a function of baseline dopamine availability, as reduced dopamine availability in projection dopamine neurons would likely affect drugs that facilitate dopamine release (such as amphetamine) to a greater degree than drugs that maintain dopamine in the synapse (such as cocaine). Accordingly, tyrosine hydroxylase, an enzyme involved with the synthesis of dopamine, was reduced in adolescent DS but not NAc (Matthews et al., 2013). This reduction in evoked-dopamine neurotransmission suggests that dopamine projections to DS, which arise from substantia nigra pars compacta (Ungerstedt, 1971 and Lynd-Balta and Haber, 1994), may be hypoactive during adolescence. Dopamine has an inhibitory influence on medium spiny neurons in the striatum (Kreitzer and Malenka, 2008). A hypoactive dopamine neurotransmission in adolescence DS may, therefore, contribute to our observed enhanced reward-evoked activity in DS neurons. Future studies recording from dopamine projections to the adolescent DS will directly address this mechanism.
The area of striatum traditionally associated with attributing value and motivation to cues and rewards is VS (Robbins and Everitt, 1996, Kelley, 2004, Cooper and Knutson, 2008 and Flagel et al., 2011). Accordingly, many theories of adolescent illness and behavioral vulnerability hinge on aberrant reward-related motivated behavior and responsivity of reward-related brain circuitry (Bjork et al., 2004, Galvan et al., 2006, Geier et al., 2010 and Van Leijenhorst et al., 2010). The previous data, on the other hand, suggest that age-related differences to rewards may be even greater in DS (Sturman and Moghaddam, 2012 and Matthews et al., 2013). While these do not preclude the role of the developing VS in adolescent behavioral and disease vulnerability, they suggest that DS may also play a substantial role in adolescent behavioral tendencies.
The DS is strongly associated with learning and the physical manifestation of locomotive behavior (Robbins and Everitt, 1992, Packard and Knowlton, 2002 and Gittis and Kreitzer, 2012). In particular the dorsomedial striatum (DMS), or associative striatum region of the DS is implicated in linking actions to rewarding outcomes, as lesions of DMS abolish the learning and expression of goal-directed behavior (Yin and Knowlton, 2004 and Ragozzino, 2007), and DMS activity also has been implicated in the encoding of flexible response patterns (Kimchi and Laubach, 2009). Conversely, dorsolateral striatum (DLS) is involved with the consolidation and expression of habitual behavior, during which actions are no longer dependent on outcome representation (Yin et al., 2004 and Yin et al., 2009). The studies of adolescent neuronal activity and dopamine release detailed in this review (Sturman and Moghaddam, 2012 and Matthews et al., 2013) were both localized to DMS, underscoring the importance of this region in development toward the adolescent behavioral phenotype and illness vulnerability. In line with this idea, several differences have been observed in instrumental behavior between adult and adolescent rats, with adolescents demonstrating differences in instrumental behavior, including differences in appetitive motivation, reduced extinction, attenuated response inhibition and impaired ability to adjust to changes in action-outcome contingencies (Friemel et al., 2010, Sturman et al., 2010, Andrzejewski et al., 2011, Spear, 2011, Burton and Fletcher, 2012 and Naneix et al., 2012). In addition, adolescents exhibit reduced ability to quickly initiate an appropriate response after a stop signal (Simon et al., 2013), similar to the effect observed after lesions of DMS (Eagle and Robbins, 2003).
In contrast to adolescent DMS, the presence of developmental differences in DLS is less clear. During the expression of goal-directed behavior, actions are initially tightly linked to outcome representation. After overtraining, however, actions become less influenced by outcome representation, and more automated (“habitual”) (Dickinson, 1985). Plasticity related to this habit learning occurs in DLS (Yin et al., 2009, Balleine and O’Doherty, 2010 and Thorn et al., 2010), and the shift from goal-directed to habitual behavior is mediated in part by dopamine transmission in DS (Packard and White, 1991 and Belin and Everitt, 2008). There are conflicting data on the development of habit formation in adolescent vs. adult rats. Adolescent rats demonstrate an inability to adjust responding to changes in contingency, as well as increased habitual behavior in a reinforcer devaluation task (Naneix et al., 2012 and Hammerslag and Gulley, 2014). There is evidence for either behavioral rigidity or flexibility in adolescent rats on a set shifting task compared to adults, based on task design and parameters (Leslie et al., 2004, Newman and McGaughy, 2011 and Snyder et al., 2014). More complex tasks appear to consistently yield greater levels of flexibility in adolescents. A four-choice reversal task, which requires a greater cognitive load than the standard two-choice set shifting design, revealed greater flexibility in adolescent compared to adult mice (Johnson and Wilbrecht, 2011). In addition, recent data demonstrate that, after learning to withhold an action in the presence of a cue, adolescent rats acquire that cue more quickly as a Pavlovian-conditioned stimulus predictive of reward, as assessed by an increase in reward approach behavior. This suggested that adolescents are able to rapidly adjust the value of a cue that was previous salient (which differs from reversal tasks, which typically involve attributing value to a previously unrewarded cue). A recent experiment in our lab tested this ability to adjust to changes in cue identity further by training rats in a cued instrumental paradigm, during which a 10 s cue (light or tone) was presented, and a nose poke into a lit port resulted in food pellet delivery. No difference in correct responses between adults and adolescents was observed in this task (F(1,12) = .23, p = .64; n = 7/age group; Fig. 2). In the second phase of this experiment, the instrumental cue was shifted in modality to a 10 s Pavlovian cue. After the shift in cue-outcome relationship, adolescents showed a higher percentage of Pavlovian approach during this cue than adults, as assessed by time spent in the food trough during the cue (F(1,12) = 6.96, p = .023; Fig. 2). In a control experiment, adolescent and adult rats acquired Pavlovian approach to a novel cue at an equal rate, indicating that this effect was not related to an age related difference in the general ability to learn or perform Pavlovian conditioning (F(1,12) = .26, p = .62). These data, therefore, indicate that, when a cue acts as either a stop or go signal within an instrumental context, changes in cue-outcome relationships can be flexibly acquired by adolescent rats more quickly than adults. This characteristic of the adolescent brain would allow it to adjust to changes in value of previously salient cues or environments more efficiently than an adult brain. This is an interesting finding because much of the research on adolescents focuses on maladaptive behaviors, whereas behavioral flexibility is generally suggested to be an advantageous characteristic.
- Fig. 2.
(A) Adult and adolescent rats learned to perform an instrumental action for reward following cue presentation. (B) The same cue was shifted to a Pavlovian cue, during which reward was no longer contingent on a response, but was always delivered as the cue terminated. Adolescent rats acquired a Pavlovian response to the cue (defined as time spent in the food trough anticipating reward during the cue) more quickly than adults.
The summarized data suggest that adolescent rats may encode relationships between cues and outcomes in which cues were previously meaningful more flexibly than adults (Simon et al., 2013; Fig. 2), or in situations with a higher cognitive load (Johnson and Wilbrecht, 2011). The hyper-responsivity observed in adolescent DMS during reward-related events (Sturman and Moghaddam, 2012) may promote increased ability to alter behavioral strategies (Kimchi and Laubach, 2009). It would be of interest to record from adolescent DLS, which is involved with the learning and expression of habitual behavior, to observe if this region is hypoactive compared to adults. Accelerated habit formation is proposed to promote addiction, as habitual drug seeking behavior is less sensitive to the negative consequences of drug abuse and addiction (Everitt et al., 2008 and Hogarth et al., 2013). Thus, ongoing study of the role of the developing DS in habit formation is highly relevant toward the preponderance of adolescent drug addiction.
Both DS and VS are involved with risky decision-making (Cardinal, 2006, Simon et al., 2011, Kohno et al., 2013 and Mitchell et al., 2014), defined as a preference for risky over safe rewards. Risky behavior is a hallmark of adolescence, and is linked to drug abuse (Bornovalova et al., 2005 and Balogh et al., 2013). Moreover, recent evidence from a rat model of risky decision-making demonstrates that risky behavior in adolescents predicts cocaine self-administration (Mitchell et al., 2014), which may facilitate the drug abuse and addiction vulnerability during adolescence (Adriani and Laviola, 2004, Merline et al., 2004 and Doremus-Fitzwater et al., 2010). Reduced dopamine receptor availability in both striatal regions is predictive of higher levels of risky decision-making in rats, and local infusion of selective dopamine agonists either systemically or into adolescent striatum reduces risky behavior (Simon et al., 2011 and Mitchell et al., 2014). Accordingly, adolescent rats demonstrate reduced dopamine responsivity and TH expression in DS (Matthews et al., 2013), which may provide a partial mechanism for adolescent risky behavior. Risky decision-making also is associated with neuronal activity and dopamine receptor expression in OFC (Eshel et al., 2007, Van Leijenhorst et al., 2010, Simon et al., 2011 and O’Neill and Schultz, 2013). It is possible that the hyperactive reward responses in both OFC and DS (Sturman and Moghaddam, 2011b and Sturman and Moghaddam, 2012) are related to the excessive and occasionally maladaptive risky decision-making during adolescence. Further study of this circuitry could yield interesting data and therapeutic options for the early stages of diseases characterized by risky behavior that manifest during adolescence, including addiction, schizophrenia and depression (Ludewig et al., 2003, Bornovalova et al., 2005 and Taylor Tavares et al., 2007).
2.3. Ventral tegmental area
Dopamine neurons, especially those localized in ventral tegmental area (VTA), are involved with reward processing, associative learning, and the pathophysiology of addiction, mood disorders, and schizophrenia (Wise and Bozarth, 1985, Schultz, 1998, Wise, 2004, Sesack and Grace, 2010 and Howes et al., 2012). The dopamine system has been implicated in adolescent behavioral and illness vulnerabilities (Luciana et al., 2012, Matthews et al., 2013 and Niwa et al., 2013), and aspects of dopamine transmission and VTA activity are different in adults and adolescents (Robinson et al., 2011, McCutcheon et al., 2012 and Matthews et al., 2013). In addition, dopamine neurons in VTA project to prefrontal cortex and ventral striatum, regions undergoing development during adolescence. Little is known, however, about how adolescent VTA neurons process reward related events compared to adults. Recent preliminary recording of extracellular activity from VTA neurons in adult and adolescent rats indicates that these neurons have similar basal firing rate and responding to reward related cues (Kim and Moghaddam, 2012), and work is ongoing that will assess adolescent reward processing in this, and other, dopaminergic regions.
2.4. Reward processing circuitry summary
Adolescents demonstrate enhanced impulsive behavior, risk taking, cue salience, drug and reward seeking, and behavioral flexibility compared to adults. As detailed above, single unit electrophysiology revealed age-related differences in reward processing that are likely involved with these behavioral tendencies. Adolescents demonstrate hyper-activation to reward relative to adults in both OFC and DS (Fig. 3). The OFC directly projects to the DS, at least in adult rodents, suggesting that immature OFC-DS connectivity also may contribute to these observed effects (Berendse et al., 1992 and Reep et al., 2003). Dopaminergic neurons projecting from the substantia nigra also project to DS (Voorn et al., 2004), and aberrant reward-evoked activity in these neurons may contribute to hyperactive DS reward processing in adolescence. The reduced dopamine efflux observed in DS following amphetamine exposure suggests that these neurons may indeed be hyperactive compared to adults, although further experiments are necessary to confirm this functional difference. Reward-evoked activity in DLS, which receives the strongest dopaminergic input from substantia nigra (Groenewegen, 2003 and Voorn et al., 2004), also is likely to differ between adults and adolescents, as the development of behavioral habits varies across the lifespan (Johnson and Wilbrecht, 2011, Newman and McGaughy, 2011, Simon et al., 2013 and Snyder et al., 2014).
- Fig. 3.
A modified reward circuit for the adolescent brain. Connections of the common “reward circuits” are depicted in black and involve nucleus accumbens (NAc), ventral tegmental area (VTA), and medial prefrontal cortex (mPFC). Our findings in adolescents identify a complementary reward processing pathway depicted in red. We find that dopamine projections to the dorsal striatum (DS), which arise from substantia nigra (SNc) may be hypoactive in adolescents (Matthews et al., 2013) while orbitofrontal cortex (OFC) and DS neurons of adolescents are hyper-responsive to reward compared to adults (Sturman and Moghaddam, 2011a, Sturman and Moghaddam, 2011b and Sturman and Moghaddam, 2012). On the other hand, NAc dopamine release and reward-evoked activity, and baseline firing of dopamine neurons in the ventral tegmental area (VTA) are comparable between adults and adolescents (Kim and Moghaddam, 2012 and Matthews et al., 2013).
Interestingly, no substantial age-related differences were observed in NAc reward processing, despite VS being a prominent factor in models of adolescent behavioral vulnerability (Ernst et al., 2009 and Geier et al., 2010). This similar neural activity between age groups is consistent with reports of no age related differences in drug-evoked dopamine efflux in NAc (Frantz et al., 2007 and Matthews et al., 2013), although studies about dopamine receptor expression in NAc are conflicting (Teicher et al., 1995 and Tarazi and Baldessarini, 2000). The lack of differences in NAc reward-processing does not preclude the influence of the developing adolescent NAc on behavioral and psychopathology vulnerabilities; however, the observed differences in motivational processes during adolescence (Spear, 2011) may arise from functional neural activity in DS and PFC regions to a greater extent than NAc. Collectively, these finding suggest that the traditional brain reward circuitry should be modified for adolescents (Fig. 3).
3. Conclusion
The findings reviewed here inform future adolescent research in two ways: (1) baseline activity or response to sensory stimuli such as reward predicting cues are unaffected, or less affected, than neuronal processing around the time of reward. Thus, a focus on reward response may provide the ideal biomarker for early vulnerability to disorders of motivation and affect. (2) Robust neuronal responses were observed in regions that are not typically associated with reward processing in adults. Thus, the dynamic circuitry of motivated behavior may be different than our adult models and involve cortical and basal ganglia regions that are not classically associated with reward processing. Future emphasis on regions such as the DS may greatly enhance our knowledge of this dynamic circuitry and its contribution to disease vulnerability in at-risk individuals.
Conflicts of interest
The authors declare that there are no conflicts of interest.
Acknowledgements
This work was supported by DA 035050 (NWS) and MH048404-23 (BM).
References
- Adriani and Laviola, 2003
- W. Adriani, G. Laviola
- Elevated levels of impulsivity and reduced place conditioning with d-amphetamine: two behavioral features of adolescence in mice
- Behav. Neurosci., 117 (2003), pp. 695–703
|
|
- Brenhouse et al., 2008
- H.C. Brenhouse, K.C. Sonntag, S.L. Andersen
- Transient d1 dopamine receptor expression on prefrontal cortex projection neurons: relationship to enhanced motivational salience of drug cues in adolescence
- J. Neurosci., 28 (2008), pp. 2375–2382
|
|
- Brenhouse and Andersen, 2008
- H.C. Brenhouse, S.L. Andersen
- Delayed extinction and stronger reinstatement of cocaine conditioned place preference in adoelscent rats, compared to adults
- Behav. Neurosci., 122 (2008), pp. 460–465
|
|
- Bornovalova et al., 2005
- M.A. Bornovalova, S.B. Daughters, G.D. Hernandez, J.B. Richards, C.W. Lejuez
- Differences in impulsivity and risk-taking propensity between primary users of crack cocaine and primary users of heroin in a residential substance-use program
- Exp. Clin. Psychopharmacol., 13 (2005), pp. 311–318
|
|
- Bolanos et al., 1998
- C.A. Bolanos, S.J. Glatt, D. Jackson
- Subsensitivity to dopaminergic drugs in periadolescent rats: a behavioral and neurochemical analysis
- Brain Res. Dev. Brain Res., 111 (1998), pp. 25–33
|
|
|
- Bjork et al., 2004
- J.M. Bjork, B. Knutson, G.W. Fong, D.M. Caggiano, S.M. Bennett, D.W. Hommer
- Incentive-elicited brain activation in adolescents: similarities and differences from young adults
- J. Neurosci., 24 (2004), pp. 1793–1802
|
|
- Berlin et al., 2004
- H.A. Berlin, E.T. Rolls, U. Kischka
- Impulsivity, time perception, emotion and reinforcement sensitivity in patients with orbitofrontal cortex lesions
- Brain, 127 (2004), pp. 1108–1126
|
|
- Berendse et al., 1992
- H.W. Berendse, Y. Galis-de Graaf, H.J. Groenewegen
- Topographical organization and relationship with ventral striatal compartments of prefrontal corticostriatal projections in the rat
- J. Comp. Neurol., 316 (1992), pp. 314–347
|
|
- Belin and Everitt, 2008
- D. Belin, B.J. Everitt
- Cocaine seeking habits depend upon dopamine-dependent serial connectivity linking the ventral with the dorsal striatum
- Neuron, 57 (2008), pp. 432–441
|
|
|
- Bechara et al., 2001
- A. Bechara, S. Dolan, N. Denburg, A. Hindes, S.W. Anderson, P.E. Nathan
- Decision-making deficits, linked to dysfunctional ventromedial prefrontal cortex, revealed in alcohol and stimulant abusers
- Neuropsychologia, 39 (2001), pp. 376–389
|
|
|
- Balogh et al., 2013
- K.N. Balogh, L.C. Mayes, M.N. Potenza
- Risk-taking and decision-making in youth: relationships to addiction vulnerability
- J. Behav. Addict., 2 (2013), pp. 1–9
|
|
- Balleine et al., 2011
- B.W. Balleine, B.K. Leung, S.B. Ostlund
- The orbitofrontal cortex, predicted value, and choice
- Ann. N. Y. Acad. Sci., 1239 (2011), pp. 43–50
|
- Balleine et al., 2007
- B.W. Balleine, M.R. Delgado, O. Hikosaka
- The role of the dorsal striatum in reward and decision-making
- J. Neurosci., 27 (2007), pp. 8161–8165
|
|
- Balleine and O’Doherty, 2010
- B.W. Balleine, J.P. O’Doherty
- Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action
- Neuropsychopharmacol.: Off. Publ. Am. Coll. Neuropsychopharmacol., 35 (2010), pp. 48–69
|
|
- Anker et al., 2009
- J.J. Anker, J.L. Perry, L.A. Gliddon, M.E. Carroll
- Impulsivity predicts the escalation of cocaine self-administration in rats
- Pharmacol. Biochem. Behav., 93 (2009), pp. 343–348
|
|
|
- Andrzejewski et al., 2011
- M.E. Andrzejewski, T.L. Schochet, E.C. Feit, R. Harris, B.L. Mc Kee, A.E. Kelley
- A comparison of adult and adolescent rat behavior in operant learning, extinction, and behavioral inhibition paradigms
- Behav. Neurosci., 125 (2011), pp. 93–105
|
|
- Andersen et al., 2000
- S.L. Andersen, A.T. Thompson, M. Rutstein, J.C. Hostetter, M.H. Teicher
- Dopamine receptor pruning in prefrontal cortex during the periadolescent period in rats
- Synapse, 37 (2000), pp. 167–169
|
|
- Andersen et al., 1997
- S.L. Andersen, N.L. Dumont, M.H. Teicher
- Developmental differences in dopamine synthesis inhibition by (+/−)-7-OH-DPAT
- Naunyn-Schmiedeberg’s Arch. Pharmacol., 356 (1997), pp. 173–181
|
|
- Ahn et al., 2011
- W.-Y. Ahn, O. Rass, D.J. Fridberg, A.J. Bishara, J.K. Forsyth, A. Breier, J.R. Busemeyer, W.P. Hetrick, A.R. Bolbecker, B.F. O’Donnell
- Temporal discounting of rewards in patients with bipolar disorder and schizophrenia
- J. Abnorm. Psychol., 120 (2011), pp. 911–921
|
|
- Adriani and Laviola, 2004
- W. Adriani, G. Laviola
- Windows of vulnerability to psychopathology and therapeutic strategy in the adolescent rodent model
- Behav. Pharmacol., 15 (2004), pp. 341–352
|
|
- Brenhouse et al., 2010
- H.C. Brenhouse, K. Dumais, S.L. Andersen
- Enhancing the salience of dullness: behavioral and pharmacological strategies to facilitate extinction of drug-cue associations in adolescent rats
- Neuroscience, 169 (2010), pp. 628–636
|
|
|
- Everitt et al., 2008
- B.J. Everitt, D. Belin, D. Economidou, Y. Pelloux, J.W. Dalley, T.W. Robbins
- Neural mechanisms underlying the vulnerability to develop compulsive drug-seeking habits and addiction
- Philos. Trans. R. Soc. B: Biol. Sci., 363 (2008), pp. 3125–3135
|
|
- Eshel et al., 2007
- N. Eshel, E.E. Nelson, J. Blair, D.S. Pine, M. Ernst
- Neural substrates of choice selection in adults and adolescents: development of the ventrolateral prefrontal and anterior cingulate cortices
- Neuropsychologia, 45 (2007), pp. 1270–1279
|
|
|
- Ernst et al., 2009
- M. Ernst, R.D. Romeo, S.L. Andersen
- Neurobiology of the development of motivated behaviors in adolescence: a window into a neural systems model
- Pharmacol. Biochem. Behav., 93 (2009), pp. 199–211
|
|
|
- Ernst et al., 2006
- M. Ernst, D.S. Pine, M. Hardin
- Triadic model of the neurobiology of motivated behavior in adolescence
- Psychol. Med., 36 (2006), pp. 299–312
|
- Ernst, 2014
- M. Ernst
- The triadic model perspective for the study of adolescent motivated behavior
- Brain Cognit., 89 (2014), pp. 104–111
|
|
|
- Eagle and Robbins, 2003
- D.M. Eagle, T.W. Robbins
- Inhibitory control in rats performing a stop-signal reaction-time task: effects of lesions of the medial striatum and d-amphetamine
- Behav. Neurosci., 117 (2003), pp. 1302–1317
|
|
- Doremus-Fitzwater et al., 2012
- T.L. Doremus-Fitzwater, M. Barretto, L.P. Spear
- Age-related differences in impulsivity among adolescent and adult Sprague-Dawley rats
- Behav. Neurosci., 126 (2012), pp. 735–741
|
|
- Doremus-Fitzwater et al., 2010
- T.L. Doremus-Fitzwater, E.I. Varlinskaya, L.P. Spear
- Motivational systems in adolescence: possible implications for age differences in substance abuse and other risk-taking behaviors
- Brain Cognit., 72 (2010), pp. 114–123
|
|
|
- Doherty et al., 2013
- J.M. Doherty, B.M. Cooke, K.J. Frantz
- A role for the prefrontal cortex in heroin-seeking after forced abstinence by adult male rats but not adolescents
- Neuropsychopharmacol.: Off. Publ. Am. Coll. Neuropsychopharmacol., 38 (2013), pp. 446–454
|
|
- Dickinson, 1985
- A. Dickinson
- Actions and habits: the development of behavioral autonomy
- Philos. Trans. R. Soc. Lond. Ser. B: Biol. Sci., 308 (1985), pp. 67–78
- de Wit, 2009
- H. de Wit
- Impulsivity as a determinant and consequence of drug use: a review of underlying processes
- Addict. Biol., 14 (2009), pp. 22–31
|
|
- Cooper and Knutson, 2008
- J.C. Cooper, B. Knutson
- Valence and salience contribute to nucleus accumbens activation
- NeuroImage, 39 (2008), pp. 538–547
|
|
|
- Churchland et al., 2010
- M.M. Churchland, et al.
- Stimulus onset quenches neural variability: a widespread cortical phenomenon
- Nat. Neurosci., 13 (2010), pp. 369–378
|
|
- Casey et al., 2008
- B.J. Casey, R.M. Jones, T.A. Hare
- The adolescent brain
- Ann. N. Y. Acad. Sci., 1124 (2008), pp. 111–126
|
|
- Cardinal, 2006
- R.N. Cardinal
- Neural systems implicated in delayed and probabilistic reinforcement
- Neural Netw., 19 (2006), pp. 1277–1301
|
|
|
- Cao et al., 2007
- J. Cao, S. Lotfipour, S.E. Loughlin, F.M. Leslie
- Adolescent maturation of cocaine-sensitive neural mechanisms
- Neuropsychopharmacol.: Off. Publ. Am. Coll. Neuropsychopharmacol., 32 (2007), pp. 2279–2289
|
|
- Buzsaki, 2004
- G. Buzsaki
- Large-scale recording of neuronal ensembles
- Nat. Neurosci., 7 (2004), pp. 446–451
|
|
- Burton and Fletcher, 2012
- C.L. Burton, P.J. Fletcher
- Age and sex differences in impulsive action in rats: the role of dopamine and glutamate
- Behav. Brain Res., 230 (2012), pp. 21–33
|
|
|
- Burgos-Robles et al., 2013
- A. Burgos-Robles, H. Bravo-Rivera, G.J. Quirk
- Prelimbic and infralimbic neurons signal distinct aspects of appetitive instrumental behavior
- PLOS ONE, 8 (2013), p. e57575
- Flagel et al., 2011
- S.B. Flagel, J.J. Clark, T.E. Robinson, L. Mayo, A. Czuj, I. Willuhn, C.A. Akers, S.M. Clinton, P.E.M. Phillips, H. Akil
- A selective role for dopamine in stimulus-reward learning
- Nature, 469 (2011), pp. 53–57
- Juckel et al., 2012
- G. Juckel, E. Friedel, M. Koslowski, H. Witthaus, S. Ozgurdal, Y. Gudlowski, B. Knutson, J. Wrase, M. Brune, A. Heinz, F. Schlagenhauf
- Ventral striatal activation during reward processing in subjects with ultra-high risk for schizophrenia
- Neuropsychobiology, 66 (2012), pp. 50–56
|
|
- Johnson and Wilbrecht, 2011
- C. Johnson, L. Wilbrecht
- Juvenile mice show greater flexibility in multiple choice reversal learning than adults
- Dev. Cognit. Neurosci., 1 (2011), pp. 540–551
|
|
|
- Howes et al., 2012
- O.D. Howes, J. Kambeitz, E. Kim, D. Stahl, M. Slifstein, A. Abi-Dargham, S. Kapur
- The nature of dopamine dysfunction in schizophrenia and what this means for treatment: meta-analysis of imaging studies
- Arch. Gen. Psychiatry, 69 (2012), pp. 776–786
|
- Horga and Abi-Dargham, 2014
- G. Horga, A. Abi-Dargham
- The striatum and dopamine: a crossroad of risk for schizophrenia
- JAMA Psychiatry, 71 (2014), pp. 489–491
|
|
- Hogarth et al., 2013
- L. Hogarth, B.W. Balleine, L.H. Corbit, S. Killcross
- Associative learning mechanisms underpinning the transition from recreational drug use to addiction
- Ann. N. Y. Acad. Sci., 1282 (2013), pp. 12–24
|
|
- Hart et al., 2014
- G. Hart, B.K. Leung, B.W. Balleine
- Dorsal and ventral streams: the distinct role of striatal subregions in the acquisition and performance of goal-directed actions
- Neurobiol. Learn. Mem., 108 (2014), pp. 104–118
|
|
|
- Hammerslag and Gulley, 2014
- L.R. Hammerslag, J.M. Gulley
- Age and sex differences in reward behavior in adolescent and adult rats
- Dev. Psychobiol., 56 (2014), pp. 611–621
|
|
- Groenewegen, 2003
- H.J. Groenewegen
- The basal ganglia and motor control
- Neural Plast., 10 (2003), pp. 107–120
|
|
- Green et al., 1994
- L. Green, A.F. Fry, J. Myerson
- Discounting of delayed rewards: a life-span comparison
- Psychol. Sci., 5 (1994), pp. 33–36
|
|
- Goldman-Rakic, 1995
- P.S. Goldman-Rakic
- Cellular basis of working memory
- Neuron, 14 (1995), pp. 477–485
|
|
|
- Gladwin et al., 2011
- T.E. Gladwin, B. Figner, E.A. Crone, R.W. Wiers
- Addiction, adolescence, and the integration of control and motivation
- Dev. Cognit. Neurosci., 1 (2011), pp. 364–376
|
|
|
- Gittis and Kreitzer, 2012
- A.H. Gittis, A.C. Kreitzer
- Striatal microcircuitry and movement disorders
- Trends Neurosci., 35 (2012), pp. 557–564
|
|
|
- Geier et al., 2010
- C.F. Geier, R. Terwilliger, T. Teslovich, K. Velanova, B. Luna
- Immaturities in reward processing and its influence on inhibitory control in adolescence
- Cereb. Cortex, 20 (2010), pp. 1613–1629
|
|
- Garavan and Stout, 2005
- H. Garavan, J.C. Stout
- Neurocognitive insights into substance abuse
- Trends Cognit. Sci., 9 (2005), pp. 195–201
|
|
|
- Galvan et al., 2006
- A. Galvan, T.A. Hare, C.E. Parra, J. Penn, H. Voss, G. Glover, B.J. Casey
- Earlier development of the accumbens relative to orbitofrontal cortex might underlie risk-taking behavior in adolescents
- J. Neurosci., 26 (2006), pp. 6885–6892
|
|
- Fuster, 2001
- J.M. Fuster
- The prefrontal cortex – an update: time is of the essence
- Neuron, 30 (2001), pp. 319–333
|
|
|
- Fries, 2005
- P. Fries
- A mechanism for cognitive dynamics: neuronal communication through neuronal coherence
- Trends Cogn. Sci., 9 (2005), pp. 474–480
|
|
|
- Friemel et al., 2010
- C.M. Friemel, R. Spanagel, M. Schneider
- Reward sensitivity for a palatable food reward peaks during pubertal developmental in rats
- Front. Behav. Neurosci., 4 (2010)
- Frantz et al., 2007
- K.J. Frantz, L.E. O’Dell, L.H. Parsons
- Behavioral and neurochemical responses to cocaine in periadolescent and adult rats
- Neuropsychopharmacol.: Off. Publ. Am. Coll. Neuropsychopharmacol., 32 (2007), pp. 625–637
|
|
- Kalivas and Volkow, 2005
- P.W. Kalivas, N.D. Volkow
- The neural basis of addiction: a pathology of motivation and choice
- Am. J. Psychiatry, 162 (2005), pp. 1403–1413
|
|
- Mitchell and Potenza, 2014
- M.R. Mitchell, M.N. Potenza
- Addictions and personality traits: impulsivity and related constructs
- Curr. Behav. Neurosci. Rep., 1 (2014), pp. 1–12
- Merline et al., 2004
- A.C. Merline, P.M. O’Malley, J.E. Schulenberg, J.G. Bachman, L.D. Johnston
- Substance use among adults 35 years of age: prevalence, adulthood predictors, and impact of adolescent substance use
- Am. J. Public Health, 94 (2004), pp. 96–102
|
|
- Mendez et al., 2010
- I.A. Mendez, N.W. Simon, N. Hart, M.R. Mitchell, J.R. Nation, P.J. Wellman, B. Setlow
- Self-administered cocaine causes lasting increases in impulsive choice in a delay discounting task
- Behav. Neurosci., 124 (2010), pp. 470–477
|
|
- McCutcheon et al., 2012
- J.E. McCutcheon, K.L. Conrad, S.B. Carr, K.A. Ford, D.S. McGehee, M. Marinelli
- Dopamine neurons in the ventral tegmental area fire faster in adolescent rats than in adults
- J. Neurophysiol., 108 (2012), pp. 1620–1630
|
|
- Matthews et al., 2013
- M. Matthews, C. Bondi, G.E. Torres, B. Moghaddam
- Reduced presynaptic dopamine activity in adolescent dorsal striatum
- Neuropsychopharmacology, 38 (2013), pp. 1344–1351
|
|
- Mathews and McCormick, 2012
- I.Z. Mathews, C.M. McCormick
- Role of medial prefrontal cortex dopamine in age differences in response to amphetamine in rats: locomotor activity after intra-mPFC injections of dopaminergic ligands
- Dev. Neurobiol., 72 (2012), pp. 1415–1421
|
|
- Magno et al., 2006
- E. Magno, J.J. Foxe, S. Molholm, I.H. Robertson, H. Garavan
- The anterior cingulate and error avoidance
- J. Neurosci., 26 (2006), pp. 4769–4773
|
|
- Lynd-Balta and Haber, 1994
- E. Lynd-Balta, S.N. Haber
- The organization of midbrain projections to the striatum in the primate: sensorimotor-related striatum versus ventral striatum
- Neuroscience, 59 (1994), pp. 625–640
|
|
|
- Ludewig et al., 2003
- K. Ludewig, M.P. Paulus, F.X. Vollenweider
- Behavioural dysregulation of decision-making in deficit but not nondeficit schizophrenia patients
- Psychiatry Res., 119 (2003), pp. 293–306
|
|
|
- Luciana et al., 2012
- M. Luciana, D. Wahlstrom, J.N. Porter, P.F. Collins
- Dopaminergic modulation of incentive motivation in adolescence: age-related changes in signaling, individual differences, and implications for the development of self-regulation
- Dev. Psychol., 48 (2012), pp. 844–861
|
|
- Leslie et al., 2004
- F.M. Leslie, S.E. Loughlin, R. Wang, L. Perez, S. Lotfipour, J.D. Belluzzia
- Adolescent development of forebrain stimulant responsiveness: insights from animal studies
- Ann. N. Y. Acad. Sci., 1021 (2004), pp. 148–159
|
|
- Kreitzer and Malenka, 2008
- A.C. Kreitzer, R.C. Malenka
- Striatal plasticity and basal ganglia circuit function
- Neuron, 60 (2008), pp. 543–554
|
|
|
- Kota et al., 2011
- D. Kota, S. Sanjakdar, M.J. Marks, O. Khabour, K. Alzoubi, M.I. Damaj
- Exploring behavioral and molecular mechanisms of nicotine reward in adolescent mice
- Biochem. Pharmacol., 82 (2011), pp. 1008–1014
|
|
|
- Kohno et al., 2013
- M. Kohno, D.G. Ghahremani, A.M. Morales, C.L. Robertson, K. Ishibashi, A.T. Morgan, M.A. Mandelkern, E.D. London
- Risk-taking behavior: dopamine D2/D3 receptors, feedback, and frontolimbic activity
- Cereb. Cortex (2013) Advance Access published August 21, 2013
- Kimchi et al., 2009
- E.Y. Kimchi, M.M. Torregrossa, J.R. Taylor, M. Laubach
- Neuronal correlates of instrumental learning in the dorsal striatum
- J. Neurophysiol., 102 (2009), pp. 475–489
|
|
- Kimchi and Laubach, 2009
- E.Y. Kimchi, M. Laubach
- Dynamic encoding of action selection by the medial striatum
- J. Neurosci., 29 (2009), pp. 3148–3159
|
|
- Kim and Moghaddam, 2012
- Y. Kim, B. Moghaddam
- VTA neural responses are different between adolescent and adult rats during appetitive instrumental learning and extinction
- Society for Neuroscience Abstracts 704.11/DDD73 (2012)
- Killcross and Coutureau, 2003
- S. Killcross, E. Coutureau
- Coordination of actions and habits in the medial prefrontal cortex of rats
- Cereb. Cortex, 13 (2003), pp. 400–408
|
|
- Kelley, 2004
- A.E. Kelley
- Ventral striatal control of appetitive motivation: role in ingestive behavior and reward-related learning
- Neurosci. biobehav. Rev., 27 (2004), pp. 765–776
|
|
|
- Mitchell et al., 2014
- M.R. Mitchell, V.G. Weiss, B.S. Beas, D. Morgan, J.L. Bizon, B. Setlow
- Adolescent risk taking, cocaine self-administration, and striatal dopamine signaling
- Neuropsychopharmacol.: Off. Publ. Am. Coll. Neuropsychopharmacol., 39 (2014), pp. 955–962
|
|
- Roesch and Olson, 2005
- M.R. Roesch, C.R. Olson
- Neuronal activity in primate orbitofrontal cortex reflects the value of time
- J. Neurophysiol., 94 (2005), pp. 2457–2471
|
|
- Robinson et al., 2011
- D.L. Robinson, D.L. Zitzman, K.J. Smith, L.P. Spear
- Fast dopamine release events in the nucleus accumbens of early adolescent rats
- Neuroscience, 176 (2011), pp. 296–307
|
|
|
- Robbins and Everitt, 1996
- T.W. Robbins, B.J. Everitt
- Neurobehavioural mechanisms of reward and motivation
- Curr. Opin. Neurobiol., 6 (1996), pp. 228–236
|
|
|
- Robbins and Everitt, 1992
- T.W. Robbins, B.J. Everitt
- Functions of dopamine in the dorsal and ventral striatum
- Semin. Neurosci., 4 (1992), pp. 119–127
|
|
|
- Reep et al., 2003
- R.L. Reep, J.L. Cheatwood, J.V. Corwin
- The associative striatum: organization of cortical projections to the dorsocentral striatum in rats
- J. Comp. Neurol., 467 (2003), pp. 271–292
|
|
- Ragozzino, 2007
- M.E. Ragozzino
- The contribution of the medial prefrontal cortex, orbitofrontal cortex, and dorsomedial striatum to behavioral flexibility
- Ann. N. Y. Acad. Sci., 1121 (2007), pp. 355–375
|
|
- Price, 2007
- J.L. Price
- Definition of the orbital cortex in relation to specific connections with limbic and visceral structures and other cortical regions
- Ann. N. Y. Acad. Sci., 1121 (2007), pp. 54–71
|
|
- Pezze et al., 2014
- M. Pezze, S. McGarrity, R. Mason, K.C. Fone, T. Bast
- Too little and too much: hypoactivation and disinhibition of medial prefrontal cortex cause attentional deficits
- J. Neurosci., 34 (2014), pp. 7931–7946
|
|
- Peters et al., 2008
- J. Peters, R.T. LaLumiere, P.W. Kalivas
- Infralimbic prefrontal cortex is responsible for inhibiting cocaine seeking in extinguished rats
- J. Neurosci., 28 (2008), pp. 6046–6053
|
|
- Perry et al., 2008
- J.L. Perry, S.E. Nelson, M.E. Carroll
- Impulsive choice as a predictor of acquisition of IV cocaine self-administration and reinstatement of cocaine-seeking behavior in male and female rats
- Exp. Clin. Psychopharmacol., 16 (2008), pp. 165–177
|
|
- Packard and White, 1991
- M.G. Packard, N.M. White
- Dissociation of hippocampus and caudate nucleus memory systems by posttraining intracerebral injection of dopamine agonists
- Behav. Neurosci., 105 (1991), pp. 295–306
|
|
- Packard and White, 1990
- M.G. Packard, N.M. White
- Lesions of the caudate nucleus selectively impair reference memory acquisition in the radial maze
- Behav. Neural Biol., 53 (1990), pp. 39–50
|
|
|
- Packard and Knowlton, 2002
- M.G. Packard, B.J. Knowlton
- Learning and memory functions of the basal ganglia
- Annu. Rev. Neurosci., 25 (2002), pp. 563–593
|
|
- O’Neill and Schultz, 2013
- M. O’Neill, W. Schultz
- Risk prediction error coding in orbitofrontal neurons
- J. Neurosci., 33 (2013), pp. 15810–15814
|
|
- Nolan et al., 2011
- K.A. Nolan, D. D’Angelo, M.J. Hoptman
- Self-report and laboratory measures of impulsivity in patients with schizophrenia or schizoaffective disorder and healthy controls
- Psychiatry Res., 187 (2011), pp. 301–303
|
|
|
- Niwa et al., 2013
- M. Niwa, H. Jaaro-Peled, S. Tankou, S. Seshadri, T. Hikida, Y. Matsumoto, N.G. Cascella, S.-i. Kano, N. Ozaki, T. Nabeshima, A. Sawa
- Adolescent stress-induced epigenetic control of dopaminergic neurons via glucocorticoids
- Science, 339 (2013), pp. 335–339
|
|
- Newman and McGaughy, 2011
- L.A. Newman, J. McGaughy
- Adolescent rats show cognitive rigidity in a test of attentional set shifting
- Dev. Psychobiol., 53 (2011), pp. 391–401
|
|
- Naneix et al., 2012
- F. Naneix, A.R. Marchand, G. Di Scala, J.-R. Pape, E. Coutureau
- Parallel maturation of goal-directed behavior and dopaminergic systems during adolescence
- J. Neurosci., 32 (2012), pp. 16223–16232
|
|
- Moghaddam and Wood, 2014
- B. Moghaddam, J. Wood
- Teamwork matters: coordinated neuronal activity in brain systems relevant to psychiatric disorders
- JAMA Psychiatry, 71 (2014), pp. 197–199
|
- Roesch et al., 2006
- M.R. Roesch, A.R. Taylor, G. Schoenbaum
- Encoding of time-discounted rewards in orbitofrontal cortex is independent of value representation
- Neuron, 51 (2006), pp. 509–520
|
|
|
- Sturman and Moghaddam, 2011b
- D.A. Sturman, B. Moghaddam
- Reduced neuronal inhibition and coordination of adolescent prefrontal cortex during motivated behavior
- J. Neurosci., 31 (2011), pp. 1471–1478
|
|
- Sturman and Moghaddam, 2011a
- D.A. Sturman, B. Moghaddam
- The neurobiology of adolescence: changes in brain architecture, functional dynamics, and behavioral tendencies
- Neurosci. Biobehav. Rev., 35 (2011), pp. 1704–1712
|
|
|
- Stanis and Andersen, 2014
- J. Stanis, S. Andersen
- Reducing substance use during adolescence: a translational framework for prevention
- Psychopharmacology, 231 (2014), pp. 1437–1453
|
- Spear, 2011
- L.P. Spear
- Rewards, aversions and affect in adolescence: emerging convergences across laboratory animal and human data
- Dev. Cognit. Neurosci., 1 (2011), pp. 390–403
|
|
|
- Spear, 2000
- L.P. Spear
- The adolescent brain and age-related behavioral manifestations
- Neurosci. Biobehav. Rev., 24 (2000), pp. 417–463
|
|
|
- Sowell et al., 1999
- E.R. Sowell, P.M. Thompson, C.J. Holmes, T.L. Jernigan, A.W. Toga
- In vivo evidence for post-adolescent brain maturation in frontal and striatal regions
- Nat. Neurosci., 2 (1999), pp. 859–861
|
|
- Sonntag et al., 2014
- K.C. Sonntag, H.C. Brenhouse, N. Freund, B.S. Thompson, M. Puhl, S.L. Andersen
- Viral over-expression of D1 dopamine receptors in the prefrontal cortex increase high-risk behaviors in adults: comparison with adolescents
- Psychopharmacology (Berlin), 231 (2014), pp. 1615–1626
|
|
- Somerville et al., 2011
- L.H. Somerville, T. Hare, B.J. Casey
- Frontostriatal maturation predicts cognitive control failure to appetitive cues in adolescents
- J. Cognit. Neurosci., 23 (2011), pp. 2123–2134
|
|
- Snyder et al., 2014
- K.P. Snyder, M. Barry, R.J. Valentino
- Cognitive impact of social stress and coping strategy throughout development
- Psychopharmacology (Berlin) (2014)
- Simon et al., 2013
- N.W. Simon, T.A. Gregory, J. Wood, B. Moghaddam
- Differences in response inhibition and behavioral flexibility between adolescent and adult rats
- Behav. Neurosci., 127 (2013), pp. 23–32
|
|
- Simon et al., 2011
- N.W. Simon, K.S. Montgomery, B.S. Beas, M.R. Mitchell, C.L. LaSarge, I.A. Mendez, C. Banuelos, C.M. Vokes, A.B. Taylor, R.P. Haberman, J.L. Bizon, B. Setlow
- Dopaminergic modulation of risky decision-making
- J. Neurosci., 31 (2011), pp. 17460–17470
|
- Simon et al., 2007
- N.W. Simon, I.A. Mendez, B. Setlow
- Cocaine exposure causes long term increases in impulsive choice
- Behav. Neurosci., 121 (2007), pp. 543–549
|
|
- Setlow et al., 2009
- B. Setlow, I.A. Mendez, M.R. Mitchell, N.W. Simon
- Effects of chronic administration of drugs of abuse on impulsive choice (delay discounting) in animal models
- Behav. Pharm., 20 (2009), pp. 380–389
|
|
- Sesack and Grace, 2010
- S.R. Sesack, A.A. Grace
- Cortico-basal ganglia reward network: microcircuitry
- Neuropsychopharmacology, 35 (2010), pp. 27–47
|
|
- Schultz, 1998
- W. Schultz
- Predictive reward signal of dopamine neurons
- J. Neurophysiol., 80 (1998), pp. 1–27
|
- Schramm-Sapyta et al., 2009
- N.L. Schramm-Sapyta, Q.D. Walker, J.M. Caster, E.D. Levin, C.M. Kuhn
- Are adolescents more vulnerable to drug addiction than adults? Evidence from animal models
- Psychopharmacology (Berlin), 206 (2009), pp. 1–21
|
|
- Schoenbaum et al., 2011
- G. Schoenbaum, Y. Takahashi, T-L. Liu, M.A. McDannald
- Does the orbitofrontal cortex signal value?
- Ann. N. Y. Acad. Sci., 9 (2011), pp. 1287–1299
- Schochet et al., 2005
- T.L. Schochet, A.E. Kelley, C.F. Landry
- Differential expression of arc mRNA and other plasticity-related genes induced by nicotine in adolescent rat forebrain
- Neuroscience, 135 (2005), pp. 285–297
|
|
|
- Rolls and Grabenhorst, 2008
- E.T. Rolls, F. Grabenhorst
- The orbitofrontal cortex and beyond: from affect to decision-making
- Prog. Neurobiol., 86 (2008), pp. 216–244
|
|
|
- Sturman and Moghaddam, 2012
- D.A. Sturman, B. Moghaddam
- Striatum processes reward differently in adolescents versus adults
- Proc. Natl. Acad. Sci., 109 (2012), pp. 1719–1724
|
|
- Wood et al., 2012
- J. Wood, Y. Kim, B. Moghaddam
- Disruption of prefrontal cortex large scale neuronal activity by different classes of psychotomimetic drugs
- J. Neurosci., 32 (2012), pp. 3022–3031
|
|
- Wise and Bozarth, 1985
- R.A. Wise, M.A. Bozarth
- Brain mechanisms of drug reward and euphoria
- Psychiatric Med., 3 (1985), pp. 445–460
|
- Wise, 2004
- R.A. Wise
- Dopamine, learning and motivation
- Nat. Rev. Neurosci., 5 (2004), pp. 483–494
|
|
- Winstanley et al., 2010
- C.A. Winstanley, F.D. Zeeb, A. Bedard, K. Fu, B. Lai, C. Steele, A.C. Wong
- Dopaminergic modulation of the orbitofrontal cortex affects attention, motivation and impulsive responding in rats performing the five-choice serial reaction time task
- Behav. Brain Res., 210 (2010), pp. 263–272
|
|
|
- Winstanley, 2007
- C.A. Winstanley
- The orbitofrontal cortex, impulsivity, and addiction: probing orbitofrontal dysfunction at the neural, neurochemical, and molecular level
- Ann. N. Y. Acad. Sci., 1121 (2007), pp. 639–655
|
|
- Walker et al., 2010
- Q.D. Walker, S.E. Morris, A.E. Arrant, J.M. Nagel, S. Parylak, G. Zhou, J.M. Caster, C.M. Kuhn
- Dopamine uptake inhibitors but not dopamine releasers induce greater increases in motor behavior and extracellular dopamine in adolescent rats than in adult male rats
- J. Pharmacol. Exp. Ther., 335 (2010), pp. 124–132
|
|
- Walker and Kuhn, 2008
- Q.D. Walker, C.M. Kuhn
- Cocaine increases stimulated dopamine release more in periadolescent than adult rats
- Neurotoxicol. Teratol., 30 (2008), pp. 412–418
|
|
|
- Voorn et al., 2004
- P. Voorn, L.J. Vanderschuren, H.J. Groenewegen, T.W. Robbins, C.M. Pennartz
- Putting a spin on the dorsal–ventral divide of the striatum
- Trends Neurosci., 27 (2004), pp. 468–474
|
|
|
- Volz et al., 2009
- T.J. Volz, S.J. Farnsworth, S.D. Rowley, G.R. Hanson, A.E. Fleckenstein
- Age-dependent differences in dopamine transporter and vesicular monoamine transporter-2 function and their implications for methamphetamine neurotoxicity
- Synapse, 63 (2009), pp. 147–151
|
- Van Leijenhorst et al., 2010
- L. Van Leijenhorst, B. Gunther Moor, Z.A. Op de Macks, S.A. Rombouts, P.M. Westenberg, E.A. Crone
- Adolescent risky decision-making: neurocognitive development of reward and control regions
- NeuroImage, 51 (2010), pp. 345–355
|
|
|
- van Duuren et al., 2007
- E. van Duuren, F.A.N. Escamez, R.N.J.M.A. Joosten, R. Visser, A.B. Mulder, C.M.A. Pennartz
- Neural coding of reward magnitude in the orbitofrontal cortex of the rat during a five-odor olfactory discrimination task
- Learn Mem., 14 (2007), pp. 446–456
|
|
- Ungerstedt, 1971
- U. Ungerstedt
- Stereotaxic mapping of the monoamine pathways in the rat brain
- Acta Physiol. Scand. Suppl., 367 (1971), pp. 1–48
|
|
- Uhlhaas and Singer, 2012
- P.J. Uhlhaas, W. Singer
- Neuronal dynamics and neuropsychiatric disorders: toward a translational paradigm for dysfunctional large-scale networks
- Neuron, 75 (2012), pp. 963–980
|
|
|
- Thorn et al., 2010
- C.A. Thorn, H. Atallah, M. Howe, A.M. Graybiel
- Differential dynamics of activity changes in dorsolateral and dorsomedial striatal loops during learning
- Neuron, 66 (2010), pp. 781–795
|
|
|
- Teicher et al., 1995
- M.H. Teicher, S.L. Andersen, J.C. Hostetter Jr.
- Evidence for dopamine receptor pruning between adolescence and adulthood in striatum but not nucleus accumbens
- Dev. Brain Res., 89 (1995), pp. 167–172
|
|
|
- Taylor Tavares et al., 2007
- J.V. Taylor Tavares, L. Clark, D.M. Cannon, K. Erickson, W.C. Drevets, B.J. Sahakian
- Distinct profiles of neurocognitive function in unmedicated unipolar depression and bipolar II depression
- Biol. Psychiatry, 62 (2007), pp. 917–924
|
|
|
- Tarazi et al., 1998
- F.I. Tarazi, E.C. Tomasini, R.J. Baldessarini
- Postnatal development of dopamine and serotonin transporters in rat caudate-putamen and nucleus accumbens septi
- Neurosci. Lett., 254 (1998), pp. 21–24
|
|
|
- Tarazi and Baldessarini, 2000
- F.I. Tarazi, R.J. Baldessarini
- Comparative postnatal development of dopamine D1, D2 and D4 receptors in rat forebrain
- Int. J. Dev. Neurosci., 18 (2000), pp. 29–37
|
|
|
- Sturman et al., 2010
- D.A. Sturman, D.R. Mandell, B. Moghaddam
- Adolescents exhibit behavioral differences from adults during instrumental learning and extinction
- Behav. Neurosci., 124 (2010), pp. 16–25
|
|
- Yin and Knowlton, 2004
- H.H. Yin, B.J. Knowlton
- Contributions of striatal subregions to place and response learning
- Learn Mem., 11 (2004), pp. 459–463
|
|
- Zeeb et al., 2010
- F. Zeeb, S. Floresco, C. Winstanley
- Contributions of the orbitofrontal cortex to impulsive choice: interactions with basal levels of impulsivity, dopamine signalling, and reward-related cues
- Psychopharmacology, 211 (2010), pp. 87–98
|
|
- Yin et al., 2009
- H.H. Yin, S.P. Mulcare, M.R. Hilario, E. Clouse, T. Holloway, M.I. Davis, A.C. Hansson, D.M. Lovinger, R.M. Costa
- Dynamic reorganization of striatal circuits during the acquisition and consolidation of a skill
- Nat. Neurosci., 12 (2009), pp. 333–341
|
|
- Yin et al., 2004
- H.H. Yin, B.J. Knowlton, B.W. Balleine
- Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning
- Eur. J. Neurosci., 19 (2004), pp. 181–189
|
|
- Corresponding author at: University of Pittsburgh, Department of Neuroscience, A210 Langley Hall, Pittsburgh, PA 15260, United States. Tel.: +1 412 624 2653; fax: +1 412 624 9198.