Addict Behav. 2018 Feb 12;81:157-166. doi: 10.1016/j.addbeh.2018.02.017.
Ioannidis K1, Treder MS2, Chamberlain SR1, Kiraly F3, Redden SA4, Stein DJ5, Lochner C6, Grant JE7.
Abstract
BACKGROUND AND AIMS:
Problematic internet use (PIU; otherwise known as Internet Addiction) is a growing problem in modern societies. There is scarce knowledge of the demographic variables and specific internet activities associated with PIU and a limited understanding of how PIU should be conceptualized. Our aim was to identify specific internet activities associated with PIU and explore the moderating role of age and gender in those associations.
METHODS:
We recruited 1749 participants aged 18 and above via media advertisements in an Internet-based survey at two sites, one in the US, and one in South Africa; we utilized Lasso regression for the analysis.
RESULTS:
Specific internet activities were associated with higher problematic internet use scores, including general surfing (lasso β: 2.1), internet gaming (β: 0.6), online shopping (β: 1.4), use of online auction websites (β: 0.027), social networking (β: 0.46) and use of online pornography (β: 1.0). Age moderated the relationship between PIU and role-playing-games (β: 0.33), online gambling (β: 0.15), use of auction websites (β: 0.35) and streaming media (β: 0.35), with older age associated with higher levels of PIU. There was inconclusive evidence for gender and gender × internet activities being associated with problematic internet use scores. Attention-deficit hyperactivity disorder (ADHD) and social anxiety disorder were associated with high PIU scores in young participants (age ≤ 25, β: 0.35 and 0.65 respectively), whereas generalized anxiety disorder (GAD) and obsessive-compulsive disorder (OCD) were associated with high PIU scores in the older participants (age > 55, β: 6.4 and 4.3 respectively).
CONCLUSIONS:
Many types of online behavior (e.g. shopping, pornography, general surfing) bear a stronger relationship with maladaptive use of the internet than gaming supporting the diagnostic classification of problematic internet use as a multifaceted disorder. Furthermore, internet activities and psychiatric diagnoses associated with problematic internet use vary with age, with public health implications.
KEYWORDS: Behavioral addiction; Internet addiction; Internet gaming disorder; Lasso; Machine learning; Problematic internet use
PMID: 29459201
DOI: 10.1016/j.addbeh.2018.02.017
1
Introduction
Problematic internet use (PIU; otherwise known as Internet Addiction), is a public health concern in modern societies across the globe. The epidemiology of PIU is still unclear (
; ) with a wide range of reported point prevalence estimates (1% to 36.7%), likely reflecting not only population differences but also the diversity of assessment tools and different operational definitions of PIU behaviors. DSM-5 has highlighted Internet gaming disorder as a condition for further study ( ), specifically excluding other internet based activities like gambling and use of social media, despite the accumulating evidence that problematic internet use is a multifaceted problem that goes beyond online gaming ( ; ; ). Many different online behaviors have been described as being capable of impairing normal functioning when undertaken to excess, including online gaming and massively-multiplayer online role-playing-games ( ; ; ; ; ; ), online gambling ( ; ), online shopping ( ; ; ), viewing pornography ( ; ; ), frequent email checking, instant messaging ( ; ; ) and overuse of social media ( ; ). Online behaviors can also cause concern for individuals’ physical health ( ; ) or lay the ground for criminal acts ( ). Impulsive and compulsive characteristics may underpin problematic internet behaviors ( ; ; ; ; ), while specific internet activities have been linked with psychiatric disorders; for example, online shopping has been linked with depression and hoarding (
).
Young people and students are considered to be most vulnerable for PIU (
; ; ; ; ), but middle-aged and older populations have not been comprehensively investigated. Young age has been associated with problematic online shopping ( ; ). However, there have been a number of studies identifying problematic internet activities, including excessive internet based shopping, in adult populations (
). Overall, the natural history of problematic internet use is still unknown and there may be age related differences in PIU overall, or in different problematic online behaviors.
PIU has been considered to have a male preponderance (
; ) and is likely more prevalent among Asian male youth, but females can also be vulnerable ( ; ). On a clinical level, the majority of PIU studies included male participants only ( ) and it is unclear whether female clinical populations may have been understudied. There is some evidence from observational studies that males and females differ in the way they operate in the online environment in terms of activities they choose and their negative consequences ( ; ). Excessive use of chatting and social media has been associated with female gender in young students ( ; ; ; ; S ). Female gender has also been identified as a predictor of problematic online shopping ( ), but the opposite has also been reported ( ; ). Online gaming has been associated with male gender ( ), but massively multiplayer online role-play gaming has been reported in both genders ( ). Online pornography as well as online gambling have been reported to be more frequent among adult males ( ), however, it has been argued that the role of reward reinforcement, cue reactivity and craving of online sex are similar for both genders ( ). Particular platforms of social media with addictive potential, such as networking sites like Facebook, are used by both genders and it has been argued that females might be particularly at risk ( ). Overall, there might be gender-specific differences for aspects of PIU; alternatively, it may be that once clinical and behavioral characteristics/confounds are taken into account, both genders are similarly affected ( ; ;
).
Overall, problematic internet use including the wide variety of problematic internet behaviors require more rigorous investigations that would shed light onto which specific activities should be regarded as problematic or dysfunctional or in general contributing to the phenomenon described as PIU. The way in which age and gender moderate the relationship between particular internet activities and PIU has been understudied, warranting more attention.
Our objective was to identify specific internet-related activities statistically associated with PIU and whether there are interactions with age or gender that moderate those relationships.
2
Material and methods
2.1
Setting and measures
More details about the setting and measures of this study have also been described in our previous publication on PIU (
). Reporting of methods for this study follows the STROBE guideline (
). The current study was conducted from January 2014–February 2015. Individuals aged 18 years and above were recruited at two sites: Chicago (USA) and Stellenbosch (South Africa) using internet advertisements (mean age 29 [18–77]; 1119 males [64%]; 1285 Caucasian [73%]). The advertisements asked individuals to take part in an online survey about internet use. Participants completed the survey anonymously using Survey Monkey software. The survey was sent through Craigslist so only participants from the specific locales were targeted. The study was approved by the institutional review boards at each research site. Participants received no compensation for taking part but were enrolled in a random lottery whereby five prizes were available with each prize valued between $50 and $200 in USA and three prizes between ZAR250 and ZAR750 in South Africa.
The online survey contained questions about each individual’s age, gender, race, relationship status, sexual orientation and education background, along with various measures of specific internet activities. We measured a number of different internet activities including 1) general surfing 2) internet gaming total 3) Online role playing games (RPG) 4) Time wasters/skill games (i.e. Apps on iPod/iPad/cell phone, Tetris, Jewels) 5) Online action multiplayer (i.e. Call of Duty, Gears of War) 6) Online shopping 7) Auction websites (i.e. Ebay) 8) Online gambling 9) Social networking 10) Online sports (i.e. Fantasy sports, ESPN) 11) Pornography/Sex on internet 12) Messaging/Blogging (i.e. AIM, Skype) and 13) Streaming videos/media (i.e. YouTube, Hulu). The survey also included clinical measures: the Internet Addiction Test (IAT) (
) to provide a measure of maladaptive internet use; select Mini International Neuropsychiatric Interview (MINI) modules ( ) to identify probable social anxiety disorder (SAD), generalized anxiety disorder (GAD) and obsessive-compulsive disorder (OCD); the Adult ADHD Self-Report Scale Symptom Checklist (ASRS-v1.1) ( ) to identify attention-deficit hyperactivity disorder (ADHD) symptoms; the Padua Inventory (PI) ( ) to identify obsessive-compulsive tendencies; and the Barratt Impulsiveness Scale (BIS-11) to quantify impulsive personality (
). Descriptive statistics for all variables are summarized and stratified by age in Supplementary Table S1a.
The IAT comprises 20 questions examining facets of PIU. Scores on the IAT range from 20 to 100 with 20–49 reflecting mild Internet use, 50–79 moderate Internet use, and 80–100 reflecting severe Internet use. The PI consists of 39 items assessing common obsessional and compulsive behavior. The BIS-11 is a self-report questionnaire used to determine levels of impulsiveness.
We performed a Principal Components Analysis (PCA) to identify whether a few components of internet activities would be able to account for a significant portion of the variance. However, this analysis showed that we required >11 out of 13 components to achieve >90% of variance indicating that a significant portion of the variables of internet activities contribute uniquely to the variance. We therefore decided to use each variable separately in our analysis.
Only data from participants who completed the entirety of the online survey, including the internet activity measures, were included in the analyses. The original sample included 2551 individuals. 63 individuals were excluded for lacking IAT scores. A further 18 individuals were excluded for reporting transgender gender and 459 for missing important predictor variables e.g. PI or BIS questionnaire scores. Five individuals were excluded for reporting age <18 years old. A further 257 individuals were excluded due to missing measures of internet activity. The final full set included 1749 individuals with complete scores on all variables. This last step of exclusion process accounts for the sample difference between the present study and
. This final full set included 1063 individuals from the Stellenbosch site and 686 individuals from the Chicago site. The estimated point prevalence of PIU was ~8.5% using an IAT cut-off of 50 or above. Comparing the two study site populations, the Stellenbosch site had younger participants [mean(range) 24.3(18–76) vs 36.3(18–77), ANOVA F < 0.05, η 2 : 0.20], a lower proportion of male gender [58% vs 73%, χ 2 < 0.05, φ :0.15], higher proportion of heterosexual sexual orientation [91% vs 84%, χ 2 < 0.05, φ :0.10], higher rates of ADHD [50% vs 41% χ 2 < 0.05, φ :0.9], lower rates of online shopping [mean(range) 0.48(0–5) vs 1.27(0–5), ANOVA F < 0.05, η 2 : 0.18] and slightly lower IAT scores [mean(range) 30.3(20–94) vs 35.9(20–85), ANOVA F < 0.05, η 2 : 0.06]. A more detailed comparison is presented in the Supplementary Table S1b. Recruitment and exclusion process are graphically presented in Fig. 1 . All continuous variables (i.e. BIS score) were standardized to increase the interpretability of the model coefficients. The prediction methods used the IAT score as a numeric variable (Range 20–94, Mean 32.48). All analyses were undertaken in R Studio version 3.1.2. Lasso Generalized Linear Models were performed using the “glmnet” package (Package glmnet version 2.0–5 (
)). More details about the analysis process can be found in the Supplement (methodology appendix).
2.2
Exploration of correlations
We explored correlations between the variables in our data (see Fig. 2 ). All different internet activities had weak positive correlations with the IAT score (Pearson correlation coefficient range 0.23–0.48). Some moderate positive correlations between internet activity variables were identified i.e. total internet gaming and RPG (r = 0.57), total internet gaming and action multiplayer games (r = 0.55), online shopping and use of auction websites (r = 0.55), general surfing and shopping (r = 0.44), general surfing and social networking (r = 0.44), general surfing and streaming media (r = 0.44). There were weak positive correlations between sports and pornography (r = 0.38), male gender and sports (r = 0.30) or pornography (r = 0.39) or action multiplayer gaming (r = 0.27). There were weak correlations between online gambling and action multiplayer (r = 0.41), RGP (r = 0.32), auction websites (r = 0.38), sports (r = 0.38) or pornography (r = 0.39). Impulsivity was weakly positively correlated with general surfing, online shopping, use of auction websites, social networking, streaming media and pornography (0.2 ≤ r ≤ 0.3). There was also a weak correlation between older age and shopping activities (r = 0.33) or use of auction websites (r = 0.22), and between non-heterosexual sexual orientation and pornography (r = 0.22). All other correlations between internet activities and age, gender, relationship status, sexual orientation, level of education, race and levels of impulsivity and compulsivity were very weak (−0.2 < r < 0.2).
2.3
Dealing with over-fitting
For our statistical methods we used models that included demographic variables (age, race, education level, gender, relationship status, sexual orientation), clinical characteristics (diagnoses of ADHD, GAD, Social Anxiety and OCD), behavioral dimensions known to be associated with PIU (impulsivity and compulsivity), internet activities and interaction terms between Internet activities × Age or Gender; the latter was decided to test the hypothesis that age or gender moderate the relationship between internet activities and problematic internet use scores. We included a total of 51 predictor variables. By including a plethora of variables we aimed for a model that is more accurate and at the same time captures complex interactions between demographic and internet activity variables. However, the downside of having many predictor variables is that this typically leads to over-fitting accompanied by large coefficients. Furthermore, in-sample linear regression also tends to over-fit, especially in complex models, and is fundamentally flawed in making predictions on new data. There is extensive evidence of the downsides of over-fitting models (
). To deal with over-fitting, we have discussed using out-of-sample statistical methods (cross-validation) to get an estimate of the generalization and prediction error of the model (
). We explored this approach in our current data when we used an out-of-sample cross-validated estimation of the root-mean-squared-error in conjunction with backward selection of variables to test whether models improve by adding a high number of variables in the subsets of possible combinations of predictors, and we saw that sparse models (i.e. with about between 13 and 16 variables) were non-inferior in terms of cross-validated RMSE compared to more complex models (including >16 variables). This is shown in exploratory Fig. 3 (top left).
2.4
Regularized regression with sparsity constraints
For the reasons mentioned in the previous paragraph, we wanted to use a method of prediction that would not over-fit as much, while being comparable to standard statistical methods in terms of predicting PIU scores. It would also be valuable if our method could also do variable selection (i.e. by reducing the number of predictors with non-zero coefficients), in order to help with the interpretability of the model. Regularization, initially designed by Tikhonov to solve integral equations (
) and later introduced in statistical science by has some of the desired aforementioned properties of shifting model construction towards sparsity and reducing over-fitting ( ). Lasso (generalized linear model with penalized maximum likelihood, known as regression using Least Absolute Shrinkage and Selection Operator (Lasso or LASSO ( ))) is a regularization and regression analysis method now often used in medical sciences ( ; ) and has potential for use in clinical prediction modeling in psychiatry (R C ). Ridge regression is another form of regularized linear regression that shrinks coefficients by introducing a coefficient penalty ( ). The elastic-net is an intermediate model between ridge and lasso and its penalty is controlled by α, which bridges the gap between Lasso (α = 1) and ridge (α = 0). The tuning parameter λ controls the overall strength of the penalty. Lasso uses the L1 penalty and ridge uses the L2 penalty. In contrast to ridge regression, the effect of the Lasso L1 penalty is that most coefficients are driven to zero, leading to a regularized solution that is sparse at the same time. By this mechanism, the Lasso performs variable selection which can greatly simplify interpretation especially if many predictors are involved in the model. Another non-standard method known for high accuracy and ability to avoid over fitting is random forests (
). Random forests are a machine learning method that performs well against non-linear dependencies and therefore, exploring the performance of this model could give us insight into, possibly ‘hidden’, complex associations.
2.5
Prediction methods
To choose the appropriate model in our analysis, we compared linear regression, ridge regression, elastic-net, Lasso and random forest models with one another and against a naïve baseline, using a cross-validated out-of-sample estimate of RMSE. Our cross-validation included randomly splitting the data in a training and testing set, tuning the model parameters in the training set and making predictions for IAT scores in the testing set. Due to the random nature of splitting the data into folds, we repeated this process 50 times to get a stable and replicable estimate. We then compared the final vectors of RMSE scores using Exact Wilcoxon-Pratt signed rank tests. All models were significantly superior to the naïve baseline (p corrected <0.001, Cohen’s d = −0.87) (see Supplementary Table S2). Summary statistics of RMSE scores are presented in Supplementary Table S3. Lasso and elastic net were superior to ridge regression (p-corrected <0.01, d = 0.51, d = 0.49) and linear regression (p corrected <0.001, d = 0.76) and not statistically different between each other (p corrected >0.05, d = −0.08). Random forest was non-superior to either lasso (p = 0.12) or elastic net (p corrected >0.05). Therefore, in our analysis, we used Lasso, because, further to good out-of-sample prediction performance, Lasso was able to perform variable selection by shrinking coefficients to zero and therefore increasing interpretability. Although the elastic net can also perform variable selection, it tends to select more variables, and despite being a more complex and more powerful model, it did not give significantly better performance than lasso. In our final analysis full data and subgroup analyses, we used 10-fold cross-validation to produce the optimal lambda for each lasso model and report coefficients produced by those models. Explanatory plots deriving from the full data analysis are presented in Fig. 3 .
3
Results
Lasso regression results are summarized in the whole sample and stratified by age in Tables 1 and 2 . Full tables of results for subgroup analyses, including stratified by age and by study site are presented in the online Supplementary tables (Tables S4–S10). Exploratory plots of the data are presented in Supplementary figures (Figs. S1–S3). Results from the more standard statistical approach of linear regression are also presented in Supplementary Tables S4–S10 and any differences in structural inference compared to the main results presented below are conditional upon the choice of another model.
| Internet activity | All (n = 1749) | 18 ≤ Age ≤ 25 (n = 1042) | 26 ≤ Age ≤ 55 (n = 592) | Age > 55 (n = 115) |
|---|---|---|---|---|
| General surfing | 2.100 | 2.400 | 1.500 | 0.590 |
| Internet gaming | 0.600 | 0.450 | 0.110 | 0.000 |
| RPG | 0.000 | 0.000 | 0.710 | 0.000 |
| Time wasters | 0.000 | 0.000 | 0.000 | 0.450 |
| Action multiplayer | 0.000 | 0.000 | 0.000 | 0.000 |
| Shopping | 1.400 | 0.840 | 1.500 | 0.000 |
| Auction websites | 0.027 | 0.000 | 0.990 | 0.230 |
| Gambling | 0.000 | 0.000 | 0.780 | 0.000 |
| Social networking | 0.460 | 0.000 | 1.300 | 0.000 |
| Sports | 0.000 | 0.000 | 0.000 | 0.000 |
| Pornography | 1.000 | 1.400 | 0.210 | 0.000 |
| Messaging | 0.000 | 0.000 | 0.110 | 0.000 |
| Streaming media | 0.000 | 0.000 | 0.000 | 1.200 |
| PADUA | 0.074 | 0.085 | 0.029 | 0.065 |
| BIS | 0.066 | 0.048 | 0.072 | 0.086 |
| ADHD Diagnosis | 1.700 | 0.350 | 3.100 | 0.000 |
| GAD diagnosis | 0.230 | 0.000 | 0.000 | 6.400 |
| Social anxiety diagnosis | 0.000 | 0.560 | 0.000 | 0.000 |
| OCD diagnosis | 0.270 | 0.000 | 0.000 | 4.300 |
| Internet activity | All (n = 1749) | 18 ≤ Age ≤ 25 (n = 1042) | 26 ≤ Age ≤ 55 (n = 592) | Age > 55 (n = 115) |
|---|---|---|---|---|
| Demographic variables | 0.000 | 0.000 | 0.000 | 0.000 |
| Gender × any Internet activity | 0.000 | 0.000 | 0.000 | 0.000 |
| Age × general surfing | 0.000 | – | – | – |
| Age × Internet gaming | 0.000 | – | – | – |
| Age × RPG | 0.330 | – | – | – |
| Age × time wasters | 0.000 | – | – | – |
| Age × action multiplayer | 0.000 | – | – | – |
| Age × shopping | 0.000 | – | – | – |
| Age × gambling | 0.150 | – | – | – |
| Age × auction websites | 0.350 | – | – | – |
| Age × social networking | 0.000 | – | – | – |
| Age × sports | 0.000 | – | – | – |
| Age × pornography | 0.000 | – | – | – |
| Age × messaging | 0.000 | – | – | – |
| Age × streaming media | 0.350 | – | – | – |
3.1
Demographics
In lasso regression no variable including age, gender, race, education level, relationship status or sexual orientation was associated with PIU in any age subgroup or in the full data.
3.2
Internet activities
In the full data Lasso regression, a number of internet activities were associated with high PIU scores including general surfing (β: 2.1), internet gaming (β: 0.6), online shopping (β: 1.4), use of auction websites (β: 0.027), social networking (β: 0.46) and use of online pornography (β: 1.0). The relationships between PIU and role-playing-games (RPGs), online gambling, use of auction websites and using streaming media were moderated by age (β: 0.33, 0.15, 0.35 and 0.35 respectively), with older age associated with higher PIU scores. In age-subgroup analysis (young participants age ≤ 25, middle age participants 25 < age ≤ 55; older participants age > 55), general surfing was associated with PIU in all age groups, but more strongly in the young (β: 2.4), less in the middle aged (β: 1.5), and even less in the older participants (β: 0.59). A similar trend was seen in internet gaming (β: 0.45, 0.11 and 0.0 for the three age groups respectively) and use of online pornography (β: 1.4, 0.21 and 0.0). Some internet activities such as use of online RPGs were more strongly associated with PIU in middle aged participants compared to other age groups (β: 0.71). The same was true for online gambling (β: 0.78), instant messaging (β: 0.11) and online social networking (β: 1.3). Use of auction websites was also more strongly associated with PIU in middle aged participants (β: 0.99), but also predictive in the older participants (β: 0.23). Streaming online media and use of time wasters were associated with PIU in the older participants (β: 1.2, 0.45 respectively), but not in any other age group.
3.3
Clinical and behavioral characteristics
Symptoms of attention-deficit hyperactivity disorder (ADHD) (β: 1.7), generalized anxiety disorder (GAD) (β: 0.23) and obsessive-compulsive disorder (OCD) (β: 0.27) were associated with higher PIU scores. In age-subgroup analysis, ADHD and SAD were associated with higher PIU scores in younger participants (β: 0.35 and 0.56 respectively), while ADHD remained significant in the middle-aged subgroup (β: 3.1). GAD and OCD were associated with higher PIU scores in the older participants subgroup (β: 6.4 and 4.3 respectively), but not in the other age groups. BIS scores (impulsive personality) and PADUA scores (obsessive-compulsive tendencies) were associated with higher PIU scores in the full data (β: 0.066 and 0.074 respectively) and in all age subgroups analyses.
4
Discussion
This paper is the first attempt to comprehensively explore the different types of internet activities associated with maladaptive use of the internet, i.e. with problematic internet use. Previous work has generally tackled the issue of specific internet activities leading to problematic use by focusing on isolated internet activities (
; ; ; ; ). We have shown here that a range of internet activities, including general surfing, internet gaming, online shopping, use of auction websites, online gambling, social networking and use of online pornography contribute separately and uniquely to PIU, providing evidence that PIU is a complex phenomenon comprising a variety of problematic behaviors. Further to that, we have shown that those behaviors retain their statistically significant associations with PIU, even when psychiatric symptoms known to be associated with PIU (i.e. symptoms of ADHD, GAD and OCD) ( ; ) and dimensions of behavior known to be predictive of PIU (i.e. personality measures of impulsivity and compulsivity) ( ; ; ;
) are taken into account. We have further demonstrated that specific internet activities like RPG, online gambling, use of auction websites and streaming media are associated with higher PIU scores and that this relationship is influenced by age. Finally, our data show that other types of online behavior (e.g. shopping, pornography, general surfing) bear a stronger relationship with maladaptive use of the internet than gaming and it is possible that this relates to the fact that previous studies have not included such a wide array of internet-related activities. These results have significant implications for the conceptualization of PIU as a clinically meaningful disorder, as they draw the attention away from the unidimensional and relatively narrow construct of ‘Internet gaming disorder’, towards a multidimensional entity of problematic internet use or internet addiction comprising multiple facets of human online behavior.
Moreover, using out-of-sample cross validation we have shown that the ‘non-standard’ approach of using Lasso regression is more accurate in predicting PIU scores as compared to the ‘more standard’ linear regression. Using out-of-sample estimation of the predictive value of a model often helps with tackling the phenomenon by which significances decay in replication studies. However, the choice of Lasso regression comes with the caveat that variables which are not selected by the model (with zero coefficients) can still be predictive, especially when there are high correlations between selected and non-selected variables. In our data set, we did not have any highly correlated variables, nevertheless, this limitation means that we should treat any negative results conservatively. For example, the lack of association between gender and PIU as well as the lack of association between gender × Internet activities with PIU arguably supports the hypothesis that if a wider range of PIU behaviors and potential confounders are taken into account, both genders are equally vulnerable to developing facets of PIU (
; ). However, due to the limitations of our analysis, we cannot exclude the possibility that other associations between PIU and gender exist. For example, it has been suggested that gender moderates the relationship between online shopping and PIU and that females may be more at risk ( ). Of relevance may be that compulsive buying disorder, a disorder that is prominent in middle aged groups has a female predominance by 5:1 ratio ( ), and may be driving such findings. We did not have any data on this disorder to test this hypothesis. It is also important to note, that the IAT instrument used here has received critique on its lack of robustness concerning factor structure, differences from current DSM-5 operationalization (gaming disorder) and lagging behind the technological advances of internet applications ( ;
). Future PIU research would be well served by methodologically robust, validated instruments, which would also be able to capture the quickly evolving nature of PIU from a technological and behavioral perspective.
Our age-subgroup analysis provided insight into the age related associations between PIU and various internet activities. The common conception that PIU is a disorder of youth is not necessarily correct and may be based on the lack of appropriately designed studies that capture online behaviors across all age groups. Insufficient knowledge for the natural history of PIU across the lifespan does not allow a comprehensive exploration of vulnerabilities in the older populations in terms of risk to develop PIU. However, our results indicate that those vulnerabilities do exist and further research is warranted to map out the characteristics of the populations at risk. For example, having ADHD or social anxiety symptoms may be a predictor for PIU in young populations, whereas having OCD or GAD symptoms may be a predictor for PIU in older populations. The fact that OCD was not found to be associated with PIU in a recent meta-analysis (
) may be an indicator that older populations have been understudied. The fact that ADHD was strongly associated with high PIU scores is not surprising, as other studies have reported a very high prevalence of ADHD (up to 100%) in PIU populations ( ). At the same time, specific middle aged populations (between 26 and 55) may be more at risk of PIU, if they also suffer from compulsive buying disorder or gambling disorder, given the natural history of those disorders, which peak in middle age (
).
Furthermore, the findings that a particular online activity was associated with PIU only in specific age groups, imply that particular age groups may be at risk of developing aspects of PIU. While young people might be more at risk of developing PIU with a propensity for viewing pornography, a vulnerability that may be less strong in middle age and wane later on in life, older people might be more prone to develop PIU characterized by problematic use of time wasters and streaming media (see exploratory Fig. 4 ). Finally, general surfing might be an underestimated facet of PIU, which seems to be more strongly associated with higher PIU scores in young people, but important across all age groups; this finding may be related to the fact that early adult life can be less goal directed and the young people are spending more time during unstructured activities in online environments compared to other older age groups.
Our results also have public health implications in relation to the regulation of online content, and targeting interventions. If particular activities are more strongly linked with the development of problematic use than others, then the question arises as to whether public health policies should be targeting groups of vulnerable individuals to improve their resilience towards risk of PIU, or whether more universal interventions targeting specific facets of internet behaviors, should be considered to make the online environments less addictive. For example, online platforms may in some cases be using specific architectures that take advantage of users’ vulnerabilities (i.e. impulsive or compulsive traits) and that aim to maximize users’ length of stay within the online environment. While this makes sense from a marketing perspective, it does raise concern of whether these environments should also issue a health warning to the user.
4.1
Limitations
This was a cross-sectional online survey, therefore no causal relationships can be drawn. Moreover, because of the recruitment methodology, and possible propensity for people with PIU to be more likely to complete an online survey, the current findings may not generalize to PIU in the general background population at large. Another limitation of our study is the lack of clinical data for some diagnostic entities associated with PIU, for example depression or substance misuse. Therefore, it is possible that depression or substance misuse could account for some of the associations observed in our study. Future studies should include a wider range of clinical parameters to explore whether those account for associations observed between PIU and internet activities. There are further limitations in regards to our clinical data deriving from using the MINI; this is validated to be delivered from a trained person in a face-to-face interview whereas in our study it was delivered via an online tool. However, our clinical data are in agreement with previous studies in PIU. Furthermore, another downside to our data collection, was that we assessed internet activity using time spent on the activity as proxy measure for PIU of that activity. While this can capture excessive, and therefore problematic use, it can also possibly capture essential use. While the activities assessed in this study were often by default non-essential due to their nature (e.g. time wasters), or when they are performed in severe excess (e.g. >8 h/day of shopping, gambling or pornography), future studies could include measures that can differentiate essential from non-essential internet use for each internet activity, to allow for such analyses. Another limitation of our study is the lack of data for children and adolescent populations. Children and adolescent populations may interact with the internet in a different way, but also are exposed to online use during a different neurodevelopmental window. Therefore, such differences may imply different vulnerabilities or resilience in terms of risk to develop PIU. For example, early, low level exposure to the online environment may have a ‘stress inoculation’ effect (
) that steels individuals from future development of PIU. If such the case, this can further explain why older populations that only got their first exposure of online environments in adulthood may be more vulnerable. Future studies could include those child and adolescent age groups and examine prospectively whether specific internet activities are predictive of PIU. Unfortunately, the number of participants reporting transgender gender was small (n = 18), which did not allow for a meaningful analysis of the effect of transgender gender. A final limitation of our study is that our study population consists of healthy adults who only in <1% suffer from significant PIU behaviors (IAT > 80). Future studies would benefit from having a specific focus on the higher end of the PIU spectrum to be able to compare those severe PIU populations with a control group of low to moderate or non-PIU individuals. While the estimated point prevalence of PIU in our sample was ~8.5% (using IAT ≥ 50 cut-off), the thresholds for clinical caseness for PIU remain contentious and future research would benefit from a universally accepted measure and definition of PIU.
4.2
Conclusion
To summarize, DSM-5 highlights internet gaming disorder as a candidate disorder, but other types of online behavior (e.g. shopping, pornography, general surfing) bear a stronger relationship with maladaptive use of the internet than gaming. Psychiatric diagnoses and internet activities associated with Problematic internet use vary with age, a finding that has public health implications. These results contribute to the limited knowledge about internet activities associated with problematic internet use and may contribute to the diagnostic classification of problematic internet use as a multifaceted disorder.
Role of funding sources
This research received internal departmental funds of the Department of Psychiatry at the University of Chicago . Dr. Ioannidis research activities are supported by Health Education East of England Higher Training Special interest sessions. Authors received no funding for the preparation of this manuscript. The funding source played no role in the design, data analysis, or writing of the study.
Contributors
KI designed the idea for the manuscript, analysed the data, wrote the majority of the manuscript and Supplementary material and coordinated the co-authors’ contributions. MT and FK participated in the conception and review of the statistical analysis. SRC, SR, DJS, CL and JEG designed and coordinated the study and collected and managed the data. All authors read and approved the final manuscript and contributed to the drafting and revising of the paper as well as to interpreting the results.
Conflict of interest
Dr. Grant has received research grants from NIDA ( RC1DA028279-01 ), the National Center for Responsible Gaming , and Roche and Forest Pharmaceuticals . Dr. Grant receives compensation from Springer as the editor-in-chief of the Journal of Gambling Studies and has received royalties from McGraw Hill, Oxford University Press, Norton, and the APPI. Dr. Chamberlain consults for Cambridge Cognition and his involvement in this research was supported by an Intermediate Clinical Fellowship from the Wellcome Trust (UK; 110049/Z/15/Z ). Dan Stein and Christine Lochner are funded by the Medical Research Council of South Africa. The other authors report no financial relationships with commercial interest. None of the aforementioned sources had any role in the study design, collection, analysis or interpretation of the data, writing the manuscript, or the decision to submit the paper for publication.
Acknowledgement
We are indebted to the volunteers of both sites who participated in the study.
Appendix A
Supplementary data
Supplementary material
References
- Achab et al., 2011. Achab S., Nicolier M., Mauny F., Monnin J., Trojak B., Vandel P., and Haffen E.: Massively multiplayer online role-playing games: Comparing characteristics of addict vs non-addict online recruited gamers in a French adult population. BMC Psychiatry 2011; 11: pp. 144
View In Article - American Psychiatric Association, 2013. American Psychiatric Association : Diagnostic and statistical manual of mental disorders: DSM-5. Washington, D.C: American Psychiatric Association, 2013.
View In Article - Andreassen et al., 2012. Andreassen C.S., Torsheim T., Brunborg G.S., and Pallesen S.: Development of a Facebook addiction scale. Psychological Reports 2012; 110: pp. 501-517
View In Article | Cross Ref - Bakken et al., 2009. Bakken I.J., Wenzel H.G., Götestam K.G., Johansson A., and Oren A.: Internet addiction among Norwegian adults: A stratified probability sample study. Scandinavian Journal of Psychology 2009; 50: pp. 121-127
View In Article | Cross Ref - Black, 2007. Black D.W.: A review of compulsive buying disorder. World Psychiatry: Official Journal of the World Psychiatric Association (WPA) 2007; 6: pp. 14-18
View In Article - Block, 2008. Block J.J.: Issues for DSM-V: Internet addiction. American Journal of Psychiatry 2008; 165: pp. 306-307
View In Article | Cross Ref - Brand et al., 2011. Brand M., Laier C., Pawlikowski M., Schächtle U., Schöler T., and Altstötter-Gleich C.: Watching pornographic pictures on the Internet: Role of sexual arousal ratings and psychological-psychiatric symptoms for using Internet sex sites excessively. Cyberpsychology, Behavior and Social Networking 2011; 14: pp. 371-377
View In Article | Cross Ref - Breiman, 2001. Breiman L.: Statistical modeling: The two cultures. Statistical Science 2001; 16: pp. 199-215
View In Article - Bujak et al., 2016. Bujak R., Daghir-Wojtkowiak E., Kaliszan R., and Markuszewski M.J.: PLS-based and regularization-based methods for the selection of relevant variables in non-targeted metabolomics data. Frontiers in Molecular Biosciences 2016; 3: pp. 1-10
View In Article - Burns et al., 1996. Burns G.L., Keortge S.G., Formea G.M., and Sternberger L.G.: Revision of the Padua Inventory of obsessive compulsive disorder symptoms: Distinctions between worry, obsessions, and compulsions. Behaviour Research and Therapy 1996; 34: pp. 163-173
View In Article | Cross Ref - Cao et al., 2007. Cao F., Su L., Liu T., and Gao X.: The relationship between impulsivity and internet addiction in a sample of Chinese adolescents. European Psychiatry 2007; 22: pp. 466-471
View In Article | Cross Ref - Carli et al., 2013. Carli V., Durkee T., Wasserman D., Hadlaczky G., Despalins R., Kramarz E., and Kaess M.: The association between pathological Internet use and comorbid psychopathology: A systematic review. Psychopathology 2013; 46: pp. 1-13
View In Article | Cross Ref - Claes et al., 2016. Claes L., Müller A., and Luyckx K.: Compulsive buying and hoarding as identity substitutes: The role of materialistic value endorsement and depression. Comprehensive Psychiatry 2016; 68: pp. 65-71
View In Article | Cross Ref - Cole and Hooley, 2013. Cole S.H., and Hooley J.M.: Clinical and personality correlates of MMO gaming: Anxiety and absorption in problematic internet use. Social Science Computer Review 2013; 31: pp. 424-436
View In Article | Cross Ref - Cunningham-Williams et al., 2005. Cunningham-Williams R.M., Grucza R.A., Cottler L.B., Womack S.B., Books S.J., Przybeck T.R., and Cloninger C.R.: Prevalence and predictors of pathological gambling: Results from the St. Louis personality, health and lifestyle (SLPHL) study. Journal of Psychiatric Research 2005; 39: pp. 377-390
View In Article | Cross Ref - von Elm et al., 2008. von Elm E., Altman D.G., Egger M., Pocock S.J., Gøtzsche P.C., Vandenbroucke J.P., and Initiative S.: The strengthening the reporting of observational studies in epidemiology (STROBE) statement: Guidelines for reporting observational studies. Journal of Clinical Epidemiology 2008; 61: pp. 344-349
View In Article | Cross Ref - Fernández-Villa et al., 2015. Fernández-Villa T., Alguacil Ojeda J., Almaraz Gómez A., Cancela Carral J.M., Delgado-Rodríguez M., García-Martín M., and Martín V.: Problematic Internet use in university students: Associated factors and differences of gender. Adicciones 2015; 27: pp. 265-275
View In Article | Cross Ref - Friedman et al., 2010. Friedman J., Hastie T., and Tibshirani R.: Regularization paths for generalized linear models via coordinate descent. Journal of Statistical Software 2010; 33: pp. 1-22
View In Article - Griffiths, 2003. Griffiths M.: Internet gambling: Issues, concerns, and recommendations. Cyberpsychology & Behavior: The Impact of the Internet, Multimedia and Virtual Reality on Behavior and Society 2003; 6: pp. 557-568
View In Article | Cross Ref - Ha and Hwang, 2014. Ha Y.-M., and Hwang W.J.: Gender differences in internet addiction associated with psychological health indicators among adolescents using a National web-Based Survey. International Journal of Mental Health and Addiction 2014; 12: pp. 660-669
View In Article | Cross Ref - Ho et al., 2014. Ho R.C., Zhang M.W.B., Tsang T.Y., Toh A.H., Pan F., Lu Y., and Mak K.-K.: The association between internet addiction and psychiatric co-morbidity: A meta-analysis. BMC Psychiatry 2014; 14: pp. 183
View In Article - Hoerl and Kennard, 1970. Hoerl A.E., and Kennard R.W.: Ridge regression: Biased estimation for nonorthogonal problems. Technometrics 1970; 12: pp. 55-67
View In Article - Huys et al., 2016. Huys Q.J.M., Maia T.V., and Frank M.J.: Computational psychiatry as a bridge from neuroscience to clinical applications. Nature Neuroscience 2016; 19: pp. 404-413
View In Article | Cross Ref - Igarashi et al., 2008. Igarashi T., Motoyoshi T., Takai J., and Yoshida T.: No mobile, no life: Self-perception and text-message dependency among Japanese high school students.
View In Article - Ioannidis et al., 2016. Ioannidis K., Chamberlain S.R., Treder M.S., Kiraly F., Leppink E., Redden S., and Grant J.E.: Problematic internet use (PIU): Associations with the impulsive-compulsive spectrum. Journal of Psych: An application of machine learning in psychiatry, 2016.
View In Article - Janower, 2006. Janower C.R.: Gambling on the Internet. Journal of Computer-Mediated Communication 2006; 2: pp. 0
View In Article | Cross Ref - Kessler et al., 2005. Kessler R.C., Adler L., Ames M., Demler O., Faraone S., Hiripi E., and Walters E.E.: The World Health Organization adult ADHD self-report scale (ASRS): A short screening scale for use in the general population. Psychological Medicine 2005; 35: pp. 245-256
View In Article | Cross Ref - Kessler et al., 2016. Kessler R.C., van Loo H.M., Wardenaar K.J., Bossarte R.M., Brenner L.A., Cai T., and Zaslavsky A.M.: Testing a machine-learning algorithm to predict the persistence and severity of major depressive disorder from baseline self-reports. Molecular Psychiatry 2016; 21: pp. 1366-1371
View In Article | Cross Ref - Khazaal et al., 2015. Khazaal Y., Achab S., Billieux J., Thorens G., Zullino D., Dufour M., and Rothen S.: Factor structure of the internet addiction test in online gamers and poker players. JMIR Mental Health 2015; 2:
View In Article - Kim et al., 2016. Kim D., Kang M., Biswas A., Liu C., and Gao J.: Integrative approach for inference of gene regulatory networks using lasso-based random featuring and application to psychiatric disorders. BMC Medical Genomics 2016; 9: pp. 50
View In Article - King, 1999. King S.A.: Internet gambling and pornography: Illustrative examples of the psychological consequences of communication anarchy. Cyberpsychology & Behavior 1999; 2: pp. 175-193
View In Article - King and Barak, 1999. King S.A., and Barak A.: Compulsive Internet Gambling. Cyberpsychology & Behavior 1999; 2: pp. 441-456
View In Article | Cross Ref - Király et al., 2015. Király O., Griffiths M.D., and Demetrovics Z.: Internet gaming disorder and the DSM-5: Conceptualization, debates, and controversies. Current Addiction Reports 2015; 2: pp. 254-262
View In Article - Király et al., 2014. Király O., Griffiths M.D., Urbán R., Farkas J., Kökönyei G., Elekes Z., and Demetrovics Z.: Problematic internet use and problematic online gaming are not the same: Findings from a large nationally representative adolescent sample. Cyberpsychology, Behavior and Social Networking 2014; 17: pp. 749-754
View In Article - Kittinger et al., 2012. Kittinger R., Correia C.J., and Irons J.G.: Relationship between Facebook use and problematic internet use among college students. Cyberpsychology, Behavior and Social Networking 2012; 15: pp. 324-327
View In Article | Cross Ref - Ko et al., 2012. Ko C.-H., Yen J.-Y., Yen C.-F., Chen C.-S., and Chen C.-C.: The association between Internet addiction and psychiatric disorder: A review of the literature. European Psychiatry 2012; 27: pp. 1-8
View In Article - Ko et al., 2007. Ko C.-H., Yen J.-Y., Yen C.-F., Lin H.-C., and Yang M.-J.: Factors predictive for incidence and remission of internet addiction in young adolescents: A prospective study. Cyberpsychology & Behavior: The Impact of the Internet, Multimedia and Virtual Reality on Behavior and Society 2007; 10: pp. 545-551
View In Article | Cross Ref - Kuss and Griffiths, 2011. Kuss D.J., and Griffiths M.D.: Online social networking and addiction—A review of the psychological literature. International Journal of Environmental Research and Public Health 2011; 8: pp. 3528-3552
View In Article | Cross Ref - Kuss et al., 2013. Kuss D.J., Griffiths M.D., and Binder J.F.: Internet addiction in students: Prevalence and risk factors. Computers in Human Behavior 2013; 29: pp. 959-966
View In Article | Cross Ref - Kuss and Lopez-Fernandez, 2016. Kuss D.J., and Lopez-Fernandez O.: Internet addiction and problematic Internet use: A systematic review of clinical research. World Journal of Psychiatry 2016; 6: pp. 143-176
View In Article | Cross Ref - Laconi et al., 2016. Laconi S., Andréoletti A., Chauchard E., Rodgers R.F., and Chabrol H.: Problematic Internet use, time spent online and personality traits. L’Encéphale 2016; 42: pp. 214-218
View In Article | Cross Ref - Laconi et al., 2014. Laconi S., Rodgers R.F., and Chabrol H.: The measurement of Internet addiction: A critical review of existing scales and their psychometric properties. Computers in Human Behavior 2014; 41: pp. 190-202
View In Article | Cross Ref - Laier et al., 2013. Laier C., Pawlikowski M., Pekal J., Schulte F.P., and Brand M.: Cybersex addiction: Experienced sexual arousal when watching pornography and not real-life sexual contacts makes the difference. Journal of Behavioral Addictions 2013; 2: pp. 100-107
View In Article | Cross Ref - Lecardeur, 2013. Lecardeur L.: Psychopathologie du jeu multi-joueurs en ligne. Annales Médico-Psychologiques, Revue Psychiatrique 2013; 171: pp. 579-586
View In Article | Cross Ref - Liang et al., 2016. Liang L., Zhou D., Yuan C., Shao A., and Bian Y.: Gender differences in the relationship between internet addiction and depression: A cross-lagged study in Chinese adolescents. Computers in Human Behavior 2016; 63: pp. 463-470
View In Article | Cross Ref - Lopez-Fernandez, 2015. Lopez-Fernandez O.: How has internet addiction research evolved since the advent of internet gaming disorder? An overview of cyberaddictions from a psychological perspective. Current Addiction Reports 2015; 2: pp. 263-271
View In Article | Cross Ref - Masten and Tellegen, 2012. Masten A.S., and Tellegen A.: Resilience in developmental psychopathology: Contributions of the project competence longitudinal study. Development and Psychopathology 2012; 24: pp. 345-361
View In Article | Cross Ref - Mueller et al., 2010. Mueller A., Mitchell J.E., Crosby R.D., Gefeller O., Faber R.J., Martin A., and de Zwaan M.: Estimated prevalence of compulsive buying in Germany and its association with sociodemographic characteristics and depressive symptoms. Psychiatry Research 2010; 180: pp. 137-142
View In Article | Cross Ref - Patton et al., 1995. Patton J.H., Stanford M.S., and Barratt E.S.: Factor structure of the Barratt impulsiveness scale. Journal of Clinical Psychology 1995; 51: pp. 768-774
View In Article | Recupero, 2008. Recupero P.R.: Forensic evaluation of problematic Internet use. The Journal of the American Academy of Psychiatry and the Law 2008; 36: pp. 505-514
View In Article - Rose and Dhandayudham, 2014. Rose S., and Dhandayudham A.: Towards an understanding of Internet-based problem shopping behaviour: The concept of online shopping addiction and its proposed predictors. Journal of Behavioral Addictions 2014; 3: pp. 83-89
View In Article | Cross Ref - Rutland et al., 2007. Rutland J.B., Sheets T., and Young T.: Development of a scale to measure problem use of short message service: The SMS problem use diagnostic questionnaire. Cyberpsychology & Behavior 2007; 10: pp. 841-844
View In Article | Cross Ref - Rutter, 1993. Rutter M.: Resilience: Some conceptual considerations. The Journal of Adolescent Health: Official Publication of the Society for Adolescent Medicine 1993; 14: pp. 626-631
View In Article | Cross Ref - Shaw and Black, 2008. Shaw M., and Black D.W.: Internet addiction: Definition, assessment, epidemiology and clinical management. CNS Drugs 2008; 22: pp. 353-365
View In Article | Cross Ref - Sheehan et al., 1998. Sheehan D.V., Lecrubier Y., Sheehan K.H., Amorim P., Janavs J., Weiller E., and Dunbar G.C.: The Mini-International Neuropsychiatric Interview (M.I.N.I.): The development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. The Journal of Clinical Psychiatry 1998; 59:
View In Article - Tam and Walter, 2013. Tam P., and Walter G.: Problematic internet use in childhood and youth: Evolution of a 21st century affliction. Australasian Psychiatry 2013; undefined:
View In Article - Tibshirani, 1996. Tibshirani R.: Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society, Series B 1996; 58: pp. 267-288
View In Article - Tikhonov, 1963. Tikhonov A.N.: Solution of incorrectly formulated problems and the regularization method. Soviet Mathematics Doklady 1963; 5: pp. 1035-1038
View In Article - Trotzke et al., 2015. Trotzke P., Starcke K., Müller A., and Brand M.: Pathological buying online as a specific form of internet addiction: A model-based experimental investigation. PLoS One 2015; 10:
View In Article - Tsai et al., 2009. Tsai H.F., Cheng S.H., Yeh T.L., Shih C.-C., Chen K.C., Yang Y.C., and Yang Y.K.: The risk factors of Internet addiction?A survey of university freshmen. Psychiatry Research 2009; 167: pp. 294-299
View In Article | Cross Ref - Wallace, 2014. Wallace P.: Internet addiction disorder and youth: There are growing concerns about compulsive online activity and that this could impede students’ performance and social lives. EMBO Reports 2014; 15: pp. 12-16
View In Article | Cross Ref - Xin et al., 2018. Xin M., Xing J., Pengfei W., Houru L., Mengcheng W., and Hong Z.: Online activities, prevalence of internet addiction and risk factors related to family and school among adolescents in China. Addictive Behaviors Reports 2018; 7: pp. 14-18
View In Article | Cross Ref - Yuen et al., 2004. Yuen C.N., Lavin M.J., Weinman M., and Kozak K.: Internet dependence in the collegiate population: The role of shyness. Cyberpsychology & Behavior 2004; 7: pp. 379-383
View In Article | Cross Ref - Young, 1998. Young K.S.: Internet addiction: The emergence of a new clinical disorder. CyberPsychology & Behavior 1998; 1: pp. 237-244
View In Article | Cross Ref
;