Validation of a Malay Version of the Smartphone Addiction Scale among Medical Students in Malaysia (2015)

2015 Oct 2;10(10):e0139337. doi: 10.1371/journal.pone.0139337.

Ching SM1, Yee A2, Ramachandran V3, Sazlly Lim SM4, Wan Sulaiman WA4, Foo YL4, Hoo FK4.

Abstract

INTRODUCTION:

This study was initiated to determine the psychometric properties of the Smart Phone Addiction Scale (SAS) by translating and validating this scale into the Malay language (SAS-M), which is the main language spoken in Malaysia. This study can distinguish smart phone and internet addiction among multi-ethnic Malaysian medical students. In addition, the reliability and validity of the SAS was also demonstrated.

MATERIALS AND METHODS:

A total of 228 participants were selected between August 2014 and September 2014 to complete a set of questionnaires, including the SAS and the modified Kimberly Young Internet addiction test (IAT) in the Malay language.

RESULTS:

There were 99 males and 129 females with ages ranging from 19 to 22 years old (21.7±1.1) included in this study. Descriptive and factor analyses, intra-class coefficients, t-tests and correlation analyses were conducted to verify the reliability and validity of the SAS. Bartlett’s test of sphericity was significant (p <0.01), and the Kaiser-Mayer-Olkin measure of sampling adequacy for the SAS-M was 0.92, indicating meritoriously that the factor analysis was appropriate. The internal consistency and concurrent validity of the SAS-M were verified (Cronbach’s alpha = 0.94). All of the subscales of the SAS-M, except for positive anticipation, were significantly related to the Malay version of the IAT.

CONCLUSIONS:

This study developed the first smart phone addiction scale among medical students. This scale was shown to be reliable and valid in the Malay language.

Citation: Ching SM, Yee A, Ramachandran V, Sazlly Lim SM, Wan Sulaiman WA, Foo YL, et al. (2015) Validation of a Malay Version of the Smartphone Addiction Scale among Medical Students in Malaysia. PLoS ONE 10(10): e0139337. doi:10.1371/journal.pone.0139337

Editor: Aviv M. Weinstein, University of Ariel, ISRAEL

Received: March 18, 2015; Accepted: September 11, 2015; Published: October 2, 2015

Copyright: © 2015 Ching et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited

Data Availability: All relevant data are within the paper and its Supporting Information files.

Funding: The authors also would like to thank UPM research fund (grant no: UPM/700-2/1/GP- IPM/2014/9436500) for the financial support. The URL is http://www.rmc.upm.edu.my/.

Competing interests: The authors have declared that no competing interests exist.

Introduction

This is no doubt that the smartphone has provided us with enormous convenience in our daily life, as it has a more advanced computing capability and connectivity than basic feature phones [1]. Usage of smartphone has their own variety of goals and purposes. A wide range of studies reported that smartphone has numerous benefits for social and medical purposes [2–5]. Although the smartphone has become one of the most popular and important communication tools, its excessive use has emerged as a social issue worldwide and created a new mental health concern, wherein the user tends to develop dependency on it [6–8].

Smartphone addiction is also called “mobile phone dependence”, “compulsive mobile phone overuse” or “mobile phone overuse”. These terms mainly describe the phenomenon of problematic mobile phone use [9, 10]. “Smartphone addiction” is the term typically used in the literature. This addiction is mainly characterized by excessive or poorly controlled preoccupations, urges, or behaviors regarding smartphone use, to the extent that individuals neglect other areas of life [11–13]. Studies report that excessive mobile phone usage was associated with stress, sleep disturbance, smoking and symptoms of depression [14–16].

Recent data from Malaysia showed that smartphone penetration increased from 47% in 2012 to 63% in 2013. In 2014, 10.13 million Malaysians were active smartphone users, compared with 7.7 million in 2012 [17–20]. Pathological use of the smartphone is similar to internet addiction. Usage of internet addiction becomes excessive among youths and adults worldwide [21]. Excessive internet addiction leads to psychiatric disorders, low self-esteem, depression and impaired academic and occupational performance [22–25]. Local studies reported that the prevalence of internet addiction was 43% [26], and there are more than 4.2 million active Facebook users in Malaysia; in fact, Facebook is the top networking site in this country. Given that there has been a rapid increase in smartphone usage in Malaysia, there is an urgent need to validate a scale to measure smartphone addiction in the local population to determine its prevalence and to identify who is at risk of developing smartphone addiction so that policy makers can plan a suitable intervention in the near future.

Like the factorial structure prepared for internet addiction test [27], the Smartphone Addiction Scale (SAS) developed by Min Kwon et al. was the first scale for smartphone addiction used for diagnosis [28]. This scale consists of 33 items and has been reported to be reliable, with good internal consistency (Cronbach’s alpha = 0.967), and the concurrent validity of the six subscales ranges from 0.32 to 0.61 [28].

This study aimed to translate the SAS into the Malay language and to study the psychometric properties of the Malay version of the SAS (SAS-M) to facilitate its use for further research in the local setting.

Methodology

Study Design and Setting

This was a cross-sectional study of all first- and second-year medical students from Universiti Putra Malaysia. These students were approached for a validation study from August 2014 to September 2014. This university is located in Serdang, next to Malaysia’s administrative capital city, Putrajaya. We estimated the sample size to be at least 165 based on the calculation of five cases per item in the SAS (which has a total of 33 items) [29]. Therefore, a sample size of 228 in this study was adequate.

Procedure.

Stage 1: The author obtained the English version of the SAS from Kwon et al. Translation from English to Malay was performed in parallel by two bilingual language experts, and a back translation was performed by a third bilingual language expert. Discrepancies between the original version and the back translation were discussed, and adjustments were made accordingly. A final version of the translated SAS, which we called a draft of the SAS-M, was generated by an expert panel composed of one psychiatrist, two senior physicians and one family physician, all of whom were qualified professionals regarding use of psychometric instruments and all of whom had clinical experience with depressive conditions.

Stage 2: The first draft of the SAS-M was pilot tested among 20 native Malay-speaking students to identify any flaws in this version. Any words that the respondents considered unsuitable or inappropriate in this version were noted and corrected. Most students had difficulty in accepting item 15: “Being angry and resentful when I do not have a smartphone”. This item was revised and translated to “Feeling impatient and restless when I do not have a smartphone” in the Malay language. The finalized version of the SAS-M was further reviewed by two consultant psychiatrists with more than 10 years of experience to assess the content validity and to ensure a satisfactory face and satisfactory semantics, criteria, and conceptual equivalence.

Stage 3: Each student provided written informed consent after receiving a full explanation of the nature and confidentiality of the study, and 228 students consented to participate in the study, with a non-response rate of 9%. Sociodemographic data (age, gender, ethnicity and household income) were obtained from the students. Information about the students’ smartphone use based on their own estimation, such as the number of hours of use per week, the number of years as a regular smartphone user and the age at which they started to use a smartphone, were documented. The students were given the following questionnaires:

  1. The SAS and SAS-M (Table A in S1 Text).
  2. Malay version of the Internet Addiction Test.

Instruments

Smartphone Addiction Scale [28].

The SAS is a self-completed, 6-point Likert-type scale with 33 items. Each question has a response scale from 1 to 6 (1 = strongly disagree to 6 = strongly agree), reflecting the frequency of the symptoms. The respondent circles the statement that most closely describes their smartphone use characteristics. The total score possible on the SAS ranges from 48 to 288. The higher the score is, the greater the degree of pathological use of the smartphone.

Internet Addiction Test [26].

The IAT questionnaire, which was developed by Kimberly Young in 1998, is the tool most commonly used in diagnosing internet addiction. The Malay version has been validated locally, with good internal consistency (Cronbach’s alpha = 0.91) and parallel reliability (intraclass correlation coefficient (ICC) = 0.88, P < 0.001). This is a self-completed questionnaire consisting of a 5-point Likert-type scale containing 20 items, with a minimum point value of 20 and a maximum point of value 100. The scoring of each question ranges from 1 to 5 (1 = never to 5 = always), replicating the occurrence of the symptoms. The students chose the statement that best described the features of their internet use. The higher the score is, the greater the degree of pathological use of the internet is. When the score on the Malay version of the IAT is more than 43, then the individual is diagnosed as at risk of internet addiction [26].

Statistical Analysis

All analyses were conducted using the Statistical Package for the Social Sciences version 21.0 (SPSS, Chicago, IL, USA). Descriptive statistics were computed for the baseline characteristics of the participants. Cronbach’s alpha was used to assess the internal consistency of the SAS-M, and the normality of the data was assessed using Kolmogorov-Smirnov analysis. The homogeneity of the scale items was analyzed based on correlation coefficients between items and total scores if an item was deleted. Construct validity was investigated by exploratory factor analysis and oblique promax with Kaiser Normalization. Factor loading of > 0.30 was used to determine the items for each factor. Based on Guttman-Kaiser rule, the factors with eigenvalue large than 1 are retained [30, 31]. The ICC was used to examine the parallel reliability between the SAS-M and the English version of the SAS and the test-retest reliability of the SAS-M. Pearson’s correlation was used to examine the concurrent validity between the SAS-M and the Malay version of the IAT. The optimal SAS-M cut-off score for at-risk cases was determined from the coordinate points when the score for the Malay version of the IAT was more than 43 [26], at which point the sensitivity and specificity were optimal in receiver operating characteristic (ROC) analyses. The area under the curve (AUC) was determined for the ROC curve.

Definition

Regular user is defined as those who use smartphone at least 6 or more times in 6 months [32]

Ethical Approval

Ethics approval for this study was obtained from the Ethic Committee of the Universiti Putra Malaysia (FPSK-EXP14 P091).

Results

A total of 228 students were recruited in this study. Table 1 shows the clinical characteristics of the studied population. Overall, the mean age was approximately 22 years ± 1.1. More than half of the students were female (56.6%), and the majority were of Malay ethnicity (52.4%). The mean hours of smartphone use per week was 36.5 hours. On average, the students started using a smartphone at the age of 19 years, and the mean number of years of regular smartphone use was 2.4 years.

thumbnail  

 
Table 1. Characteristics of the study population (N = 228).

 

doi:10.1371/journal.pone.0139337.t001

Factor Structure and Internal Consistency of the SAS-M

Bartlett’s test of sphericity was significant (p < 0.01), and the Kaiser-Meyer-Olkin measure of sampling adequacy for the SAS-M was 0.92, indicating that the scale was meritorious [33], which in turn indicated that the factor analysis was appropriate. Six factors were extracted (eigenvalue >1.00) via the exploratory factor analysis approach and the oblique promax rotation with Kaiser normalization which accounted for 65.3% of the total variance. This result was consistent with the original SAS [28].

The SAS-M exhibited good internal consistency; Cronbach’s alpha coefficient for the total scale was 0.94, and the respective coefficients for the six factors were 0.877, 0.843, 0.865, 0.837, 0.865 and 0.861. The six factors corresponding to the SAS subscales were referred to as “cyberspace-oriented relationship”, “daily life disturbance”, “primacy”, “overuse”, “positive anticipation” and “withdrawal” (Table 2). All items had corrected-item total correlations of more than 0.9. Deletion of any of the items did not increase the internal consistency of the total score (Table 3). The parallel reliability between the SAS-M and the SAS was high, as demonstrated by an ICC of 0.95 (95% Confidence interval = 0.937–0.962). The test-retest reliability of the SAS-M after a 1-week interval was high, with an ICC of 0.85 (95% Confidence interval = 0.808–0.866).

thumbnail  

 
Table 2. Factor analysis of the SAS-Malay version.

 

doi:10.1371/journal.pone.0139337.t002

thumbnail  

 
Table 3. Corrected item–Total correlations and Cronbach’s alpha if item was deleted for the SAS-M.

 

doi:10.1371/journal.pone.0139337.t003

Concurrent Validity of the SAS-M: Correlations between the Subscales of the SAS-M and the Malay Version of the IAT

The results of the Pearson correlation analysis that was conducted between the subscales of the SAS-M and the Malay version of the IAT are shown in Table 4. The results show that all of the subscales of the SAS-M, except for “positive anticipation”, were significantly related to the Malay version of the IAT.

thumbnail  

 
Table 4. Concurrent validity of SAS-M (Pearson’s correlation): Subscales of the SAS-M and the Malay version of the IAT.

 

doi:10.1371/journal.pone.0139337.t004

The AUC for the ROC curve was 0.801 (95% CI = 0.746 to 0.855). The optimal cut-off score for identifying at-risk cases was more than 98, with a sensitivity of 71.43%, a specificity of 71.03%, a positive predictive value (PPV) of 64.10% and a negative predictive value (NPV) of 77.44%. The prevalence of an at-risk case developing smartphone addiction in this study was 46.9%, based on a score of 98.

Discussion

This study examined the internal consistency, dimensionality, and concurrent and construct validity of the SAS-M. Findings from the study indicate that the SAS-M is a reliable and valid instrument for assessing smartphone addiction in the Malay-speaking population.

In this study, the SAS-M exhibited good internal consistency; Cronbach’s alpha coefficient for the total scale was 0.94, and the respective coefficients for the six factors were 0.877, 0.843, 0.865, 0.837, 0.865 and 0.861. The parallel reliability of the SAS-M and the test-retest reliability after a 1-week interval were found to be good, with ICCs of 0.95 and 0.85, respectively, which are even better than those of the original version of the SAS [28]. To date, this is the first study of its kind related to smartphone addiction, and it shows that the SAS-M is as good as the English version.

However, the six dominant components that explained a large proportion of the variability of the SAS-M were similar to those of the original SAS. In the present study, the components consisted of “cyberspace-oriented relationship”, “daily life disturbance”, “primacy”, “overuse”, “positive anticipation” and “withdrawal”. The components in the original SAS were “daily life disturbance”, “positive anticipation”, “withdrawal”, “cyberspace-oriented relationship”, “overuse” and “tolerance”. Not all of the factors acquired in this factor analysis paralleled to the factors obtained in the original SAS. It is more likely due to the fact that this reflects the differences between Malay and Korean samples. The meaning of the original SAS had been changed during the translation process.

The majority of the components reported in the current study are the same, except for the component “primacy”, which is different from the component “tolerance” in the original SAS. The possible reasons could be our study population were younger (21.7 ± 1.1 years with an age range from 20 to 27) compared to the Korean population (26.1± 6.0 with age ranges from 18 to 53). The background our study population was homogenous as all the subjects were medical students compared to the wide range of the occupation and education level in the original SAS study. The different interpretation could be complicated by the heterogeneity in the backgrounds and education of the studied population.

In this study, all of the subscales of the SAS-M, except for “positive anticipation”, were significantly related to the Malay version of the IAT. This may be the only subscale that does not correlate well with the IAT because the IAT mainly measures adverse use of the internet, so there are no items asking about positive anticipation. Nevertheless, this aspect does not reduce the concurrent validity because the other 5 subscales are strongly correlated.

The prevalence of at-risk cases that could be identified as smartphone addiction using this scale was 46.9%. There are several possible explanations for this result. The high prevalence of smartphone addiction is expected as a local study has shown that 85% of Malaysians own mobile phones [18]. Smartphones are the favorite option because Malaysians tend to follow trends in the community [20]. In addition, smartphone provides free instant messaging through certain platforms, e.g., WhatsApp and WeChat, which enrich the lives of users. Entertainment is another possible explanation of the high prevalence of smartphone addiction because with these phones, medical students can listen to music, watch movies and play games to relieve stress [34]. Therefore, they may tend to spend more time with their smartphone at the end of the day and to ultimately become pathological users.

However, one of the concern in our study would be the optimal SAS-M cut-off score for at-risk cases was determined from the coordinate points when the score for the Malay version of the IAT was more than 43. This is not up to date well-established cut-offs for IAT. Similarly there is no established diagnostic criterion of internet or smartphone addiction according to DSM V in the spectrum of addiction disorder [21, 25]. Thus, the cut-off point proposed by our study was probably too low leading to a very high estimated rate of smartphone addiction. By right the diagnosis of internet addiction should be based on three criteria as described by Ko, et al, 2012 [25].

SAS-M functions more like a screening or a scale for the assessment of the severity of addictive use of smartphone than a diagnostic instrument. Making a proper diagnosis of smartphone addiction will be an important issue for future research. We proposed that in the future the diagnosis of smartphone addiction should include more criteria which consist of criteria A, B, and C. Criterion A contains six characteristic symptoms of smartphone addiction like cyberspace orientated relationship, daily life disturbance, primacy, overuse, positive anticipation and withdrawal. Criterion B needs to include the functional impairment secondary to smartphone use. Criterion C should exclude other psychiatric disorder like bipolar disorder or other impulsive disorder. Subjects who fulfilling all the criteria A, B, and C would only be considered to have smartphone addiction.

Strength and limitations

The results of this study should be interpreted in the context of the study’s limitations: First, there is no established diagnostic criterion for internet or smartphone addiction according to DSM V in the spectrum of addiction disorder [21, 25]. However, in view of the limited studies in smartphone addiction in local setting, the results of this study still can give some insights to the health care professional team. Second, despite the sample size was adequate but it was not randomized. The gender and the race were not equally distributed. Moreover, this study was conducted at a single center, so the sample population was homogenous and may not reflect the general population of Malaysia.

Despite this limitation, the results of the present study proven that the SAS-M can be used for the evaluation of smartphone addiction among educated Malaysian young adults.

Conclusion

This study developed the first smart phone addiction scale among medical students. This study also provides evidence that the SAS-M is a valid and reliable, self-administered tool to screen for those at risk of having smartphone addiction.

Supporting Information

S1_Text.doc
 
 

S1 Text. Smart phone addiction Malay Version Questionnaire.

doi:10.1371/journal.pone.0139337.s001

(DOC)

Author Contributions

Conceived and designed the experiments: SMC AY FKH. Performed the experiments: VR SMSL WAWS YLF. Analyzed the data: SMC AY. Contributed reagents/materials/analysis tools: SMC AY. Wrote the paper: SMC AY VR.

References

  1. 1. Rashvand HF, Hsiao KF (2015) Smartphone intelligent applications: a brief review. Multimedia Systems 21(1):103–119 doi: 10.1007/s00530-013-0335-z
  2. 2. Mosa AS, Yoo I, Sheets L (2012) A systematic review of healthcare applications for smartphones. BMC Medical Informatics and Decision Making 12: 67. doi: 10.1186/1472-6947-12-67. pmid:22781312
  3. View Article
  4. PubMed/NCBI
  5. Google Scholar
  6. View Article
  7. PubMed/NCBI
  8. Google Scholar
  9. View Article
  10. PubMed/NCBI
  11. Google Scholar
  12. View Article
  13. PubMed/NCBI
  14. Google Scholar
  15. View Article
  16. PubMed/NCBI
  17. Google Scholar
  18. View Article
  19. PubMed/NCBI
  20. Google Scholar
  21. View Article
  22. PubMed/NCBI
  23. Google Scholar
  24. View Article
  25. PubMed/NCBI
  26. Google Scholar
  27. View Article
  28. PubMed/NCBI
  29. Google Scholar
  30. View Article
  31. PubMed/NCBI
  32. Google Scholar
  33. View Article
  34. PubMed/NCBI
  35. Google Scholar
  36. View Article
  37. PubMed/NCBI
  38. Google Scholar
  39. View Article
  40. PubMed/NCBI
  41. Google Scholar
  42. View Article
  43. PubMed/NCBI
  44. Google Scholar
  45. View Article
  46. PubMed/NCBI
  47. Google Scholar
  48. View Article
  49. PubMed/NCBI
  50. Google Scholar
  51. View Article
  52. PubMed/NCBI
  53. Google Scholar
  54. View Article
  55. PubMed/NCBI
  56. Google Scholar
  57. View Article
  58. PubMed/NCBI
  59. Google Scholar
  60. View Article
  61. PubMed/NCBI
  62. Google Scholar
  63. View Article
  64. PubMed/NCBI
  65. Google Scholar
  66. View Article
  67. PubMed/NCBI
  68. Google Scholar
  69. View Article
  70. PubMed/NCBI
  71. Google Scholar
  72. View Article
  73. PubMed/NCBI
  74. Google Scholar
  75. View Article
  76. PubMed/NCBI
  77. Google Scholar
  78. View Article
  79. PubMed/NCBI
  80. Google Scholar
  81. View Article
  82. PubMed/NCBI
  83. Google Scholar
  84. View Article
  85. PubMed/NCBI
  86. Google Scholar                     
  87. 3. Lane N, Mohammod M, Lin M, Yang X, Lu H, Ali S, et al. (2011) BeWell: A smartphone application to monitor, model and promote wellbeing. 5th International Conference on Pervasive Computing Technologies for Healthcare, Dublin.
  88. 4. Patrick K, Griswold WG, Raab F, Intille SS (2008) Health and the mobile phone. American Journal of Preventive Medicine 35: 177–181. doi: 10.1016/j.amepre.2008.05.001. pmid:18550322
  89. 5. Derbyshire E, Dancey D (2013) Smartphone Medical Applications for Women’s Health: What Is the Evidence-Base and Feedback? International Journal of Telemedicine and Applications Article ID 782074, 10. doi: 10.1155/2013/782074
  90. 6. Emad AS, Haddad E (2015) The Influence of Smart Phones on Human Health and Behavior: Jordanians’ Perceptions. International Journal of Computer Networks and Applications 2 (2): 52–56.
  91. 7. Sarwar M, Soomro TR (2013) Impact of Smartphone’s on Society. European Journal of Scientific Research 98(2): 216–226.
  92. 8. Acharya JP, Acharya I, Waghrey D (2013) A Study on Some of the Common Health Effects of Cell-Phones amongst College Students. Journal of Community Medicine & Health Education 3: 21. doi: 10.5958/j.2319-5886.2.3.068
  93. 9. Lin YH, Chang LR, Lee YH, Tseng HW, Kuo TB, Chen SH. (2014) Development and validation of the Smartphone Addiction Inventory (SPAI). PLoS One 9: e98312. doi: 10.1371/journal.pone.0098312. pmid:24896252
  94. 10. Billieux J, Van der Linden M, d’Acremont M, Ceschi G, Zermatten A (2007) Does impulsivity relate to perceived dependence on and actual use of the mobile phone? Applied Cognitive Psychology 21: 527–537. doi: 10.1002/acp.1289
  95. 11. Park N, Lee H (2012) Social implications of smartphone use: Korean college students’ smartphone use and psychological well-being. Cyberpsychology, Behavior, and Social Networking 15: 491–497. doi: 10.1089/cyber.2011.0580
  96. 12. Yen CF, Tang TC, Yen JY, Lin HC, Huang CF, Liu SC, et al. (2009) Symptoms of problematic cellular phone use, functional impairment and its association with depression among adolescents in Southern Taiwan. Journal of Adolescence 32: 863–873. doi: 10.1016/j.adolescence.2008.10.006. pmid:19027941
  97. 13. Beranuy M, Oberst U, Carbonell X, Chamarro A (2009) Problematic Internet and mobile phone use and clinical symptoms in college students: The role of emotional intelligence. Computers in Human Behavior 25: 1182–1187. doi: 10.1016/j.chb.2009.03.001
  98. 14. Thomee S, Harenstam A, Hagberg M (2011) Mobile phone use and stress, sleep disturbances, and symptoms of depression among young adults–-a prospective cohort study. BMC Public Health 11: 66. doi: 10.1186/1471-2458-11-66. pmid:21281471
  99. 15. Ezoe S, Toda M, Yoshimura K, Naritomi A, Den R, Morimoto K (2009) Relationships of personality and lifestyle with mobile phone dependence among female nursing students. Social Behavior and Personality: an international journal 37(2): 231–238. doi: 10.2224/sbp.2009.37.2.231
  100. 16. Toda M, Monden K, Kubo K, Morimoto K (2006) Mobile phone dependence and health-related lifestyle of university students. Social Behavior and Personality 34(10): 1277–1284. doi: 10.2224/sbp.2006.34.10.1277
  101. 17. Malaysian Communications and Multimedia Commission (2012) Hand phone Users Survey 2011. Available: http://www.skmm.gov.my/skmmgovmy/media/G​eneral/pdf/SSKMM-HandPhoneSurvey-2011.pd​f
  102. 18. Malaysian Communications and Multimedia Commission (2014) Hand phone Users Survey 2012. Available: http://www.skmm.gov.my/skmmgovmy/media/G​eneral/pdf/130717_HPUS2012.pdf
  103. 19. ecommercemilo (2014). Available: http://www.ecommercemilo.com/2014/09/12-​facts-mobile-malaysia.html#.Va8ru_mqpBe.
  104. 20. Osman MA, Talib AZ, Sanusi ZA, Shiang-Yen T, Alwi AS (2012) A Study of the Trend of Smartphone and its Usage Behavior in Malaysia. International Journal of New Computer Architectures and their Applications 2: 274–285.
  105. 21. Weinstein A, Lejoyeux M (2010) Internet addiction or excessive internet use. The American Journal of Drug and Alcohol Abuse 36: 277–283. doi: 10.3109/00952990.2010.491880. pmid:20545603
  106. 22. Jenaro C, Flores N, Gómez-Vela M, González-Gil F, Caballo C (2007) Problematic internet and cell-phone use: Psychological, behavioral, and health correlates. Addiction research & theory 15: 309–320. doi: 10.1080/16066350701350247
  107. 23. Niemz K, Griffiths M, Banyard P (2005) Prevalence of pathological Internet use among university students and correlations with self-esteem, the General Health Questionnaire (GHQ), and disinhibition. CyberPsychology & Behavior 8: 562–570. pmid:16332167 doi: 10.1089/cpb.2005.8.562
  108. 24. Young KS, Rogers RC (1998) The relationship between depression and Internet addiction. CyberPsychology & Behavior 1: 25–28. doi: 10.1089/cpb.1998.1.25
  109. 25. Ko CH, Yen JY, Yen CF, Chen CS, Chen CC (2012) The association between Internet addiction and psychiatric disorder: a review of the literature. European Psychiatry 27: 1–8. doi: 10.1016/j.eurpsy.2010.04.011. pmid:22153731
  110. 26. Guan NC, Isa SM, Hashim AH, Pillai SK, Harbajan Singh MK (2015) Validity of the Malay version of the Internet Addiction Test: a study on a group of medical students in Malaysia. Asia-Pacific Journal of Public Health 27: 2210–2219. doi: 10.1177/1010539512447808
  111. 27. Khazaal Y, Billieux J, Thorens G, Khan R, Louati Y, Scarlatti E, et al. (2008) French validation of the internet addiction test. CyberPsychology & Behavior 11: 703–706. doi: 10.1089/cpb.2007.0249. pmid:18954279
  112. 28. Kwon M, Lee J-Y, Won W-Y, Park J-W, Min J-A, Hahn C, et al. (2013) Development and validation of a smartphone addiction scale (SAS). PloS one 8: e56936. doi: 10.1371/journal.pone.0056936. pmid:23468893
  113. 29. Gorsuch RL (1983) Factor analysis. 2nd ed. Hillsdale, New Jersey: Erlbaum.
  114. 30. Kaiser HF (1960) The application of electronic computers to factor analysis. Educational and Psychological Measurement 20: 141–151 doi: 10.1177/001316446002000116
  115. 31. Guttman L (1954) Some necessary conditions for common factor analysis. Psychometrika 19: 149–161. doi: 10.1007/bf02289162
  116. 32. Ybama ML (2004) Linkages between depressive symptomatology and Internet harassment among young regular users. CyberPsychology & Behavior 7:247–257. pmid:15140367 doi: 10.1089/109493104323024500
  117. 33. Kaiser HF (1974) An index of factorial simplicity. Psychometrika 39: 31–36. doi: 10.1007/bf02291575
  118. 34. Elias H, Ping WS, Abdullah MC (2011) Stress and academic achievement among undergraduate students in Universiti Putra Malaysia. Procedia-Social and Behavioral Sciences 29: 646–655. doi: 10.1016/j.sbspro.2011.11.288