Psychometric Properties of the Revised Trolling Questionnaire in Argentinean Adults

Abstract

Trolling with new technologies is a disruptive, deceptive, and destructive behavior, with great psychosocial, legal, and economical relevance. However, there are no studies in the scientific literature that have examined the properties of questionnaires to assess them. Therefore, the purpose of the present study was to observe the psychometric properties of the Revised Trolling Questionnaire by Buckels et al.’s in a sample of Argentinean adults. An intentional sample of 837 participants from Argentina (mean age = 28.4 years; 61% female) was formed. They completed the Buckels et al.’s Revised Trolling Questionnaire, measures of dark personality, Internet addiction, cyberstalking, and socio-demographic questions. Exploratory and confirmatory factorial analyses indicated a one-factor structure with correct fit statistics. Internal consistency was adequate: Cronbach’s α = .80 and Omega coefficient (ω) = .81. Concurrent validity of the trolling questionnaire was observed with dark personality (Machiavellianism, narcissism and psychopathy), problematic Internet use (symptomatology and disfunctionality), and cyberstalking. Machiavellianism and disfunctionality were the most significant variables associated with trolling. Therefore, the Argentinean Spanish version of this test showed evidence of adequate psychometric properties.

References

Akhtar, S., & Morrison, C. (2019). The prevalence and impact of online trolling of UK members of parliament. Computers in Human Behavior, 99, 322-327. https://doi. org/10.1016/j.chb.2019.05.015

Aydın, A., Arda, B., Güneş. B., & Erbaş, O. (2021). Psychopathology of Cyberbullying and Internet Trolling. Journal of Experimental and Basic Medical Sciences, 2(3), 380-391. https://www.jebms.org/full-text/79

Bentler, P. M. (1992). On the fit of models to covariances and methodology to the Bulletin. Psychological Bulletin, 112(3), 400-404.

Boomsma, A., & Hoogland, J. J. (2001). The Robustness of LISREL Modeling Revisited. In R. Cudeck, S. du Toit, & D. Sörbom (Eds.), Structural Equation Models: Present and Future. A Festschrift in Honor of Karl Jöreskog (pp. 139-168). Scientific Software International.

Brown, T. A. (2006). Confirmatory factor analysis for applied research. Guilford Press.

Buckels, E. E., Trapnell, P. & Andjelovic, T., & Paulhus, D. L. (2018). Internet Trolling and Everyday Sadism: Parallel Effects on Pain Perception and Moral Judgment. Journal of Personality, 87(2), 328-340. https://doi. org/10.1111/jopy.12393

Buckels, E., Trapnell, P., & Paulhus, D. (2014). Trolls just want to have fun. Personality and Individual Differences, 67, 97-102. https://doi.org/10.1016/j.paid.2014.01.016

Byrne, B. (2010). Structural equation modeling with AMOS: Basic concepts, applications, and programming. Routledge. Byrne, B. (2012). Structural equation modeling with MPLUS: Basic concepts, applications, and programming. Routledge.

Case, C., & King, D. (2018). Internet Trolling Victimization: An Empirical Examination of Incidence in Undergraduate Business Students. Research in Higher Education Journal, 34, 32-40. https://www.aabri.com/ manuscripts/172726.pdf

Chou, C.-P., & Bentler, P. M. (1995). Estimation and tests in structural equation modeling. In R. H. Hoyle (Ed.), Structural equation modeling: Concepts, issues, and applications (pp. 37–55). Sage.

Cook, C., Corcoran, L., Mc Guckin, C., & Prentice, G. (2015). Cyberbullying or Cyber Aggression? A Review of Existing Definitions of Cyber-Based Peer-to-Peer Aggression. Societies, 5(2), 245-255. https://doi. org/10.3390/soc5020245

Craker, N., & March, E. (2016). The dark side of Facebook®: The Dark Tetrad, negative social potency, and trolling behaviours. Personality and Individual Differences, 102, 79-84. https://doi.org/10.1016/j.paid.2016.06.043

Cupani, M. (2012). Análisis de Ecuaciones Estructurales: conceptos, etapas de desarrollo y un ejemplo de aplicación. Tesis, 1,186-199. https://rdu.unc.edu.ar/bitstream/ handle/11086/22039/16.pdf?sequence=1&isAllowed=y

Curran, P. J., West, S. G, & Finch, J. F. (1996). The robustness of test statistics to nonnormality and specification error in confirmatory factor analysis. Psychological Methods, 1, 16-29. https://web.archive. org/web/20170808040148id_/http://hbanaszak.mjr. uw.edu.pl/TempTxt/CurranEtAl_1996_RobustnessOfTe stStatistToNonormalityInCFA.pdf

DeVellis, R. F. (2012). Scale Development: Theory and Applications. Sage. Dynel, M. (2016). “Trolling is not stupid”: Internet trolling as the art of deception serving entertainment. Intercultural Pragmatics, 13(3), 353-381. https://doi.org/10.1515/ ip-2016-0015

Fichman, P., & Sanfilippo, M. R. (2016). Online trolling and its perpetrators: Under the cyberbridge. Rowman & Littlefield. Field, A. (2013). Discovering Statistics Using IBM SPSS Statistics And Sex and Drugs and Rock “N” Roll. Sage.

Flora, D. B., LaBrish, C., & Chalmers, R. P. (2012). Old and new ideas for data screening and assumption testing for exploratory and confirmatory factor analysis. Frontiers in Quantitative Psychology and Measurement, 3(55), Article e55. https://doi.org/10.3389/fpsyg.2012.00055

Furian, L., & March, E. (2023). Trolling, the Dark Tetrad, and the four-facet spectrum of narcissism. Personality and Individual Differences, 208, Article e112169. https:// doi.org/10.1016/j.paid.2023.112169

Furnham, A., Richards, S. C. & Paulhus, D. L. (2013). The Dark Triad of personality: A 10 year review. Social and Personality Psychology Compass, 7(3), 199-216. https:// doi.org/10.1111/spc3.12018

Gani, A. (2016, February 9). Internet trolling: quarter of teenagers suffered online abuse last year. The Guardian. https://www.theguardian.com/uk-news/2016/feb/09/ internet-trolling-teenagers-online-abuse-hate-cyberbullying

González Caino, P., & Resett, S. (2020). Predicción del Trolling desde el sadismo y la adicción a Internet en jóvenes adultos de Buenos Aires. Interacciones, 6(3), Article e178. http://dx.doi.org/10.24016/2020.v6n3.178

Hair, J. F., Black, W. C., Babin, B.J., & Anderson, R.E. (2010). Multivariate Data Analysis (7th Edition). Pearson. Hardaker, C. (2010). Trolling in asynchronous computer mediated communication: From user discussions to academic definitions. Journal of Politeness Research, 6(2), 215-242. https://doi.org/10.1515/jplr.2010.011

Hardaker, C. (2013). “Uh... not to be nitpicky, but... the past tense of drag is dragged, not drug”: An overview of trolling strategies. Journal of Language Aggression and Conflict, 1(1), 58–86. https://doi.org/10.1075/ jlac.1.1.04har

Hartung, C., Little, C., S., Allen, E., K., & Page, M. (2011). A psychometric comparison of two self-report measures of bullying and victimization: Differences by sex and grade. School Mental Health, 3, 44-57. https://doi. org/10.1007/s12310-010-9046-1

Herring, S.C., Job-Sluder, K., Scheckler, R., & Barab, S. (2002). Searching for Safety Online: Managing “Trolling” in a Feminist Forum. The Information Society, 18(5), 371-384. https://doi.org/10.1080/01972240290108186

Hidalgo-Fuentes, S. (2023). La relación de los factores de personalidad y la conducción agresiva: los Cinco Grandes y la Tríada Oscura. Acta Colombiana de Psicología, 26(1), 188-199. https://www.doi.org/10.14718/ACP.2023.26. 1.12

Hilvert-Bruce, Z., & Neill, J. (2020). I’m just trolling: The role of normative beliefs in aggressive behaviour in online gaming. Computers in Human Behavior, 102, 303- 311. https://doi.org/10.1016/j.chb.2019.09.003

Hu, L.T., & Bentler, P.M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1-55. https://doi.org/10.1080/10705519909540118

Jones, D. & Paulhus, D. (2010). Different Provocations Trigger Aggression in Narcissists and Psychopaths. Social Psychological and Personality Science, 1(1), 12- 18. https://doi.org/10.1177/1948550609347591

Jones, D., & Paulhus, D. (2014). Introducing the short Dark Triad (SD3): A brief measure of dark personality traits. Assessment, 21(1), 28–41. https://doi. org/10.1177/1073191113514105

Kaplan, R. M., & Saccuzzo D. P. (2006). Pruebas psicológicas: principios, aplicaciones y temas. (6th edition). International Thomson.

Kline, R. (2015). Principles and practice of structural equation modeling (4th edition). Guilford.

Komaç, G., & Çağıltay, K. (2019, 6-7 November). An Overview of Trolling Behavior in Online Spaces and Gaming Context. Paper presented at 1st International Informatics and Software Engineering Conference, Ankara, Turkey. https://doi.org/10.1109/ UBMYK48245.2019.8965625

Kurniasanti, K.S, Asanti, P., Ismail, R.I., Nasrun. M.W.S., & Wiguna, T. (2019). Internet addiction: a new addiction? Medical Journal of Indonesia, 28(1), 82-91. https://mji. ui.ac.id/journal/index.php/mji/article/view/2752

Lam-Figueroa, N., Contreras-Pulache, H., Mori-Quispe, E., Nizama-Valladolid, M., Gutiérrez, C., HinostrozaCamposano, W., Torrejón Reyes, E., HinostrozaCamposano, R., Coaquira-Condori, E., & HinostrozaCamposano, W. (2011). Adicción a internet: Desarrollo y validación de un instrumento en escolares adolescentes de Lima, Perú. Revista Peruana de Medicina Experimental y Salud Pública, 28(3), 462-469. https:// doi.org/10.17843/rpmesp.2011.283.524

Lenhart, A., Ybarra, M., & Price-Feeney, M. (2016). Nonconsensual Image Sharing: One In 25 Americans Has Been A Victim Of “Revenge Porn”. Data & Society Research Institute. https://datasociety.net/pubs/oh/ Nonconsensual_Image_Sharing_2016.pdf

Leone, M. (2017). The art of trolling. Unpublished manuscript, University of Turin. Lloret-Segura, S., Ferreres-Traver, A., Hernández-Baeza, A., & Tomás-Marco, I. (2014). El análisis factorial exploratorio de los ítems: una guía práctica, revisada y actualizada. Anales de Psicología, 30(3), 1151-1169. http:// dx.doi.org/10.6018/analesps.30.3.199361

Loewenthal, K. M. (2001). An introduction to psychological tests and scales (2nd edition). Psychology Press.

Lopes, B., & Yu, H. (2017). Who do you troll and Why: An investigation into the relationship between the Dark Triad Personalities and online trolling behaviours towards popular and less popular Facebook profiles. Computers in Human Behavior, 77, 69-76. https://doi.org/10.1016/j. chb.2017.08.036

March, E. (2019). Psychopathy, sadism, empathy, and the motivation to cause harm: New evidence confirms malevolent nature of the internet troll. Personality and Individual Differences, 141, 133-137. https://doi. org/10.1016/j.paid.2019.01.001

March, E., Grieve, R., Marrington, J., & Jonason, P. K. (2017). Trolling on Tinder® (and other dating apps): examining the role of the Dark Tetrad and impulsivity. Personality and Individual Differences, 110, 139-143. https://doi.org/10.1016/j.paid.2017.01.025

March, E., Litten, V., Sullivan, D. H., & Ward, L. (2020). Somebody that I (used to) know: Gender and dimensions of dark personality traits as predictors of intimate partner cyberstalking. Personality and Individual Differences, 163, Article 110084. https://doi.org/10.1016/j.paid.2020. 110084

March, E., & Steele, G. (2020). High Esteem and Hurting Others Online: Trait Sadism Moderates the Relationship Between Self-Esteem and Internet Trolling. Cyberpsychology Behavior, and Social Network, 23(7), 441-446. https://doi.org/10.1089/cyber.2019.0652

Mehari, K. R., Farrell, A. D., & Le, A. H. (2014). Cyberbullying among adolescents: Measures in search of a construct. Psychology of Violence, 4(4), 399–415. https://doi.org/10.1037/a0037521

Miller, J., Lynam, D., Hyatt, C., & Campbell, K. (2017). Controversies in Narcissism. Annual review of clinical psychology, 13(1), 291-315. https://doi.org/10.1146/ annurev-clinpsy-032816-045244

Miller, J., Price, J., Gentile, B., Lynam D., & Campbell, W. (2012). Grandiose and vulnerable narcissism from the perspective of the interpersonal circumplex. Personalilty and Individual Differences, 53(4), 507–512. https://doi. org/10.1016/j.paid.2012.04.026

Muñiz, J., Elosua, P., & Hambleton, R. K. (2013). Directrices para la traducción y adaptación de los tests: segunda edición. Psicothema, 25(2), 151-157. https://doi. org/10.7334/psicothema2013.24

Muris, P., Merckelbach, H., Otgaar, H., & Meijer, E. (2017). The malevolent side of human nature: A meta-analysis and critical review of the literature on the dark triad (narcissism, Machiavellianism, and psychopathy). Perspectives on Psychological Science, 12(2), 183–204. https://doi.org/10.1177/1745691616666 070

Navarro, J., Marcum, C., Higgins, G., & Ricketts, M. (2015). Addicted to the Thrill of the Virtual Hunt: Examining the Effects of Internet Addiction on the Cyberstalking Behaviors of Juveniles. Deviant Behavior, 37(8), 893- 903. https://doi.org/10.1080/01639625.2016.1153366

Navarro-Carrillo, G., Torres-Marín, J., & Carretero-Dios, H. (2021). Do trolls just want to have fun? Assessing the role of humor-related traits in online trolling behavior. Computers in Human Behavior, 114, Article e106551. https://doi.org/10.1016/j.chb.2020.106551

Nitschinsk, L, Tobin, S.J., & Vanman, E.J. (2022). The Disinhibiting Effects of Anonymity Increase Online Trolling. Cyberpsychology, Behavior, and Social Network, 25(6), 377-383. https://doi.org/10.1089/ cyber.2022.0005

Oliden, P. & Zumbo, B. (2008). Coeficientes de fiabilidad para escalas ordinales. Psicothema, 20(4), 896-901. https://www.psicothema.com/pdf/3572.pdf

Ortiz, S. M. (2020). Trolling as a Collective Form of Harassment: An Inductive Study of How Online Users Understand Trolling. Social Media & Society, 6(2), Article e205630512092851. https://doi.org/10.1177/20 56305120928512

Paulhus, D. L, & Williams, K. M. (2002). The Dark Triad of personality: Narcissism, Machiavellianism, and psychopathy. Journal of Research in Personality, 36(6), 556–563. https://doi.org/10.1016/S0092-6566(02)00505-6

Petrosyan, A. (2023, April 3). Number of internet and social media users worldwide as of January 2023. Statista. https://www.statista.com/statistics/617136/digital-popu lation-worldwide/

Phillips, W. (2015). This is why we can’t have nice things: Mapping the relationship between online trolling and mainstream culture. The MIT Press.

Pineda, D., Sandín, B., & Muris, P. (2020). Psychometrics properties of the Spanish version of two Dark Triad scales: The Dirty Dozen and the Short Dark Triad. Current Psychology, 39, 1873–1881. https://doi. org/10.1007/s12144-018-9888-5

Resett, S., & González Caino, P. (2019). Propiedades psicométricas de un Cuestionario de Trolling en una muestra argentina. Revista Argentina de Ciencias del Comportamiento, 11(1), 48-57. https://doi. org/10.32348/1852.4206.v11.n1.20870

Resett, S., & González Caino, P. (2020). Un modelo para predecir el cyberstalking a partir de la personalidad y el uso de TIC. Revista Argentina de Ciencias del Comportamiento (Suplemento), 12(1), 135-136. https:// dialnet.unirioja.es/servlet/articulo?codigo=7447330

Resett, S., González Caino, P., & Zapata, J. (2022). Propiedades Psicométricas del Dirty Dozen en Adultos Masculinos Recluidos en Establecimientos Penitenciarios. Revista Iberoamericana de Diagnóstico y Evaluación, 2(63), 103- 118. https://doi.org/10.21865/RIDEP63.2.08

Sanfilippo, M. R., Fichman, P., & Yang, S. (2018). Multidimensionality of online trolling behaviors. The Information Society, 34(1), 27–39. https://doi.org/10. 1080/01972243.2017.1391911

Sanfilippo, M. R., Yang, S., & Fichman, P. (2017). Trolling here, there, and everywhere: perceptions of trolling behaviors in context. Journal of the Association for Science and Technology, 68(10), 2313–2337. https://doi. org/10.1002/asi.23902

Schaafsma, J., & Antheunis, M. (2018). Under the bridge: An in-depth examination of online trolling in the gaming context. New Media & Society, 20(9), 3323-3340. https://doi.org/10.1177/1461444817748578.

Shachaf, P., & Hara, N. (2010). Beyond vandalism: Wikipedia trolls. Journal of Information Science, 36(3), 357-370. https://doi.org/10.1177/0165551510365390 Sheridan, L. & Grant, T. (2007). Is cyberstalking different? Psychology, Crime and Law, 13(6), 627-640. https://doi. org/10.1080/10683160701340528

Shorey, R., Cornelius, T. & Strauss, C. (2015). Stalking in College Student Dating Relationships: A Descriptive Investigation. Journal of Family Violence, 30(7), 935- 942. https://doi.org/10.1007/s10896-015-9717-7

Sest, N., & March, E. (2017). Constructing the cyber-troll: Psychopathy, sadism, and empathy. Personality and Individual Differences, 119, 69-72. https://doi. org/10.1016/j.paid.2017.06.038

Slonje, R., Smith, P., & Frisén, A. (2013). The nature of cyberbullying, and strategies for prevention. Computers in Human Behavior, 29(1), 26-32. https://doi.org/10.1016/j. chb.2012.05.024

Smoker, M. & March, E. (2017). Predicting Perpetration of Intimate Partner Cyberstalking: Gender and the Dark Tetrad. Computers in Human Behavior, 72, 390-396. https://doi.org/10.1016/j.chb.2017.03.012

Solís-Salazar, M. (2015). The dilemma of combining positive and negative items in scales. Psicothema, 27(2), 192-199. https://doi.org/10.7334/psicothema2014.266

Soto, A., de Miguel, N., & Pérez Díaz, V. (2018). An approach to addiction to new technologies: A proposal for prevention in the school environment and rehabilitation treatment. Papeles del Psicólogo, 39(2), 120-126. https:// doi.org/10.23923/pap.psicol2018.2867

Spitzberg, B. H., & Cupach, W. R. (2007). The state of the art of stalking: Taking stock of the emerging literature. Aggression and Violent Behavior, 12(1), 64–86. https:// doi.org/10.1016/j.avb.2006.05.001

Suárez, J., Pedrosa, I., Lozano, L., García-Cueto, E., Cuesta, M., & Muñiz, J. (2018). Using reversed items in Likert scales: A questionable practice. Psicothema, 30, 149- 158. https://doi.org/10.7334/psicothema2018.33

Tabachnick, B. G., & Fidell, L. S. (2014). Using multivariate statistics (6th edition). Allyn & Bacon/Pearson Education.

Van Sonderen, E., Sanderman R., & Coyne J. C. (2013). Ineffectiveness of reverse wording of questionnaire items: Let’s learn from cows in the rain. PLOS ONE, 8, Article e68967. https://doi.org/10.1371/journal. pone.0068967

Vize, C., Collison, K., Miller, J., & Lynam, D. (2020). The “core” of the Dark Triad: A test of competing hypotheses. Personality Disorders: Theory, Research, and Treatment, 11(2), 91-99. https://doi.org/10.1037/per0000386

Volkmer, S.A., Gaube, S., Raue, M., & Lermer, E. (2023).Troll story: The dark tetrad and online trolling revisited with a glance at humor. PLoS One,18(3), Article e0280271. https://doi.org/10.1371/journal.pone.0280271

Widyanto, L., & Griffiths, M.D. (2011). An Empirical Study of Problematic Internet Use and SelfEsteem. International Journal of Cyber Behavior, Psychology and Learning, 1(1), 13-24. https://doi. org/10.4018/ijcbpl.2011010102

Wilson, C., Sheridan, L., & Garratt-Reed, D. (2022). Examining Cyberstalking Perpetration and Victimization: A Scoping Review. Trauma Violence Abuse, 6, Article e15248380221082937. https://doi. org/10.1177/15248380221082937

Young, K. S. (2011). CBT-IA: The first treatment model for internet addiction. Journal of Cognitive Psychotherapy, 25(4), 304-312. https://doi. org/10.1891/0889-8391.25.4.304

Zezulka, L. & Seigfried-Spellar, K. (2016). Differentiating Cyberbullies and Internet Trolls by Personality Characteristics and Self-Esteem. Journal of Digital Forensics, Security and Law, 11(3), Article 5. https://doi. org/10.15394/jdfsl.2016.1415

Reference by