Artículo
|
|
Artículo Psychometric Properties of the Revised Trolling Questionnaire in Argentinean AdultsPropiedades psicométricas del Cuestionario Revisado de Trolling en adultos argentinos |
Santiago Resett1
Pablo Christian González Caino2
1 0000-0001-7337-0617 Universidad Argentina de la Empresa-CONICET, Paraná, Argentina
2 0000-0003-2387-5777 Universidad Argentina de la Empresa-CONICET, Buenos Aires, Argentina
* Corresponding author: Laurencena 22 bis, Paraná, Entre Ríos, Argentina, CP 3100. Phone number: 543436101147. santiago_resett@hotmail.com.
Recibido, junio 8/2022
Concepto de evaluación, enero 3/2023
Aceptado, febrero 13/2023
How to cite this article: Resett, S., & González Caino, P. C. (2023). Psychometric Properties of the Revised Trolling Questionnaire in Argentinean Adults. Acta Colombiana de Psicología, 26(2), 101-113. https://www.doi.org/10.14718/ACP.2023.26.2.9
Abstract
Trolling with new technologies is a disruptive, deceptive, and destructive behavior, with great psychosocial, legal, and economical relevance. However, there are no studies in the scientific literature that have examined the properties of questionnaires to assess them. Therefore, the purpose of the present study was to observe the psychometric properties of the Revised Trolling Questionnaire by Buckels et al.'s in a sample of Argentinean adults. An intentional sample of 837 participants from Argentina (mean age = 28.4 years; 61% female) was formed. They completed the Buckels et al.'s Revised Trolling Questionnaire, measures of dark personality, Internet addiction, cyberstalking, and socio-demographic questions. Exploratory and confirmatory factorial analyses indicated a one-factor structure with correct fit statistics. Internal consistency was adequate: Cronbach's α = .80 and Omega coefficient (ω) = .81. Concurrent validity of the trolling questionnaire was observed with dark personality (Machiavellianism, narcissism and psychopathy), problematic Internet use (symptomatology and disfunctionality), and cyberstalking. Machiavellianism and disfunctionality were the most significant variables associated with trolling. Therefore, the Argentinean Spanish version of this test showed evidence of adequate psychometric properties.
Keywords: questionnaire, Troll, aggression, property, technology.
Resumen
El trolling mediante las nuevas tecnologías es un comportamiento disruptivo, molesto y destructivo, con una gran relevancia psicosocial, legal y jurídica. No existen estudios en la literatura científica que hayan examinado las propiedades de un instrumento para evaluarlo. El propósito del presente estudio fue observar las propiedades del Cuestionario Revisado de Trolling de Buckels et al. en una muestra de adultos argentinos. Se constituyó una muestra intencional de 837 participantes argentinos (edad promedio=28,4 años; 61% mujeres). Completaron el Cuestionario Revisado de Trolling de Buckels et al., un cuestionario de personalidad oscura (maquiavelismo, psicopatía y narcicismo), de adicción a internet, de cyberstalking y preguntas sociodemográficas. Un análisis factorial exploratorio como confirmatorio indicó una correcta estructura unifactorial. La consistencia interna fue adecuada: α de Cronbach = .80 y Omega coefficient (ω) = .81. La validez concurrente del cuestionario se observó con el cyberstalking, la personalidad oscura (maquiavelismo, narcisismo y psicopatía) y el uso problemático de Internet. El maquiavelismo y la disfuncionalidad eran las variables más asociadas al trolling. De este modo, la versión al español argentino de dicho test mostró evidencia de adecuadas propiedades psicométricas.
Palabras claves: cuestionario, Troll, agresión, propiedades, tecnología.
New technologies have grown exponentially in recent years, leading to a world of great interconnection and communication. On the other hand, they have also generated negative behaviors in their users, such as grooming, cyberstalking or trolling. Online trolling, however, has been little addressed by researchers compared to cyberbullying (Hardaker, 2010; Herring et al., 2002; Shachaf & Hara, 2010; Zezulka & Seigfried-Spellar, 2016).
The trolling phenomenon is defined in multiple ways, but always refers to disruptive, deceptive and destructive behavior in the context of the Internet, with no apparent instrumental purpose, except for disturbing others (Buckels et al., 2014; Herring et al., 2002; Navarro-Carrillo et al., 2021 ; Sanfilippo et al., 2018). Therefore, trolls have baited users to engage in conversations, enjoying the flame they initiate or generate, mainly in gaming contexts (Cook et al., 2018; Hilvert-Bruce & Neill, 2020), as in many other scenarios (Sanfilippo et al., 2017).
Although there is no consensus on how to define this behavior (Komaç & Çagiltay, 2019, Ortiz, 2020) and it is multidisciplinary (Akhtar & Morrison, 2019; Aydin et al., 2021; Hardaker, 2010; Sanfilippo et al., 2018), the most finished definition of trolling was offered by Fichman and Sanfilippo (2016) who conceptualized it as an intentionally disruptive behavior that occurs online, and between users having no existing relationship in real life. Thus, trolling is a deliberate provocation that often results in conflict and emotional reactions for the victims (Hardaker, 2010; Phillips, 2015). This is the definition used in this study to conceptualize trolling.
Trolls may act alone or in a group; indiscriminately or selectively toward specific individuals or corporate entities (Aydin et al., 2021). In some cases, trolling is reduced to a simple attempt to annoy others. On the other hand, some trolls demonstrate considerable skill, ability, creativity, and dedication (Dynel, 2016; Leone, 2017). Hence, trolling can be distinguished from other online aggression based on form, content, intent, and consequences (Fichman & Sanilippo, 2016; Hardaker, 2010; Leone, 2017; Shachaf & Hara, 2010). Sest and March (2017) differentiate it from the concept of cyberbullying, which is much more direct, repeated, purposeful, and targeted at speciic individuals. Unlike cyberbullying, trolling encompasses behaviors that may be one-off, unintentional, or untargeted (Slonje et al., 2013).In addition, the personality correlates of cyberbullying and trolling are quite different (Zezulka & Seigfried-Spellar, 2016).
Despite the efforts to prevent trolling, this behaviour is increasingly problematic given the growth of social networks and users (Case & King, 2018), especially in video game players, a space in which this behavior tends to be more justified (Hilvert-Bruce & Neill, 2020; Schaafsma, & Antheunis, 2018). For example, nearly 5.16 billion people were Internet users in 2020, encompassing 64.4% of the global population (Petrosyan, 2023). In terms of statistics on trolling, a survey conducted in the United States (Lenhart et al., 2016) found that people aged 15-29 were the most likely to report being trolled by sharing nude images (7% of cases).
With respect to trolling incidence, a survey of over 1,500 participants aged 13-18 in the United Kingdom showed that 24% of them had been bullied online because of their sexual orientation and gender, among others (Gani, 2016). The consequences of suffering online harassment are notorious for the victim: anxiety, depression, and, in some cases, suicide (Mehari et al., 2014). There are not many studies on the psychosocial consequences of trolling victims, but researchers suggested that this victimization can include committing suicide or insulting victims and their families after their death (Fichman & Sanfilippo, 2016). Due the impact and prevalence of this behavior, exploration of trolling is necessary (March, 2019).
An important behavior associated with the development of computers and mobile phones is an addiction to new technologies. It is a broad and evolving category (Soto et al., 2018), but it is defined as a constant preoccupation with new technologies and an inability to control their use (Young, 2011). One of the most common addictions in this regard is Internet addiction (Kurniasanti et al., 2019; Lam-Figueroa et al., 2011). There are almost no studies on the relationship between Internet addictions and trolling. Among the few studies available, one of them found that Internet addiction was associated with increased trolling behaviors (Resett & González Caino, 2019). Another study detected relationships between the frequency of online comments, trolling enjoyment, and trolling behavior (Buckels et al, 2014). Because other studies (Buckels et al., 2014; González Caino & Resett, 2020; Resett & González Caino, 2019) identified a strong relationship between Internet addiction and trolling, mainly due to the disinhibition effect and problems controlling its use (Aydin et al., 2021; Nitschinsk et al., 2022), this study aimed to examine this association.
Another disruptive behavior through new technologies that has spread rapidly is cyberstalking (Wilson et al., 2022), which is defined as stalking, chasing, and manipulating others through information technologies (Sheridan & Grant, 2017; Shorey et al., 2015; Smoker & March, 2017) with negative psychosocial consequences for victims (March et al., 2020). Although cyberstalking and trolling are different constructs, both could be associated because they share aggressive attributes (Corcoran et al., 2015). On the other hand, both can be associated because of Internet addiction. For example, the relationship between cyberstalking and Internet addiction is well established in many studies (e. g., Navarro et al., 2015; Resett & González Caino, 2020), and between Internet addiction and trolling, as noted.
Many researchers have argued that relative anonymity on the Internet facilitates disinhibition, which leads to aggression and trolling (e.g., Nitschinsk et al., 2022). Thus, this disinhibition effect on aggression and other variables has been vastly studied in the psychological literature, including that individuals may feel more confident to attack if they believe they are protected by anonymity (e.g., Aydin et al., 2021; Nitschinsk et al., 2022; Smoker & March 2017; Widyanto & Griffiths, 2011). On the other hand, the personal knowledge afforded by an established relationship gives perpetrators of cyberbullying an advantage in the ability to manipulate their victim (Smoker & March 2017; Spitzberg & Cupach, 2007). In line with this, Smoker and March (2017) found that Machiavellianism was the most significant predictor. Hence, individuals with high scores on Machiavellianism may tend to engage in both trolling and cyberstalking behaviors.
Concerning the psychological and psychosocial variables predicting trolling, this was associated with normative beliefs in aggression (Hilvert-Bruce & Neill, 2020), self-esteem (March & Steele, 2020; Zezulka & Seigfried-Spellar, 2016), sadism (Buckels et al., 2014; Buckels et al., 2018), and social reward (Craker & March, 2016). However, one of the most important aspects in this respect is dark personality, whose traits are strongly associated with aggressive behavior (Hidalgo-Fuentes, 2023). According to Vize et al. (2020), this construct is defined as negative, malicious or aversive personality traits (Machiavellianism, narcissism, and psychopathy), but which are frequent in normal populations (Furnham et al., 2013). Therefore, scientific studies on dark personality have been increasing, exploring these aversive personality traits, based on narcissism, Machiavellianism and psychopathy (Muris et al., 2017). Subclinical narcissism is divided into two: grandiose and vulnerable. Grandiose narcissism is characterized by exhibitionism, lack of humility and modesty, and interpersonal dominance; on the other hand, vulnerable narcissism is characterized by negative affect, distrust and the need for attention and recognition (Miller et al., 2012).
On the other hand, Machiavellianism is defined by a pattern of strategic thinking, manipulative ability, and callous pragmatism, where the desire for success shows control of impulsivity (Miller et., 2017). Finally, subclinical psychopathy is characterized by insensitivity, lack of empathy, impulsivity, disinhibition, and malice, being the most aversive construct within the dark triad due to its relationship to antisocial behavior and aggression (Paulhus & Williams, 2002; Resett et al., 2022). Buckels et al. (2014) found a significant correlation between dark personality and trolling behavior, which can be understood as an activity enjoyed by the perpetrator. This was also confirmed by Craker and March (2016), Lopes and Yu (2017), and March et al. (2017). Sest and March (2017) -using R-GAIT- found psychopathy to be a more significant predictor compared to the remainding.
As a very frequent behavior on the Internet, the need for a scale to measure trolling is evident. The Global Assessment of Internet Trolling (GAIT, Buckels et al., 2014) is one of the few instruments available to measure it. Although this questionnaire is one of the few existing ones with adequate properties, a major disadvantage is that it consists of only four items. Field (2013) indicated that so few items may be insufficient to evaluate a construct. For this reason, Sest and March (2017) reviewed the GAIT and added four more questions to improve construct validity. The Revised version of the GAIT (R-GAIT) demonstrated reliability and construct validity (Sest & March, 2017). Although there are many data collection techniques (observations, interviews, etc.), the advantages of self-reports are their ease of application and interpretation (Hartung et al., 2011). One the other hand, another advantage of this questionnaire is that it considers the conceptualization of trolling as an intentionally disruptive behavior that occurs on the Internet for no other purpose than to annoy others.
Despite public awareness of this behaviour and the growth of Internet users, there is little empirical research on trolling (Buckels et al., 2014). Therefore, the value of the present study is to be the irst one in the scientiic literature to assess the psychometric properties of the R-GAIT -a brief and self-administered questionnaire. Examining in detail the psychometric properties of an instrument to evaluate trolling is of remarkable importance. Not only for the theoretical value of this behavior, but also for the early detection and prevention of a problem with important psychosocial, clinical, legal, and economic implications.
Aims
To explore the factor structure and internal reliability of the revised Trolling Questionnaire (R-GAIT).
To examine the concurrent validity of this questionnaire with dark personality, Internet addiction, and cyberstalking.
Method
Type of study
The research was part of a larger study called Test Adaptation for the Measurement of Violence and Aggression. It was a psychometric study.
Participants
The sample was intentionally selected, comprised of adults (N = 837) from the Autonomous Cities of Buenos Aires and Paraná, Argentina. To recruit participants, the following criteria were considered: adults of both genders, aged between 18 and 50, who had completed secondary education and were familiar with the new technologies -such as mobile phones and computers-. Twenty-three participants were excluded because they were younger or older than 50, had not completed secondary school, or did not regularly use new technologies. Concerning age, the average was 28.4 years (SD = 9.4). Regarding gender, 39% were male and 61% female. In terms of education, 18% had completed secondary studies, 41% had some university studies, 33% had completed university studies and the remaining group was completing or had completed postgraduate studies.
Measures
Sociodemographic questionnaire: gender, age, among others Revised Global Assessment for Internet Trolling (R-GAIT) ( Sest & March, 2017 )
It consists of eight questions that are answered on a five-point Likert scale ranging from 1 (strongly disagree) to 5 (strongly agree). The items are: "I have sent people to unpleasant internet sites just for pleasure"; "I like to annoy, tease or insult people on the Internet (e.g. on forums or websites)"; "I like to annoy other players in-network or internet video games"; "The nicer a thing is, the more I feel like destroying it"; "I enjoy upsetting people I do not personally know on the Internet"; "Although some people think my posts/comments are offensive, I think they are funny"; "I say what I like, and if people can't handle it, it's just because they can't handle the truth" and "I prefer not to cause controversy or stir up trouble"(reversed). The irst four questions are from the original GAIT (Buckels et al., 2014). The irst three questions measured trolling performance and trolling enjoyment, while the last question is about identiication with the trolling culture. Sest and March (2017) added the other four remaining questions for better measurement of the construct. Questions can be added or averaged to derive a global score.
The original version showed construct validity as adequate internal reliability (Buckels et al., 2014; Buckels et al., 2018). Similarly, the revised version indicated adequate Cronbach's a = .85 and concurrent validity (Sest & March, 2017) with dark personality, sadism, and empathy. In this study, the Buckels et al. (2014) trolling questionnaire adapted to Argentina by Resett and González Caino (2019) was used. The remaining four questions were translated following recommendations of Muñiz et al. (2013). Those who translated from English to Spanish were researchers in psychology with knowledge of English, while the Spanish version was translated back into English by two different translators (native English speakers with knowledge of the Spanish language). Finally, the Spanish version was administered to 44 psychology students in a pilot sample. Cronbach's a was = .84 in this pilot sample.
Short Dark Triad ( SD3; Jones & Paulhus, 2014 )
The SD3 is a 27- item instrument divided into three subs-cales to measure each trait of the dark triad of personality: Machiavellianism, narcissism, and psychopathy. It presents a Likert-type response option with five choices ranging from strongly disagree (1) to strongly agree (5). Higher scores reflect higher levels of dark personality. Its psychometric properties - validity and reliability - are well determined in the United States and Northern European nations (Furnham et al., 2013; Jones & Paulhus, 2014) and Latin American countries, such as Argentina (Resett & González Caino, 2020) and Spain (Pineda et al., 2020). Cronbach's as were .84, .72, and .83 in the present study, respectively.
Intimate partner cyberstalking Scale ( Smoker & March 2017 )
It consists of 21 items to measure online cyberstalking behaviors towards romantic partners, love ex-partners or positive attitudes toward cyberstalking. A sample question is: "I would help or have helped friends access their partner/ ex-partner's online accounts". Responses are scored on a Likert scale from 1 (strongly disagree) to 5 (strongly agree). Higher scores indicate a higher level of the construct being assessed. In first -world countries, this scale showed adequate internal reliability and construct validity. In Argentina, it also presented satisfactory internal consistency and construct validity (Resett & González Caino, 2020). Cronbach's a was .94 in this study.
Scale for Internet Addiction ( Lam-Figueroa et al., 2011 ).
This scale measures Internet addiction and has two dimensions: behavioral symptoms with eight questions (being online for a long time, feeling bad when not online, among others) and dysfunctionality, with three questions (problems associated with addiction: missing work or school because of being online for a long time, among others). Each item is rated on a 4-point scale ranging from Very seldom (1) to Always (4). Its psychometric properties are well- established in South American countries (Lam-Figueroa et al., 2011; Resett & Gonzalez Caino, 2019). Cronbach's as in the present study were .88 and .70, respectively.
Procedures
The purpose of the study was explained to the participants, and confidentiality, anonymity of responses, and voluntary participation were assured. Participants were recruited through social networks -Facebook and Instagram, among others- or at two universities in psychology courses. Questionnaires were sent by email or were answered at the university, with 61% of responses online and 39% face-to-face.
Ethical aspects
The study was approved by the Universidad Argentina de la Empresa following international and national ethical guidelines. It was determined that the research participants were not at any psychosocial risk.
Statistical analysis
Data were analyzed with the Statistical Program for Social Sciences SPSS version 23, MPLUS 6, and LISREL Student version. When examining the skewness and kurtosis values, it was observed that the trolling items deviated from normality. For skewness, the values ranged from .72 to 3.93. For kurtosis, they ranged from .41 to 9.83. Skewness values greater than 3 and kurtosis values of 8 to 20 -or more- are considered extreme (Kline, 2015; Tabacknick & Fidell, 2014). Other authors postulate similar criteria with values of 2 and 7, respectively (Boomsma & Hoogland, 2001; Chou & Bentler, 1995; Curran et al., 1996).
On the other hand, it was also detected that the relative multivariate kurtosis was not met by a p <.001. The sample was randomly divided into two groups: n = 400 participants for exploratory factor analysis EFA and the rest for the confirmatory factor analysis CFA (n = 437). The EFA was carried out using the weighted least squares (WLS) method, because this indicator is suitable for categorical data (Brown, 2006). Running the WLS is the recent recommendation instead of using principal component analysis (Flora et al., 2012; Lloret-Segura et al., 2014). Similarly, confirmatory factor analysis was performed using the weighted least squares robust method (WLSMV), as it is suggested for categorical data with a with less than five options and non-normal distribution (Byrne, 2012; Brown, 2006). To assess model fit, CFI and TLI were taken into account, which must have values above .90, and RMSEA and SRMR values below .10 to be acceptable (Bentler, 1992; Byrne, 2010). The more stringent criteria of CFI and TLI above.95 and RMSEA and RMR below. 05 were also considered in this regard (Hu & Bentler, 1999).
Finally, the significance of the model's x2 and the average variance extracted AVE were considered, which must be greater than .50 (Hair et al., 2010). Non-significant x2 values are a demanding criterion and depend on the sample size (Byrne, 2010). For this reason, it is suggested to divide x2 by degrees of freedom. Although there is no universally agreed standard as to what is good in this respect, values of 3 or less are a common reference point (Cupani, 2012). For internal consistency, although Cronbach α index was reported, the composite reliability calculation was also used -the latter is a more current and more convenient index for ordinal data (Oliden & Zumbo, 2008). Due to the ordinal nature of the scale, the McDonalds Omega coefficient (ω) was also calculated using the Jamovi 2.2.5 program. To examine concurrent validity, Spearman correlations were performed between the trolling scores and the other variables, as the trolling scale could not be considered a continuous variable. SPSS software was used to calculate Cronbach's a and correlations; MPLUS for the EFA, and CFA; and LISREL for the calculation of relative multivariate kurtosis.
Results
To assess the factor structure of the R-GAIT, an EFA was first performed. The results showed that the one-factor model was the only acceptable solution and the only with eigenvalues > 1 (4.66). The goodness-of-fit values were correct CFI =.98 TLI = .97 RMSEA = .07 SRMR = .05 x2(20) = 133.80; p < .001. This structure explained 58% of the variance. All item loadings were above .33, as shown in Table 1.
Factor loadings from the EFA of R-GAIT
To further examine its factor structure, a CFA was conducted with the eight items of the R-GAIT to test the modelling that had emerged in EFA, such as presented in Figure 1. An inadequate modelling fit was found, as shown in Table 2 (Model 1). When looking at the under-specification indices, two covariances were found between the measurement errors of items 1 and 2, and 6 and 7, respectively. By specifying the covariance between the measurement error between items 1 and 2 and between items 6 and 7 (42.37 and 60.87, respectively), as shown in Figure 2, the model it increased satisfactorily for all indicators, as presented in Table 2. This re-speciication was carried out following Byrne (2010, 2012) who indicates that such covariances may be due to the fact that the items ask about similar topics or there is a bias in answering these questions. Although the x2 of the model was significant (p <.02), when divided by the degree of freedom, a value of 1.79 was found. The factor loading of each item was significant (p <.001) and ranged from .31 to .77. The mean variance extracted was 1.51.
When exploring the internal consistency of the R-GAIT, Cronbach's a was .76, and when assessing the correlation of each item with the corrected total score about the impact of the item in question, very acceptable correlations were found. The correlation of each item with the corrected total score ranged from .40 to .60, with the sole exception of item eight, whose correlation was .21. When this item was removed, reliability amounted to .80 and all items loaded above .41. Compound reliability showed a satisfactory value at .98. With respect to the Omega coefficient, it was .81.
Hypothesized one-factor CFA model of R-GAIT
Hypothesized one-factor CFA model of R-GAIT with covariances among measurement errors
Results from the CFA of R-GAIT
Note. fd = degrees of freedom. CFI = Comparative Fix Index. TLI = Tucker-Lewis Index. RMSEA = root mean square of residuals. WRMR = weight root mean square residual. ∆x2 = difference in x2 between models. ∆df = difference in degress of freedom between models. ∆CFI difference of CFI between.
To explore the concurrent validity of the R-GAIT, Spearman correlations were computed between scores of R-GAIT and the dark triad of personality, on one hand, and scores of R-GAIT and addiction to the Internet and cyberstalking. As shown in Table 3, trolling scores correlated positively and signiicantly with Machiavellianism, narcissism, and psychopathy. Also, trolling scores correlated positively and signiicantly with dysfunctionality, symptomatology, and cyberstalking, as is shown in Table 4.
Spearman correlations between dark personality and trolling
** p = .003
***p < .001
Spearman correlations between Internet addiction, cyberstalking and trolling
** p = .002
***p < .001
Discussion
The purpose of this paper was to evaluate the psychometric properties of the Revised Global Trolling Questionnaire (R-GAIT) (Sest & March, 2017) in an Argentinean sample. This test is one of the most widely used to measure such behavior in the world, although there are no studies on its properties in international studies. To assess its concurrent validity, variables that showed a strong association with said behavior in international studies, such as dark personality, cyberstalking, and Internet addiction were examined.
In terms of factor structure, both the exploratory and conirmatory analyses found a one- factor model. In the EFA, this structure explained 58% of the variance and all factor loadings were above .33. The CFA yielded a very good fit: CFI and TLI above .95 and RMSEA and WRMR below .05. The results were even in line with recent criteria of CFI above .97 and RSMEA and WRMR below .07 (Hair et al, 2010). Although there are no other studies with which to compare these results, this unidimensional factor structure is similar to that detected for the GAIT by Buckels et al. (Resett & González Caino, 2019).
Regarding its internal consistency, it was Cronbach's α = .76. An index between .70 and .80 is considered an adequate estimate of internal consistency (DeVellis, 2012; Kaplan & Saccuzzo, 2006; Loewenthal, 2001 ). By eliminating item eight "I preferred not to cause controversy or stir up trouble", due to its low correlation with the corrected total score, the consistency increased to .80. Item eight is the only reversed question. Many authors suggest that these questions may generate response bias (Solís-Salazar, 2015; Suárez et al., 2018; Van Sonderen et al., 2013). Another study with the R-GAIT also found satisfactory values of .84 (Sest & March, 2017). Composite reliability (.98) and the Omega index (.81) were also adequate (.98).
As for its concurrent validity, significant and positive associations of the R-GAIT with the three dimensions of dark personality were observed. Similar indings were detected by Lopes and Yu (2017). They also coincide -albeit partially- with Buckels et al. (2014), who found associations between Machiavellianism and psychopathy but did not detect correlations between narcissism and trolling. However, another study did ind the latter association (Furian & March, 2023), while Craker and March (2016) and Volkmer et al. (2023) detected significant correlations between psychopathy and R-GAIT. The fact that in the present study, trolling was associated both with Machiavellianism and psychopathy is not surprising due to the aggressive and manipulative features of trolling (Hardaker, 2013). The relationship between narcissism and aggression is not surprising either. Research indicates that narcissitic individuals may react aggressively to feel superior or when their ego is threatened (Jones & Paulhus, 2010).
In line with other studies, trolling scores were positively associated with Internet addiction (Buckels et al., 2014; Resett & Gonzalez Caino, 2019). Regarding the relationship with cyberstalking, associations with trolling were also detected. The fact that some associations were small or moderate can be explained by the fact that constructs in psychology are multidetermined. It is posible that the relationships of trolling with Internet addiction and cyberstalking could be explained not only by the desinhibition and anonimity related to social networks, as suggested for trolling (Nitschinsk et al., 2022), but also by the technological motivations of trolls (desire for challenge, desire for innovation and exploration, among others) (Fichman & Sanilippo, 2016).
Even though Argentina is a less developed country with a different cultural tradition from the irst world, such as northern European countries, the United States or Canada, these indings suggest that this instrument would present evidence of psychometric properties in Spanish. In addition, it could be a useful tool to distinguish trolling from other online aggressions, such as cyberbullying or hacking. Also, as it is a brief questionnaire, but with solid psychometric properties, it can be a quick screening tool to promptly detect and prevent this problem in adolescents and young people, as well as other problems associated with new technologies, such as Internet addiction or cyberstalking. In this sense, it is a very useful instrument to measure the effectiveness of interventions carried out to reduce trolling and other aggressive online behaviors. It also contributes to the prevention of possible factors associated with trolling that should be taken into account for its detection, such as dark personality and Internet addiction.
This study has several limitations that should be mentioned: Firstly, it was conducted with an intentional sample of adults from the Autonomous City of Buenos Aires and Paraná, Argentina. On the other hand, the data have been collected through self-report, which artificially inflates the relationships between variables due to the variance shared by the data collection method. Also, self-report has known limitations: response bias, lack of honesty in the answers, giving extreme responses or marking socially desirable alternatives, mainly in negative behaviors such as trolling and where many participants - because of their aversive behavior or their troll behavior - may have responded with much dishonesty, irony or withholding socially undesirable information. In addition, the fact that the study was been cross-sectional does not allow assessing its test / re-test reliability and does not allow inferring the directionality of the causality between variables.
Future studies should examine this problem in larger, randomly selected samples from several cities in Argentina - as well as examine the properties in samples from other countries - to generalize the results and determine whether they maintain their measurement invariance across different regions and nations. A relevant issue is that future research should be longitudinal, both to examine the test / retest consistency and to determine how temporarily stable trolling is - considering the rapid changes occurring in new technologies.
References
Akhtar, S., & Morrison, C. (2019). The prevalence and impact of online trolling of UK members of parliament. Computers in Human Behavior, 99, 322-327. https://doi.org/10.1016/j.chb.2019.05.015
Aydin, A., Arda, B., Güneş. B., & Erbaş, O. (2021). Psychopathology of Cyberbullying and Internet Trolling. Journal of Experimental and Basic Medical Sciences, 2(3), 380-391. https://www.jebms.org/full-text/79
Bentler, P. M. (1992). On the fit of models to covariances and methodology to the Bulletin. Psychological Bulletin, 112(3), 400-404.
Boomsma, A., & Hoogland, J. J. (2001). The Robustness of LISREL Modeling Revisited. In R. Cudeck, S. du Toit, & D. Sörbom (Eds.), Structural Equation Models: Present and Future. A Festschrift in Honor of Karl Jóreskog (pp. 139-168). Scientific Software International.
Brown, T. A. (2006). Confirmatory factor analysis for applied research. Guilford Press.
Buckels, E. E., Trapnell, P. & Andjelovic, T., & Paulhus, D. L. (2018). Internet Trolling and Everyday Sadism: Parallel Effects on Pain Perception and Moral Judgment. Journal of Personality, 87(2), 328-340. https://doi.org/10.1111/jopy.12393
Buckels, E., Trapnell, P., & Paulhus, D. (2014). Trolls just want to have fun. Personality and Individual Differences, 67, 97-102. https://doi.org/10.1016/j.paid.2014.01.016
Byrne, B. (2010). Structural equation modeling with AMOS: Basic concepts, applications, and programming. Routledge.
Byrne, B. (2012). Structural equation modeling with MPLUS: Basic concepts, applications, and programming. Routledge.
Case, C., & King, D. (2018). Internet Trolling Victimization: An Empirical Examination of Incidence in Undergraduate Business Students. Research in Higher Education Journal, 34, 32-40. https://www.aabri.com/manuscripts/172726.pdf
Chou, C.-P., & Bentler, P. M. (1995). Estimation and tests in structural equation modeling. In R. H. Hoyle (Ed.), Structural equation modeling: Concepts, issues, and applications (pp. 37-55). Sage.
Cook, C., Corcoran, L., Mc Guckin, C., & Prentice, G. (2015). Cyberbullying or Cyber Aggression? A Review of Existing Definitions of Cyber-Based Peer-to-Peer Aggression. Societies, 5(2), 245-255. https://doi.org/10.3390/soc5020245
Craker, N., & March, E. (2016). The dark side of Facebook®: The Dark Tetrad, negative social potency, and trolling behaviours. Personality and Individual Differences, 102, 79-84. https://doi.org/10.1016/j.paid.2016.06.043
Cupani, M. (2012). Análisis de Ecuaciones Estructurales: conceptos, etapas de desarrollo y un ejemplo de aplicación. Tesis, 1,186-199. https://rdu.unc.edu.ar/bitstream/handle/11086/22039/16.pdf?sequence=1&isAllowed=y
Curran, P. J., West, S. G, & Finch, J. F. (1996). The robustness of test statistics to nonnormality and s pecification error in confirmatory factor analysis. Psychological Methods, 1, 16-29. https://web.archive.org/web/20170808040148id_/http://hbanaszak.mjr.uw.edu.pl/TempTxt/CurranEtAl_1996_RobustnessOíTestStatistToNonormalityInCFA.pdf
DeVellis, R. F. (2012). Scale Development: Theory and Applications. Sage.
Dynel, M. (2016). "Trolling is not stupid": Internet trolling as the art of deception serving entertainment. Intercultural Pragmatics, 13(3), 353-381. https://doi.org/10.1515/ip-2016-0015
Fichman, P., & Sanfilippo, M. R. (2016). Online trolling and its perpetrators: Under the cyberbridge. Rowman & Littlefield.
Field, A. (2013). Discovering Statistics Using IBM SPSS Statistics And Sex and Drugs and Rock "N" Roll. Sage.
Flora, D. B., LaBrish, C., & Chalmers, R. P. (2012). Old and new ideas for data screening and assumption testing for exploratory and confirmatory factor analysis. Frontiers in Quantitative Psychology and Measurement, 3(55), Article e55. https://doi.org/10.3389/fpsyg.2012.00055
Furian, L., & March, E. (2023). Trolling, the Dark Tetrad, and the four-facet spectrum of narcissism. Personality and Individual Differences, 208, Article e112169. https://doi.org/10.1016/j.paid.2023.112169
Furnham, A., Richards, S. C. & Paulhus, D. L. (2013). The Dark Triad of personality: A 10 year review. Social and Personality Psychology Compass, 7(3), 199-216. https://doi.org/10.1111/spc3.12018
Gani, A. (2016, February 9). Internet trolling: quarter of teenagers suffered online abuse last year. The Guardian. https://www.theguardian.com/uk-news/2016/feb/09/internet-trolling-teenagers-online-abuse-hate-cyberbullying
González Caino, P., & Resett, S. (2020). Predicción del Trolling desde el sadismo y la adicción a Internet en jóvenes adultos de Buenos Aires. Interacciones, 6(3), Article e178. http://dx.doi.org/10.24016/2020.v6n3.178
Hair, J. F., Black, W. C., Babin, B.J., & Anderson, R.E. (2010). Multivariate Data Analysis (7th Edition). Pearson.
Hardaker, C. (2010). Trolling in asynchronous computer mediated communication: From user discussions to academic definitions. Journal of Politeness Research, 6(2), 215-242. https://doi.org/10.1515/jplr.2010.011
Hardaker, C. (2013). "Uh... not to be nitpicky, but... the past tense of drag is dragged, not drug": An overview of trolling strategies. Journal of Language Aggression and Conflict, 1(1), 58-86. https://doi.org/10.1075/jlac.1.1.04har
Hartung, C., Little, C., S., Allen, E., K., & Page, M. (2011). A psychometric comparison of two self-report measures of bullying and victimization: Differences by sex and grade. School Mental Health, 3, 44-57. https://doi.org/10.1007/s12310-010-9046-1
Herring, S.C., Job-Sluder, K., Scheckler, R., & Barab, S. (2002). Searching for Safety Online: Managing "Trolling" in a Feminist Forum. The Information Society, 18(5), 371-384. https://doi.org/10.1080/01972240290108186
Hidalgo-Fuentes, S. (2023). La relación de los factores de personalidad y la conducción agresiva: los Cinco Grandes y la Tríada Oscura. Acta Colombiana de Psicología, 26(1), 188-199. https://www.doi.org/10.14718/ACP.2023.26.1.12
Hilvert-Bruce, Z., & Neill, J. (2020). I'm just trolling: The role of normative beliefs in aggressive behaviour in online gaming. Computers in Human Behavior, 102, 303311. https://doi.org/10.1016Zj.chb.2019.09.003
Hu, L.T., & Bentler, P.M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1-55. https://doi.org/10.1080/10705519909540118
Jones, D. & Paulhus, D. (2010). Different Provocations Trigger Aggression in Narcissists and Psychopaths. Social Psychological and Personality Science, 1(1), 12-18. https://doi.org/10.1177/1948550609347591
Jones, D., & Paulhus, D. (2014). Introducing the short Dark Triad (SD3): A brief measure of dark personality traits. Assessment, 21(1), 28-41. https://doi.org/10.1177/1073191113514105
Kaplan, R. M., & Saccuzzo D. P. (2006). Pruebas psicológicas: principios, aplicaciones y temas. (6th edition). International Thomson.
Kline, R. (2015). Principles and practice of structural equation modeling (4th edition). Guilford.
Komaç, G., & Çagiltay, K. (2019, 6-7 November). An Overview of Trolling Behavior in Online Spaces and Gaming Context. Paper presented at 1st International Informatics and Software Engineering Conference, Ankara, Turkey. https://doi.org/10.1109/UBMYK48245.2019.8965625
Kurniasanti, K.S, Asanti, P., Ismail, R.I., Nasrun. M.W.S., & Wiguna, T. (2019). Internet addiction: a new addiction? Medical Journal of Indonesia, 28(1), 82-91. https://mji.ui.ac.id/journal/index.php/mji/article/view/2752
Lam-Figueroa, N., Contreras-Pulache, H., Mori-Quispe, E., Nizama-Valladolid, M., Gutiérrez, C., Hinostroza-Camposano, W., Torrejon Reyes, E., Hinostroza-Camposano, R., Coaquira-Condori, E., & Hinostroza-Camposano, W. (2011). Adicción a internet: Desarrollo y validación de un instrumento en escolares adolescentes de Lima, Perú. Revista Peruana de Medicina Experimental y Salud Pública, 28(3), 462-469. https://doi.org/10.17843/rpmesp.2011.283.524
Lenhart, A., Ybarra, M., & Price-Feeney, M. (2016). Nonconsensual Image Sharing: One In 25 Americans Has Been A Victim Of "Revenge Porn". Data & Society Research Institute. https://datasociety.net/pubs/oh/Nonconsensual_Image_Sharing_2016.pdf
Leone, M. (2017). The art of trolling. Unpublished manuscript, University of Turin.
Lloret-Segura, S., Ferreres-Traver, A., Hernández-Baeza, A., & Tomás-Marco, I. (2014). El análisis factorial exploratorio de los ítems: una guía práctica, revisada y actualizada. Anales de Psicología, 30(3), 1151-1169. http://dx.doi.org/10.6018/analesps.30.3.199361
Loewenthal, K. M. (2001). An introduction to psychological tests and scales (2nd edition). Psychology Press.
Lopes, B., & Yu, H. (2017). Who do you troll and Why: An investigation into the relationship between the Dark Triad Personalities and online trolling behaviours towards popular and less popular Facebook profiles. Computers in Human Behavior, 77, 69-76. https://doi.org/10.1016/j.chb.2017.08.036
March, E. (2019). Psychopathy, sadism, empathy, and the motivation to cause harm: New evidence confirms malevolent nature of the internet troll. Personality and Individual Differences, 141, 133-137. https://doi.org/10.1016/j.paid.2019.01.001
March, E., Grieve, R., Marrington, J., & Jonason, P. K. (2017). Trolling on Tinder® (and other dating apps): examining the role of the Dark Tetrad and impulsivity. Personality and Individual Differences, 110, 139-143. https://doi.org/10.1016/j.paid.2017.01.025
March, E., Litten, V., Sullivan, D. H., & Ward, L. (2020). Somebody that I (used to) know: Gender and dimensions of dark personality traits as predictors of intimate partner cyberstalking. Personality and Individual Differences, 163, Article 110084. https://doi.org/10.1016/j.paid.2020.110084
March, E., & Steele, G. (2020). High Esteem and Hurting Others Online: Trait Sadism Moderates the Relationship Between Self-Esteem and Internet Trolling. Cyberpsychology Behavior, and Social Network, 23(7), 441-446. https://doi.org/10.1089/cyber.2019.0652
Mehari, K. R., Farrell, A. D., & Le, A. H. (2014). Cyberbullying among adolescents: Measures in search of a construct. Psychology of Violence, 4(4), 399-415. https://doi.org/10.1037/a0037521
Miller, J., Lynam, D., Hyatt, C., & Campbell, K. (2017). Controversies in Narcissism. Annual review of clinical psychology, 13(1), 291-315. https://doi.org/10.1146/annurev-clinpsy-032816-045244
Miller, J., Price, J., Gentile, B., Lynam D., & Campbell, W. (2012). Grandiose and vulnerable narcissism from the perspective of the interpersonal circumplex. Personalilty and Individual Differences, 53(4), 507-512. https://doi.org/10.1016/j.paid.2012.04.026
Muñiz, J., Elosua, P., & Hambleton, R. K. (2013). Directrices para la traducción y adaptación de los tests: segunda edición. Psicothema, 25(2), 151-157. https://doi.org/10.7334/psicothema2013.24
Muris, P., Merckelbach, H., Otgaar, H., & Meijer, E. (2017). The malevolent side of human nature: A meta-analysis and critical review of the literature on the dark triad (narcissism, Machiavellianism, and psychopathy). Perspectives on Psychological Science, 12(2), 183-204. https://doi.org/10.1177/1745691616666070
Navarro, J., Marcum, C., Higgins, G., & Ricketts, M. (2015). Addicted to the Thrill of the Virtual Hunt: Examining the Effects of Internet Addiction on the Cyberstalking Behaviors of Juveniles. Deviant Behavior, 37(8), 893-903. https://doi.org/10.1080/01639625.2016.1153366
Navarro-Carrillo, G., Torres-Marín, J., & Carretero-Dios, H. (2021). Do trolls just want to have fun? Assessing the role of humor-related traits in online trolling behavior. Computers in Human Behavior, 114, Article e106551. https://doi.org/10.1016/j.chb.2020.106551
Nitschinsk, L, Tobin, S.J., & Vanman, E.J. (2022). The Disinhibiting Effects of Anonymity Increase Online Trolling. Cyberpsychology, Behavior, and Social Network, 25(6), 377-383. https://doi.org/10.1089/cyber.2022.0005
Oliden, P. & Zumbo, B. (2008). Coeficientes de fiabilidad para escalas ordinales. Psicothema, 20(4), 896-901. https://www.psicothema.com/pdf/3572.pdf
Ortiz, S. M. (2020). Trolling as a Collective Form of Harassment: An Inductive Study of How Online Users Understand Trolling. Social Media & Society, 6(2), Article e205630512092851. https://doi.org/10.1177/2056305120928512
Paulhus, D. L, & Williams, K. M. (2002). The Dark Triad of personality: Narcissism, Machiavellianism, and psychopathy. Journal of Research in Personality, 36(6), 556-563. https://doi.org/10.1016/S0092-6566(02)00505-6
Petrosyan, A. (2023, April 3). Number of internet and social media users worldwide as of January 2023. Statista. https://www.statista.com/statistics/617136/digital-population-worldwide/
Phillips, W. (2015). This is why we can't have nice things: Mapping the relationship between online trolling and mainstream culture. The MIT Press.
Pineda, D., Sandín, B., & Muris, P. (2020). Psychometrics properties of the Spanish version of two Dark Triad scales: The Dirty Dozen and the Short Dark Triad. Current Psychology, 39, 1873-1881. https://doi.org/10.1007/s12144-018-9888-5
Resett, S., & González Caino, P. (2019). Propiedades psicométricas de un Cuestionario de Trolling en una muestra argentina. Revista Argentina de Ciencias del Comportamiento, 11(1), 48-57. https://doi.org/10.32348/1852.4206.v11.n1.20870
Resett, S., & González Caino, P. (2020). Un modelo para predecir el cyberstalking a partir de la personalidad y el uso de TIC. Revista Argentina de Ciencias del Comportamiento (Suplemento), 12(1), 135-136. https://dialnet.unirioja.es/servlet/articulo?codigo=7447330
Resett, S., González Caino, P., & Zapata, J. (2022). Propiedades Psicométricas del Dirty Dozen en Adultos Masculinos Recluidos en Establecimientos Penitenciarios. Revista Iberoamericana de Diagnóstico y Evaluación, 2(63), 103-118. https://doi.org/10.21865/RIDEP63.2.08
Sanfilippo, M. R., Fichman, P., & Yang, S. (2018). Multidimensionality of online trolling behaviors. The Information Society, 34(1), 27-39. https://doi.org/10.1080/01972243.2017.1391911
Sanfilippo, M. R., Yang, S., & Fichman, P. (2017). Trolling here, there, and everywhere: perceptions of trolling behaviors in context. Journal of the Association for Science and Technology, 68(10), 2313-2337. https://doi.org/10.1002/asi.23902
Schaafsma, J., & Antheunis, M. (2018). Under the bridge: An in-depth examination of online trolling in the gaming context. New Media & Society, 20(9), 3323-3340. https://doi.org/10.1177/1461444817748578.
Shachaf, P., & Hara, N. (2010J. Beyond vandalism: Wikipedia trolls. Journal of Information Science, 36(3), 357-370. https://doi.org/10.1177/0165551510365390
Sheridan, L. & Grant, T. (2007). Is cyberstalking different? Psychology, Crime and Law, 13(6), 627-640. https://doi.org/10.1080/10683160701340528
Shorey, R., Cornelius, T. & Strauss, C. (2015). Stalking in College Student Dating Relationships: A Descriptive Investigation. Journal of Family Violence, 30(7), 935-942. https://doi.org/10.1007/s10896-015-9717-7
Sest, N., & March, E. (2017). Constructing the cyber-troll: Psychopathy, sadism, and empathy. Personality and Individual Differences, 119, 69-72. https://doi.org/10.1016/j.paid.2017.06.038
Slonje, R., Smith, P., & Frisén, A. (2013). The nature of cyberbullying, and strategies for prevention. Computers in Human Behavior, 29(1), 26-32. https://doi.org/10.1016lj.chb.2012.05.024
Smoker, M. & March, E. (2017). Predicting Perpetration of Intimate Partner Cyberstalking: Gender and the Dark Tetrad. Computers in Human Behavior, 72, 390-396. https://doi.org/10.1016/j.chb.2017.03.012
Solís-Salazar, M. (2015). The dilemma of combining positive and negative items in scales. Psicothema, 27(2), 192-199. https://doi.org/10.7334/psicothema2014.266
Soto, A., de Miguel, N., & Pérez Díaz, V. (2018). An approach to addiction to new technologies: A proposal for prevention in the school environment and rehabilitation treatment. Papeles del Psicólogo, 39(2), 120-126. https://doi.org/10.23923/pap.psicol2018.2867
Spitzberg, B. H., & Cupach, W. R. (2007). The state of the art of stalking: Taking stock of the emerging literature. Aggression and Violent Behavior, 12(1), 64-86. https://doi.org/10.1016/j.avb.2006.05.001
Suárez, J., Pedrosa, I., Lozano, L., García-Cueto, E., Cuesta, M., & Muñiz, J. (2018). Using reversed items in Likert scales: A questionable practice. Psicothema, 30, 149-158. https://doi.org/10.7334/psicothema2018.33
Tabachnick, B. G., & Fidell, L. S. (2014). Using multivariate statistics (6th edition). Allyn & Bacon/Pearson Education.
Van Sonderen, E., Sanderman R., & Coyne J. C. (2013). Ineffectiveness of reverse wording of questionnaire items: Let's learn from cows in the rain. PLOS ONE, 8, Article e68967. https://doi.org/10.1371/journal.pone.0068967
Vize, C., Collison, K., Miller, J., & Lynam, D. (2020). The "core" of the Dark Triad: A test of competing hypotheses. Personality Disorders: Theory, Research, and Treatment, 11 (2), 91-99. https://doi.org/10.1037/per0000386
Volkmer, S.A., Gaube, S., Raue, M., & Lermer, E. (2023).Troll story: The dark tetrad and online trolling revisited with a glance at humor. PLoS One,18(3), Article e0280271. https://doi.org/10.1371/journal.pone.0280271
Widyanto, L., & Griffiths, M.D. (2011). An Empirical Study of Problematic Internet Use and Self-Esteem. International Journal of Cyber Behavior, Psychology and Learning, 1(1), 13-24. https://doi.org/10.4018/ijcbpl.2011010102
Wilson, C., Sheridan, L., & Garratt-Reed, D. (2022). Examining Cyberstalking Perpetration and Victimization: A Scoping Review. Trauma Violence Abuse, 6, Article e15248380221082937. https://doi.org/10.1177/15248380221082937
Young, K. S. (2011). CBT-IA: The first treatment model for internet addiction. Journal of Cognitive Psychotherapy, 25(4), 304-312. https://doi.org/10.1891/0889-8391.25.4.304
Zezulka, L. & Seigfried-Spellar, K. (2016). Differentiating Cyberbullies and Internet Trolls by Personality Characteristics and Self-Esteem. Journal of Digital Forensics, Security and Law, 11 (3), Article 5. https://doi.org/10.15394/jdfsl.2016.1415