No. WP- 02-03
Searching for Safety Online: Managing "Trolling" in a Feminist Forum [pdf]
Indiana University, Bloomington
Kirk Job-Sluder, Rebecca Scheckler, and Sasha Barab
School of Education
Indiana University, Bloomington
Abstract. A common phenomenon in online discussion groups is the individual who baits and provokes other group members, often with the result of drawing them into fruitless argument and diverting attention from the stated purposes of the group. This study documents a case in which the members of a vulnerable online community—a feminist web-based discussion forum—are targeted by a “troller” attempting to disrupt their discussion space. We analyze the strategies that make the troller successful and the targeted group largely ineffectual in responding to his attack, as a means to understand how such behavior might be minimized and managed in general. The analysis further suggests that feminist and other non-mainstream online forums are especially vulnerable, in that they must balance inclusive ideals against the need for protection and safety, a tension that can be exploited by disruptive elements to generate intragroup conflict.
Running head: SEARCHING FOR SAFETY
Key words: CMC, trolling, deception, disruptive behavior, conflict management, feminism
Online discussion forums allow for convenient and ongoing communication among groups of people separated in place and time. In the best of cases, such forums can evolve into communities whose members share information, experience a sense of belonging, and provide mutual support (Preece, 2000; Rheingold, 1993). Moreover, the relative anonymity of the Internet can make people feel safe talking about issues that might be considered sensitive, inappropriate or dangerous in face-to-face public conversation (Donath, 1999; cf. Kiesler et al., 1984). These properties make online forums especially attractive to individuals seeking support for suffering from disease or abuse, and to members of minority social and political groups such as homosexuals, racial minorities, and feminists. Such groups can be considered vulnerable populations, in that they tend to be discriminated against or stigmatized by mainstream society.
At the same time, online discussion forums provide a new battleground for power inequities such as those motivated by sexism, racism, and heterosexism. The relative anonymity of the Internet releases some of the inhibitions of a civil society, resulting in flaming, harassment, and hate speech online (Ess, 1996). Despite the illusion they can give of security and privacy (King, 1996), online forums can be accessed by individuals hostile to the purpose of the forums, actively seeking to disrupt and undermine them. Moreover, the asynchronous, distributed nature of online discussion forums allows those motivated to disrupt discussions to have far-reaching effects. These practices, while clearly problematic, are nonetheless widespread and often tolerated, due in part to the pervasiveness of civil libertarian values on the Internet that consider abusive speech a manifestation of individual freedom of expression (Pfaffenberger, 1996).
As a consequence of these characteristics of discussion forums, non-mainstream groups must confront a number of tensions online. Primary among these is the need to balance safety for participants with openness to free expression and discussion. Even in a community of individuals who share common values and experiences, a diversity of viewpoints can be expected, and differing views must be tolerated and respected if a climate of support and trust is to be achieved and diversity encouraged . But must online communities tolerate viewpoints that are directly in conflict with the goals of the community itself? In the case of groups already on the fringes of society, this may include harassing or hostile speech that reproduces the discrimination they face in mainstream society. While some participants find that challenging prejudice online can be an empowering act of resistance, others find that it diverts energy and attention away from the goals of the group (Collins-Jarvis, 1997). If a decision is made to restrict participation in an online forum to those individuals who support its goals, a second tension arises between setting protective boundaries and avoiding “ghettoization” of the group (Hall, 1996). A common question underlying these tensions is: When—and where—is it legitimate to draw the line?
In this study, we document a case study in which the members of a vulnerable online community—a feminist web-based discussion forum—respond to an individual attempting to disrupt their discussion space. In as much as the individual represents himself insincerely (in this case, as interested in discussing feminism), we characterize his behavior as trolling, and his messages that lure members of the community into fruitless argument as trolls (Donath, 1999). With the exception of Donath (1999), who defines the phenomenon and gives examples from Usenet newsgroups, trolling has received little scholarly attention to date. In this study, we move beyond Donath’s limited, albeit useful, observations to analyze the specific mechanisms used by a troller, and the responses of the group. The troller in this case succeeded in disrupting the group for nearly two months, but the group failed to reach a consensus regarding how to deal with him, despite unanimous agreement that he was a problem. The analysis sheds empirical light on the mechanisms of online deception and disruptive behavior, and points up the challenges of dealing effectively with such behavior in large, distributed, online groups, where consensus is often difficult to achieve (Dubrovsky, et al., 1991; Sudweeks & Rafaeli, 1996).
The remainder of this paper is organized into six sections. We first review the literature on trolling and on disruption of online feminist spaces. We then discuss the data and methods used in this study. The third section analyzes in detail the troller’s behavior, including his ideological manipulation of tensions inherent in the feminist movement. This is followed by an analysis of the community’s response in which members attempt to isolate the troller by challenging, shunning and calling for the forum administrators to ban him. The fifth section discusses the forum's relative lack of success in managing the troller, noting the challenges inherent in such situations. We conclude by proposing interventions to forestall trolling behavior, and identifying further avenues for research into disruptive behavior in online discussion groups.
Trolling entails luring others into pointless and time-consuming discussions. The name derives from the practice used in fishing where a baited line is dragged behind a boat (Oxford English Dictionary, 1992), although some Internet discourse refers to the troll as a fictional monster waiting under the bridge to snare innocent bystanders. Trolling often starts with a message that is “intentionally incorrect but not overly controversial." In this respect, trolling contrasts with flaming, which is “[a]n electronic mail or Usenet news message intended to insult, provoke or rebuke, or the act of sending such a message”(Free Online Dictionary of Computing, 1998). Trolling further differs from flaming in that the goal of flame bait is to incite any and all readers, whereas the goal of a troll is to draw in particularly naïve or vulnerable readers. Catching inexperienced users or “newbies” is a commonly stated aim of trollers (Andrew, 1996; Donath, 1999). As one Internet user, Andrew, states on his web site dedicated to trolling, “The object of recreational trolling is to sit back and laugh at all those gullible idiots that will believe *anything*” (Andrew, 1996). In practice, however, trolling and flaming often merge, in that in both cases, there is intent to disrupt the on-going conversation, and both can lead to extended aggravated argument.
Donath characterizes trolling as “a game about identity deception” (Donath, 1999, p. 45) in which all the participants are not cognizant of the nature of the game. The troller tries to write something deceptive, but not blatantly so, in order to attract the maximum number of responses (Andrew, 1996; Donath, 1999). Andrew extols a successful troll:His troll ran for over a year, it is known to have generated in excess of 3,500 responses (an average of 1 response every 160 minutes for a whole year) and the greatest coup of all was when an innocent american [sic] student lost not only her internet account but was also expelled from high school for abuse of the computer systems. Somehow she had managed to get the blame for causing the troll.In the context of Usenet, where trolling first arose, a highly successful troll is one that is cross-posted to, and responded to on, many different newsgroups, thereby disrupting multiple groups with a minimum expenditure of effort. Andrew (1996) distinguishes "career trollers"—individuals who deliberately set out to disrupt groups and/or make trouble—from others motivated simply by the desire to attract attention.
The incident cited above had disastrous results for a female high school student, an outcome claimed as success by the troller. Other effects included the disruption of discussion and waste of bandwidth for a year. For Donath, there is a further repercussion, the loss of trust that can occur in a discussion group disrupted by trolling. The seriousness of this effect is dependent upon the nature of the group. Groups that deal with emotionally charged and sensitive topics, for example groups for victims of rape and sexual abuse, are more at risk than lighthearted ones. Some participants opt not to post to groups following incidents of loss of trust (Brail, 1996). In this regard, vulnerable and inexperienced CMC participants are not only more likely to be targeted by trolling, but they may also be more adversely affected by it. New users tend disproportionately to be women, the young, and other non-traditional computer users (Mowbray, 2001). For this reason, perhaps, Andrew (1996) refers to the generic target of trolling as "she".
Disruption of online feminist spaces
When women gather online, and especially when they attempt to discuss feminism, they are not uncommonly the target of negative attention from individuals, mostly men, who feel threatened by or otherwise uncomfortable with feminism. The literature on disruption of online feminist spaces dates back to the early days of computer-mediated communication research. Balka (1993) traces the history of four feminist forums from the 1980s, all of which experienced some degree of male harassment. Ebben (1994) describes the evolution of the soc.feminism newsgroup on Usenet, which was started in response to an earlier incarnation of the newsgroup (soc.women) having been taken over by men, and which itself has subsequently been taken over by men posting anti-feminist and misogynistic messages (Sutton, 1994). Collins-Jarvis (1997) documents the crisis that befell Comserve’s Gender hotline when several males began bombarding the forum with anti-feminist messages, causing female subscribers to flee the group, and the forum eventually to be shut down. In a similar vein, Reid (1994) reports an incident on a MUD for sexual abuse survivors, in which a male-presenting character with the name “Daddy” traumatized the community by shouting graphic descriptions of violent sexual acts to those present on the MUD.
In the interests of insuring a space in which women feel safe to participate, feminists online have sometimes taken the separatist route of excluding males from participation. Hall (1996) describes the practices of a women-only discussion group for lesbians and bisexuals, its reasons for not allowing men, and the challenges it faces in enforcing its women-only policy. The women-only policy of Systers, an online forum for women in computer science, is explained and justified by its founder, Anita Borg, in Camp (1996). Herring et al. (1995) suggest that women-only groups, regardless of whether they discuss feminism, are a reaction to patterns of male domination in mixed-gender discussion groups on the Internet. Women are discouraged from participating in computer mediated communication (CMC) by men posting more, longer, and more aggressive messages (Herring, 1994; Herring, 1999; Herring, Johnson, & DiBenedetto, 1995; Kramarae & Taylor, 1993; Spender, 1995), and by complaints that women are dominating the conversation even when such is not the case (Herring et al., 1995). Women-only groups create environments in which women can speak and be heard on topics of interest to them. At the same time, such groups are controversial: They risk being exclusionary and thereby provoking further male resentment (Hall, 1996), and they can become “ghettoes” in which women’s online presence is marginalized relative to the Internet at large (cf. Herring, 1994).
As an alternative to excluding male participants, some women-centered groups respond to disruptive or harassing behaviors by implementing participation policies that make it more difficult for future disruption to occur. Thus the Gender hotline re-opened with a moderator who now filters all messages received before posting them (Collins-Jarvis, 1997). The MUD for sexual abuse survivors described by Reid (1994) implemented a process of identity verification, and disabled the feature that allowed users to communicate simultaneously with everyone in the MUD. Other groups introduce a policy that allows disruptive participants to be banned from the group, as occurred in the present study.
Disruptive incidents that force group members to articulate explicit norms and rules may also have the unintended effect of strengthening an online group’s self-definition as a community. A well-known example is the virtual rape that took place on LambdaMOO, in which the characters of two women were taken over by a male-presenting character, MrBungle, and made to commit violent sexual acts on themselves in a public forum. This incident was greeted with widespread outrage in LambdaMOO, although the group could not agree on how MrBungle should be dealt with, even after a public meeting was held in the MOO to discuss it. Ultimately, a single wizard took matters into his own hands and “killed” MrBungle’s character. As a result of these disruptive events, a system of self-governance was established on the MOO, complete with elected officials, effectively institutionalizing the community’s newly-articulated value system (Dibbell, 1993).
The reactions of online groups to harassment and disruption can be situated theoretically with respect to two dialectics that run through the literature on women’s online discussion groups. The first is the tension between libertarian values on individual freedom of expression, on the one hand, and communitarian values on the good of the group, on the other. In the libertarian view, the Internet is a new frontier, free from rules. Although most see freedom of speech as a feature of democracy (Ess, 1996), some libertarian discussions go so far as to argue for anarchy of the Internet (Barlow, 1996). A communitarian view of freedom of speech, in contrast, recognizes that less empowered persons might require buffering so that their rights to speech are preserved, and for the good of the community as a whole (Ellsworth, 1989; Ess, 1996; Herring, 1996, 1999; Reid, 1999).
The literature about on-line harassment underscores the tension between libertarian and communitarian values, in that harassment often arises in spaces known for their freedom, lack of censure, and experimental nature (Brail, 1996; Dibbell, 1993; Reid, 1999). Herring makes an explicit connection between on-line harassment and libertarian values in a study of gender harassment, noting that "[t]his 'rhetoric of harassment' crucially invokes libertarian principles of freedom of expression, constructing women's resistance as 'censorship'" (1999, p. 151).
The second dialectic is found in the literature on feminist stances (Gur-Ze'ev, 1999; Hall, 1996; Kenway & Nixon, 1999). Hall (1996) explicitly contrasts bringing women into the extant culture, the liberal view, with the provision of separate women’s spaces, the radical view. The literature on online harassment provides ample evidence as to why women might want separate online spaces. In addition to the research on silencing cited above, numerous studies report the use of CMC to annoy, intimidate, and harass women on-line (Dibbell, 1993; Donath, 1999; Ebben & Kramarae, 1993; Ebben, 1994; Herring, 1994, 1996, 1999; Herring et al., 1995; Shade, 1993; Sutton, 1994; We, 1993).
The present study describes one trolling incident targeted at a feminist group, and the tension attempts to manage it provoked within the group between libertarian/liberal and communitarian/separatist values.
THE CASE STUDY
The trolling incident occurred on a web-based discussion forum sponsored by a large-circulation feminist magazine published in the United States. The purpose of the discussion forum is to provide a space for dialogue advancing feminist concerns and issues. The forum has over 4,000 members, of whom about 200 participate actively. In the discussion analyzed in this paper, 41 individuals participated, 90% of them female and 10% of them male. Participants sometimes disagree on individual interpretations of feminist ideology and action, but generally share an agreement that women are politically disadvantaged compared to men, and that feminism is the best way to address this problem.
In early February of 2000, this agreement was challenged from two different sources. Several gun rights advocates from another forum joined the feminist forum exclusively to advocate against gun control legislation, starting more than a dozen new threads to argue their point of view. During the same period, a new male participant, Kent, started posting messages that were intentionally antagonistic to the core values of the forum. In his introduction to the forum, Kent identified himself as a middle-aged man in a professional position that involved overseas travel. He claimed to have been previously removed from other feminist forums for his views, and he also claimed he would eventually be removed from this feminist forum. He described himself as openly hostile to feminism, and started attacking forum members in dozens of posts spread throughout the forum.
Over a period of eight days alone, more than 80 posts were written to a thread discussing Kent's participation in that thread. Partly as a result of this discussion, the forum administrators adopted a new policy for participating in the forum (see Appendix A). Kent was eventually banned from the forum as a result of the new policy.
Our analysis focused on Kent’s activities in the forum, as represented in a single thread of 111 messages posted between March 13 and March 21. This thread was selected because it contained the most explicit discussion by the group about how to respond to Kent's behavior.
The data analysis used grounded theory methods (Strauss & Corbin, 1998; Glaser & Strauss, 1967) to develop a coding scheme for behaviors exhibited in the thread. After the first pass coding of the data, we reviewed our coding and identified patterns in terms of related themes. Once we came to an agreement about the main themes, and what they meant, we coded all member posts accordingly and went back through the data to extract the examples used in this paper.
The coding process was informed by the previous experiences of the authors in Internet discussion forums, and by the fact that one of the authors had participated in the forum for several months prior to this discussion. Our data analysis thus draws on observations and analyses of similar incidents in the past and on an intimate knowledge of the context of the forum.
The troller, Kent, was successful in disrupting communication on the forum for a period of almost eight weeks. It is instructive to examine the strategies he used, and consider why they were successful. In fact, Kent does not precisely fit the model of the disingenuous troll, but rather succeeds in disrupting the group by a combination of trolling and other means, including provocations attuned to the topic (feminism) and the audience (feminists; mostly women) of the group. Specifically, he exploits tensions within feminism itself with regard to freedom of expression and the legitimacy of separatist spaces, making it more difficult for the group to take effective action against him.
The Troller Provokes
Following Andrew (1996), we identify three definitional criteria for trolls:1) messages from a sender who appears outwardly sincere,Kent's participation in the feminist forum meets all three criteria for trolling. Each of these behaviors is discussed below.
2) messages designed to attract predictable responses or flames,
3) messages that waste a group's time by provoking futile argument.
Outward manifestations of sincerity. In several messages, Kent presents himself as someone who is sincerely interested in debating the merits of feminism, and thus as a legitimate participant in the group. He appeals to feminists on the forum to provide "proof" against his anti-feminist claims:Example 1He also claims to be sincerely unclear about why others have a problem with his postings, and appeals to them to explain it to him, implying (and in some cases, overtly stating) that he will modify the behaviors they find offensive:
Kent 3-15-2000 04:48 PM
Every poster here has told me that I'm wrong and they are right about feminism. Do you see that? I at least offer proof. I want to discuss, not just drop a slogan and ride out throwing dismissive insults.
To prove or not to prove would obviously be the rightful subject of my entire time here. If you disagree then you can say so. You do. If you want to shut me up though, better be more convincing than just saying you disagree. [emphasis added]Example 2In these messages, Kent attempts to present himself as rigorous and principled as regards the rules of debate, and potentially cooperative if others meet his conditions (providing proofs, answering his questions, etc.). Rather than provoking response through contentiousness, he appeals to others to respond in good faith. He attempts to appear outwardly sincere (criterion 1 of our definition of trolling) as a means of drawing others into responding.
Kent 3-15-2000 01:38 PM
In summary what exactly is offensive about my posts? If you can tell me I will either stop doing it or leave the board. If however you refuse to tell me, and I've not been shy about asking SPECIFICALLY what standards I'm supposed to live by, then I will carry on doing it of course.
I'm aware of the trouble I'm causing you [web mistress]. I'm aware that you've been willing to go to that trouble (probably not on my account but on principle of course). I'm not ungrateful and if you come up with some solution that involves me changing my behavior than please feel free to ask me. [emphasis added]
Flame bait. The posts by Kent that others find offensive are pejorative statements about feminism and feminists, including the members of the forum. Given the audience, these remarks are "designed to attract predictable comments or flames" (criterion 2). They include insults, name-calling, contentious presuppositions, and blatantly contentious assertions about feminism, as for example the following:Example 3Still, although such posts are clearly intended to be offensive, it might be argued that Kent is still acting in good faith, according to his stated intent to debate the merits of feminism. Indeed, in one post he justifies the use of insults as necessary to his debate strategy:
Kent 3-13-2000 09:29 PM
Incidentally I take the silence over the gender wage gap hoax to mean that no feminist here even wants to TRY to defend their biggest lie: that men are paid more for the same work than women are.
[contentious presuppositions (the gender wage gap is a hoax; that men are paid more for the same work than women is a lie)]
Kent 3-14-2000 01:51 PM
Gee, Simone, I dunno, maybe its because you're a bimbo who can't figure out the difference between an anecdote and a statistic? If you want more money then get off your lazy ass and make some.
Kent 3-14-2000 10:11 PM (quoted by another member)
Feminism is evil and bigoted and always has been. Just look at the bitches on this group. Frankly I don't see how you can bear to be near them.
[blatantly contentious assertion; name-calling; insults]Example 6Attempts to provoke futile argument. However, further analysis makes clear that Kent is not, in fact, interested in the give-and-take of genuine debate, but rather in provoking futile argument (criterion 3). A fundamental uncooperativeness and perverseness is evident in Kent's covert rhetorical strategies, which include refusing to acknowledge others' points (or even that they have responded), willfully misinterpreting others' motives and views, and taunting others for not ignoring him.
Kent 3-15-2000 01:38 PM
My personal feeling is that I don't want to insult people more than is necessary to expound my point of view. Those of you who think insults are not necessary should talk to those who have just said that, for example, use of the word "bigot"... should be considered an insult. Or talk to those who challenged me to get personal by dismissing all my points about the feminist leadership, history and activities as "just extremists" and said "point out hate on this board."
Now having said that personal challenges are a necessary part of my point of view [...]Example 7Kent employs strategies of denial and distortion, even when others respond to his questions or attempt to correct his misrepresentations. As a consequence, his offers to modify his behavior if others will only "answer" his questions or provide "arguments" or "proof" ultimately appear insincere. He does not acknowledge anything that others post as answers, arguments, or proofs.
Kent 3-15-2000 04:58 PM
[Context: Venus and others have made numerous arguments to which Kent has not responded]
Venus, if you ever get around to making any arguments I will reply to them in the same tone or better. Find me an example of where I haven't or didn't and I'll certainly apologise to whoever.
[Refusing to acknowledge others' points.]
Kent 3-15-2000 08:10 PM
[Context: Simone pointed out that Kent had not responded to a challenge she made about the gender wage gap in response to Kent's previous challenge.]
Now Simone, isn't that better than biching and moaning? Sorry if you feel I've been ignoring you.
[Willfully misinterpreting another's point.]
Finally, Kent manifests perversity in taking those who are critical of him to task for not doing what they say they will do, even though it is unfavorable to him:Example 9This post is paradoxical, in that Kent has been expending considerable effort to post over a period of several weeks. He clearly wants others to read and respond to him, yet here he exhorts the "women" in the group to ignore him. This allows him to taunt them for not being "strong" enough to do what they say they are going to do, and as such is a further put-down of feminism and the forum. At the same time, it sows confusion by introducing an appearance of arbitrariness into Kent's position. This strategy, together with the distortion and denial strategies described above, violates conventional rules of conversational cooperation (Grice 1991). To the extent that Kent is engaging in such behavior intentionally, it suggests a motive on his part to "create chaos and confusion", one of the objectives of trolling (Andrew, 1996).
Kent 3-15-2000 10:21 PM
This conversation reminds me of the quote at the top of the board sometimes about high-heels. THINK. If you don't like reading my stuff than just DON'T ok?
Now is that so hard, you "strong women"?
Don't read it.
Don't reply to it.
Don't post stupid comments about it.
Don't make jokes about it.
Don't reply with pathetic insults.
Don't post about how your so NOT reading it.
Don't post asking others not to read it.
JUST CUT IT OUT FOT GOD'S SAKE
There is thus considerable evidence that Kent is a troller—that is, someone who is intentionally misrepresenting himself as interested in debating about feminism, but whose actual motive is to provoke and disrupt. Kent provides explicit support for this interpretation by his avowal that he has come to the group in order to provoke its members to kick him off, and in his boasting mention that he has been kicked off of several feminist groups previously, suggesting that he views the activity as entertainment or sport.
At the same time, he is both less and more than a typical troller. He does not obey the principle of minimal expenditure of effort, nor does he attempt to engage other groups in the interaction. Moreover, he does not hide his trolling intent (although he does not refer to it in those terms), and his intentions are ultimately clear enough to the majority of group members—that is, he does not really "fool" them, inconsistent with another objective of trolling. Ultimately, his attempts at appearing sincere are too riddled with hostility and sarcasm to be persuasive.
Ideological manipulation. What Kent lacks in deceptiveness, he makes up for in ideological manipulation of his audience. He exploits the tension between freedom of expression and the mostly female group's interest in maintaining a civil environment by presupposing that the former should outweigh the latter:Example 10In another post, he suggests that women are "refusing to debate" with him because they fear the threat he poses to feminism; this ties back to his general claim that feminists are intolerant of debate. Later, he explicitly delegitimizes the communitarian value system that underlies the calls to ban him by describing the forum as a "girlies support group" characterized by "catty / emotional infighting", a feature he also attributes to "early feminism as a movement". This line of argument touches a nerve with this audience, in as much as feminism struggles to balance openness with a recognition of the need for women-centered spaces. Taken seriously, it places the group members in a double bind: If they allow Kent to continue, he pollutes their online environment with anti-feminist harassment; if they ban him, they close off debate and risk being labeled censorious. This bind may partially explain why forum members were unable to reach a consensus on how to deal with Kent.
Kent 3-15-2000 04:48 PM
So to re-cap. What you are saying is that I should be banned because I keep saying all feminists are bigots and liars and so forth? In fact I should be banned for my well-documented and supported opinion on the very topic which this board is set up to discuss?
The Group Responds
All but a small minority of participants expressed the view that Kent was a problem, and agreed that his behavior was intended to undermine the forum. Moreover, most ultimately agreed that his posts were in violation of the group's norms and values. However, despite widespread agreement on the existence and nature of the problem, the group could not agree on a course of action. Rather, participants split between calling for Kent to be banned, and calling for the group as a whole to ignore him in the hopes that he would lose interest and go away. In practice, neither suggestion was followed: Participants engaged with Kent by trying to reason with him, and, when that failed, by insulting him in an escalating conflict, thereby falling into the trap the troller had laid for them. At the same time, the conflict led group members to negotiate explicitly what was appropriate discourse for the forum, reinforcing the group's identity and leading to clearer limits on disruptive behavior. These responses are discussed below.
Calls for administrative banning. Many participants in the discussion proposed banning Kent administratively from participation on the forum system. Some explicitly invoked the communitarian or "radical" notion of protecting the forum as a "safe space" for feminists:Example 11Perhaps out of a concern that this stance could be interpreted as isolationist, censorious, or admitting female weakness (interpretations repeatedly articulated by Kent), others who favored banning offered a more legalistic justification, maintaining that Kent’s posts were in violation of the rules of the forum, and that he should be removed on those grounds.
Danielle (Member) 03-16-2000 01:09 PM
I can't believe we're discussing whether or not to ban [Kent]. There's no question in my mind. Free speech does not include a long list of behaviors. Police are obligated to investigate death threats. Threats against the President or US Government have to be investigated by the Secret Service. Libel and slander laws limit what can be printed. Not all printed materials, like pornography, are available to all citizens, like children. Filing a false police report is a crime. There's no excuse for [Kent]'s behavior. There's no political rationalization.
I have only read a couple of his posts because I don't need that shit. I see that some of you have engaed him and that's your decision. But I wish you wouldn't. One thing that I've always looked forward to in feminism is the creation of "safe" spaces. [Kent] is not going away on his own. I have no qualms about advocating the use of the [ ] boards with this in mind. [emphasis added]Example 12The proposal to ban Kent met with considerable support, but it also encountered two obstacles. First, the forum members did not know what technological or administrative procedures would have to be followed in order to ban someone. In fact, no one had ever been banned from the forum before, and thus no procedures had been formally established. Second, an equally vocal group of participants opposed banning on philosophical grounds.
mizz-t (Member) 03-14-2000 02:55 PM
[Quotes an insulting post from Kent (example 4)]
--call me a rat, a tattle-tale, a trouble maker, a whiny bitch, whatever
you like, but isn't this violating the rules of the board already????????
I have HAD it with this guy!!
Calls to ignore the user voluntarily. This group of members recommended simply not responding to Kent, suggesting that he would disappear if he did not get the kinds of angry responses he was seeking. Voluntarily ignoring Kent would deny him his audience, while maintaining the forum’s dedication to free speech. These justifications are present in Emily's call to ignore Kent:Example 13This is a characteristically libertarian approach to trolling, in that it relies on denying the troller’s desire to stir up trouble (shunning) rather than administrative sanctions (banning).
Emily (Member) 03-16-2000 05:34 PM
I really don't think we should be banning or censoring anyone. If it becomes ridiculously extreme, sure why not. But I don't really think it is necessary here. I think if everyone starts ignoring him he's bound to go away eventually.
At the same time, Glenda raises a central problem with shunning. Although shunning is presented as a passive strategy (i.e., just do nothing), in fact it requires considerable self-control not to respond to offensive provocation. Glenda argues that ignoring Kent is an appealing (and more effective) solution, but ultimately too difficult to carry out:Example 14Experienced forum members might ignore Kent's provocations, but new forum members would be tempted to respond in kind. Glenda's distinction makes an important point: Effectively shunning a disruptive individual requires a group consensus to follow through on ignoring the individual. Despite widespread agreement that ignoring Kent was a good idea, many participants continued to argue with him, thereby undermining the group's attempt to shun him.
Glenda (Member) 03-15-2000 12:04 AM
On to Kent - I keep TRYING to keep my mouth shut and ignore him, I really do! Guess I've got more masochistic tendencies than I thought. :rollseyes: Actually, I'm getting better at not offering any opinions of my own - just raking him over the coals for his. Shunning is ssoooo much more effective than banning - but that won't stop any junior members from unwittingly stepping into his trap.
Refuting the antagonist’s claims. Forum members occasionally attempted to refute Kent’s claims by answering his questions, suggesting counter-examples, or pointing out logical flaws. In a lengthy post, Majorie challenges Kent on numerous fronts:Example 15This post is characterized by an angry and aggressive tone, including heavy use of sarcasm such as "…you're sooo innocent of any wrongdoing." Marjorie's intent appears to be to shame Kent by "telling it like it is."
Majorie 03-15-2000 02:50 PM
'What was offensive?'??? Being called a bitch, for starters.
And referring to 'those bitches who run the shelters'.
And "Maybe you should try being a man and facing sexual rejection hundreds of times from bitches like you."
And "Yes you miserable **** you get to CHOOSE. The man, poor bastard, has no choice. Do you comprehend the difference princess?"
And "What you mean is the feminist fag-boy self-flagellation view of men's issues."
And "Gee, Merilyn, I dunno, maybe its because you're a bimbo who can't figure out the difference between an anecdote and a statistic?"
And all the bullshit on Julie.
What's offensive is the fact that you repeatedly run back to the basest terms you can: bimbo, bitch, princess, baby, girl. Anything to let us know we're less than people.
And for all the prolific posting you do, you can't name a single instance of anyone here hating men, not caring about men, blaming men for everything, etc. Anyone who comes close is immediately reminded (by us)that THAT'S NOT WHAT FEMINISM IS ABOUT. All you can do is go on and on about how you know what we *really* mean, even when it's the opposite of what we say. Twist the words around, call us liars and bigots, and treat us like shit, all to "prove" your point. You call EVERYTHING we say "feminist propaganda lies." As determined by you, definition courtesy of you. Why the fuck should *anyone* bother?
But what is most insulting is the continual whining about how put-upon you are. How HOUNDED you are. Like you didn't come here and TELL US you were going to hound us. Like you didn't come here SPECIFICALLY to get this reaction. Like your previous experiences didn't clue you into the fact that when you treat people like shit, THEY WON'T WANT YOU AROUND. And you DO treat people like shit, constantly. Me? I get it because I point that fact out. You seem to have no ability whatsoever to refrain from your verbal abusiveness, and then we get to hear about how not only is it our fault, but you're doing it FOR us, out of the goodness of your heart.
Personally, I'm sick to death of YOUR lies (all feminists are bigots and liars, we blame men for everything, blah, blah, blah). And how lucky you are to just be handed this forum for saying anything you want, and how badly you abuse it and us, and then go running to your "oh, poor me" excuses while calling *us* victims, because you're sooo innocent of any wrongdoing. Grow up.
Insulting the antagonist. In other posts, forum members simply return insults for insults, effectively lowering themselves to Kent's level:Example 16This example came after Kent’s lengthy explanation of his goals on the forum (Example 6, above). Sharon directly insults Kent’s ability to participate in the discussion, using vulgar language to do so. In other posts, forum members portray Kent as immature, suggesting he is an eight-year-old child pretending to be an adult.
Sharon 03-15-2000 04:54 PM
i don't think you could even give us an accurate summary of your ass Kent....
Another strategy used by some forum members is the off-record insult. Donald made an inflammatory statement in the context of an ongoing discussion about Kent, yet without mentioning Kent's name:Example 17Kent responded with anger a few posts later, clearly interpreting the comment as directed at him personally. In response, Donald invoked plausible deniability, taking the opportunity indirectly to insult Kent further, implying he was paranoid for becoming offended:
Donald 03-14-2000 10:23 PM
Tell me if this sounds like anyone you know:
"Batterers are very into making excuses and presenting themselves as victims. They really see other people...as abusing or attempting to control them. It's the way to rationalize, minimize or deny their own behavior."
Just curious.Example 18Donald distances himself from the insult by quoting another text rather than making his own statement. For the most part, however, members avoided insulting Kent as a person, instead criticizing his posting style and his disruptive effects on the forum.
Donald 03-15-2000 03:45 PM
I just want to point out that if people assume I'm talking about them when I say bad things, that's not my fault. My comments are like birds I set free on the wind, and if someone wants to catch them and hold on to them as their very own, that is their choice.
"Paranoia, paranoia...everybody's coming to get me..."
Challenging Kent by refuting his claims and insulting him undermined attempts to shun him. As in the cases of gender harassment described by Herring (1999), insults and refutations were used by the troller as a springboard for further attacks.
Negotiating what is appropriate. In example 6, Kent expressed a controversial view of what the appropriate norms of online debate should be. He wrote that personal attacks were appropriate and necessary to achieving the political goal of challenging feminism. This view, and the behavior that accompanied it, forced the group to define more concisely what they believed to be appropriate and inappropriate styles of participation in the forum.
According to some members, an appropriate challenge focuses on a person’s ideas, while an inappropriate challenge focuses on the person expressing the ideas.Example 19A further point of discussion, introduced by the forum moderator, concerned the use of obscenities. Several participants in the discussion addressed the difference between a non-specific use of obscenities, “What the fuck?” and obscenities directed towards a specific person such as “Fuck you.” Non-specific use of obscenities was considered to be emphatic, while obscenities directed at a specific person were considered hostile.
Donald 03-14-2000 03:17 PM
Yeah, I think (hope) that just about everybody can see the difference between attacking someone's ideas and attacking someone personally. It may seem like a slight distinction from a semantic standpoint, but it is wholly significant.
"This argument is dumb" vs. "You are dumb."
"You sound like a bimbo" vs. "You are a bimbo."
"I disagree" vs. "I think you're a stupid bitch who needs to get the fuck up off her lazy fat ass and stop sitting around the house stuffing her face full of twinkies and shooting heroin and also giving pamphlets about the Devil to little children who happen to come by selling Girl Scout cookies."
We could also discuss the quantity of space taken up with a given argument, constructive vs. destructive arguments, being respectful vs. being a tool, etc.
Most importantly, and with surprisingly little discussion, the group came to an agreement that personally insulting or offensive speech that persisted after warnings from the moderator would not be tolerated: After three such warnings, the offender would be banned from the forum. A new policy statement to this effect appeared on the forum Web site for the first time on March 15 (Appendix A). However, it would not be applied to Kent until two weeks later, at which time the forum moderator—like the wizard who "killed" MrBungle in the LambdaMOO case (Dibbell, 1993)—acted independently to ban him.
Why was this group not more effective in defending itself against the troller's attacks? We propose three explanations for this lack of success, the first ideological, the second psychological, and the third relating to the nature of online forums.
As with the MrBungle case, forum members were caught between conflicting ideologies. Liberal and libertarian views advocate letting everyone participate, and combating problematic speech through debate. Communitarian views focus on maintaining safe space; together with radical views, they lead to the creation of separate environments such as those focused on women’s concerns (Hall, 1996). Kent effectively exploited this tension—inherent in the situation of any group that is vulnerable by virtue of being a target of discrimination or harassment—by pushing the bounds of harassing behavior, at the same time invoking principles of free speech and open debate. Moreover, by daring forum members to ban him—indeed, by making getting banned his goal—Kent guaranteed that he would "win" regardless of the outcome of the forum's deliberations. This form of ideological manipulation was especially effective given that his audience was a feminist forum committed in principle to inclusiveness.
At the same time, the troller's token displays of interest in feminist issues, and his token expressions of willingness to be convinced by evidence, psychologically manipulated members into continuing to engage with him, thereby prolonging an interaction that had seriously disruptive effects on the forum. Why do people respond to provocation, even when they recognize intellectually that angry responses are what is being sought? Grice (1991) observed that meaningful communication rests on a default assumption of mutual cooperation, leading communicators to assume that others are generally trying to be truthful, clear, consistent, etc., even when surface appearances suggest otherwise. Moreover, communicators are rationally motivated to protect one another's social face, on the premise that harmony is more likely than conflict to produce desirable social outcomes for all involved (Brown & Levinson, 1987). In contrast, a troller is fundamentally uncooperative: He seeks to confuse and deceive, rather than to be clear. The troller in the present study is also fundamentally unconcerned with maintaining others' social face: On the contrary, like a flamer, he seeks to maximize face threats by means of insults and put-downs. Such behavior appears irrational to many online communicators, to whom it might never have occurred that anything useful could be gained by harassing and disrupting others. Accordingly, they persist in attempting to reason with the disruptive individual, to appeal to his better nature, or, failing that, to shame him. Their belief in the universality of the social contract may partially blind them to what we take to be the troller's actual motivations: the desire to attract attention, including negative attention; and the desire to exercise control and feel superior by manipulating others to fall into a trap of the troller's design.
An additional factor that abets disruptive activity is the difficulty of achieving consensus in online groups. Text-based CMC has been claimed to result in more frequent disagreements, greater polarization on controversial issues, and longer times to reach consensus than face-to-face interaction (Sproull & Kiesler, 1991; cf. Sudweeks & Rafaeli, 1996). These effects can be overcome to some extent by centralizing authority in the role of a moderator or group administrator, removing the requirement for absolute group consensus on each decision. The group analyzed in the present study operated in a decentralized manner that required consensus (as opposed to a majority vote) in order for a decision about the troll to be implemented. Since consensus could not be achieved, no decision was taken. The Web mistress's subsequent intervention effectively implemented a more centralized authority model, which the forum members appeared to welcome, since the forum did not provide individual members with the technological means to ban or filter messages from other users. Thus both the social organization and the technological properties of the forum made it difficult for users to protect themselves from harassment by the troller, thereby inadvertently facilitating the troller's disruptive goals.
We conclude by suggesting several pro-active interventions that might help to forestall a vulnerable group from being harassed, yet not squelch debate. The first is to educate users about trolling. Trollers particularly prey on inexperienced Internet users, including populations that are often vulnerable for other reasons. Forum administrators might warn users about the patterns that trollers follow. Simply naming the danger would heighten people's awareness of it. Because the danger is emotional and not physical, we can imagine that warning about trolling might be similar to warning about phone pranks or sales scams, where awareness of the modus operandi is often sufficient to forestall the effect of the advantage-taking event.
Perhaps while we are educating users, we might also inform them of the lack of anonymity of Internet communication, no matter how safe and secure a discussion site may appear. Users need to be aware of the practice of archiving Internet transcripts, of how easily messages can be disseminated to other Internet venues, and of the fact that at least one systems administrator always has access privileges to the contents of their servers, even when messages have been deleted. Greater awareness might lead users to reflect before responding hastily
to provocative messages, since such messages could potentially come back to haunt them later.
This case also points to the need for online forums to articulate policies, guidelines for appropriate participation, and penalties for violating those guidelines, in advance of harassment episodes taking place. Public online spaces are likely to experience disruption from trolling and flaming unless policies and capabilities are implemented for excluding problem users. It is necessary in this regard to distinguish clearly between cooperative debate (however heated) and uncooperative provocation (however masked). Unambiguous and strong moderation from the start can avoid many problems (for an example, see Korenman & Wyatt, 1996). Some evidence suggests that groups vulnerable to harassment and trolling benefit especially from stricter centralized moderation (Herring, 2000).
Technological enhancements can also play a useful, if limited, role. A “killfile” capability permits individual users not to view posts from selected other individual users. Killfiles shift some of the filtering abilities of moderators from a centralized administrator to the individual participant, thereby preserving a decentralized structure and individual freedom of speech. At the same time, killfiles do not exclude the posts from the view of other readers, nor from the archives of the forum. As in the case of the virtual rape previously cited, social damage can effectively be done to individuals without their reading the offending post (Dibbell, 1993). Moreover, since killfiles are reactive, users necessarily view some objectionable messages before they set a killfile, making it only a partial filter even for individual users.
More research is needed on trolling and online harassment. In particular, cross-context studies are needed to determine if attempts at trolling are different when mainstream groups are the target rather than minority groups, and how the availability of technical tools that give participants greater control over the online environment affects trolling. Research is also needed to compare how online groups respond to disruptive individuals with face-to-face groups in such contexts as classes, office meetings, support groups, and social events. We suspect that reduction in cues in computer-mediated environments may require a more formal social structure than is necessary in co-present situations, in order to ensure that civility, safety, and freedom can coexist.
Andrew. 1996. The troller's FAQ. Retrieved 1/10/01 from the World Wide Web: http://www.altairiv.demon.co.uk/afaq/posts/trollfaq.html
Balka, Ellen. 1993. Women's access to on-line discussions about feminism. Electronic Journal of Communication 3 (1). Retrieved 11/11/01 from the World Wide Web: http://www.cios.org/www/ejc/v3n193.htm
Barlow, John Perry. 1996. A declaration of independence of cyberspace. Retrieved 1/18/01 from the World Wide Web: http://www.eff.org/~barlow/Declaration-Final.html
Brail, Stephanie. 1996. The price of admission: Harassment and free speech in the wild, wild west. In L. Cherny and E. R. Weise, eds.,
Wired_women: Gender and New Realities in Cyberspace, pp. 141-157. Seattle, WA: Seal Press.
Brown, Penelope, and Stephen Levinson. 1987. Politeness. Cambridge: Cambridge University Press.
Camp, L. Jean. 1996. We are geeks, and we are not guys: The systers mailing list. In L. Cherny and E. R. Weise, eds., Wired_women: Gender and New Realities in Cyberspace, pp. 114-125. Seattle: Seal Press.
Collins-Jarvis, Lori. 1997. Discriminatory messages and gendered power relations in on-line discussion groups. Paper presented at the 1997 annual meeting of the National Communication Association, Chicago, IL.
Dibbell, Julian. 1993. A rape in cyberspace: How an evil clown, a Haitian trickster spirit, two wizards, and a cast of dozens turned a database into a society. The Village Voice, December 23.
Donath, Judith S. 1999. Identity and deception in the virtual community. In M. A. Smith and P. Kollock, eds., Communities in cyberspace, pp. 29-59. London: Routledge.
Dubrovsky, V. J., Sara Kiesler, and B. N. Sethna. 1991. The equalization phenomenon: Status effects in computer mediated and face-to-face decision making groups. Human Computer Interaction 6:119-146.
Ebben, Maureen, and Cheris Kramarae. 1993. Women and information technologies: Creating a cyberspace of our own. In H. J. Taylor, C. Kramarae and M. Ebben, eds., Women, information technology, and scholarship, pp. 15-27. Urbana, IL: Women, Information
Technology, and Scholarship Colloquium, Center for Advanced Study, University of Illinois at Urbana-Champaign.
Ebben, Maureen M. 1994. Women on the net: An exploratory study of gender dynamics on the soc.women computer network. Unpublished doctoral dissertation, University of Illinois, Urbana-Champaign.
Ellsworth, Elizabeth. 1989. Why doesn't this feel empowering? Working through the repressive myths of critical pedagogy. Harvard Educational Review 59(3):271-297.
Ess, Charles. 1996. The political computer: Democracy, CMC, and Habermas. In C. Ess ed., Philosophical Perspectives on Computer-Mediated Communication, pp. 197-230. Albany, NY: State University of New York Press.
Free online dictionary of computing. 1998. Retrieved 11/11/01 from the World Wide Web: http://wombat.doc.ic.ac.uk/foldoc/contents.html
Glaser, Barney, and Anselm L. Strauss. 1967. The Discovery of Grounded Theory: Strategies for Qualitative Research. Aldine Press.
Grice, H. Paul. (1991. Logic and conversation. In S. David, ed., Pragmatics: A Reader, pp. 305-315. New York: Oxford University Press.
Gur-Ze'ev, I. 1999. Cyberfeminism and education in the era of the exile of the spirit. Educational Theory 49(4):437-455.
Hall, Kira. 1996. Cyberfeminism. In S. C. Herring, ed., Computer-Mediated Communication: Linguistic, Social and Cross-Cultural Perspectives, pp. 147-170. Amsterdam: John Benjamins Publishing Company.
Herring, Susan. 1994. Gender Differences in Computer-Mediated Communication: Bringing Familiar Baggage to the New Frontier. Retrieved 11/11/01 from the World Wide Web: http://www.cpsr.org/cpsr/gender/herring.txt
Herring, Susan. 1996. Posting in a different voice. In C. Ess, ed., Philosophical Perspectives on Computer-Mediated Communication, pp. 113-145. Albany, NY: State University of New York Press.
Herring, Susan. 1999. The rhetorical dynamics of gender harassment on-line. The Information Society 15:151-167.
Herring, Susan. 2000. Gender differences in CMC: Findings and implications. Computer Professionals for Social Responsibility Newsletter, Winter 2000. Retrieved 11/11/01 from the World Wide Web: http://www.cpsr.org/publications/newsletters/issues/2000/Winter2000/index.html
Herring, Susan, Deborah A. Johnson, and Tamra DiBenedetto. 1995. “This discussion is going too far!”: Male resistance to female participation on the Internet. In K. Hall and M. Bucholtz, eds., Gender Articulated: Language and the Socially Constructed Self, pp. 67-96. New York: Routledge.
Kenway, J., and H. Nixon. 1999. Cyberfeminisms, cyberliteracies, and the educational cyberspheres. Educational Theory 49(4):457-474.
Kiesler, Sara, Jane Siegel, and Timothy W. McGuire. 1984. Social psychological aspects of computer-mediated communication.
American Psychologist 39:1123-1134.
King, Storm. 1996. Researching Internet communities: Proposed ethical guidelines for the reporting of results. The Information Society 12:119-127.
Korenman, Joan and Nancy Wyatt. 1996. Group dynamics in an e-mail forum. In S. Herring, ed., Computer-Mediated Communication: Linguistic, Social and Cross-Cultural Perspectives, pp. 225-242. Amsterdam: John Benjamins Publishing Company.
Kramarae, Cheris, and H. Jeannie Taylor. 1993. Women and men on electronic networks: A conversation or a monologue? In H. J. Taylor, C. Kramarae, and M. Ebben, eds., Women, information technology, and scholarship, pp. 52-61. Urbana, IL: Women,
Information Technology, and Scholarship Colloquium, Center for Advanced Study, University of Illinois at Urbana-Champaign.
Mowbray, Melinda. 2001. Reducing demographic bias. In C. Werry and M. Mowbray, eds., Online Communities: Commerce, Community Action, and the Virtual University, pp. 97-125. Upper Saddle River, NJ: Prentice Hall.
Oxford English Dictionary. 1992. Retrieved 9/28/99 from the World Wide Web: http://etext.lib.virginia.edu/oed.html
Pfaffenberger, Brian. 1996. “If I want it, it’s OK:” Usenet and the (outer) limits of free speech. The Information Society 12:365-386.
Preece, Jennifer. 2000. Online Communities: Designing Usability, Supporting Sociability. Chichester, U.K.: John Wiley.
Reid, Elizabeth. 1994. Cultural Formations in Text-based Virtual Realities. Unpublished master’s thesis, University of Melbourne, Australia. Retrieved 6/15/01 from the World Wide Web: http://home.earthlink.net/~aluluei/cult-form.htm
Reid, Elizabeth. 1999. Hierarchy and power: Social control in cyberspace. In M. A. Smith and P. Kollock, eds., Communities in Cyberspace, pp. 107-133. London: Routledge.
Rheingold, Howard. 1993. The Virtual Community: Homesteading on the Electronic Frontier. Reading, MA: Addison-Wesley. Retrieved 6/15/01 from the World Wide Web: http://www.rheingold.com/vc/book/
Shade, Leslie Regan. 1993. Gender issues in computer networking. Retrieved 11/11/01 from the World Wide Web: http://cpsr.org/cpsr/gender/leslie_regan_shade.txt
Spender, Dale. 1995. Nattering on the net: Women, power, and cyberspace. North Melbourne: Spinifex.
Sproull, Lee, and Sara Kiesler. 1991. Connections: New Ways of Working in the Networked Organization. Cambridge, MA: MIT Press.
Strauss, Anselm, and Juliet Corbin. 1998. Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory. Newbury Park, CA: Sage.
Sudweeks, Fay, and Sheizaf Rafaeli. 1996. How do you get a hundred strangers to agree? Computer mediated communication and collaboration. In T. Harrison and T. Stephens, eds., Computer Networking and Scholarly Communication in the Twenty-First-Century University, pp. 115-136. Albany, NY: SUNY Press.
Sutton, Laurel. 1994. Using Usenet: gender, power, and silence in electronic discourse. In S. Gahl, A. Dolbey, and C. Johnson, eds., Proceedings of the 20th Annual Meeting of the Berkeley Linguistics Society, pp. 506-520. Berkeley, CA: Berkeley Linguistics Society.
We, Gladys. 1993. Cross-Gender Communication in Cyberspace. Retrieved 11/11/01 from the World Wide Web: ftp://cpsr.org/cpsr/gender/we_cross_gender
[Name] magazine's policy is to allow free debate on our boards, as long as users follow basic rules of human decency. Personally attacking, flaming or threatening another [name] board member is strictly forbidden. Threatening violence against a group of people (like Jews, or homosexuals, or feminists, for example) will also not be tolerated. If you violate these rules, you will be banned from the [name] boards.
** Correspondence concering this paper should be addressed to:Professor Herring, SLIS, Indiana University, Bloomington, IN 4745. Email: firstname.lastname@example.org