Pretty Noose 

26 January 2023

A white coffee mug with an image of Donald J. Trump’s suspended Twitter account sits on a dark brown dining table.

Suspenseful.

Tonight I want to talk, briefly, about rule enforcement on social media sites. In light of what seems like announcements dueling for “Worst Decision of the Year” awards, Twitter this week reinstated (then suspended again) the account of an avowed white supremacist, followed by Facebook and Instagram’s parent company, Meta, announcing that they will be allowing the 45th President of the United States back on their platforms

I’ve touched briefly on the topic of content moderation here in the past, so tonight, I want to share a little nuance about how we approached one aspect of suspensions inside Twitter when I was there. One of the first tasks I had as a content strategist after moving to the Design and Research team was to help our Trust and Safety folks update our enforcement emails, the ones people get explaining why their accounts had been suspended. One important part of the task included finding the right balance between our newly updated brand voice and a stern but understanding tone. 

To start, we took the finite list of policy offenses, along with the number and degrees of infractions involved, and started auditing the existing emails, prioritizing the ones we sent the most, first. As we started going through them, we noticed that we could streamline what we were saying, and to whom, by creating templates which accounted for severity (like first offenses) and the offense itself (like spamming links to people). We started to create templates with places for variables to be programmed in, such as the name of the policy people had broken and the number of times the account had violated it. For a good deal of the most frequently violated policies, this work was pretty easy: Revise the version we had with the new brand voice in mind, test it with the policy variations inserted, and then move on to the next. But here’s where doing work at Twitter gets interesting. 

Even as we were undergoing this transformation, our policies were changing. And for any social media platform you want to be a part of, they should always be changing. No service is going to be able to create a set of policies on launch day which will suffice for any good amount of time without evolving. Because the way people use those platforms will evolve. In good ways and in bad. The policy enforcement teams, hopefully working in collaboration with a lot of other people, both inside and outside of the company, need to stay on top of things like trend manipulation, spam, impersonation, and a whole host of other ways of weaponizing product features. 

Those product features, more accurately the people who are pitching, designing, and developing them, also need to be able to anticipate the number of ways a new or iterated feature can be used for harm, and either build in mitigation factors or re-evaluate launching altogether. It becomes the responsibility for each member of the team to look at what they’re building and ask not just “Who is this for?”, but “Who could this harm?”.

As we step back and think about how we’re building the social web, and what foundational decisions we continue to build upon, I am starting to wonder why we can’t move away from engagement-based metrics and towards something more benevolent. But there’s obviously no shareholder value in curiosity or community or news literacy. Unless and until we can create incentives which reward civility, we are going to keep recreating the scenarios which have ushered in today’s separatism. Especially if Web 2.0 platforms keep allowing the worst of us to drive the conversations for the rest of us.

See you tomorrow?

Posted  
Comments (0) Post a comment
Author  Stephen Fox

Kickstand

16 January 2023

Screen shot of a BuzzFeed quiz titled,“Make a horror moving, and we’ll guess your deepest secret,” with results reading, “You got: The truth is you have a hard time making friends.”

The one with the BuzzFeed quiz about friends.

While watching the Golden Globe awards last week, I was introduced to a movie I had no idea even existed: The Banshees of Inisherin. I didn’t know what it was about, or even who was in it, but as each new award came up, and the nominees were named, I got a lot more curious about what I was all about. So, this weekend, we sat down to watch it. 

One of the reasons I wanted to bump it to the top of my watch list was hearing how writer and director Martin McDonagh talked about male friendship. Now, I don’t want to spoil it for anybody, so let’s just say that a big theme in the film centers around how men navigate changes in their relationships with each other. There’s obviously a lot more nuance to the storytelling than that, but it reminded me of an episode of Welcome to Wrexham (which I finally binged of the holidays) that has stayed with me for weeks. 

In episode 17, called “Wromance,” there’s a lovely exploration of men and their friendships. It talks about how most of them are built around sport, or competition in general, and how different that is from how women build and sustain theirs. It was an interesting insight into the walls most men put up when creating the bonds with people we consider friends, and it reveals to me how rare it is to have close, emotional conversations between men.

So, this is a long introduction to the following thought for tonight: I am very grateful for the friends I have. Admittedly, I’m terrible at friendship I don’t know how to sustain them. I am awful at keeping in touch. I’m reluctant to take time away from my family for something which feels so selfish as spending a few hours watching a soccer match or seeing a band or just sitting quietly together over a couple of glasses of favorite beverages and having an intimate conversation about what’s going on with our lives, both good and bad. 

When I started drafting this post, I had one particular friend in mind. But now, as I think of the conversations I’ve cherished and felt grateful for over the last year, the number of people on the other end of them — even if they were just unexpected texts — became greater than I realized, making me rethink how many people I have in my court. I sincerely hope that they all know how much they mean to me. And I am publicly pledging to be better about letting them know just how much this year. And if you’re one of the few people who regularly read these, there’s a good chance I owe you a text, at the very least, to just say, “thanks.”

See you tomorrow?

Posted  
Comments (0) Post a comment
Author  Stephen Fox

Bones of Birds

15 November 2022

Growth mindset.

In light of recent news of Tweeps getting fired just for pointing out where the current owner is wrong, I wanted to share an anecdote of what it used to be like at Twitter when you wanted to share a dissenting opinion. Let’s get in our wayback machine together, shall we?

In the Summer of 2018, we were having many debates internally about which accounts should be allowed to remain on the platform. Among the most hotly debated, besides the then-president’s account, was one of a certain Sandy Hook-denying radio host. Jack sent an email to the entire company explaining the thinking and justification for keeping accounts like this alive on Twitter. And I was pissed. 

I drafted an email that I was ready to reply to Jack about what I thought about what we were doing. But I didn’t send it, letting my hot head cool for a bit, thinking maybe I was overreacting. And then we had our regularly scheduled all-hands meeting, called Tea Time.  

After welcoming new Tweeps and recognizing the work anniversaries of others, we moved on to launch updates and plans for the rest of the year. Then came the open Q&A, an important and perpetual part of every Tea Time. Although I don’t remember specific questions and answers, I remember a number of people openly and vigorously questioning our leadership about how and why this account — and others like it — were allowed to continue to spew lies and hatred on the service we were building. There was also a memorable moment involving a bar of soap. 

The answers left me longing. So, I revisited the email reply I had drafted, made a few revisions, and let it fly. Here is a copy of my response: 

Jack,

When this first landed in my inbox, I had an immediate — but poorly formed  — reactionary response. That reply stayed in my drafts folder until Tea Time on Friday. After your invitation to hear from us, I tried to put a bit more thought into this revised response. I hope you'll indulge me for a few minutes.

I whole-heartedly believe our work should be centered on the world’s public conversations, where every voice is allowed to speak. But to treat every voice as if it deserves the same amount of attention is more than misguided, it's dangerous. The easiest analogy I can come up with as an illustration as to why is emblazoned on our own walls: #BlackLivesMatter. I know I don't need to tell you why that hashtag is important. And the movement we’re able to help facilitate every day reinforces my belief that some voices, specifically those trying to correct injustices and advocating for a more equal world, need to be uplifted. As we make choices here, whether it's the shape of our default icon or how we train our machine learning models, our biases and lenses creep through. Being more aware of that, and coming up with strong, well-defined guidelines for how those decisions get made, makes us a better and more transparent company.

We have to be able to understand that there are voices in the world which have either been under represented, or downright silenced, and one of Twitter's greatest powers is providing a way for those to get the attention they deserve. I choose that word deliberately. Deserve. Like it or not, we are directly and indirectly deciding who deserves attention. When we sit back and let the voices on the platform decide who should get attention, we are reproducing the societal marginalization that brought the marginalized to our platform in the first place.

This is where the contradiction in my own argument becomes most threadbare. How can I, on one hand, vociferously advocate to uplift some marginalized voices while, on the other hand, insist on repressing the repugnant? The answer is simple: History. We pride ourselves on being able to learn. We learn from our colleagues. From our upbringing. From education. But we also learn from our mistakes, and the mistakes of those who came before us.

In your email, you said, “We have extremely thoughtful and empathetic people who want the best for all people out there, no matter their background or ideology.” I disagree. There are some ideologies that do not belong in a 21st century society. To ignore what we’ve learned, or reintroduce unenlightened ideologies of the previous centuries, sets us back not just as a company, but as a society. Racism. Sexism. Anti-Semitism. All of these are ideologies that have no place in a civilization that has made as much progress as ours. Just because our left-leaning perspectives happen to line up with humane, compassionate choices does not mean we should over-index or abandon them in an effort to be perceived as more balanced. We don’t need more balance, we need more humanity. And thus, there are some fundamentally benevolent biases that we should not be afraid to embrace. Otherwise, we risk introducing the paradox of tolerance, which can ultimately lead to this: Conspiracy Theories Are Eating This Alt Right-Friendly Site From the Inside.

Last point (and, if you're still reading this far, I’m humbled by your commitment) comes from the book What Price The Moral High Ground? by Cornell University’s Robert H. Frank. He makes an argument about enforcing social norms that guides a lot of my thinking when we discuss topics like this:

“… People associate with one another because — and only because — of the exchange of benefits they expect to reap in the process. Someone who abstains from associating with the violator of a social norm thus punishes not only the violator but also himself.”

We need to redefine our social norms. And we need to do it with confidence and empathy, epitomizing how it can be done in every company in Silicon Valley and beyond. At the same time, we have to be able to say there are some ideas so abhorrent they should not be uttered, much less allowed on our platform. Our recent policy changes provide many examples where we believe that.

I know these are unbelievably daunting decisions to make. But I also have confidence in our people to make the correct ones. I just hope we’re allowed to make them — choosing not to decide is still a choice. Let's make decisions that make us proud. Proud to be part of Twitter. Proud to grow as people. Proud to be humane.

As always, I thank you for your willingness to listen and learn from us.

Jack replied shortly afterward, thanking me for my input and addressing a couple of specifics. And to his credit, he replied every single time I wrote to him over my five years there. Even when I didn’t agree with our decisions, I always knew that he was listening to staff, taking opposing views into consideration, and sharing as much as he could about how our decisions were made.

This is all a long way of saying what is happening now at Twitter is antithetical to the culture that’s been built over the past decade and a half. When I started in 2015, there were 10 well-established company values, one of which was, “Communicate fearlessly to build trust.” What’s happening there now is the exact opposite of that. And even if the current owner wants to change the company culture, and its values, he’s not going to be able to do it overnight. Especially if he doesn’t communicate what the new expectations are.

As he unceremoniously fires more and more people, one thing is clear: Very soon, the loss of institutional knowledge is going to get so drastic that the institution will cease to exist. And at the rate he’s going, failure isn’t just a possibility, it’s an inevitability. Maybe even this weekend when the World Cup kicks off.

See you tomorrow?

Posted  
Comments (0) Post a comment
Author  Stephen Fox