ErosBlog

The Sex Blog Of Record
 
 

Now That’s What I Call NSFW

Tuesday, September 3rd, 2024 -- by Bacchus

Long time readers will recall that from the earliest days of sex blogging, I have strenuously rejected, despised, and refused to deploy the “Not Safe For Work” flag on adult content. I do, however, fully endorse this usage:

From GhostieGhoo.

Similar Sex Blogging:

 

Not Safe For Corporate America

Saturday, August 31st, 2013 -- by Bacchus

This, this, a thousand times, this!

Similar Sex Blogging:

 

Tumblr To Bury Adult Blogs Even Deeper, Begins Vilifying Them

Saturday, July 20th, 2013 -- by Bacchus

It’s time to be very clear about the words “NSFW” and “Adult” in the Tumblr context. They mean different things. Until recently, users were faced with two self-flagging options. This is the relevant screenshot from my May 15 post:

misleading tumblr settings showing adult blogs as visible to search engines when they are not

Here’s how Tumblr’s page on Understanding NSFW and Adult Blogs explained the difference, then and now:

Please respect the choices of people in our community and flag your blog as NSFW or Adult from your blog Settings page.

  • NSFW blogs contain occasional nudity or mature/adult-oriented content.
  • Adult blogs contain substantial nudity or mature/adult-oriented content.

Note what’s not present (this will be important later). There’s nothing there about commercial porn sites or affiliate links. The difference between NSFW and Adult is the extent of nudity or “mature/adult-oriented” content. If it’s occasional, your blog should be flagged NSFW; if it’s “substantial”, your blog should be flagged Adult. When we talk about “porn on Tumblr” everybody is talking about Tumblrs that should be flagged Adult. We’re talking about the blogs that are all porn, all the time, the raunchier the better. Accept no substitutes!

So, that’s the Tumblr policy as it’s been for at least the last several months. I am going into this so carefully because Tumblr has been (IMO deliberately) using these words to deflect inquiries and confuse the press. Ask Tumblr about porn or Adult-flagged blogs and they will come back with a phrase about NSFW blogs. The questioner may think he or she just got an answer, but in reality he got a load of bullshit about something else. Everybody needs to watch out for this going forward, if only so you can avoid all the incoherent tech press articles by reporters who never understood that this distinction exists and who (typically and somewhat reasonably) think “Adult” and “NSFW” are plain-language synonyms as they normally are.

OK, that’s the history. What’s the news?

Yesterday, at some time after I posted about the plain falsehoods in that press email from the Tumblr Head of Communications Katherine Barna, Tumblr founder David Karp posted this article to the Tumblr Staff blog, which is “The official feed from the people behind Tumblr.” Karp’s post suggests that changes are coming, and that’s reinforced by a new yellow-highlighted “This Page is out of date and is in the process of being updated” legend on the Understanding NSFW and Adult Blogs page. (That’s the one that just got updated on Thursday when Tumblr started admitting they were excluding Adult blogs from their internal search indexing. Yup, now it’s “out of date”.)

So what’s the awesome new Tumblr plan to reassure us all that Tumblr has heard our feedback? Well, it looks like the new plan is to hide all the seach-banned Adult-flagged blogs from the interface, deploy a new set of vilifying lies about these now-even-harder-to-find blogs, and carry on talking about the NSFW category only. Possibly I’m uncharitable. So let’s look at Karp’s post together, shall we?

It begins:

All, we’ve heard from a bunch of you who are concerned about Tumblr censoring NSFW/adult content. While there seems to be a lot of misinformation flying around, most of the confusion seems to stem from our complicated flagging/filtering features.

It opens like a classic corporate non-apology backtrack. “We hear you, it’s a damned shame you’ve all fallen for the terrible misinformation that’s flying around, however we are complicated which may have prevented you from understanding how awesome we are.” Note the “NSFW/adult” terms being used together in this nonspecific way. Moving on:

Let me clear up (and fix) a few things:

1. Last year, we added “Safe Mode” which lets you filter out NSFW content from tag and search pages. This is enabled by default for new users and can be toggled in your Dashboard Settings.

Here he’s using “NSFW” to mean both “NSFW” and “Adult”. Of course the Safe Mode applied to both NSFW and Adult-flagged blogs (once the Adult category was added) and it filtered them both out by default.

As some of you have pointed out, disabling Safe Mode still wasn’t allowing search results from all blogs to appear. This has been fixed.

This appears to be another flat lie. It may well be true of blogs with the NSFW tag, but Karp says “all blogs” here, and I can show you how to disprove that. Remember, Tumblr’s own little check-box chart says that NSFW blogs are indexed by Tumblr search and Adult ones are not. If they’re not indexed, how can they hope to show up when a user turns off Safe Mode? Now, watch me prove it, using a recent post on Fifi’s wonderful Feeling Is First Tumblr. Is it flagged as Adult? Yes it is; you have only to navigate to http://feeling-is-first.tumblr.com/robots.txt to see the deadly disallow-all instruction.

So, Fifi posted this yesterday (Friday, July 19th) and she tagged it #phonograph:

nude and phonograph

So, Feeling Is First is a Tumblr blog, and David Karp says that turning off the default Safe Mode in your Tumblr account “wasn’t allowing search results from all blogs to appear” but has been fixed. Well, was it actually fixed? See for yourself. Log into your Tumblr dashboard, check that you’re not in Safe Mode, and type “phonograph” into the search box. As I write this, the search is returning precisely two results from yesterday for the “phonograph” tag and neither of them is Fifi’s post.

A Karp apologist might remind us that Tumblr isn’t indexing Adult-flagged blogs, so there are no search results from these blogs to appear; they weren’t being blocked by Safe Mode, they just don’t exist. My response to that would be, it tortures the language beyond its limits. You can’t brag about enabling “search results from all blogs to appear” while chortling behind your hand about an entire class of porn blogs for which you aren’t generating search results. Especially not in a post about a controversy over disappearing porn blogs.

Karp goes on:

Some search terms are blocked (returning no results) in some of our mobile apps. Unfortunately, different app environments have different requirements that we do our best to adhere to. The reason you see innocent tags like #gay being blocked on certain platforms is that they are still frequently returning adult content which our entire app was close to being banned for. The solution is more intelligent filtering which our team is working diligently on. We’ll get there soon. In the meantime, you can browse #lgbtq – which is moderated by our community editors – in all of Tumblr’s mobile apps. You can also see unfiltered search results on tumblr.com using your mobile web browser.

There’s another whole blog post to be done on how Apple’s anti-porn apps market is chilling adult discourse on the modern internet, but that’s for another day. Let’s focus on Karp’s last sentence here: “You can also see unfiltered search results on tumblr.com using your mobile web browser.” Yesterday I called out Tumblr Head of Communications Katherine Barna for lying when she said “Users can also find all content with Tumblr search in their mobile web browser.” Karp has cleaned this up to the extent of replacing “all content” with “unfiltered search results”. Since Tumblr says it is not indexing Adult-flagged blogs, there are no search results from them to include in unfiltered results. So Karp avoids the direct lie here. But the deception remains. Karp doesn’t get to brag about “unfiltered search results” while excluding an entire class of supposedly-welcome blogs from search indexing.

But now we get to the truly-astonishing “demonize, vilify, and disappear” discussion where Karp acknowledges the genuinely Adult-flagged blogs for the first time:

Earlier this year, in an effort to discourage some not-so-nice people from using Tumblr as free hosting for spammy commercial porn sites, we started delisting this tiny subset of blogs from search engines like Google. This was never intended to be an opt-in flag, but for some reason could be enabled after checking off NSFW → Adult in your blog settings. This was confusing and unnecessary, so we’ve dropped the extra option. If your blog contains anything too sexy for the average workplace, simply check “Flag this blog as NSFW” so people in Safe Mode can avoid it. Your blog will still be promoted in third-party search engines.

Here is the genuine bad news for Adult bloggers on Tumblr. According to the soon-to-be-revised policy, the Adult-flagged blogs were formerly a perfectly-welcome part of the Tumblr community, and porn bloggers on Tumblr were asked to voluntarily flag as such if they posted “substantial” nudity. Now Tumblr is claiming this was all an accident and they are burying the Adult-flagged blogs behind an additional barrier of invisibility. They’ve removed the radio button (that somehow accidentally wrote itself into the interface) for Adult blogs and they will only use an NSFW flag going forward. In the interface, Adult-flagged blogs will no longer exist. You’ll be NSFW or nothing — and, Karp promises, NSFW blogs will (continue to be) visible to the search engines.

So, what about those gazillions of porn bloggers already on Tumblr? You know, the ones this controversy is actually about? The ones Karp now newly claims were “a tiny subset” of “not so nice people” “using Tumblr as free hosting for spammy commercial porn sites”? What’s going to happen to them?

Let’s be clear about the fast one Karp is trying to pull here. Tumblr’s community guidelines have long prohibited the creation of blogs that were “for the primary purpose of affiliate marketing.” If caught, the penalty for this (according to some threads I’ve perused on adult webmaster forums) was deletion of the offending blog. At first, Tumblr’s enforcement was lax; but as abuses piled up, they went through a period where they were deleting blogs that had just a single affiliate link. So Karp is lying when he claims that the Adult flag was only intended for “spammy commercial porn sites”. The defining characteristic was “substantial nudity”, not commercial spam. The affiliate spammers were a whole different problem with an entirely different and more draconian solution. Karp knows this. This is not a failure to communicate. This is deliberate deception aimed at marginalizing Tumblr’s porn bloggers and justifying that marginalization.

So what’s going on? Karp has gone out of his way to demonize the blogs that were flagged as Adult. That suggests to me that we won’t be seeing an “all is forgiven” removal of the search engine exclusion for formerly Adult-flagged blogs that are now (by the new definition) merely NSFW. Instead, it looks like the blogs already flagged as “Adult” will stay that way, only now the very existence of the “Adult” category will be invisible in the interface. And anybody who complains? They’re just “not so nice people” trying to scam Tumblr out of free hosting for their commercial spam.

If Karp were honestly trying to fix this, he’d have announced that the search engine blocks for blogs with substantial nudity were being removed. He didn’t say anything of the sort. Instead, he lied, and claimed that they were only supposed to be applied to spammers in the first place. But his own soon-to-be-revised policy documents show the lie; they show that the Adult flag and the search engine exclusion were intended for everyone showing substantial nudity. That’s the history Tumblr is now trying to sweep under the rug. Tumblr has buried its porn blogs, and now it’s trying to scratch dirt over the evidence with its rear claws.

Karp goes on:

Aside from these fixes, there haven’t been any recent changes to Tumblr’s treatment of NSFW content, and our view on the topic hasn’t changed.

Here he uses the NSFW word (and that “recent”) to ignore the actual controversy, which is over the search limitations on Adult (not “NSFW”) blogs that were implemented several months ago. He closes with some happy boilerplate:

Empowering your creative expression is the most important thing in the world to us. Making sure people aren’t surprised by content they find offensive is also incredibly important and we are always working to put more control in your hands.

Sorry for all of the confusion. If you have any more concerns or suggestions on how we can make these features clearer or more useful, please email us!

My predictions for the future:

  • When the “in the process of being updated” Understanding NSFW and Adult Blogs page gets updated, all references to the former “adult” category will be gone. No search blocking (internal or external) will be disclosed on the page.
  • The millions of currently Adult-flagged blogs (the ones that have “substantial nudity”) will still have the no-longer-visible-in-the-interface Adult flag, they will still have a robots.txt block in place, and they still won’t show in Tumblr’s internal searches.
  • Tumblr’s porn blog community will be invisible and unacknowledged. The suits will call this “winning”.

There is another possibility. The correct thing for Tumblr to do (if they were sincere about replacing the dual system with a single, simpler, NSFW flag) would be to reflag all the Adult-flagged blogs as NSFW. But if they were going to do that, would Karp have lied about the reason the Adult flag was implemented? I do not think so.

Somebody on Reddit said it best, yesterday: “So passes Tumblr, son of Geocities, and cousin to Digg. May it rest in cache.”

Except, of course, that the good stuff won’t be in anybody’s cache, because of robots.txt…

UPDATE: Wow, that was fast. In just three hours, the first of my predictions has already come true: the Understanding NSFW and Adult Blogs page has been updated and it looks just like I thought it would. No charts, no checkboxes, no more “adult” category, it’s all NSFW and there’s no mention of anything being excluded from search engines.

However, it looks like I missed the mark on my other two predictions (time will tell). I’m getting preliminary reports in my comments (and my own random tests agree) that the hated robots.txt is vanishing from many or most of the formerly-hidden Adult-flagged blogs. Karp still deserves censure for telling a big hairy lie about the history and reason for the Adult-flagged groups (and for attempting to deceive the world into thinking these were principally self-flagged by accident rather than auto-flagged by Tumblr) but perhaps the reason for the deception was to avoid the perception of a back-track, rather than to conceal the deeper burying of adult blogs that I feared was coming. But if the robots.txt files that are going away stay gone, this is actually a huge win for adult content on Tumblr.

Similar Sex Blogging:

 

How To Search Your Adult Tumblr Blog

Sunday, May 19th, 2013 -- by Bacchus

The full implications of Tumblr making adult-flagged porn Tumblr blogs non-searchable, and hiding their content from the search engines, are only just starting to sink in for people.

For instance: if you have an adult tumblr, now you can’t even search your own blog to find an old post.

I’m getting panicky emails from people with huge adult Tumblrs, thousands of posts. Apparently internal Tumblr search has never worked well (you can search for one tag, or for blog names, but not for post content and there are no multi-keyword searches) and it’s impractical to scroll back very far in your own Tumblr dashboard. So they were in the habit of typing [keyword] [their own tmblr url] into Google, and hey presto! There would be the post they were looking for.

Now their blogs have a non-consensual robots.txt file that excludes Google, and all of those search results are gone from Google.

Worse yet? Tumblr blogs flagged “adult” aren’t searchable even with Tumblr’s own internal search. You can test this yourself. Log into your Tumblr dashboard, go to your settings, and make sure you haven’t checked the “Browse tag pages in Safe Mode (Hide content from NSFW blogs)” setting:

setting for allowing yourself to search NSFW-flagged (but not adult-flagged) Tumblr blogs

Unlike the one that doesn’t actually “allow search engines to index your blog”, this checkbox appears to actually work in the narrow sense that if it is not checked, you can search for blogs flagged “NSWF” within the Tumblr tag search interface. But this checkbox lies by omission. You’ve got the option to search tag pages of NSFW blogs (or not) but opting to search them does not let you search blogs that have the deeper-level-of-perdition “adult” flag.

My test for this is to search for a recent post at Wicked Knickers, which I used as my “adult” flagged example in the Thou Shalt Not Search Adult Tumblr Blogs post:

a recent sample post from Wicked Knickers

The post we will be looking for in the Tumblr dashboard tag search has a time stamp of 9:30pm yesterday, May 18, and is tagged “ziegfeld” which makes it a nice handy and recent thing to search for.

date and tags on wicked knickers sample post

We already know that Google no longer has access to the posts on an adult-flagged Tumblr like this:

wicked knickers posts no longer in Google

So, what happens in the Tumblr tag search interface? If you’re logged in, this is what you see when you search for tumblr posts with the “ziegfeld” tag. The posts returned are listed in date order (most recent first) and dates are visible as tooltips on the live page, so I’ve added them in the margin with red arrows and white text. You’ll see that the Wicked Knickers post is not returned by the Tumblr search:

searching for a tagged post from adult-flagged tumblr blog

Interestingly, that logged-in Tumblr dashboard search result is displayed at a URL ( http://www.tumblr.com/tagged/ziegfeld ) that returns something very different (but still no sign of our Wicked Knickers post) if you navigate to it as a not-logged-in person:

what Tumblr shows on a tag search to the open web

Try it yourself if you’ve got an adult-flagged Tumblr blog. Log in and try to search for your own posts in the search box on your own dashboard. You will, sadly, fail.

So, what is to be done? How can you search your own Tumblr blog?

The answer is, quite simply, you cannot — not while it’s on Tumblr’s server behind their robots.txt that you do not have the power to alter or remove.

But, all is not lost. Be ye not in despair. If you could only back up your adult Tumblr blog — make a complete copy of it, on your local hard drive — you could search it there with any file searching tool. Or, if you have a web server of your own, you could upload that copy (mirror it) onto your own web space, where it would once again be indexed and searched by Google.

That’s all I got. It’s the only way. It’s also a very good idea, because eventually The Pornocalypse Comes For Us All, and because Anything Worth Doing On The Internet Is Worth Doing At Your Own Domain That You Control.

Your next logical question is “But how do I do that? How do I back up a Tumblr blog?”

It’s not a simple question. The answer isn’t simple either. But, it can be done. So, that’s my next post.

Similar Sex Blogging:

 

Thou Shalt Not Search Adult Tumblr Blogs

Wednesday, May 15th, 2013 -- by Bacchus

If you’ve got an adult blog on Tumblr, there’s a good chance Tumblr uses robots.txt to exclude the search engines from indexing it. Did you know that?

Two weeks ago in The Pornocalypse Comes For Us All, I wrote:

Who is next? My guess would be Tumblr. Tumblr is, of all the big platforms, perhaps the most porn friendly; there’s lots of porn on there and the Terms of Service do not prohibit it… But Tumblr is, famously, a popular platform in search of a revenue-generating business model. And we’ve learned that the suits have no loyalty to the porn users who made their platform popular. So, my bold prediction is that as Tumblr casts about for a business model, one of their steps will be to “clean this place up”…

And now, guess what? I’ve discovered that Tumblr uses robots.txt to bar all search engine access to blogs flagged as adult. If you’ve got an adult Tumblr, go look at your own settings. Do you see that first checkbox, the one that says “allow search engines to index your blog”?

misleading tumblr settings showing adult blogs as visible to search engines when they are not

That checkbox is a lie. It’s nicely checked, it’s not greyed out, but if your blog is flagged “adult” it’s a lie. Do you see the “Learn more about what this means” link under “Your blog was flagged NSFW” selector? It leads to this page, where Tumblr requests users to appropriately self-flag their blogs:

Please respect the choices of people in our community and flag your blog as NSFW or Adult from your blog Settings page.

  • NSFW blogs contain occasional nudity or mature/adult-oriented content.
  • Adult blogs contain substantial nudity or mature/adult-oriented content.

If you’re not sure if you should flag your blog you can leave it unflagged, but keep in mind that we might flag it later if we see a lot of mature/adult-oriented content.

To answer the question “What happens to blogs that are flagged NSFW or Adult?” Tumblr offers this handy chart. The key piece of information is the white space indicated by my red superimposed arrow:

tumblr chart showing that adult blogs are not indexed by Google no matter what preference the user has expressed

That’s right — where the “Blog indexed by Google” row intersects the “Adult Blogs” column, we find a ringing silence.

Would you have noticed? None of the adult Tumblr bloggers I know ever did. I knew from my porn researching that adult Tumblrs tended to be poorly represented in Google search results, but I chalked it up to the sheer scale of Tumblr and Google’s growing bias against returning porn search results. Nope, I found out the truth in one stark moment of astonishment, summed up by this image:

Internet Archive Wayback Machine page showing a Tumblr blog where robots.txt is blocking access

Let’s click the “See wickedknickers.tumblr.com robots.txt page” link:

a sample robots.txt for an adult tumblr showing that all user agents are forbidden

From me: Aghast. Fucking. Gulp.

In robot, that means, roughly “All robots: stay out!” No search spiders allowed. No Internet Archive crawler. The Wicked Knickers tumblr is there, but you have to know about it, or you have to be linked to it. You won’t find it in Google, you won’t find it in any other search engine that honors robots.txt, and when Tumblr decides to stop hosting it, you won’t find the pages in the Wayback Machine — it will be gone for good, lost to humanity unless somebody with the technical chops and outlaw sensibilities of Archive Team finds a way to archive it anyway, robots.txt be damned.

Wicked Knickers is just an example, one that has some meaning to me because it’s one of the first Tumblr blogs I ever noticed, and I’ve been linking to it since 2010. That’s almost 6,000 vintage erotica posts since January 2009, and none of those pages are in Google or the Wayback Machine. It was only when I twigged to that anomaly that I finally understood what Tumblr is doing to adult blogs.

In all the years that I’ve been preaching Bacchus’s First Rule (“Anything worth doing on the internet is worth doing on your own domain that you control”), I’ll confess that I never considered the power of robots.txt, or what it means to be putting stuff on an internet site where somebody else controls what robots.txt says. Not only do they control your visibility to search engines, they control whether history will remember what you said. That strikes me as a high price to pay for a “free” blogging platform.

It’s worth noting that there’s still rather a lot we don’t know about the Tumblr robots.txt blockade on adult Tumblr sites. Unanswered questions include:

  • Does Tumblr have any flexibility on this? Would their support, if asked, remove or modify the robots.txt barrier in specific cases?
  • When did Tumblr start using robots.txt to block Google from adult blogs? Has it always been like this, or is it a recent innovation?
  • Why does Tumblr display the misleading checkbox that falsely implies that search engines can see flagged adult blogs?
  • What is the actual reason for excluding adult Tumblrs from search engine and (especially) archive crawls?

In an unusual move for me, I actually reached out to press@tumblr.com, told Tumblr I was going to write this post, and asked them for answers to those questions. That was on May 11th. No response so far. If they ever do answer, I’ll be sure to update this post.

Similar Sex Blogging:

 

What “Not Safe For Work” Means

Friday, February 1st, 2013 -- by Bacchus

Maggie Mayhem nails it in a sentence:

What does it mean to be “NOT SAFE FOR WORK”? If you ask me, that’s the capitalist beast barking at people not to be distracted by their human drives for pleasure and spare time above directing their hearts, bodies, and souls for the profit of a hungry machine.

Similar Sex Blogging:

 

Roger Ebert To Working World: Grow Up

Friday, November 5th, 2010 -- by Bacchus

I’m liking Roger Ebert the blogger way more than I ever liked Roger Ebert the TV movie reviewer. Apparently after last week’s blog about Playboy (which I mentioned here), he got a lot of flak because he (horrors!) included a Playmate photo in the blog post and didn’t include a NSFW warning for timorous puritans.

Well, his most recent blog post begins as a spirited defense of his posting the photo without an NSFW warning:

As a writer, it would have offended me to preface my article with a NSFW warning. It was unsightly — a typographical offense. It would contradict the point I was making. But others wrote me about strict rules at their companies. They faced discipline or dismissal. Co-workers seeing an offensive picture on their monitor might complain of sexual harassment, and so on. But what about the context of the photo? I wondered. Context didn’t matter. A nude was a nude. The assumption was that some people might be offended by all nudes.

I heard what they were saying. I went in and resized the photo, reducing it by 2/3, so that it was postage-stamp 100 pixel size (above) and no passer-by was likely to notice it. This created a stylistic abomination on the page, but no matter. I had acted prudently. Then I realized: I’d still left it possible for the photo to be enlarged by clicking! An unsuspecting reader might suddenly find Miss June 1975 regarding him from his entire monitor! I jumped in again and disabled that command.

This left me feeling more responsible, but less idealistic. I knew there might be people offended by the sight of a Playmate. I disagreed with them. I understood that there were places where a nude photo was inappropriate, and indeed agree that porn has no place in the workplace. But I didn’t consider the photograph pornographic.

He goes on to contrast our puritanical American attitudes about nudity with more relaxed standards prevailing in Europe, and to make a favorable comparison of the artistic merits of the photo with various bits of classical fine art that would have raised no eyebrows. The only weirdness about the piece is, after essentially defending the photo and his publication of it without a warning tag, and gently ridiculing at length the poke-noses who complained, he wraps the whole article up with two unexplained sentences in which he apologizes and says he won’t do it again:

In the future I will avoid NSFW content in general, and label it when appropriate. What a long way around I’ve taken to say I apologize.

What a long way indeed, Roger — and nothing in your blog post prepared us for that jarring and inconsistent conclusion to an otherwise fine if somewhat rambling blog. Is that something the Chicago Sun-Times told you they wanted to hear you say?

Similar Sex Blogging:

 
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
 
cupid