FSTDT Forums

Community => Science and Technology => Topic started by: The Illusive Man on January 07, 2014, 04:25:40 pm

Title: Do Not Link = no page views for scum
Post by: The Illusive Man on January 07, 2014, 04:25:40 pm

For when you want to link to content without giving page views use http://www.donotlink.com. Here is how:

Quote

How does this prevent search engines from crawling the website?
Donotlink.com routes links to questionable sites through a unique intermediate url that forwards the visitor to the destination through javascript.

This url is blocked in our robots.txt file, so (search engine) robots are discouraged from crawling it. The "noindex" and "nofollow" properties of the link and the intermediate page give robots another reminder to not crawl the link.

If a known robot does decide to crawl the link, our code will identify it and serve it a blank page (403 Forbidden). (http://www.donotlink.com/dnl-how)

Even simpler:
http://donotlink.com/[URL here]
Example: http://donotlink.com/naturalnews.com

Don’t forget, screen cap for the lulz!

Title: Re: Do Not Link = no page views for scum
Post by: Ironchew on January 07, 2014, 07:20:44 pm

I used to just browse a cache from Google or the Internet Archive.

HTTP header spoofing is also effective if the aim is to obfuscate the site that linked to that page.