|
|
Cryptonomicon.Net Jail
Hi, this is the front page to the "jail page." It's basically a simple page
with this text, intended to warn humans off from clicking on the following linke:
Cryptonomicon.Net Jail (Part Two)
The idea here is that there are a few spiders out there who scan this site with no regard for the robots.txt file. There's a
general agreement amongst search engine operators and site publishers that if
a part of a site is marked as disallowed, well behaved search engines will not
try to go there.
But alas, not everyone is so nice. So what I've done is I've put a clause in
the robots.txt file asking search engines to not index the file
jail2.html. Each week we scan our access logs and cull out
the IP addresses of people who try to get this file. These IP addresses are then
put in the "IP forbid" list.
What this means in plain english is that if you click on the link above, we'll
think you're a malfunctioning spider and block your IP address. So... please... this link is not for you... it's for malfunctioning spiders.
Thank you for your kind consideration. Have you seen my blog? It's at http://www.cryptonomicon.net/msh/".
Cheers!
|
|
|
|