Subject: Re: Usenet feed? - no web access
@VIA: REALITY
@MSGID: <513B8346.1214.dove.dove-int@realitycheckbbs.org>
@REPLY: <5139C9FE.1225.dove-int@bismaninfo.hopto.org>
@TZ: 41e0
Re: Re: Usenet feed? - no web access
By: Khelair to Dreamer on Fri Mar 08 2013 05:22 am
Kh> OMG. I'm really sorry, but I haven't had enough coffee yet this morning
Kh> and it's impossible for me to bite my tongue when I'm like this. I can
Kh> totally understand Fidonet's Zone 2 wanting it to be no web-based access of
Kh> any kind.
It's been a problem for semi-closed othernets that find their message boards
spidered by search engines. Web searches have been a boon for finding
information to fix my BBS, although ironically the information I'm looking for
is almost always already in my message bases (just difficult to search).
I found that without a proper robots.txt and limiting access to my guest account
that google was able to spider my message bases. Luckily, they seem to fall off
after a while if they're unavailable.
---
■ Synchronet ■ realitycheckBBS -- http://realitycheckBBS.org
* Origin: Time Warp of the Future BBS - Home of League 10 (1:340/400)
|
