A few months ago it was < 10.

Someone linking to us again?

Nope! Just the damn Yahoo Slurp Spiders indexing the Forum. They apparently use approximately 168 different IPs to gather their info and can have nearly all of them here at one time.

The increase is something everyone running a vBulletin Forum has been noticing and many have been discussing over at vBulletin.com.

Aside from Yahoo and the other spiders, there hasn't been that great an influx of "new" visitors on any regular basis.

Regards,

Damn Yahoo Slurp

It looks like they're ignoring the robots exclusion protocol now. As we speak there are several spiders looking for things like

Viewing User Profile:
http://www.woodmann.com/forum/member.php?u=xxxxx

(LLXX and JMI were just being probed actually.. how did it feel? :devil

Viewing Calendar:
http://www.woodmann.com/forum/calendar.php?do=displaymonth&c=1&month=2&year=2007

Viewing Attachment...
Creating Event...
etc.

Now if you look at the robots.txt file I wrote (hardly a trade secret) you'll see that member.php, calendar.php etc. are on the Disallow list.

http://woodmann.com/robots.txt

As you say, there has been a sudden increase in Slurp activity and those bastids are obviously cheating or something is broken.

We Disallowed Slurp and msnbot completely on the old server, to conserve bandwidth, but this new server can handle it. Still, it looks like Slurp's being a Bad Cracker and we may need to nop them out..

I do recall that some of the discussion on vBulletin.com mentioned that the Slurp Spiders appeared to be ignoring the robots.txt files.

EDIT: I've noticed (again) that they are getting the "no permission" symbol when they attempt to access profiles, which suggests they are, indeed limited by the "usergroup" privileges of "unregistered" users.

Regards,

Probably a bug in their newer bots... my (private) site/discussion board has had search engines' IP ranges blocked off since I started the site.

I can't without making tasteless comments regarding bodily orifices

And whats so wrong with tasteless comments about bodily orifices??

Woodmann

LLXX must be at that "in between" age.

When you're real young bodily orifices are a whole new experience so discussion is necessary, and when you get to be our age its about the only thing left to talk about.

Oh please kill me before the highlight of my day becomes a good BM!

You all do know I can drag this thread right into the gutter with the least bit of provocation .

I shall refrain for the time being.

Oh, and it's not always about a good dump .

Woodmann

Having slurp spiders probing your bodily orifices is considered to be the ultimate experience of exotic pleasure,
in Hong Kong, Thailand and some leather precincts in the continental US.

Not necessarily the highlight of one's single day, I most add. . .

It's in the gutter now

HAHAHAHA

I thought this place had somehow higher moral standards than some of the other sites I frequent but not anymore

surprise buttsex

Errrrrrrrrrrrrrrr......Ummmmmmmmmm.......

So LLXX has dragged us into the gutter.

Woodmann

BTW, I think I have fixed the problem.

The spider problem, or the surprise buttsex problem?

You ppl like the reverse way.Don't you?

BAHAHAHAHAHAHAHAAAa.....

I am happy that you all have a sense of humor

Woodmann