10,000+ Page Views Today ( and 4 hours to go )...

[Vin DSL]

82 Google bots have invaded my site - for the last 18 hours!!

Did I beat the system, or what?

[Ron]

I had one period last month where msn and google and gigablast invaded my site over consecutive days.

The gigablast bot is really stupid, with more than 12,000 pages to read my 7,000 posts only a tiny fraction of which would be alone on a page. It spent time repaeatedly going to every post a reply link and view private messages link, both of which it could never do.

I had an email convo with gigablast's creator and suggested to him that gigablast ought to ignore certain filenames when dealing with certain bulletin boards.

The only other major bot that I know of to date that is as stupid about this as gigablast is msn's new msnbot which did the very same thing.

Googlebot appears to be very smart about my particular bulletin board and only follows certain links. Google has about 1,800 pages from my forum in it's index, which is probably just about right.

[Vin DSL]

They're still there - 55 bots now. I guess a few of them broke for supper or something.

The page views yesterday were 14,652, with another 4,000 so far today.

The 'funny' thing is, bots don't usually like large SID's, or so 'they' say...

[Ron]

Your statistics are all scrooged by the bots!

Doesn't your MS-Analysis have the ability to discriminate bot from human? It seems as nonsensical as AWStats.

Gigablast's bots from AWStats... Think they've got an effective load balancing scheme going?

hosts       pages hits Bandwidth   last visit
64.62.168.12 1285 1285 52.89 MB 27 Jul 2004 - 16:40 
64.62.168.18 1278 1278 53.03 MB 30 Jul 2004 - 10:41 
64.62.168.22 1273 1273 51.81 MB 30 Jul 2004 - 08:13 
64.62.168.32 1273 1273 53.73 MB 30 Jul 2004 - 08:11 
64.62.168.14 1258 1258 52.37 MB 30 Jul 2004 - 08:13 
64.62.168.16 1252 1252 52.14 MB 30 Jul 2004 - 08:11 
64.62.168.4  1248 1248 50.30 MB 27 Jul 2004 - 15:31 
64.62.168.24 1245 1245 54.46 MB 30 Jul 2004 - 08:09 
64.62.168.34 1244 1244 51.36 MB 27 Jul 2004 - 15:31 
64.62.168.26 1236 1236 50.79 MB 30 Jul 2004 - 08:11 
64.62.168.6  1235 1235 50.80 MB 30 Jul 2004 - 08:11 
64.62.168.10 1235 1235 51.16 MB 27 Jul 2004 - 15:41 
64.62.168.38 1227 1227 54.54 MB 30 Jul 2004 - 08:08 
64.62.168.30 1225 1225 49.92 MB 27 Jul 2004 - 18:33 
64.62.168.2  1173 1173 50.74 MB 30 Jul 2004 - 08:06 
64.62.168.20 1151 1151 46.51 MB 27 Jul 2004 - 13:10

The last I read about gigablast, they had 8 machines. Looks like they've doubled up on their hardware.

I was wrong and I stand corrected, by the way. It was 19,000 page views for my 7,500+- posts.

[Vin DSL]

Originally posted by Ron
Your statistics are all scrooged by the bots!

Doesn't your MS-Analysis have the ability to discriminate bot from human? It seems as nonsensical as AWStats.

My experience has been that analysis proggies will do anything you want. However, there's no such thing as a free lunch, you know? What happens is, the more you ask them to do, the more resources/time it takes to do it, and the slower your site becomes. If you have a LOT of visitors, say 100,000 per day, these analyzers will 'cause your site to grind to a halt.

Matty, MSA's Dutch author, is fully aware of this problem and purposely designs his analysis proggie to have the least impact possible. He has recently 'threatened' to remove dynamic updates for this very reason. I've been trying to talk him out of this, but I think he is resolute.

Anyway, I noticed the bots are still there, three days later - 56 of them at last count. Thank heavens for the GigaDeal...

[Vin DSL]

LoL! Every cloud has a silver lining...

I guess those nosey bots put my site over the top. I was putzing around and noticed, for the first time ever, Alexa is tracking my site. It started the same day they laid seige:

http://www.alexa.com/data/details/tr...&url=lenon.com

Never paid much attention to Alexa. I guess that means I'm in the Top 400,000 websites worldwide - according to them. Hahahaha! Makes me feel like a 'special olympics' marathon runner!

Those little boogers can hang around as long as they want...

[Vin DSL]

Hrm... I'm confused now...

I was comparing my 'rank' to Ron's website, and the only thing I can see that would account for me being listed on Alexa is the 'Reach per million users' and 'Reach rank', whatever the hell they are. Guess I'll have to do some reading!

BTW, your dogs look a LOT better on my 'new' ATI 9200SE, Ron! I feel like I can almost reach out and smell them...

[Ron]

Originally posted by Vin DSL
BTW, your dogs look a LOT better on my 'new' ATI 9200SE, Ron! I feel like I can almost reach out and smell them...

Probably just remaining 'rank' from the 'Wildfire DSL' project.

[Vin DSL]

Originally posted by Ron
Probably just remaining 'rank' from the 'Wildfire DSL' project.

Hahaha! Good one! I just woke up. That took me a few seconds...

Damn, those little puppies were busy in the wee hours of the morn - another 10,000+ page views since midnight 'server time'. And, they've all disappeared now. Weird!

Maybe they're sleeping it off...