Welcome to the JaguarPC Community
JaguarPC
Sales: (888) 338-5261
Support: (888)-551-3050
Page 1 of 2 12 LastLast
Results 1 to 15 of 21

This is a discussion on Screwed Blued & Tattooed... in the Shared & Semi-Dedicated forum
I have 647 search bots on my site right now - each one of them indexing non-existent URI's! After 7 years of being in the ...

  1. #1
    Yeah, I know a LOT! Vin DSL's Avatar
    Join Date
    Mar 2003
    Location
    Arizona Uplands
    Posts
    10,775

    Angry Screwed Blued & Tattooed...

    I have 647 search bots on my site right now - each one of them indexing non-existent URI's! After 7 years of being in the #1 spot for 'Lenon' searches, I have moved to page 2 on Google, behind a tractor dealer, a has-been football player and fishing lures!

    LoL! How now brown cow? 10 years of building my site down the drain in a single day...
    DISCLAIMER Any resemblance between the views expressed above and those of the owners and operators of this system is purely coincidental. Any resemblance between these views and my own are non-deterministic. The existence of Vin DSL is questionable. The existence of views in the absence of anyone to hold them is problematic. The existence of the reader is left as an exercise in the second-order coefficient.

    No Guts, No Story! VinDSL © 2010

  2. #2
    Yeah, I know a LOT! Vin DSL's Avatar
    Join Date
    Mar 2003
    Location
    Arizona Uplands
    Posts
    10,775
    Bah! 685 bots now - 23,000+ page views today! This is totally out of hand...

    I gotta go put a stop to this!
    DISCLAIMER Any resemblance between the views expressed above and those of the owners and operators of this system is purely coincidental. Any resemblance between these views and my own are non-deterministic. The existence of Vin DSL is questionable. The existence of views in the absence of anyone to hold them is problematic. The existence of the reader is left as an exercise in the second-order coefficient.

    No Guts, No Story! VinDSL © 2010

  3. #3
    Yeah, I know a LOT! Vin DSL's Avatar
    Join Date
    Mar 2003
    Location
    Arizona Uplands
    Posts
    10,775
    They seem to be attacking vacuous links in my forums section, so...
    Code:
    #Deny access to forums and redirect back to themselves.
    RewriteCond %{REQUEST_URI} (forum)              [NC]
    RewriteRule ^(.*) %{HTTP_REFERER}               [R=301,L]
    This seems to be thwarting them. Let's see how long it takes the situation to cool down...
    Last edited by Vin DSL; 02-28-2005 at 07:01 PM.
    DISCLAIMER Any resemblance between the views expressed above and those of the owners and operators of this system is purely coincidental. Any resemblance between these views and my own are non-deterministic. The existence of Vin DSL is questionable. The existence of views in the absence of anyone to hold them is problematic. The existence of the reader is left as an exercise in the second-order coefficient.

    No Guts, No Story! VinDSL © 2010

  4. #4
    Yeah, I know a LOT! Vin DSL's Avatar
    Join Date
    Mar 2003
    Location
    Arizona Uplands
    Posts
    10,775
    Seems to have peaked at 697 bots...
    DISCLAIMER Any resemblance between the views expressed above and those of the owners and operators of this system is purely coincidental. Any resemblance between these views and my own are non-deterministic. The existence of Vin DSL is questionable. The existence of views in the absence of anyone to hold them is problematic. The existence of the reader is left as an exercise in the second-order coefficient.

    No Guts, No Story! VinDSL © 2010

  5. #5
    Yeah, I know a LOT! Vin DSL's Avatar
    Join Date
    Mar 2003
    Location
    Arizona Uplands
    Posts
    10,775
    Hahahaha! Those damn things must be freaking out. They're triggering 404's left 'n' right!
    DISCLAIMER Any resemblance between the views expressed above and those of the owners and operators of this system is purely coincidental. Any resemblance between these views and my own are non-deterministic. The existence of Vin DSL is questionable. The existence of views in the absence of anyone to hold them is problematic. The existence of the reader is left as an exercise in the second-order coefficient.

    No Guts, No Story! VinDSL © 2010

  6. #6
    Yeah, I know a LOT! Vin DSL's Avatar
    Join Date
    Mar 2003
    Location
    Arizona Uplands
    Posts
    10,775
    Heh! 586 and counting...
    DISCLAIMER Any resemblance between the views expressed above and those of the owners and operators of this system is purely coincidental. Any resemblance between these views and my own are non-deterministic. The existence of Vin DSL is questionable. The existence of views in the absence of anyone to hold them is problematic. The existence of the reader is left as an exercise in the second-order coefficient.

    No Guts, No Story! VinDSL © 2010

  7. #7
    Yeah, I know a LOT! Vin DSL's Avatar
    Join Date
    Mar 2003
    Location
    Arizona Uplands
    Posts
    10,775
    Solid 404's now! They might as well call it a day...
    DISCLAIMER Any resemblance between the views expressed above and those of the owners and operators of this system is purely coincidental. Any resemblance between these views and my own are non-deterministic. The existence of Vin DSL is questionable. The existence of views in the absence of anyone to hold them is problematic. The existence of the reader is left as an exercise in the second-order coefficient.

    No Guts, No Story! VinDSL © 2010

  8. #8
    Yeah, I know a LOT! Vin DSL's Avatar
    Join Date
    Mar 2003
    Location
    Arizona Uplands
    Posts
    10,775
    44... Whew!

    The 'fire' is contained. Now... figuring out what caused it...
    DISCLAIMER Any resemblance between the views expressed above and those of the owners and operators of this system is purely coincidental. Any resemblance between these views and my own are non-deterministic. The existence of Vin DSL is questionable. The existence of views in the absence of anyone to hold them is problematic. The existence of the reader is left as an exercise in the second-order coefficient.

    No Guts, No Story! VinDSL © 2010

  9. #9
    Ron
    Ron is offline
    Loyal Client
    Join Date
    Aug 2002
    Posts
    7,306
    You show up 7th & 8th on my google search for "lenon"

  10. #10
    Yeah, I know a LOT! Vin DSL's Avatar
    Join Date
    Mar 2003
    Location
    Arizona Uplands
    Posts
    10,775
    Looking at my logs, here's an example of the bogus URI's they were indexing:

    http://www.lenon.com/forums.html/forumsearch_id-unanswered-sid-e34e72a36528a194e82a2e5d0ed96edb.html

    The first question in my mind is, "Why weren't the bots getting a 404 when they tried to visit this link?" I don't have a folder called 'forums.html'...

    Hrm... I think I'll have a 'Red Dog' and ponder this situation. That usually helps...
    Last edited by Vin DSL; 02-28-2005 at 09:07 PM.
    DISCLAIMER Any resemblance between the views expressed above and those of the owners and operators of this system is purely coincidental. Any resemblance between these views and my own are non-deterministic. The existence of Vin DSL is questionable. The existence of views in the absence of anyone to hold them is problematic. The existence of the reader is left as an exercise in the second-order coefficient.

    No Guts, No Story! VinDSL © 2010

  11. #11
    Yeah, I know a LOT! Vin DSL's Avatar
    Join Date
    Mar 2003
    Location
    Arizona Uplands
    Posts
    10,775
    Quote Originally Posted by Ron
    You show up 7th & 8th on my google search for "lenon"
    Yep, I'm back up to 5th spot now, according to the search I just did. So, it's coming back a little at a time...
    DISCLAIMER Any resemblance between the views expressed above and those of the owners and operators of this system is purely coincidental. Any resemblance between these views and my own are non-deterministic. The existence of Vin DSL is questionable. The existence of views in the absence of anyone to hold them is problematic. The existence of the reader is left as an exercise in the second-order coefficient.

    No Guts, No Story! VinDSL © 2010

  12. #12
    Ron
    Ron is offline
    Loyal Client
    Join Date
    Aug 2002
    Posts
    7,306
    Maybe your dual hyphen .htaccess thingy was picking it up and redirecting it to your homepage, or it was trying to get a 404 page and got redirected at that point?

    Just a thought.

  13. #13
    Yeah, I know a LOT! Vin DSL's Avatar
    Join Date
    Mar 2003
    Location
    Arizona Uplands
    Posts
    10,775
    Quote Originally Posted by Ron
    Maybe your dual hyphen .htaccess thingy was picking it up and redirecting it to your homepage, or it was trying to get a 404 page and got redirected at that point?

    Just a thought.
    Well, I finally figured out what happened. It was so obvious, upon reflection, that it came as a slap in the face...

    When I was updating phpBB, last A.M. (half asleep) I accidently deleted a bunch of arrays from my 'sessions.php' file. These arrays were part of a system that rewrites URI's in order to make them 'search engine friendly.' Half the system (mod_rewrite rules) were still in effect, in my .htaccess file, but there weren't any matching arrays in the 'sessions.php' file, so .htaccess was generating the bogus URI's. The 'search bots' picked up on it, thought they had hit the gold mine, and went to town...

    It should have been so obvious. In these situations, the first thing that should come to mind is the last thing you did, you know? In this case, upgrading phpBB to 2.0.13. However, in all the excitement, it escaped me.

    Anyway, I fixed the problem. As a sidenote, as soon as I opened the forums up, 99 bots were back on it immediately, like stink on sh!t. So, I redid the rule in .htaccess, making it more specific...
    Code:
    #Deny access to bad forum URI's and redirect back to referer.
    RewriteCond %{REQUEST_URI} ^/forums\.html/.*            [NC]
    RewriteRule ^(.*) %{HTTP_REFERER}                       [R=301,L]
    Hopefully, this will help call off 'the dogs'...
    DISCLAIMER Any resemblance between the views expressed above and those of the owners and operators of this system is purely coincidental. Any resemblance between these views and my own are non-deterministic. The existence of Vin DSL is questionable. The existence of views in the absence of anyone to hold them is problematic. The existence of the reader is left as an exercise in the second-order coefficient.

    No Guts, No Story! VinDSL © 2010

  14. #14
    Loyal Client
    Join Date
    Sep 2001
    Location
    Wichita, KS
    Posts
    1,647
    that's what you get for using phpBB :P (SMF is a better PHP forum IMHO)

  15. #15
    Yeah, I know a LOT! Vin DSL's Avatar
    Join Date
    Mar 2003
    Location
    Arizona Uplands
    Posts
    10,775
    Quote Originally Posted by mattsiegman
    that's what you get for using phpBB :P (SMF is a better PHP forum IMHO)
    Well, once again, it wasn't phpBB's fault. It was MY fault, doing a sloppy/rushed upgrade. Maybe that's why some ppl are down on phpBB - it's makes an easy scapegoat...

    To make things worse, the MySQL db got corrupted again last night and wouldn't repair. Tech services was still working in it when I went to bed. When I awoke, a few minutes ago, the db was totally blitzed (20-30 corrupt tables - a couple involving phpBB), but at least it repaired this time.

    All-in-all, not a good couple of days...
    DISCLAIMER Any resemblance between the views expressed above and those of the owners and operators of this system is purely coincidental. Any resemblance between these views and my own are non-deterministic. The existence of Vin DSL is questionable. The existence of views in the absence of anyone to hold them is problematic. The existence of the reader is left as an exercise in the second-order coefficient.

    No Guts, No Story! VinDSL © 2010

Page 1 of 2 12 LastLast

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •