Friday, March 31, 2006

Slow Blogging

Sorry the blogging is so slow but I've been stuck in Florida all week waiting for this big wedding that's going to happen tomorrow. Been trying to avoid all the cat piss on tap they call beer down here and starting to notice that although they mostly serve Bud, Miller and Coors there appears to he Amber Bock in most places for reasons I can't quite explain. Even ran into some Killian's Red the other night among the kegs of cat piss, I was stunned.

Anyway, I'll be back to California sometime next week and raising hell as usual.

In the mean time John Andrews went of the deep end, enjoy.

Wednesday, March 29, 2006

Bot Blocker PLUS Security Features

Been playing around with adding security features to the bot blocker as it became obvious there were additional things I could do such as punting pages with SQL injection, cross site scripting (XSS), certain overflow attempts and a whole bunch of other things when I was evaluating the page requests.

Now if I can add some anti-password hacking, anti-password sharing and anti-blog spamming then I'll have a complete set of tools to combat wide spread abuse without each website having to code it's own protection.

What a concept, stopping bandwidth abuse, content theft and some hack attempts all rolled into one!

Tuesday, March 28, 2006

Almost Ten Percent of All Pages Blocked

The total number of pages being blocked from non-humans masking as browsers on my site is about 10% of all pages displaying daily and this rate has been holding strong since I started blocking them.

That's right, for every 48K pages displayed daily between 4K-5K are going to scrapers, crap search engines that send no visitors, and other useless wastes of bandwidth. That's a heck of a lot of pages that are being scraped and the purposes for all of this are still only slowly unfolding as each week something new shows up somewhere on the net.

Simply amazing.

It will be interesting to get more sites profiled moving forward and see if this is a common trend or not as 10% of all site traffic being wasted, not to mention server resources, could take a decent load off many servers starting to feel the pinch.

Will get some more detailed stats together next week hopefully and put them up for everyone to take a gander at as it's blowing my mind for sure.