Skip to content

Twitter Updates for 2009-09-04

  • Yesterday someone spoofed my IP address and tried to do bad stuff to my web server. #

Twitter Updates for 2009-09-02

  • Internet channel for Wii is now free! Opera for the Wii works great, clumsy URL entry, but it works. My sites look fine, scale well onscreen #

Twitter Updates for 2009-09-01

  • @MessengerMOTR Congrats on the kickboard exercise! Keep it up! Getting started is the hardest part. #
  • @kickstarter is it better to try to get funding for one month, 3 months or one year's worth of operating on a new project? #
  • Cool, I just signed up to get the beta of the new and improved Nambu client! Thanks @nambucom ! #
  • A wonderful opensource tool for merging and splitting Acrobat PDF files: http://www.planetmike.com/x/i #

Easy Way to Watch Your Web Server Log

Based on an idea from John Graham-Cumming regarding watching his log files with single characters, I have written a brief perl program that prints a single character based on the status code logged to my apache log file. Simply change the file in the second line to the apache access log file you’d like to watch.


#!/usr/bin/perl
$in="/path-to/your/web-server-access.log";
open(INFILE,"tail -f $in |") || die "Failed!\n";

my $old_fh = select(STDOUT);
$| = 1;
select($old_fh);

while(my $line = <INFILE>)
{
$temp = $line;
@fields = split(/ /,$line);
$x = $fields[8];
$s=substr($x,0,1);
if ($x eq "200") { $y=".";} #ok
elsif ($x eq "301") { $y=">";} #redirected
elsif ($x eq "403") { $y="F";} #forbidden
elsif ($x eq "206") { $y="P";} #partial
elsif ($x eq "404") { $y="X";} #not found
elsif ($x eq "304") { $y=".";} #ok - not modified
elsif ($x eq "400") { $y="B";} #bad request
elsif ($x eq "302") { $y=">";} #redirected
elsif ($s eq "1") { $y="1";} #Silent response codes
elsif ($s eq "2") { $y="2";} #Successful codes
elsif ($s eq "3") { $y="3";} #redirection
elsif ($s eq "4") { $y="4";} #request is incomplete
elsif ($s eq "5") { $y="5";} #server errors
else { $y="?".$x;} #anything else - should never happen, prints what was actually in the 8th field of the record.
print $y;
}
close(INFILE);

The output on one of my site’s included:

.............................>....>.....>..>FFFFXXX....................

Each period is a valid request; the > is a redirected request; the X is a 404 (file not found); and the F is a forbidden request. It’s been interesting watching traffic flow by. If you have suggestions for this program, please let me know.

Twitter Updates for 2009-08-29

  • "The allowance of political calls (under the guise of free speech) simply reflects legislative selfishness." – bartwol #
  • Is it time to get rid of phone books? http://planetmike.com/x/5l #
  • Is SpamAssassin dead? No updates in 14+ months. It's still working for me, but has it been abandoned? #

Twitter Updates for 2009-08-27

Twitter Updates for 2009-08-25

Twitter Updates for 2009-08-24

  • @perishable yeah they took some of your recommendations and include a URL in their user string, but asking for many nonstandard URLs is evil in reply to perishable #
  • The number of twitter spammers is increasing. Two in the past 5 hours blocked. Twitter should check language. Post is English? No follow. #

Twitter Updates for 2009-08-23

  • idiot web browsers repeatedly requesting odd files are blocked. _vpi.xml I'm looking at you. #

DoFollow Rapist

Be on the lookout for a “seo” rapist. This guy (his blog doesn’t deserve a link) is writing a new custom search engine of only blogs that don’t nofollow. His spider hits your site, then within seconds every URL in your sitemap is hit, leading to high bandwidth and server resource usage. I recommend blocking “212.117.163.7” as well as user-agents that include “www.blogfollower.com Dofollow blogs search engine crawler” This bot is very ill-behaved. It doesn’t even pretend to ignore robots.txt, it doesn’t even request the file.

It’s fools like this guy that almost make me want to remove my nofollow plugin. It’s another case of a few bad apples spoiling a good situation for everyone.