How God Screwed With My Website Statistics

Written On Day: 588
Hand of God

A single all powerful God does not exist – it’s an absurd concept.  Instead there are thousands of mini gods.  Every mini god has a single responsibility and special power.

There is the god that makes sure that your dog takes a crap on the sidewalk when there are more then four people around.  There is the god that makes sure that the grease stain on your shirt does not come out with tap water and hand soap.  There is the god that makes sure that there is always an old lady in front of you in the ATM line.

Lately the god that makes sure that I get disappointed paid me a visit.

Every morning I check the statistics of this website:  how many visitors, how much money has been earned.

This morning task is similar to pulling pubic hairs – painful and tearful.  The difference is that because this website is about statistics it is something that I need to do every morning.

I have come to expect no change.  The sun rises in the east and revenue is less then a dollar.  Lightning is followed by thunder and a new post is followed by a no change in traffic.

But then one day I was surprised.  Traffic more then quadrupled.  Search engine traffic was way up, referent traffic was way up.  Normally there are 150 visitors a day – suddenly there are 600 visitors.

I was so happy.  Finally, the god of justice has arrived.  All the hard work is paying off.  The snowball is rolling – it can only get bigger and bigger.  I was so happy I clenched my hands together and released a quick laugh.

But I was mistaken. It was not the god of justice that visited my website.  It was my old and dependable friend, the god of disappointment.

Looking closely at the website statistics I started to notice problems:

Why Did My Website Revenue Not Increase

The first problem was that my revenue did not increase proportionaly.  One would expect that if you have four times the traffic then you will have four times the advertisement clicks.  Nope.  According to Google Adsense the number of page impressions did not increase.  As far as Adsense is concerned there is no increase in traffic.  Strange.

Why Is Google Analytics Not Reporting An Increase In Traffic

Because website statistics are so important to this website I use two sources.  AWSTATS which is a server based traffic tracker (means that every request to the server is tracked).  And Google Analytics which is a browser based traffic tracker (means that only requests from internet browsers are tracked).

Normally there is a correlation between these two trackers.  They are not the same, AWSTATS is always higher, but when one go up a so does the other.

But AWSTATS quadrupled and Goggle Analytics did not budge.  It is at this point that I spotted the god of disappointment outside my door just about to ring the doorbell.

What Is My Most Popular Webpage?

Why was AWSTATS reporting such high traffic?  What page was geting all this new traffic?

According to AWSTATS my most visited page this month is 404.php.  This page appears when the page being looked for does not exist.

The increase in traffic was due to spam bots, not an increase in real visitors.  Some jackass out there created a spambot that likes to visit my website.  Since it is looking for a page that does not exist the 404.php page becomes my most popular page.

Statistic Havoc Caused By The Spambot

Because of the spam bots my AWSTATS (server side) stats have become useless.  Here are some interesting but wrong conclusions based on the spambot tainted statistics.

  • Number of unique visitors in July = 1882.  Number of visitors in July = 14138.  Therefore each visitor visited the site an average of 7 times.
  • On Aug 8 there were 534 visitors and 3676 page views.  Which means that on average each visitor views 6 pages per visit.
  • Medical and financial sites are linking to my website.
    Website Statistics.JPG
  • So far this month 40 people have found my website by searching for “earn £437 every day”.

If any of the above were true then I would be happy.  But they are a misrepresentation of what is really going on.  They are based on statistics poisoned by the activities of the spam bot. 

Conclusion And Lesson Learnt

You can never completely avoid the disappointment god.  He is diligent and will always be around.  All you can do is to make things difficult for him.

Use more then one source for your website statistics.

  1. August 24th, 2010 at 15:28 | #1

    One other thing that may make AdSense page impressions and other stats mismatch is that a lot of corporate firewalls are now content aware and can block out ads for people surfing at work.

    Just one more thing to annoy and irritate when you’re trying to give accurate statistics!

  2. roman
    August 24th, 2010 at 16:15 | #2

    Hello Des.

    Thank you for the comment. I wrote this post almost 2 weeks ago and started to worry – no comments.

    No comments for 2 weeks. I think this is the first post that happened to. But I think I know why. I have not been visiting other blogs and leaving comments. Nor have I been responding enthusiastically to comments left of this blog. Actually, I made fun of people who leave comments on blogs in my previous post. In other words, I removed all motivation for people to leave comments on this blog.

    Was that a mistake? I am not sure because I am not certain of the value comments add to the potential success of a blog. I have seen many failing and dead blogs that have lots of comments and the enthusiastic interaction of the blogger. From what I have seen there does not seem to be any coloration between comments and how successful a blog will become.

    Yet regardless of their benefit to this blog, the fact is I miss the comments. They are fun to read.

    So, once again Des thank you for your comments. And I will try to be more social.

  3. December 17th, 2010 at 14:24 | #3

    Thanks for writing this article. I really like your writing style, and the information you’ve given is really useful. I’m just starting out in affiliate marketing and I’m finding that there’s a huge learning curve involved. I too check my stats every day and while initially I was delighted that my stats seem to be increasing, Google analytics show zero links and zero search queries. I suspected it was due to spam bots and I was searching for information on Awstats entry “Java (Often spam bot)” when I came across your post. You seem to have confirmed my suspicions. Damn! I’m now going to read the rest of your articles and subscribe to your rss feed. I hope since you wrote this post that you’ve got rid of the spam bots and increased your traffic. Good luck!

  1. No trackbacks yet.
You must be logged in to post a comment.