So the MSN Bot made a vengeful return yesterday logging another 10,000 hits on the site and burning through even more bandwidth. So far the search robot has accounted for over 90% of the sites bandwidth usage this month.
Below is the email I sent to Microsoft. I don’t expect a response from them, but one never knows.
Two days ago I wrote to you to complain about
your msnbot crawling my site and using 40% of my
monthly bandwidth in less than two days.
At the same time I proceeded to add msnbot to my
robits.txt file and disallowing access to all
areas of my site.Two days have passed and your bot has made
another 10000 hits to my site ate
http://green-scissors.com. So far this month,
your bot has accounted for over 90% of the total
bandwidth usage on my site. This is completely
unacceptable. Despite the fact that I run a php
portal that has many dynamic pages, Google and
other search bots rarely register as a blip on my
log files. Your companies product, however, has
nearly shut down my site due to bandwidth
overusage.I do not expect micrsoft (in all its wisdom) to
conform to my needs, although since you are
costing me money it would be a nice gesture. So
to combat this problem in that face of your bots
failure to acknowledge the entry in robots.txt, I
have IP banned 65.54.If I find any further instances of your bot on my
site, I will further ban IP addresses.My site is a small personal community site and
not a commercial venture. However, if it were I
would be following this email with legal action
to recoup to cost of the bandwidth you seem so
happy to consume.I hope that in the future you can create a better
product. My site will not be appearing on MSN
search and I will encourage others to take
actions similar to mine.Thank you.
