The problems when you are a spider..

Yep, now you know.. you’re not the only one with problems.. spiders have them too. And I mean Web Spiders.

Say you are called Slurp, Googlebot or something Microsoftish.. you vist websites all the time.. and some websites don’t like that.. like imdb.com :) (The above image says: “Request Limit Reached: There have been an unusually high number of pages requested by you”).

0 Responses to “The problems when you are a spider..”


  1. No Comments

Leave a Reply