It didn’t take long for Google and MSN to drop WebmasterWorld completely from their indexes after Brett Tabke changed WebmasterWorld’s robots.txt to disallow all spiders. WebmasterWorld is not showing up in Google or MSN and I’m sure Yahoo is soon to follow.

I know Brett is making a point here about resources being consumed by search engine spiders, but banning them entirely and not providing an alternative site search is a horrible decision from a user stand point.

Danny Sullivan has more indepth coverage about the changes at WebmasterWorld and the recent delisting from the search engines.