Re:Free news articles (Score:5, Informative)
by gEvil (beta) (945888) on Saturday February 18, @08:45AM (#14749013)

If you're using Firefox, get the user agent switcher extension and add this to it:

Mozilla/5.0 (compatible; googlebot/2.1; +http://www.google.com/bot.html)

A lot of registration-only news sites will let you in as googlebot. After all, they want to be indexed...

Re:Free news articles (Score:5, Informative)
by inter alias (947885) on Saturday February 18, @09:42AM (#14749214)

It's also worth mentioning that a few site downloaders (search engine spammers) and bad bots use a fake googlebot user agent. It's a fairly good indicator that someone is banworthy when that user agent comes from outside google's ip ranges. You may find yourself automatically banned from a lot of other sites.