Official Google Blog: Robots Exclusion Protocol: now with even more flexibility googleblog.blogspot.com · Originally posted on Pinboard

Paul Love2 Aug 2007 #google #search #robots.txt #seo #web